I: pbuilder: network access will be disabled during build I: Current time: Wed Oct 6 06:25:04 +14 2021 I: pbuilder-time-stamp: 1633451104 I: Building the build Environment I: extracting base tarball [/var/cache/pbuilder/bullseye-reproducible-base.tgz] I: copying local configuration I: mounting /proc filesystem I: mounting /sys filesystem I: creating /{dev,run}/shm I: mounting /dev/pts filesystem I: redirecting /dev/ptmx to /dev/pts/ptmx I: policy-rc.d already exists I: using eatmydata during job I: Copying source file I: copying [consul_1.8.7+dfsg1-2.dsc] I: copying [./consul_1.8.7+dfsg1.orig.tar.xz] I: copying [./consul_1.8.7+dfsg1-2.debian.tar.xz] I: Extracting source gpgv: unknown type of key resource 'trustedkeys.kbx' gpgv: keyblock resource '/tmp/dpkg-verify-sig.Ppcw7DXo/trustedkeys.kbx': General error gpgv: Signature made Sun Apr 25 01:25:37 2021 +14 gpgv: using RSA key C5A5B9DDC33D93FBB63D67C83287D89A97CDA87B gpgv: issuer "vvidic@debian.org" gpgv: Can't check signature: No public key dpkg-source: warning: failed to verify signature on ./consul_1.8.7+dfsg1-2.dsc dpkg-source: info: extracting consul in consul-1.8.7+dfsg1 dpkg-source: info: unpacking consul_1.8.7+dfsg1.orig.tar.xz dpkg-source: info: unpacking consul_1.8.7+dfsg1-2.debian.tar.xz dpkg-source: info: using patch list from debian/patches/series dpkg-source: info: applying provider-no-k8s.patch dpkg-source: info: applying t-skip-unreliable-tests.patch dpkg-source: info: applying CVE-2020-25864.patch I: using fakeroot in build. I: Installing the build-deps I: user script /srv/workspace/pbuilder/12155/tmp/hooks/D01_modify_environment starting debug: Running on ionos12-i386. I: Changing host+domainname to test build reproducibility I: Adding a custom variable just for the fun of it... I: Changing /bin/sh to bash Removing 'diversion of /bin/sh to /bin/sh.distrib by dash' Adding 'diversion of /bin/sh to /bin/sh.distrib by bash' Removing 'diversion of /usr/share/man/man1/sh.1.gz to /usr/share/man/man1/sh.distrib.1.gz by dash' Adding 'diversion of /usr/share/man/man1/sh.1.gz to /usr/share/man/man1/sh.distrib.1.gz by bash' I: Setting pbuilder2's login shell to /bin/bash I: Setting pbuilder2's GECOS to second user,second room,second work-phone,second home-phone,second other I: user script /srv/workspace/pbuilder/12155/tmp/hooks/D01_modify_environment finished I: user script /srv/workspace/pbuilder/12155/tmp/hooks/D02_print_environment starting I: set BASH=/bin/sh BASHOPTS=checkwinsize:cmdhist:complete_fullquote:extquote:force_fignore:globasciiranges:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath BASH_ALIASES=() BASH_ARGC=() BASH_ARGV=() BASH_CMDS=() BASH_LINENO=([0]="12" [1]="0") BASH_SOURCE=([0]="/tmp/hooks/D02_print_environment" [1]="/tmp/hooks/D02_print_environment") BASH_VERSINFO=([0]="5" [1]="1" [2]="4" [3]="1" [4]="release" [5]="i686-pc-linux-gnu") BASH_VERSION='5.1.4(1)-release' BUILDDIR=/build BUILDUSERGECOS='second user,second room,second work-phone,second home-phone,second other' BUILDUSERNAME=pbuilder2 BUILD_ARCH=i386 DEBIAN_FRONTEND=noninteractive DEB_BUILD_OPTIONS='buildinfo=+all reproducible=+all,-fixfilepath parallel=7' DIRSTACK=() DISTRIBUTION= EUID=0 FUNCNAME=([0]="Echo" [1]="main") GROUPS=() HOME=/root HOSTNAME=i-capture-the-hostname HOSTTYPE=i686 HOST_ARCH=i386 IFS=' ' INVOCATION_ID=874d6c6b50484199b13a1826fff9a81d LANG=C LANGUAGE=de_CH:de LC_ALL=C LD_LIBRARY_PATH=/usr/lib/libeatmydata LD_PRELOAD=libeatmydata.so MACHTYPE=i686-pc-linux-gnu MAIL=/var/mail/root OPTERR=1 OPTIND=1 OSTYPE=linux-gnu PATH=/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path PBCURRENTCOMMANDLINEOPERATION=build PBUILDER_OPERATION=build PBUILDER_PKGDATADIR=/usr/share/pbuilder PBUILDER_PKGLIBDIR=/usr/lib/pbuilder PBUILDER_SYSCONFDIR=/etc PIPESTATUS=([0]="0") POSIXLY_CORRECT=y PPID=12155 PS4='+ ' PWD=/ SHELL=/bin/bash SHELLOPTS=braceexpand:errexit:hashall:interactive-comments:posix SHLVL=3 SUDO_COMMAND='/usr/bin/timeout -k 24.1h 24h /usr/bin/ionice -c 3 /usr/bin/nice -n 11 /usr/bin/unshare --uts -- /usr/sbin/pbuilder --build --configfile /srv/reproducible-results/rbuild-debian/tmp.W8fNMbI5Ts/pbuilderrc_f4oO --hookdir /etc/pbuilder/rebuild-hooks --debbuildopts -b --basetgz /var/cache/pbuilder/bullseye-reproducible-base.tgz --buildresult /srv/reproducible-results/rbuild-debian/tmp.W8fNMbI5Ts/b2 --logfile b2/build.log consul_1.8.7+dfsg1-2.dsc' SUDO_GID=112 SUDO_UID=107 SUDO_USER=jenkins TERM=unknown TZ=/usr/share/zoneinfo/Etc/GMT-14 UID=0 USER=root _='I: set' http_proxy=http://78.137.99.97:3128 I: uname -a Linux i-capture-the-hostname 5.10.0-8-686-pae #1 SMP Debian 5.10.46-5 (2021-09-23) i686 GNU/Linux I: ls -l /bin total 5776 -rwxr-xr-x 1 root root 1367848 Aug 5 10:25 bash -rwxr-xr-x 3 root root 38280 Jul 21 2020 bunzip2 -rwxr-xr-x 3 root root 38280 Jul 21 2020 bzcat lrwxrwxrwx 1 root root 6 Jul 21 2020 bzcmp -> bzdiff -rwxr-xr-x 1 root root 2225 Jul 21 2020 bzdiff lrwxrwxrwx 1 root root 6 Jul 21 2020 bzegrep -> bzgrep -rwxr-xr-x 1 root root 4877 Sep 5 2019 bzexe lrwxrwxrwx 1 root root 6 Jul 21 2020 bzfgrep -> bzgrep -rwxr-xr-x 1 root root 3775 Jul 21 2020 bzgrep -rwxr-xr-x 3 root root 38280 Jul 21 2020 bzip2 -rwxr-xr-x 1 root root 17768 Jul 21 2020 bzip2recover lrwxrwxrwx 1 root root 6 Jul 21 2020 bzless -> bzmore -rwxr-xr-x 1 root root 1297 Jul 21 2020 bzmore -rwxr-xr-x 1 root root 38824 Sep 23 2020 cat -rwxr-xr-x 1 root root 71624 Sep 23 2020 chgrp -rwxr-xr-x 1 root root 67528 Sep 23 2020 chmod -rwxr-xr-x 1 root root 75752 Sep 23 2020 chown -rwxr-xr-x 1 root root 157960 Sep 23 2020 cp -rwxr-xr-x 1 root root 128724 Dec 11 2020 dash -rwxr-xr-x 1 root root 124904 Sep 23 2020 date -rwxr-xr-x 1 root root 92172 Sep 23 2020 dd -rwxr-xr-x 1 root root 100752 Sep 23 2020 df -rwxr-xr-x 1 root root 153964 Sep 23 2020 dir -rwxr-xr-x 1 root root 83644 Jul 29 09:09 dmesg lrwxrwxrwx 1 root root 8 Nov 8 2019 dnsdomainname -> hostname lrwxrwxrwx 1 root root 8 Nov 8 2019 domainname -> hostname -rwxr-xr-x 1 root root 34664 Sep 23 2020 echo -rwxr-xr-x 1 root root 28 Nov 10 2020 egrep -rwxr-xr-x 1 root root 34664 Sep 23 2020 false -rwxr-xr-x 1 root root 28 Nov 10 2020 fgrep -rwxr-xr-x 1 root root 71928 Jul 29 09:09 findmnt -rwsr-xr-x 1 root root 30112 Feb 27 2021 fusermount -rwxr-xr-x 1 root root 210488 Nov 10 2020 grep -rwxr-xr-x 2 root root 2346 Mar 3 2021 gunzip -rwxr-xr-x 1 root root 6376 Mar 3 2021 gzexe -rwxr-xr-x 1 root root 100952 Mar 3 2021 gzip -rwxr-xr-x 1 root root 21916 Nov 8 2019 hostname -rwxr-xr-x 1 root root 83980 Sep 23 2020 ln -rwxr-xr-x 1 root root 55572 Feb 8 2020 login -rwxr-xr-x 1 root root 153964 Sep 23 2020 ls -rwxr-xr-x 1 root root 153124 Jul 29 09:09 lsblk -rwxr-xr-x 1 root root 96328 Sep 23 2020 mkdir -rwxr-xr-x 1 root root 79912 Sep 23 2020 mknod -rwxr-xr-x 1 root root 47048 Sep 23 2020 mktemp -rwxr-xr-x 1 root root 58920 Jul 29 09:09 more -rwsr-xr-x 1 root root 50720 Jul 29 09:09 mount -rwxr-xr-x 1 root root 13856 Jul 29 09:09 mountpoint -rwxr-xr-x 1 root root 157996 Sep 23 2020 mv lrwxrwxrwx 1 root root 8 Nov 8 2019 nisdomainname -> hostname lrwxrwxrwx 1 root root 14 Apr 19 05:38 pidof -> /sbin/killall5 -rwxr-xr-x 1 root root 38824 Sep 23 2020 pwd lrwxrwxrwx 1 root root 4 Aug 5 10:25 rbash -> bash -rwxr-xr-x 1 root root 46984 Sep 23 2020 readlink -rwxr-xr-x 1 root root 75720 Sep 23 2020 rm -rwxr-xr-x 1 root root 46984 Sep 23 2020 rmdir -rwxr-xr-x 1 root root 22292 Sep 28 2020 run-parts -rwxr-xr-x 1 root root 125036 Dec 23 2018 sed lrwxrwxrwx 1 root root 4 Oct 6 06:25 sh -> bash lrwxrwxrwx 1 root root 4 Sep 21 23:26 sh.distrib -> dash -rwxr-xr-x 1 root root 34696 Sep 23 2020 sleep -rwxr-xr-x 1 root root 83880 Sep 23 2020 stty -rwsr-xr-x 1 root root 79396 Jul 29 09:09 su -rwxr-xr-x 1 root root 34696 Sep 23 2020 sync -rwxr-xr-x 1 root root 602584 Feb 17 2021 tar -rwxr-xr-x 1 root root 13860 Sep 28 2020 tempfile -rwxr-xr-x 1 root root 108520 Sep 23 2020 touch -rwxr-xr-x 1 root root 34664 Sep 23 2020 true -rwxr-xr-x 1 root root 17768 Feb 27 2021 ulockmgr_server -rwsr-xr-x 1 root root 30236 Jul 29 09:09 umount -rwxr-xr-x 1 root root 34664 Sep 23 2020 uname -rwxr-xr-x 2 root root 2346 Mar 3 2021 uncompress -rwxr-xr-x 1 root root 153964 Sep 23 2020 vdir -rwxr-xr-x 1 root root 63024 Jul 29 09:09 wdctl lrwxrwxrwx 1 root root 8 Nov 8 2019 ypdomainname -> hostname -rwxr-xr-x 1 root root 1984 Mar 3 2021 zcat -rwxr-xr-x 1 root root 1678 Mar 3 2021 zcmp -rwxr-xr-x 1 root root 5880 Mar 3 2021 zdiff -rwxr-xr-x 1 root root 29 Mar 3 2021 zegrep -rwxr-xr-x 1 root root 29 Mar 3 2021 zfgrep -rwxr-xr-x 1 root root 2081 Mar 3 2021 zforce -rwxr-xr-x 1 root root 7585 Mar 3 2021 zgrep -rwxr-xr-x 1 root root 2206 Mar 3 2021 zless -rwxr-xr-x 1 root root 1842 Mar 3 2021 zmore -rwxr-xr-x 1 root root 4553 Mar 3 2021 znew I: user script /srv/workspace/pbuilder/12155/tmp/hooks/D02_print_environment finished -> Attempting to satisfy build-dependencies -> Creating pbuilder-satisfydepends-dummy package Package: pbuilder-satisfydepends-dummy Version: 0.invalid.0 Architecture: i386 Maintainer: Debian Pbuilder Team Description: Dummy package to satisfy dependencies with aptitude - created by pbuilder This package was created automatically by pbuilder to satisfy the build-dependencies of the package being currently built. Depends: debhelper-compat (= 12), bash-completion, dh-golang (>= 1.42~), golang-any (>= 2:1.13~), golang-github-armon-circbuf-dev, golang-github-armon-go-metrics-dev (>= 0.0~git20171117~), golang-github-armon-go-radix-dev, golang-github-aws-aws-sdk-go-dev, golang-github-azure-go-autorest-dev (>= 10.15.5~), golang-github-bgentry-speakeasy-dev, golang-github-census-instrumentation-opencensus-proto-dev, golang-github-circonus-labs-circonus-gometrics-dev (>= 2.3.1~), golang-github-circonus-labs-circonusllhist-dev, golang-github-coreos-go-oidc-dev, golang-github-datadog-datadog-go-dev, golang-github-davecgh-go-spew-dev, golang-github-denverdino-aliyungo-dev, golang-github-docker-go-connections-dev, golang-github-elazarl-go-bindata-assetfs-dev, golang-github-gogo-protobuf-dev (>= 1.2.1~), golang-github-golang-snappy-dev, golang-github-googleapis-gnostic-dev, golang-github-google-gofuzz-dev, golang-github-gophercloud-gophercloud-dev, golang-github-hashicorp-go-bexpr-dev, golang-github-hashicorp-go-checkpoint-dev, golang-github-hashicorp-go-cleanhttp-dev (>= 0.5.1~), golang-github-hashicorp-go-discover-dev, golang-github-hashicorp-go-hclog-dev (>= 0.9.2~), golang-github-hashicorp-go-immutable-radix-dev (>= 1.1.0~), golang-github-hashicorp-golang-lru-dev, golang-github-hashicorp-go-memdb-dev (>= 1.2.1~), golang-github-hashicorp-go-msgpack-dev (>= 0.5.5~), golang-github-hashicorp-go-multierror-dev, golang-github-hashicorp-go-raftchunking-dev, golang-github-hashicorp-go-retryablehttp-dev, golang-github-hashicorp-go-rootcerts-dev (>= 1.0.2~), golang-github-hashicorp-go-sockaddr-dev, golang-github-hashicorp-go-syslog-dev, golang-github-hashicorp-go-uuid-dev, golang-github-hashicorp-go-version-dev, golang-github-hashicorp-hcl-dev, golang-github-hashicorp-hil-dev (>= 0.0~git20160711~), golang-github-hashicorp-memberlist-dev (>= 0.2.2~), golang-github-hashicorp-net-rpc-msgpackrpc-dev, golang-github-hashicorp-raft-boltdb-dev, golang-github-hashicorp-raft-dev (>= 1.1.2~), golang-github-hashicorp-serf-dev (>= 0.9.4~), golang-github-hashicorp-yamux-dev, golang-github-imdario-mergo-dev, golang-github-json-iterator-go-dev, golang-github-kr-text-dev, golang-github-mattn-go-isatty-dev, golang-github-miekg-dns-dev (>= 1.1.26~), golang-github-mitchellh-cli-dev (>= 1.1.1~), golang-github-mitchellh-go-testing-interface-dev (>= 1.14.1~), golang-github-mitchellh-copystructure-dev, golang-github-mitchellh-hashstructure-dev, golang-github-mitchellh-mapstructure-dev, golang-github-mitchellh-reflectwalk-dev, golang-github-nytimes-gziphandler-dev, golang-github-packethost-packngo-dev, golang-github-pascaldekloe-goe-dev, golang-github-patrickmn-go-cache-dev, golang-github-pierrec-lz4-dev, golang-github-pmezard-go-difflib-dev, golang-github-ryanuber-columnize-dev, golang-github-ryanuber-go-glob-dev, golang-github-shirou-gopsutil-dev, golang-go.opencensus-dev, golang-golang-x-sys-dev, golang-golang-x-time-dev (>= 0.0+git20200630~), golang-gopkg-inf.v0-dev, golang-gopkg-square-go-jose.v2-dev, golang-k8s-sigs-yaml-dev, mockery, procps dpkg-deb: building package 'pbuilder-satisfydepends-dummy' in '/tmp/satisfydepends-aptitude/pbuilder-satisfydepends-dummy.deb'. Selecting previously unselected package pbuilder-satisfydepends-dummy. (Reading database ... 19675 files and directories currently installed.) Preparing to unpack .../pbuilder-satisfydepends-dummy.deb ... Unpacking pbuilder-satisfydepends-dummy (0.invalid.0) ... dpkg: pbuilder-satisfydepends-dummy: dependency problems, but configuring anyway as you requested: pbuilder-satisfydepends-dummy depends on debhelper-compat (= 12); however: Package debhelper-compat is not installed. pbuilder-satisfydepends-dummy depends on bash-completion; however: Package bash-completion is not installed. pbuilder-satisfydepends-dummy depends on dh-golang (>= 1.42~); however: Package dh-golang is not installed. pbuilder-satisfydepends-dummy depends on golang-any (>= 2:1.13~); however: Package golang-any is not installed. pbuilder-satisfydepends-dummy depends on golang-github-armon-circbuf-dev; however: Package golang-github-armon-circbuf-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-armon-go-metrics-dev (>= 0.0~git20171117~); however: Package golang-github-armon-go-metrics-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-armon-go-radix-dev; however: Package golang-github-armon-go-radix-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-aws-aws-sdk-go-dev; however: Package golang-github-aws-aws-sdk-go-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-azure-go-autorest-dev (>= 10.15.5~); however: Package golang-github-azure-go-autorest-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-bgentry-speakeasy-dev; however: Package golang-github-bgentry-speakeasy-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-census-instrumentation-opencensus-proto-dev; however: Package golang-github-census-instrumentation-opencensus-proto-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-circonus-labs-circonus-gometrics-dev (>= 2.3.1~); however: Package golang-github-circonus-labs-circonus-gometrics-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-circonus-labs-circonusllhist-dev; however: Package golang-github-circonus-labs-circonusllhist-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-coreos-go-oidc-dev; however: Package golang-github-coreos-go-oidc-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-datadog-datadog-go-dev; however: Package golang-github-datadog-datadog-go-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-davecgh-go-spew-dev; however: Package golang-github-davecgh-go-spew-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-denverdino-aliyungo-dev; however: Package golang-github-denverdino-aliyungo-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-docker-go-connections-dev; however: Package golang-github-docker-go-connections-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-elazarl-go-bindata-assetfs-dev; however: Package golang-github-elazarl-go-bindata-assetfs-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-gogo-protobuf-dev (>= 1.2.1~); however: Package golang-github-gogo-protobuf-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-golang-snappy-dev; however: Package golang-github-golang-snappy-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-googleapis-gnostic-dev; however: Package golang-github-googleapis-gnostic-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-google-gofuzz-dev; however: Package golang-github-google-gofuzz-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-gophercloud-gophercloud-dev; however: Package golang-github-gophercloud-gophercloud-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-bexpr-dev; however: Package golang-github-hashicorp-go-bexpr-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-checkpoint-dev; however: Package golang-github-hashicorp-go-checkpoint-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-cleanhttp-dev (>= 0.5.1~); however: Package golang-github-hashicorp-go-cleanhttp-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-discover-dev; however: Package golang-github-hashicorp-go-discover-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-hclog-dev (>= 0.9.2~); however: Package golang-github-hashicorp-go-hclog-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-immutable-radix-dev (>= 1.1.0~); however: Package golang-github-hashicorp-go-immutable-radix-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-golang-lru-dev; however: Package golang-github-hashicorp-golang-lru-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-memdb-dev (>= 1.2.1~); however: Package golang-github-hashicorp-go-memdb-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-msgpack-dev (>= 0.5.5~); however: Package golang-github-hashicorp-go-msgpack-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-multierror-dev; however: Package golang-github-hashicorp-go-multierror-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-raftchunking-dev; however: Package golang-github-hashicorp-go-raftchunking-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-retryablehttp-dev; however: Package golang-github-hashicorp-go-retryablehttp-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-rootcerts-dev (>= 1.0.2~); however: Package golang-github-hashicorp-go-rootcerts-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-sockaddr-dev; however: Package golang-github-hashicorp-go-sockaddr-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-syslog-dev; however: Package golang-github-hashicorp-go-syslog-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-uuid-dev; however: Package golang-github-hashicorp-go-uuid-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-go-version-dev; however: Package golang-github-hashicorp-go-version-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-hcl-dev; however: Package golang-github-hashicorp-hcl-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-hil-dev (>= 0.0~git20160711~); however: Package golang-github-hashicorp-hil-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-memberlist-dev (>= 0.2.2~); however: Package golang-github-hashicorp-memberlist-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-net-rpc-msgpackrpc-dev; however: Package golang-github-hashicorp-net-rpc-msgpackrpc-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-raft-boltdb-dev; however: Package golang-github-hashicorp-raft-boltdb-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-raft-dev (>= 1.1.2~); however: Package golang-github-hashicorp-raft-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-serf-dev (>= 0.9.4~); however: Package golang-github-hashicorp-serf-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-hashicorp-yamux-dev; however: Package golang-github-hashicorp-yamux-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-imdario-mergo-dev; however: Package golang-github-imdario-mergo-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-json-iterator-go-dev; however: Package golang-github-json-iterator-go-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-kr-text-dev; however: Package golang-github-kr-text-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-mattn-go-isatty-dev; however: Package golang-github-mattn-go-isatty-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-miekg-dns-dev (>= 1.1.26~); however: Package golang-github-miekg-dns-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-mitchellh-cli-dev (>= 1.1.1~); however: Package golang-github-mitchellh-cli-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-mitchellh-go-testing-interface-dev (>= 1.14.1~); however: Package golang-github-mitchellh-go-testing-interface-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-mitchellh-copystructure-dev; however: Package golang-github-mitchellh-copystructure-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-mitchellh-hashstructure-dev; however: Package golang-github-mitchellh-hashstructure-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-mitchellh-mapstructure-dev; however: Package golang-github-mitchellh-mapstructure-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-mitchellh-reflectwalk-dev; however: Package golang-github-mitchellh-reflectwalk-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-nytimes-gziphandler-dev; however: Package golang-github-nytimes-gziphandler-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-packethost-packngo-dev; however: Package golang-github-packethost-packngo-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-pascaldekloe-goe-dev; however: Package golang-github-pascaldekloe-goe-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-patrickmn-go-cache-dev; however: Package golang-github-patrickmn-go-cache-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-pierrec-lz4-dev; however: Package golang-github-pierrec-lz4-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-pmezard-go-difflib-dev; however: Package golang-github-pmezard-go-difflib-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-ryanuber-columnize-dev; however: Package golang-github-ryanuber-columnize-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-ryanuber-go-glob-dev; however: Package golang-github-ryanuber-go-glob-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-github-shirou-gopsutil-dev; however: Package golang-github-shirou-gopsutil-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-go.opencensus-dev; however: Package golang-go.opencensus-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-golang-x-sys-dev; however: Package golang-golang-x-sys-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-golang-x-time-dev (>= 0.0+git20200630~); however: Package golang-golang-x-time-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-gopkg-inf.v0-dev; however: Package golang-gopkg-inf.v0-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-gopkg-square-go-jose.v2-dev; however: Package golang-gopkg-square-go-jose.v2-dev is not installed. pbuilder-satisfydepends-dummy depends on golang-k8s-sigs-yaml-dev; however: Package golang-k8s-sigs-yaml-dev is not installed. pbuilder-satisfydepends-dummy depends on mockery; however: Package mockery is not installed. pbuilder-satisfydepends-dummy depends on procps; however: Package procps is not installed. Setting up pbuilder-satisfydepends-dummy (0.invalid.0) ... Reading package lists... Building dependency tree... Reading state information... Initializing package states... Writing extended state information... Building tag database... pbuilder-satisfydepends-dummy is already installed at the requested version (0.invalid.0) pbuilder-satisfydepends-dummy is already installed at the requested version (0.invalid.0) The following NEW packages will be installed: autoconf{a} automake{a} autopoint{a} autotools-dev{a} bash-completion{a} bsdextrautils{a} ca-certificates{a} debhelper{a} dh-autoreconf{a} dh-golang{a} dh-strip-nondeterminism{a} dwz{a} file{a} gettext{a} gettext-base{a} golang-1.15-go{a} golang-1.15-src{a} golang-any{a} golang-dbus-dev{a} golang-github-alecthomas-units-dev{a} golang-github-armon-circbuf-dev{a} golang-github-armon-go-metrics-dev{a} golang-github-armon-go-radix-dev{a} golang-github-aws-aws-sdk-go-dev{a} golang-github-azure-go-autorest-dev{a} golang-github-beorn7-perks-dev{a} golang-github-bgentry-speakeasy-dev{a} golang-github-boltdb-bolt-dev{a} golang-github-census-instrumentation-opencensus-proto-dev{a} golang-github-cespare-xxhash-dev{a} golang-github-circonus-labs-circonus-gometrics-dev{a} golang-github-circonus-labs-circonusllhist-dev{a} golang-github-coreos-go-oidc-dev{a} golang-github-coreos-go-systemd-dev{a} golang-github-coreos-pkg-dev{a} golang-github-creack-pty-dev{a} golang-github-datadog-datadog-go-dev{a} golang-github-davecgh-go-spew-dev{a} golang-github-denverdino-aliyungo-dev{a} golang-github-dghubble-sling-dev{a} golang-github-dgrijalva-jwt-go-dev{a} golang-github-digitalocean-godo-dev{a} golang-github-dimchansky-utfbom-dev{a} golang-github-docker-go-connections-dev{a} golang-github-docopt-docopt-go-dev{a} golang-github-elazarl-go-bindata-assetfs-dev{a} golang-github-fatih-color-dev{a} golang-github-ghodss-yaml-dev{a} golang-github-go-kit-kit-dev{a} golang-github-go-logfmt-logfmt-dev{a} golang-github-go-stack-stack-dev{a} golang-github-go-test-deep-dev{a} golang-github-gogo-protobuf-dev{a} golang-github-golang-groupcache-dev{a} golang-github-golang-mock-dev{a} golang-github-golang-snappy-dev{a} golang-github-google-btree-dev{a} golang-github-google-go-cmp-dev{a} golang-github-google-go-querystring-dev{a} golang-github-google-gofuzz-dev{a} golang-github-google-uuid-dev{a} golang-github-googleapis-gax-go-dev{a} golang-github-googleapis-gnostic-dev{a} golang-github-gophercloud-gophercloud-dev{a} golang-github-grpc-ecosystem-grpc-gateway-dev{a} golang-github-hashicorp-errwrap-dev{a} golang-github-hashicorp-go-bexpr-dev{a} golang-github-hashicorp-go-checkpoint-dev{a} golang-github-hashicorp-go-cleanhttp-dev{a} golang-github-hashicorp-go-discover-dev{a} golang-github-hashicorp-go-hclog-dev{a} golang-github-hashicorp-go-immutable-radix-dev{a} golang-github-hashicorp-go-memdb-dev{a} golang-github-hashicorp-go-msgpack-dev{a} golang-github-hashicorp-go-multierror-dev{a} golang-github-hashicorp-go-raftchunking-dev{a} golang-github-hashicorp-go-retryablehttp-dev{a} golang-github-hashicorp-go-rootcerts-dev{a} golang-github-hashicorp-go-sockaddr-dev{a} golang-github-hashicorp-go-syslog-dev{a} golang-github-hashicorp-go-uuid-dev{a} golang-github-hashicorp-go-version-dev{a} golang-github-hashicorp-golang-lru-dev{a} golang-github-hashicorp-hcl-dev{a} golang-github-hashicorp-hil-dev{a} golang-github-hashicorp-logutils-dev{a} golang-github-hashicorp-mdns-dev{a} golang-github-hashicorp-memberlist-dev{a} golang-github-hashicorp-net-rpc-msgpackrpc-dev{a} golang-github-hashicorp-raft-boltdb-dev{a} golang-github-hashicorp-raft-dev{a} golang-github-hashicorp-serf-dev{a} golang-github-hashicorp-yamux-dev{a} golang-github-imdario-mergo-dev{a} golang-github-jmespath-go-jmespath-dev{a} golang-github-jonboulle-clockwork-dev{a} golang-github-jpillora-backoff-dev{a} golang-github-json-iterator-go-dev{a} golang-github-julienschmidt-httprouter-dev{a} golang-github-kr-pretty-dev{a} golang-github-kr-text-dev{a} golang-github-mattn-go-colorable-dev{a} golang-github-mattn-go-isatty-dev{a} golang-github-miekg-dns-dev{a} golang-github-mitchellh-cli-dev{a} golang-github-mitchellh-copystructure-dev{a} golang-github-mitchellh-go-homedir-dev{a} golang-github-mitchellh-go-testing-interface-dev{a} golang-github-mitchellh-hashstructure-dev{a} golang-github-mitchellh-mapstructure-dev{a} golang-github-mitchellh-reflectwalk-dev{a} golang-github-modern-go-concurrent-dev{a} golang-github-modern-go-reflect2-dev{a} golang-github-mwitkow-go-conntrack-dev{a} golang-github-nytimes-gziphandler-dev{a} golang-github-opentracing-opentracing-go-dev{a} golang-github-packethost-packngo-dev{a} golang-github-pascaldekloe-goe-dev{a} golang-github-patrickmn-go-cache-dev{a} golang-github-pierrec-lz4-dev{a} golang-github-pkg-errors-dev{a} golang-github-pmezard-go-difflib-dev{a} golang-github-posener-complete-dev{a} golang-github-pquerna-cachecontrol-dev{a} golang-github-prometheus-client-golang-dev{a} golang-github-prometheus-client-model-dev{a} golang-github-prometheus-common-dev{a} golang-github-prometheus-procfs-dev{a} golang-github-rogpeppe-fastuuid-dev{a} golang-github-ryanuber-columnize-dev{a} golang-github-ryanuber-go-glob-dev{a} golang-github-shirou-gopsutil-dev{a} golang-github-sirupsen-logrus-dev{a} golang-github-stretchr-objx-dev{a} golang-github-stretchr-testify-dev{a} golang-github-tv42-httpunix-dev{a} golang-github-vmihailenco-tagparser-dev{a} golang-github-vmware-govmomi-dev{a} golang-glog-dev{a} golang-go{a} golang-go.opencensus-dev{a} golang-golang-x-crypto-dev{a} golang-golang-x-net-dev{a} golang-golang-x-oauth2-dev{a} golang-golang-x-oauth2-google-dev{a} golang-golang-x-sync-dev{a} golang-golang-x-sys-dev{a} golang-golang-x-term-dev{a} golang-golang-x-text-dev{a} golang-golang-x-time-dev{a} golang-golang-x-xerrors-dev{a} golang-google-api-dev{a} golang-google-cloud-compute-metadata-dev{a} golang-google-genproto-dev{a} golang-google-grpc-dev{a} golang-gopkg-alecthomas-kingpin.v2-dev{a} golang-gopkg-check.v1-dev{a} golang-gopkg-inf.v0-dev{a} golang-gopkg-mgo.v2-dev{a} golang-gopkg-square-go-jose.v2-dev{a} golang-gopkg-tomb.v2-dev{a} golang-gopkg-vmihailenco-msgpack.v2-dev{a} golang-gopkg-yaml.v2-dev{a} golang-gopkg-yaml.v3-dev{a} golang-goprotobuf-dev{a} golang-k8s-sigs-yaml-dev{a} golang-protobuf-extensions-dev{a} golang-src{a} groff-base{a} intltool-debian{a} iproute2{a} libarchive-zip-perl{a} libbpf0{a} libbsd0{a} libcap2{a} libcap2-bin{a} libdebhelper-perl{a} libelf1{a} libfile-stripnondeterminism-perl{a} libglib2.0-0{a} libicu67{a} libmagic-mgc{a} libmagic1{a} libmd0{a} libmnl0{a} libncurses6{a} libpipeline1{a} libprocps8{a} libprotobuf-dev{a} libprotobuf-lite23{a} libprotobuf23{a} libprotoc23{a} libsasl2-2{a} libsasl2-dev{a} libsasl2-modules-db{a} libsigsegv2{a} libsub-override-perl{a} libsystemd-dev{a} libtool{a} libuchardet0{a} libxml2{a} libxtables12{a} m4{a} man-db{a} mockery{a} openssl{a} pkg-config{a} po-debconf{a} procps{a} protobuf-compiler{a} sensible-utils{a} zlib1g-dev{a} The following packages are RECOMMENDED but will NOT be installed: curl gogoprotobuf libarchive-cpio-perl libatm1 libglib2.0-data libgpm2 libltdl-dev libmail-sendmail-perl libpam-cap libsasl2-modules lynx psmisc shared-mime-info wget xdg-user-dirs 0 packages upgraded, 212 newly installed, 0 to remove and 0 not upgraded. Need to get 126 MB of archives. After unpacking 842 MB will be used. Writing extended state information... Get: 1 http://deb.debian.org/debian bullseye/main i386 bsdextrautils i386 2.36.1-8 [149 kB] Get: 2 http://deb.debian.org/debian bullseye/main i386 libuchardet0 i386 0.0.7-1 [67.9 kB] Get: 3 http://deb.debian.org/debian bullseye/main i386 groff-base i386 1.22.4-6 [952 kB] Get: 4 http://deb.debian.org/debian bullseye/main i386 libpipeline1 i386 1.5.3-1 [36.8 kB] Get: 5 http://deb.debian.org/debian bullseye/main i386 man-db i386 2.9.4-2 [1367 kB] Get: 6 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-sys-dev all 0.0~git20210124.22da62e-1 [308 kB] Get: 7 http://deb.debian.org/debian bullseye/main i386 golang-github-sirupsen-logrus-dev all 1.7.0-2 [45.3 kB] Get: 8 http://deb.debian.org/debian bullseye/main i386 libelf1 i386 0.183-1 [171 kB] Get: 9 http://deb.debian.org/debian bullseye/main i386 libbpf0 i386 1:0.3-2 [107 kB] Get: 10 http://deb.debian.org/debian bullseye/main i386 libmd0 i386 1.0.3-3 [28.9 kB] Get: 11 http://deb.debian.org/debian bullseye/main i386 libbsd0 i386 0.11.3-1 [111 kB] Get: 12 http://deb.debian.org/debian bullseye/main i386 libcap2 i386 1:2.44-1 [24.5 kB] Get: 13 http://deb.debian.org/debian bullseye/main i386 libmnl0 i386 1.0.4-3 [13.0 kB] Get: 14 http://deb.debian.org/debian bullseye/main i386 libxtables12 i386 1.8.7-1 [47.2 kB] Get: 15 http://deb.debian.org/debian bullseye/main i386 libcap2-bin i386 1:2.44-1 [33.1 kB] Get: 16 http://deb.debian.org/debian bullseye/main i386 iproute2 i386 5.10.0-4 [987 kB] Get: 17 http://deb.debian.org/debian bullseye/main i386 libncurses6 i386 6.2+20201114-2 [110 kB] Get: 18 http://deb.debian.org/debian bullseye/main i386 libprocps8 i386 2:3.3.17-5 [64.2 kB] Get: 19 http://deb.debian.org/debian bullseye/main i386 procps i386 2:3.3.17-5 [501 kB] Get: 20 http://deb.debian.org/debian bullseye/main i386 sensible-utils all 0.0.14 [14.8 kB] Get: 21 http://deb.debian.org/debian bullseye/main i386 bash-completion all 1:2.11-2 [234 kB] Get: 22 http://deb.debian.org/debian bullseye/main i386 openssl i386 1.1.1k-1 [860 kB] Get: 23 http://deb.debian.org/debian bullseye/main i386 ca-certificates all 20210119 [158 kB] Get: 24 http://deb.debian.org/debian bullseye/main i386 libmagic-mgc i386 1:5.39-3 [273 kB] Get: 25 http://deb.debian.org/debian bullseye/main i386 libmagic1 i386 1:5.39-3 [133 kB] Get: 26 http://deb.debian.org/debian bullseye/main i386 file i386 1:5.39-3 [69.0 kB] Get: 27 http://deb.debian.org/debian bullseye/main i386 gettext-base i386 0.21-4 [176 kB] Get: 28 http://deb.debian.org/debian bullseye/main i386 libsigsegv2 i386 2.13-1 [35.1 kB] Get: 29 http://deb.debian.org/debian bullseye/main i386 m4 i386 1.4.18-5 [206 kB] Get: 30 http://deb.debian.org/debian bullseye/main i386 autoconf all 2.69-14 [313 kB] Get: 31 http://deb.debian.org/debian bullseye/main i386 autotools-dev all 20180224.1+nmu1 [77.1 kB] Get: 32 http://deb.debian.org/debian bullseye/main i386 automake all 1:1.16.3-2 [814 kB] Get: 33 http://deb.debian.org/debian bullseye/main i386 autopoint all 0.21-4 [510 kB] Get: 34 http://deb.debian.org/debian bullseye/main i386 libdebhelper-perl all 13.3.4 [189 kB] Get: 35 http://deb.debian.org/debian bullseye/main i386 libtool all 2.4.6-15 [513 kB] Get: 36 http://deb.debian.org/debian bullseye/main i386 dh-autoreconf all 20 [17.1 kB] Get: 37 http://deb.debian.org/debian bullseye/main i386 libarchive-zip-perl all 1.68-1 [104 kB] Get: 38 http://deb.debian.org/debian bullseye/main i386 libsub-override-perl all 0.09-2 [10.2 kB] Get: 39 http://deb.debian.org/debian bullseye/main i386 libfile-stripnondeterminism-perl all 1.12.0-1 [26.3 kB] Get: 40 http://deb.debian.org/debian bullseye/main i386 dh-strip-nondeterminism all 1.12.0-1 [15.4 kB] Get: 41 http://deb.debian.org/debian bullseye/main i386 dwz i386 0.13+20210201-1 [179 kB] Get: 42 http://deb.debian.org/debian bullseye/main i386 libicu67 i386 67.1-7 [8775 kB] Get: 43 http://deb.debian.org/debian bullseye/main i386 libxml2 i386 2.9.10+dfsg-6.7 [728 kB] Get: 44 http://deb.debian.org/debian bullseye/main i386 gettext i386 0.21-4 [1322 kB] Get: 45 http://deb.debian.org/debian bullseye/main i386 intltool-debian all 0.35.0+20060710.5 [26.8 kB] Get: 46 http://deb.debian.org/debian bullseye/main i386 po-debconf all 1.0.21+nmu1 [248 kB] Get: 47 http://deb.debian.org/debian bullseye/main i386 debhelper all 13.3.4 [1049 kB] Get: 48 http://deb.debian.org/debian bullseye/main i386 dh-golang all 1.51 [24.6 kB] Get: 49 http://deb.debian.org/debian bullseye/main i386 golang-1.15-src i386 1.15.9-6 [13.8 MB] Get: 50 http://deb.debian.org/debian bullseye/main i386 golang-1.15-go i386 1.15.9-6 [46.2 MB] Get: 51 http://deb.debian.org/debian bullseye/main i386 golang-src i386 2:1.15~1 [4856 B] Get: 52 http://deb.debian.org/debian bullseye/main i386 golang-go i386 2:1.15~1 [24.0 kB] Get: 53 http://deb.debian.org/debian bullseye/main i386 golang-any i386 2:1.15~1 [4980 B] Get: 54 http://deb.debian.org/debian bullseye/main i386 golang-dbus-dev all 5.0.3-2 [55.9 kB] Get: 55 http://deb.debian.org/debian bullseye/main i386 golang-github-alecthomas-units-dev all 0.0~git20201120.1786d5e-1 [7504 B] Get: 56 http://deb.debian.org/debian bullseye/main i386 golang-github-armon-circbuf-dev all 0.0~git20190214.5111143-1 [4388 B] Get: 57 http://deb.debian.org/debian bullseye/main i386 golang-github-circonus-labs-circonusllhist-dev all 0.0~git20191022.ec08cde-1 [11.1 kB] Get: 58 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-cleanhttp-dev all 0.5.2-1 [10.8 kB] Get: 59 http://deb.debian.org/debian bullseye/main i386 golang-github-mattn-go-isatty-dev all 0.0.12-1 [6472 B] Get: 60 http://deb.debian.org/debian bullseye/main i386 golang-github-mattn-go-colorable-dev all 0.1.7-1 [9936 B] Get: 61 http://deb.debian.org/debian bullseye/main i386 golang-github-fatih-color-dev all 1.7.0-1 [11.4 kB] Get: 62 http://deb.debian.org/debian bullseye/main i386 golang-github-davecgh-go-spew-dev all 1.1.1-2 [29.7 kB] Get: 63 http://deb.debian.org/debian bullseye/main i386 golang-github-pmezard-go-difflib-dev all 1.0.0-3 [12.3 kB] Get: 64 http://deb.debian.org/debian bullseye/main i386 golang-github-stretchr-objx-dev all 0.3.0-1 [25.4 kB] Get: 65 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-yaml.v3-dev all 3.0.0~git20200121.a6ecf24-3 [70.5 kB] Get: 66 http://deb.debian.org/debian bullseye/main i386 golang-github-stretchr-testify-dev all 1.6.1-2 [60.4 kB] Get: 67 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-hclog-dev all 0.11.0-1 [17.9 kB] Get: 68 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-retryablehttp-dev all 0.6.4-2 [17.5 kB] Get: 69 http://deb.debian.org/debian bullseye/main i386 golang-github-pkg-errors-dev all 0.9.1-1 [13.0 kB] Get: 70 http://deb.debian.org/debian bullseye/main i386 golang-github-tv42-httpunix-dev all 0.0~git20150427.b75d861-2 [3744 B] Get: 71 http://deb.debian.org/debian bullseye/main i386 golang-github-circonus-labs-circonus-gometrics-dev all 2.3.1-3 [65.9 kB] Get: 72 http://deb.debian.org/debian bullseye/main i386 golang-github-datadog-datadog-go-dev all 2.1.0-3 [14.9 kB] Get: 73 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-uuid-dev all 1.0.2-1 [8764 B] Get: 74 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-golang-lru-dev all 0.5.4-2 [14.7 kB] Get: 75 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-immutable-radix-dev all 1.3.0-1 [25.0 kB] Get: 76 http://deb.debian.org/debian bullseye/main i386 golang-github-pascaldekloe-goe-dev all 0.1.0-2 [21.7 kB] Get: 77 http://deb.debian.org/debian bullseye/main i386 golang-github-beorn7-perks-dev all 1.0.1-1 [12.1 kB] Get: 78 http://deb.debian.org/debian bullseye/main i386 golang-github-cespare-xxhash-dev all 2.1.1-1 [8748 B] Get: 79 http://deb.debian.org/debian bullseye/main i386 golang-github-modern-go-concurrent-dev all 1.0.3-1.1 [4668 B] Get: 80 http://deb.debian.org/debian bullseye/main i386 golang-github-modern-go-reflect2-dev all 1.0.1-1 [10.6 kB] Get: 81 http://deb.debian.org/debian bullseye/main i386 golang-github-json-iterator-go-dev all 1.1.10-2 [69.4 kB] Get: 82 http://deb.debian.org/debian bullseye/main i386 zlib1g-dev i386 1:1.2.11.dfsg-2 [194 kB] Get: 83 http://deb.debian.org/debian bullseye/main i386 libprotobuf23 i386 3.12.4-1 [975 kB] Get: 84 http://deb.debian.org/debian bullseye/main i386 libprotobuf-lite23 i386 3.12.4-1 [263 kB] Get: 85 http://deb.debian.org/debian bullseye/main i386 libprotobuf-dev i386 3.12.4-1 [1335 kB] Get: 86 http://deb.debian.org/debian bullseye/main i386 libprotoc23 i386 3.12.4-1 [872 kB] Get: 87 http://deb.debian.org/debian bullseye/main i386 protobuf-compiler i386 3.12.4-1 [75.3 kB] Get: 88 http://deb.debian.org/debian bullseye/main i386 golang-goprotobuf-dev i386 1.3.4-2+b6 [1442 kB] Get: 89 http://deb.debian.org/debian bullseye/main i386 golang-github-prometheus-client-model-dev all 0.2.0-2 [8476 B] Get: 90 http://deb.debian.org/debian bullseye/main i386 golang-github-dgrijalva-jwt-go-dev all 3.2.0-3 [33.6 kB] Get: 91 http://deb.debian.org/debian bullseye/main i386 golang-github-go-logfmt-logfmt-dev all 0.5.0-2 [13.4 kB] Get: 92 http://deb.debian.org/debian bullseye/main i386 golang-github-go-stack-stack-dev all 1.8.0-1 [8696 B] Get: 93 http://deb.debian.org/debian bullseye/main i386 golang-github-opentracing-opentracing-go-dev all 1.2.0-1 [29.4 kB] Get: 94 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-text-dev all 0.3.6-1 [3857 kB] Get: 95 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-net-dev all 1:0.0+git20210119.5f4716e+dfsg-4 [659 kB] Get: 96 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-time-dev all 0.0+git20200630.3af7569-1 [10.1 kB] Get: 97 http://deb.debian.org/debian bullseye/main i386 golang-github-golang-mock-dev all 1.3.1-2 [35.1 kB] Get: 98 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-xerrors-dev all 0.0~git20191204.9bdfabe-1 [14.2 kB] Get: 99 http://deb.debian.org/debian bullseye/main i386 golang-github-google-go-cmp-dev all 0.5.4-1 [83.7 kB] Get: 100 http://deb.debian.org/debian bullseye/main i386 golang-glog-dev all 0.0~git20160126.23def4e-3 [17.3 kB] Get: 101 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-oauth2-dev all 0.0~git20190604.0f29369-2 [31.9 kB] Get: 102 http://deb.debian.org/debian bullseye/main i386 golang-google-cloud-compute-metadata-dev all 0.56.0-1 [34.0 kB] Get: 103 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-oauth2-google-dev all 0.0~git20190604.0f29369-2 [13.2 kB] Get: 104 http://deb.debian.org/debian bullseye/main i386 golang-google-genproto-dev all 0.0~git20200413.b5235f6-1 [4037 kB] Get: 105 http://deb.debian.org/debian bullseye/main i386 golang-google-grpc-dev all 1.27.1-1 [478 kB] Get: 106 http://deb.debian.org/debian bullseye/main i386 golang-github-go-kit-kit-dev all 0.6.0-3 [103 kB] Get: 107 http://deb.debian.org/debian bullseye/main i386 golang-github-julienschmidt-httprouter-dev all 1.3.0-1 [19.3 kB] Get: 108 http://deb.debian.org/debian bullseye/main i386 golang-github-jpillora-backoff-dev all 1.0.0-1.1 [3712 B] Get: 109 http://deb.debian.org/debian bullseye/main i386 golang-github-mwitkow-go-conntrack-dev all 0.0~git20190716.2f06839-2 [14.6 kB] Get: 110 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-alecthomas-kingpin.v2-dev all 2.2.6-3 [42.8 kB] Get: 111 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-yaml.v2-dev all 2.4.0-1 [61.3 kB] Get: 112 http://deb.debian.org/debian bullseye/main i386 golang-protobuf-extensions-dev all 1.0.1-1 [29.6 kB] Get: 113 http://deb.debian.org/debian bullseye/main i386 golang-github-prometheus-common-dev all 0.15.0-2 [102 kB] Get: 114 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-sync-dev all 0.0~git20210220.036812b-1 [19.1 kB] Get: 115 http://deb.debian.org/debian bullseye/main i386 golang-github-prometheus-procfs-dev all 0.3.0-2 [110 kB] Get: 116 http://deb.debian.org/debian bullseye/main i386 golang-github-prometheus-client-golang-dev all 1.9.0-2 [134 kB] Get: 117 http://deb.debian.org/debian bullseye/main i386 golang-github-armon-go-metrics-dev all 0.3.4-1 [30.5 kB] Get: 118 http://deb.debian.org/debian bullseye/main i386 golang-github-armon-go-radix-dev all 1.0.0-1 [7420 B] Get: 119 http://deb.debian.org/debian bullseye/main i386 golang-github-jmespath-go-jmespath-dev all 0.4.0-1 [91.5 kB] Get: 120 http://deb.debian.org/debian bullseye/main i386 golang-github-aws-aws-sdk-go-dev all 1.36.33-1 [7723 kB] Get: 121 http://deb.debian.org/debian bullseye/main i386 golang-github-dimchansky-utfbom-dev all 1.1.1-1 [5468 B] Get: 122 http://deb.debian.org/debian bullseye/main i386 golang-github-mitchellh-go-homedir-dev all 1.1.0-1 [5168 B] Get: 123 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-term-dev all 0.0~git20201210.2321bbc-1 [14.5 kB] Get: 124 http://deb.debian.org/debian bullseye/main i386 golang-golang-x-crypto-dev all 1:0.0~git20201221.eec23a3-1 [1538 kB] Get: 125 http://deb.debian.org/debian bullseye/main i386 golang-github-azure-go-autorest-dev all 14.1.1-1 [113 kB] Get: 126 http://deb.debian.org/debian bullseye/main i386 golang-github-bgentry-speakeasy-dev all 0.1.0-2 [5384 B] Get: 127 http://deb.debian.org/debian bullseye/main i386 golang-github-boltdb-bolt-dev all 1.3.1-7 [60.7 kB] Get: 128 http://deb.debian.org/debian bullseye/main i386 golang-github-google-go-querystring-dev all 1.0.0-1 [7456 B] Get: 129 http://deb.debian.org/debian bullseye/main i386 golang-github-dghubble-sling-dev all 1.3.0-1 [18.4 kB] Get: 130 http://deb.debian.org/debian bullseye/main i386 golang-github-ghodss-yaml-dev all 1.0.0-1.1 [13.1 kB] Get: 131 http://deb.debian.org/debian bullseye/main i386 golang-github-rogpeppe-fastuuid-dev all 0.0~git20150106.0.6724a57-2.1 [4292 B] Get: 132 http://deb.debian.org/debian bullseye/main i386 golang-github-grpc-ecosystem-grpc-gateway-dev all 1.6.4-2 [281 kB] Get: 133 http://deb.debian.org/debian bullseye/main i386 golang-github-census-instrumentation-opencensus-proto-dev all 0.2.1+dfsg1-2 [40.0 kB] Get: 134 http://deb.debian.org/debian bullseye/main i386 libsystemd-dev i386 247.3-6 [401 kB] Get: 135 http://deb.debian.org/debian bullseye/main i386 libglib2.0-0 i386 2.66.8-1 [1437 kB] Get: 136 http://deb.debian.org/debian bullseye/main i386 pkg-config i386 0.29.2-1 [66.3 kB] Get: 137 http://deb.debian.org/debian bullseye/main i386 golang-github-coreos-go-systemd-dev all 22.1.0-3 [53.4 kB] Get: 138 http://deb.debian.org/debian bullseye/main i386 golang-github-coreos-pkg-dev all 4-3 [25.2 kB] Get: 139 http://deb.debian.org/debian bullseye/main i386 golang-github-jonboulle-clockwork-dev all 0.1.0-4.1 [5772 B] Get: 140 http://deb.debian.org/debian bullseye/main i386 golang-github-pquerna-cachecontrol-dev all 0.0~git20171018.0dec1b3-1.1 [14.3 kB] Get: 141 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-square-go-jose.v2-dev all 2.5.1-2 [266 kB] Get: 142 http://deb.debian.org/debian bullseye/main i386 golang-github-coreos-go-oidc-dev all 2.1.0-2 [19.3 kB] Get: 143 http://deb.debian.org/debian bullseye/main i386 golang-github-creack-pty-dev all 1.1.11-1 [8380 B] Get: 144 http://deb.debian.org/debian bullseye/main i386 golang-github-digitalocean-godo-dev all 1.37.0-1 [73.4 kB] Get: 145 http://deb.debian.org/debian bullseye/main i386 golang-github-docker-go-connections-dev all 0.4.0-3 [26.6 kB] Get: 146 http://deb.debian.org/debian bullseye/main i386 golang-github-docopt-docopt-go-dev all 0.6.2+git20180111.ee0de3b-1 [17.6 kB] Get: 147 http://deb.debian.org/debian bullseye/main i386 golang-github-elazarl-go-bindata-assetfs-dev all 1.0.0-1.1 [5592 B] Get: 148 http://deb.debian.org/debian bullseye/main i386 golang-github-go-test-deep-dev all 1.0.3-1 [9876 B] Get: 149 http://deb.debian.org/debian bullseye/main i386 golang-github-gogo-protobuf-dev all 1.3.2-1 [849 kB] Get: 150 http://deb.debian.org/debian bullseye/main i386 golang-github-golang-groupcache-dev all 0.0~git20200121.8c9f03a-1 [23.1 kB] Get: 151 http://deb.debian.org/debian bullseye/main i386 golang-github-golang-snappy-dev all 0.0.2-2 [54.3 kB] Get: 152 http://deb.debian.org/debian bullseye/main i386 golang-github-google-btree-dev all 1.0.0-1 [13.2 kB] Get: 153 http://deb.debian.org/debian bullseye/main i386 golang-github-google-gofuzz-dev all 1.2.0-1 [12.9 kB] Get: 154 http://deb.debian.org/debian bullseye/main i386 golang-github-google-uuid-dev all 1.2.0-1 [15.0 kB] Get: 155 http://deb.debian.org/debian bullseye/main i386 golang-github-googleapis-gax-go-dev all 2.0.5-1 [12.0 kB] Get: 156 http://deb.debian.org/debian bullseye/main i386 golang-github-googleapis-gnostic-dev all 0.2.0-2 [83.7 kB] Get: 157 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-errwrap-dev all 1.1.0-1 [6168 B] Get: 158 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-bexpr-dev all 0.1.2-2 [33.8 kB] Get: 159 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-checkpoint-dev all 0.5.0-1 [9456 B] Get: 160 http://deb.debian.org/debian bullseye/main i386 golang-github-denverdino-aliyungo-dev all 0.0~git20180921.13fa8aa-2 [125 kB] Get: 161 http://deb.debian.org/debian bullseye/main i386 golang-github-gophercloud-gophercloud-dev all 0.12.0-1 [628 kB] Get: 162 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-multierror-dev all 1.1.0-1 [7720 B] Get: 163 http://deb.debian.org/debian bullseye/main i386 golang-github-miekg-dns-dev all 1.1.35-1 [162 kB] Get: 164 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-mdns-dev all 1.0.3-2 [12.5 kB] Get: 165 http://deb.debian.org/debian bullseye/main i386 golang-github-packethost-packngo-dev all 0.2.0-2 [40.7 kB] Get: 166 http://deb.debian.org/debian bullseye/main i386 golang-github-vmware-govmomi-dev all 0.23.0-1 [707 kB] Get: 167 http://deb.debian.org/debian bullseye/main i386 golang-go.opencensus-dev all 0.22.4-2 [129 kB] Get: 168 http://deb.debian.org/debian bullseye/main i386 golang-google-api-dev all 0.28.0-2 [3818 kB] Get: 169 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-discover-dev all 0.0+git20190905.34a6505-2 [26.7 kB] Get: 170 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-memdb-dev all 1.2.1-1 [34.6 kB] Get: 171 http://deb.debian.org/debian bullseye/main i386 golang-github-vmihailenco-tagparser-dev all 0.1.1-2 [4440 B] Get: 172 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-vmihailenco-msgpack.v2-dev all 4.3.1-2 [27.5 kB] Get: 173 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-tomb.v2-dev all 0.0~git20161208.d5d1b58-3 [6840 B] Get: 174 http://deb.debian.org/debian bullseye/main i386 libsasl2-modules-db i386 2.1.27+dfsg-2.1 [70.0 kB] Get: 175 http://deb.debian.org/debian bullseye/main i386 libsasl2-2 i386 2.1.27+dfsg-2.1 [110 kB] Get: 176 http://deb.debian.org/debian bullseye/main i386 libsasl2-dev i386 2.1.27+dfsg-2.1 [295 kB] Get: 177 http://deb.debian.org/debian bullseye/main i386 golang-github-kr-text-dev all 0.2.0-1 [11.1 kB] Get: 178 http://deb.debian.org/debian bullseye/main i386 golang-github-kr-pretty-dev all 0.2.1+git20200831.59b4212-1 [14.6 kB] Get: 179 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-check.v1-dev all 0.0+git20200902.038fdea-1 [32.1 kB] Get: 180 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-mgo.v2-dev all 2016.08.01-7 [316 kB] Get: 181 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-msgpack-dev all 0.5.5-1 [43.3 kB] Get: 182 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-raft-dev all 1.1.2-1 [90.9 kB] Get: 183 http://deb.debian.org/debian bullseye/main i386 golang-github-mitchellh-reflectwalk-dev all 1.0.1-1 [8188 B] Get: 184 http://deb.debian.org/debian bullseye/main i386 golang-github-mitchellh-copystructure-dev all 0.0~git20161013.0.5af94ae-2.1 [8900 B] Get: 185 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-raftchunking-dev all 0.6.2-2 [12.3 kB] Get: 186 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-sockaddr-dev all 0.0~git20170627.41949a1+ds-2 [62.7 kB] Get: 187 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-syslog-dev all 1.0.0-1 [6040 B] Get: 188 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-version-dev all 1.2.0-1 [13.8 kB] Get: 189 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-hcl-dev all 1.0.0-1.1 [58.8 kB] Get: 190 http://deb.debian.org/debian bullseye/main i386 golang-github-mitchellh-mapstructure-dev all 1.3.3-1 [25.9 kB] Get: 191 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-hil-dev all 0.0~git20160711.1e86c6b-1 [32.6 kB] Get: 192 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-logutils-dev all 1.0.0-1 [8816 B] Get: 193 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-memberlist-dev all 0.2.2-1 [81.2 kB] Get: 194 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-net-rpc-msgpackrpc-dev all 0.0~git20151116.0.a14192a-1.1 [4388 B] Get: 195 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-raft-boltdb-dev all 0.0~git20171010.6e5ba93-3 [11.1 kB] Get: 196 http://deb.debian.org/debian bullseye/main i386 golang-github-posener-complete-dev all 1.2.3-2 [16.0 kB] Get: 197 http://deb.debian.org/debian bullseye/main i386 golang-github-mitchellh-cli-dev all 1.1.1-1 [24.3 kB] Get: 198 http://deb.debian.org/debian bullseye/main i386 golang-github-ryanuber-columnize-dev all 2.1.1-2 [6800 B] Get: 199 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-serf-dev all 0.9.4~ds1-1 [131 kB] Get: 200 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-yamux-dev all 0.0+git20190923.df201c7-1 [22.0 kB] Get: 201 http://deb.debian.org/debian bullseye/main i386 golang-github-imdario-mergo-dev all 0.3.8-3 [18.6 kB] Get: 202 http://deb.debian.org/debian bullseye/main i386 golang-github-mitchellh-go-testing-interface-dev all 1.14.1-1 [4336 B] Get: 203 http://deb.debian.org/debian bullseye/main i386 golang-github-mitchellh-hashstructure-dev all 1.0.0-1.1 [7584 B] Get: 204 http://deb.debian.org/debian bullseye/main i386 golang-github-nytimes-gziphandler-dev all 1.1.1-1 [39.9 kB] Get: 205 http://deb.debian.org/debian bullseye/main i386 golang-github-patrickmn-go-cache-dev all 2.1.0-1.1 [12.3 kB] Get: 206 http://deb.debian.org/debian bullseye/main i386 golang-github-pierrec-lz4-dev all 2.5.2-1 [5102 kB] Get: 207 http://deb.debian.org/debian bullseye/main i386 golang-github-ryanuber-go-glob-dev all 1.0.0-2 [4588 B] Get: 208 http://deb.debian.org/debian bullseye/main i386 golang-github-shirou-gopsutil-dev all 2.19.11-4 [104 kB] Get: 209 http://deb.debian.org/debian bullseye/main i386 golang-gopkg-inf.v0-dev all 0.9.1-1 [14.3 kB] Get: 210 http://deb.debian.org/debian bullseye/main i386 golang-k8s-sigs-yaml-dev all 1.2.0-3 [15.0 kB] Get: 211 http://deb.debian.org/debian bullseye/main i386 mockery i386 0.0~git20181123.e78b021-3+b6 [1498 kB] Get: 212 http://deb.debian.org/debian bullseye/main i386 golang-github-hashicorp-go-rootcerts-dev all 1.0.2-2 [8356 B] Fetched 126 MB in 3s (44.6 MB/s) debconf: delaying package configuration, since apt-utils is not installed Selecting previously unselected package bsdextrautils. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 19675 files and directories currently installed.) Preparing to unpack .../000-bsdextrautils_2.36.1-8_i386.deb ... Unpacking bsdextrautils (2.36.1-8) ... Selecting previously unselected package libuchardet0:i386. Preparing to unpack .../001-libuchardet0_0.0.7-1_i386.deb ... Unpacking libuchardet0:i386 (0.0.7-1) ... Selecting previously unselected package groff-base. Preparing to unpack .../002-groff-base_1.22.4-6_i386.deb ... Unpacking groff-base (1.22.4-6) ... Selecting previously unselected package libpipeline1:i386. Preparing to unpack .../003-libpipeline1_1.5.3-1_i386.deb ... Unpacking libpipeline1:i386 (1.5.3-1) ... Selecting previously unselected package man-db. Preparing to unpack .../004-man-db_2.9.4-2_i386.deb ... Unpacking man-db (2.9.4-2) ... Selecting previously unselected package golang-golang-x-sys-dev. Preparing to unpack .../005-golang-golang-x-sys-dev_0.0~git20210124.22da62e-1_all.deb ... Unpacking golang-golang-x-sys-dev (0.0~git20210124.22da62e-1) ... Selecting previously unselected package golang-github-sirupsen-logrus-dev. Preparing to unpack .../006-golang-github-sirupsen-logrus-dev_1.7.0-2_all.deb ... Unpacking golang-github-sirupsen-logrus-dev (1.7.0-2) ... Selecting previously unselected package libelf1:i386. Preparing to unpack .../007-libelf1_0.183-1_i386.deb ... Unpacking libelf1:i386 (0.183-1) ... Selecting previously unselected package libbpf0:i386. Preparing to unpack .../008-libbpf0_1%3a0.3-2_i386.deb ... Unpacking libbpf0:i386 (1:0.3-2) ... Selecting previously unselected package libmd0:i386. Preparing to unpack .../009-libmd0_1.0.3-3_i386.deb ... Unpacking libmd0:i386 (1.0.3-3) ... Selecting previously unselected package libbsd0:i386. Preparing to unpack .../010-libbsd0_0.11.3-1_i386.deb ... Unpacking libbsd0:i386 (0.11.3-1) ... Selecting previously unselected package libcap2:i386. Preparing to unpack .../011-libcap2_1%3a2.44-1_i386.deb ... Unpacking libcap2:i386 (1:2.44-1) ... Selecting previously unselected package libmnl0:i386. Preparing to unpack .../012-libmnl0_1.0.4-3_i386.deb ... Unpacking libmnl0:i386 (1.0.4-3) ... Selecting previously unselected package libxtables12:i386. Preparing to unpack .../013-libxtables12_1.8.7-1_i386.deb ... Unpacking libxtables12:i386 (1.8.7-1) ... Selecting previously unselected package libcap2-bin. Preparing to unpack .../014-libcap2-bin_1%3a2.44-1_i386.deb ... Unpacking libcap2-bin (1:2.44-1) ... Selecting previously unselected package iproute2. Preparing to unpack .../015-iproute2_5.10.0-4_i386.deb ... Unpacking iproute2 (5.10.0-4) ... Selecting previously unselected package libncurses6:i386. Preparing to unpack .../016-libncurses6_6.2+20201114-2_i386.deb ... Unpacking libncurses6:i386 (6.2+20201114-2) ... Selecting previously unselected package libprocps8:i386. Preparing to unpack .../017-libprocps8_2%3a3.3.17-5_i386.deb ... Unpacking libprocps8:i386 (2:3.3.17-5) ... Selecting previously unselected package procps. Preparing to unpack .../018-procps_2%3a3.3.17-5_i386.deb ... Unpacking procps (2:3.3.17-5) ... Selecting previously unselected package sensible-utils. Preparing to unpack .../019-sensible-utils_0.0.14_all.deb ... Unpacking sensible-utils (0.0.14) ... Selecting previously unselected package bash-completion. Preparing to unpack .../020-bash-completion_1%3a2.11-2_all.deb ... Unpacking bash-completion (1:2.11-2) ... Selecting previously unselected package openssl. Preparing to unpack .../021-openssl_1.1.1k-1_i386.deb ... Unpacking openssl (1.1.1k-1) ... Selecting previously unselected package ca-certificates. Preparing to unpack .../022-ca-certificates_20210119_all.deb ... Unpacking ca-certificates (20210119) ... Selecting previously unselected package libmagic-mgc. Preparing to unpack .../023-libmagic-mgc_1%3a5.39-3_i386.deb ... Unpacking libmagic-mgc (1:5.39-3) ... Selecting previously unselected package libmagic1:i386. Preparing to unpack .../024-libmagic1_1%3a5.39-3_i386.deb ... Unpacking libmagic1:i386 (1:5.39-3) ... Selecting previously unselected package file. Preparing to unpack .../025-file_1%3a5.39-3_i386.deb ... Unpacking file (1:5.39-3) ... Selecting previously unselected package gettext-base. Preparing to unpack .../026-gettext-base_0.21-4_i386.deb ... Unpacking gettext-base (0.21-4) ... Selecting previously unselected package libsigsegv2:i386. Preparing to unpack .../027-libsigsegv2_2.13-1_i386.deb ... Unpacking libsigsegv2:i386 (2.13-1) ... Selecting previously unselected package m4. Preparing to unpack .../028-m4_1.4.18-5_i386.deb ... Unpacking m4 (1.4.18-5) ... Selecting previously unselected package autoconf. Preparing to unpack .../029-autoconf_2.69-14_all.deb ... Unpacking autoconf (2.69-14) ... Selecting previously unselected package autotools-dev. Preparing to unpack .../030-autotools-dev_20180224.1+nmu1_all.deb ... Unpacking autotools-dev (20180224.1+nmu1) ... Selecting previously unselected package automake. Preparing to unpack .../031-automake_1%3a1.16.3-2_all.deb ... Unpacking automake (1:1.16.3-2) ... Selecting previously unselected package autopoint. Preparing to unpack .../032-autopoint_0.21-4_all.deb ... Unpacking autopoint (0.21-4) ... Selecting previously unselected package libdebhelper-perl. Preparing to unpack .../033-libdebhelper-perl_13.3.4_all.deb ... Unpacking libdebhelper-perl (13.3.4) ... Selecting previously unselected package libtool. Preparing to unpack .../034-libtool_2.4.6-15_all.deb ... Unpacking libtool (2.4.6-15) ... Selecting previously unselected package dh-autoreconf. Preparing to unpack .../035-dh-autoreconf_20_all.deb ... Unpacking dh-autoreconf (20) ... Selecting previously unselected package libarchive-zip-perl. Preparing to unpack .../036-libarchive-zip-perl_1.68-1_all.deb ... Unpacking libarchive-zip-perl (1.68-1) ... Selecting previously unselected package libsub-override-perl. Preparing to unpack .../037-libsub-override-perl_0.09-2_all.deb ... Unpacking libsub-override-perl (0.09-2) ... Selecting previously unselected package libfile-stripnondeterminism-perl. Preparing to unpack .../038-libfile-stripnondeterminism-perl_1.12.0-1_all.deb ... Unpacking libfile-stripnondeterminism-perl (1.12.0-1) ... Selecting previously unselected package dh-strip-nondeterminism. Preparing to unpack .../039-dh-strip-nondeterminism_1.12.0-1_all.deb ... Unpacking dh-strip-nondeterminism (1.12.0-1) ... Selecting previously unselected package dwz. Preparing to unpack .../040-dwz_0.13+20210201-1_i386.deb ... Unpacking dwz (0.13+20210201-1) ... Selecting previously unselected package libicu67:i386. Preparing to unpack .../041-libicu67_67.1-7_i386.deb ... Unpacking libicu67:i386 (67.1-7) ... Selecting previously unselected package libxml2:i386. Preparing to unpack .../042-libxml2_2.9.10+dfsg-6.7_i386.deb ... Unpacking libxml2:i386 (2.9.10+dfsg-6.7) ... Selecting previously unselected package gettext. Preparing to unpack .../043-gettext_0.21-4_i386.deb ... Unpacking gettext (0.21-4) ... Selecting previously unselected package intltool-debian. Preparing to unpack .../044-intltool-debian_0.35.0+20060710.5_all.deb ... Unpacking intltool-debian (0.35.0+20060710.5) ... Selecting previously unselected package po-debconf. Preparing to unpack .../045-po-debconf_1.0.21+nmu1_all.deb ... Unpacking po-debconf (1.0.21+nmu1) ... Selecting previously unselected package debhelper. Preparing to unpack .../046-debhelper_13.3.4_all.deb ... Unpacking debhelper (13.3.4) ... Selecting previously unselected package dh-golang. Preparing to unpack .../047-dh-golang_1.51_all.deb ... Unpacking dh-golang (1.51) ... Selecting previously unselected package golang-1.15-src. Preparing to unpack .../048-golang-1.15-src_1.15.9-6_i386.deb ... Unpacking golang-1.15-src (1.15.9-6) ... Selecting previously unselected package golang-1.15-go. Preparing to unpack .../049-golang-1.15-go_1.15.9-6_i386.deb ... Unpacking golang-1.15-go (1.15.9-6) ... Selecting previously unselected package golang-src:i386. Preparing to unpack .../050-golang-src_2%3a1.15~1_i386.deb ... Unpacking golang-src:i386 (2:1.15~1) ... Selecting previously unselected package golang-go. Preparing to unpack .../051-golang-go_2%3a1.15~1_i386.deb ... Unpacking golang-go (2:1.15~1) ... Selecting previously unselected package golang-any:i386. Preparing to unpack .../052-golang-any_2%3a1.15~1_i386.deb ... Unpacking golang-any:i386 (2:1.15~1) ... Selecting previously unselected package golang-dbus-dev. Preparing to unpack .../053-golang-dbus-dev_5.0.3-2_all.deb ... Unpacking golang-dbus-dev (5.0.3-2) ... Selecting previously unselected package golang-github-alecthomas-units-dev. Preparing to unpack .../054-golang-github-alecthomas-units-dev_0.0~git20201120.1786d5e-1_all.deb ... Unpacking golang-github-alecthomas-units-dev (0.0~git20201120.1786d5e-1) ... Selecting previously unselected package golang-github-armon-circbuf-dev. Preparing to unpack .../055-golang-github-armon-circbuf-dev_0.0~git20190214.5111143-1_all.deb ... Unpacking golang-github-armon-circbuf-dev (0.0~git20190214.5111143-1) ... Selecting previously unselected package golang-github-circonus-labs-circonusllhist-dev. Preparing to unpack .../056-golang-github-circonus-labs-circonusllhist-dev_0.0~git20191022.ec08cde-1_all.deb ... Unpacking golang-github-circonus-labs-circonusllhist-dev (0.0~git20191022.ec08cde-1) ... Selecting previously unselected package golang-github-hashicorp-go-cleanhttp-dev. Preparing to unpack .../057-golang-github-hashicorp-go-cleanhttp-dev_0.5.2-1_all.deb ... Unpacking golang-github-hashicorp-go-cleanhttp-dev (0.5.2-1) ... Selecting previously unselected package golang-github-mattn-go-isatty-dev. Preparing to unpack .../058-golang-github-mattn-go-isatty-dev_0.0.12-1_all.deb ... Unpacking golang-github-mattn-go-isatty-dev (0.0.12-1) ... Selecting previously unselected package golang-github-mattn-go-colorable-dev. Preparing to unpack .../059-golang-github-mattn-go-colorable-dev_0.1.7-1_all.deb ... Unpacking golang-github-mattn-go-colorable-dev (0.1.7-1) ... Selecting previously unselected package golang-github-fatih-color-dev. Preparing to unpack .../060-golang-github-fatih-color-dev_1.7.0-1_all.deb ... Unpacking golang-github-fatih-color-dev (1.7.0-1) ... Selecting previously unselected package golang-github-davecgh-go-spew-dev. Preparing to unpack .../061-golang-github-davecgh-go-spew-dev_1.1.1-2_all.deb ... Unpacking golang-github-davecgh-go-spew-dev (1.1.1-2) ... Selecting previously unselected package golang-github-pmezard-go-difflib-dev. Preparing to unpack .../062-golang-github-pmezard-go-difflib-dev_1.0.0-3_all.deb ... Unpacking golang-github-pmezard-go-difflib-dev (1.0.0-3) ... Selecting previously unselected package golang-github-stretchr-objx-dev. Preparing to unpack .../063-golang-github-stretchr-objx-dev_0.3.0-1_all.deb ... Unpacking golang-github-stretchr-objx-dev (0.3.0-1) ... Selecting previously unselected package golang-gopkg-yaml.v3-dev. Preparing to unpack .../064-golang-gopkg-yaml.v3-dev_3.0.0~git20200121.a6ecf24-3_all.deb ... Unpacking golang-gopkg-yaml.v3-dev (3.0.0~git20200121.a6ecf24-3) ... Selecting previously unselected package golang-github-stretchr-testify-dev. Preparing to unpack .../065-golang-github-stretchr-testify-dev_1.6.1-2_all.deb ... Unpacking golang-github-stretchr-testify-dev (1.6.1-2) ... Selecting previously unselected package golang-github-hashicorp-go-hclog-dev. Preparing to unpack .../066-golang-github-hashicorp-go-hclog-dev_0.11.0-1_all.deb ... Unpacking golang-github-hashicorp-go-hclog-dev (0.11.0-1) ... Selecting previously unselected package golang-github-hashicorp-go-retryablehttp-dev. Preparing to unpack .../067-golang-github-hashicorp-go-retryablehttp-dev_0.6.4-2_all.deb ... Unpacking golang-github-hashicorp-go-retryablehttp-dev (0.6.4-2) ... Selecting previously unselected package golang-github-pkg-errors-dev. Preparing to unpack .../068-golang-github-pkg-errors-dev_0.9.1-1_all.deb ... Unpacking golang-github-pkg-errors-dev (0.9.1-1) ... Selecting previously unselected package golang-github-tv42-httpunix-dev. Preparing to unpack .../069-golang-github-tv42-httpunix-dev_0.0~git20150427.b75d861-2_all.deb ... Unpacking golang-github-tv42-httpunix-dev (0.0~git20150427.b75d861-2) ... Selecting previously unselected package golang-github-circonus-labs-circonus-gometrics-dev. Preparing to unpack .../070-golang-github-circonus-labs-circonus-gometrics-dev_2.3.1-3_all.deb ... Unpacking golang-github-circonus-labs-circonus-gometrics-dev (2.3.1-3) ... Selecting previously unselected package golang-github-datadog-datadog-go-dev. Preparing to unpack .../071-golang-github-datadog-datadog-go-dev_2.1.0-3_all.deb ... Unpacking golang-github-datadog-datadog-go-dev (2.1.0-3) ... Selecting previously unselected package golang-github-hashicorp-go-uuid-dev. Preparing to unpack .../072-golang-github-hashicorp-go-uuid-dev_1.0.2-1_all.deb ... Unpacking golang-github-hashicorp-go-uuid-dev (1.0.2-1) ... Selecting previously unselected package golang-github-hashicorp-golang-lru-dev. Preparing to unpack .../073-golang-github-hashicorp-golang-lru-dev_0.5.4-2_all.deb ... Unpacking golang-github-hashicorp-golang-lru-dev (0.5.4-2) ... Selecting previously unselected package golang-github-hashicorp-go-immutable-radix-dev. Preparing to unpack .../074-golang-github-hashicorp-go-immutable-radix-dev_1.3.0-1_all.deb ... Unpacking golang-github-hashicorp-go-immutable-radix-dev (1.3.0-1) ... Selecting previously unselected package golang-github-pascaldekloe-goe-dev. Preparing to unpack .../075-golang-github-pascaldekloe-goe-dev_0.1.0-2_all.deb ... Unpacking golang-github-pascaldekloe-goe-dev (0.1.0-2) ... Selecting previously unselected package golang-github-beorn7-perks-dev. Preparing to unpack .../076-golang-github-beorn7-perks-dev_1.0.1-1_all.deb ... Unpacking golang-github-beorn7-perks-dev (1.0.1-1) ... Selecting previously unselected package golang-github-cespare-xxhash-dev. Preparing to unpack .../077-golang-github-cespare-xxhash-dev_2.1.1-1_all.deb ... Unpacking golang-github-cespare-xxhash-dev (2.1.1-1) ... Selecting previously unselected package golang-github-modern-go-concurrent-dev. Preparing to unpack .../078-golang-github-modern-go-concurrent-dev_1.0.3-1.1_all.deb ... Unpacking golang-github-modern-go-concurrent-dev (1.0.3-1.1) ... Selecting previously unselected package golang-github-modern-go-reflect2-dev. Preparing to unpack .../079-golang-github-modern-go-reflect2-dev_1.0.1-1_all.deb ... Unpacking golang-github-modern-go-reflect2-dev (1.0.1-1) ... Selecting previously unselected package golang-github-json-iterator-go-dev. Preparing to unpack .../080-golang-github-json-iterator-go-dev_1.1.10-2_all.deb ... Unpacking golang-github-json-iterator-go-dev (1.1.10-2) ... Selecting previously unselected package zlib1g-dev:i386. Preparing to unpack .../081-zlib1g-dev_1%3a1.2.11.dfsg-2_i386.deb ... Unpacking zlib1g-dev:i386 (1:1.2.11.dfsg-2) ... Selecting previously unselected package libprotobuf23:i386. Preparing to unpack .../082-libprotobuf23_3.12.4-1_i386.deb ... Unpacking libprotobuf23:i386 (3.12.4-1) ... Selecting previously unselected package libprotobuf-lite23:i386. Preparing to unpack .../083-libprotobuf-lite23_3.12.4-1_i386.deb ... Unpacking libprotobuf-lite23:i386 (3.12.4-1) ... Selecting previously unselected package libprotobuf-dev:i386. Preparing to unpack .../084-libprotobuf-dev_3.12.4-1_i386.deb ... Unpacking libprotobuf-dev:i386 (3.12.4-1) ... Selecting previously unselected package libprotoc23:i386. Preparing to unpack .../085-libprotoc23_3.12.4-1_i386.deb ... Unpacking libprotoc23:i386 (3.12.4-1) ... Selecting previously unselected package protobuf-compiler. Preparing to unpack .../086-protobuf-compiler_3.12.4-1_i386.deb ... Unpacking protobuf-compiler (3.12.4-1) ... Selecting previously unselected package golang-goprotobuf-dev. Preparing to unpack .../087-golang-goprotobuf-dev_1.3.4-2+b6_i386.deb ... Unpacking golang-goprotobuf-dev (1.3.4-2+b6) ... Selecting previously unselected package golang-github-prometheus-client-model-dev. Preparing to unpack .../088-golang-github-prometheus-client-model-dev_0.2.0-2_all.deb ... Unpacking golang-github-prometheus-client-model-dev (0.2.0-2) ... Selecting previously unselected package golang-github-dgrijalva-jwt-go-dev. Preparing to unpack .../089-golang-github-dgrijalva-jwt-go-dev_3.2.0-3_all.deb ... Unpacking golang-github-dgrijalva-jwt-go-dev (3.2.0-3) ... Selecting previously unselected package golang-github-go-logfmt-logfmt-dev. Preparing to unpack .../090-golang-github-go-logfmt-logfmt-dev_0.5.0-2_all.deb ... Unpacking golang-github-go-logfmt-logfmt-dev (0.5.0-2) ... Selecting previously unselected package golang-github-go-stack-stack-dev. Preparing to unpack .../091-golang-github-go-stack-stack-dev_1.8.0-1_all.deb ... Unpacking golang-github-go-stack-stack-dev (1.8.0-1) ... Selecting previously unselected package golang-github-opentracing-opentracing-go-dev. Preparing to unpack .../092-golang-github-opentracing-opentracing-go-dev_1.2.0-1_all.deb ... Unpacking golang-github-opentracing-opentracing-go-dev (1.2.0-1) ... Selecting previously unselected package golang-golang-x-text-dev. Preparing to unpack .../093-golang-golang-x-text-dev_0.3.6-1_all.deb ... Unpacking golang-golang-x-text-dev (0.3.6-1) ... Selecting previously unselected package golang-golang-x-net-dev. Preparing to unpack .../094-golang-golang-x-net-dev_1%3a0.0+git20210119.5f4716e+dfsg-4_all.deb ... Unpacking golang-golang-x-net-dev (1:0.0+git20210119.5f4716e+dfsg-4) ... Selecting previously unselected package golang-golang-x-time-dev. Preparing to unpack .../095-golang-golang-x-time-dev_0.0+git20200630.3af7569-1_all.deb ... Unpacking golang-golang-x-time-dev (0.0+git20200630.3af7569-1) ... Selecting previously unselected package golang-github-golang-mock-dev. Preparing to unpack .../096-golang-github-golang-mock-dev_1.3.1-2_all.deb ... Unpacking golang-github-golang-mock-dev (1.3.1-2) ... Selecting previously unselected package golang-golang-x-xerrors-dev. Preparing to unpack .../097-golang-golang-x-xerrors-dev_0.0~git20191204.9bdfabe-1_all.deb ... Unpacking golang-golang-x-xerrors-dev (0.0~git20191204.9bdfabe-1) ... Selecting previously unselected package golang-github-google-go-cmp-dev. Preparing to unpack .../098-golang-github-google-go-cmp-dev_0.5.4-1_all.deb ... Unpacking golang-github-google-go-cmp-dev (0.5.4-1) ... Selecting previously unselected package golang-glog-dev. Preparing to unpack .../099-golang-glog-dev_0.0~git20160126.23def4e-3_all.deb ... Unpacking golang-glog-dev (0.0~git20160126.23def4e-3) ... Selecting previously unselected package golang-golang-x-oauth2-dev. Preparing to unpack .../100-golang-golang-x-oauth2-dev_0.0~git20190604.0f29369-2_all.deb ... Unpacking golang-golang-x-oauth2-dev (0.0~git20190604.0f29369-2) ... Selecting previously unselected package golang-google-cloud-compute-metadata-dev. Preparing to unpack .../101-golang-google-cloud-compute-metadata-dev_0.56.0-1_all.deb ... Unpacking golang-google-cloud-compute-metadata-dev (0.56.0-1) ... Selecting previously unselected package golang-golang-x-oauth2-google-dev. Preparing to unpack .../102-golang-golang-x-oauth2-google-dev_0.0~git20190604.0f29369-2_all.deb ... Unpacking golang-golang-x-oauth2-google-dev (0.0~git20190604.0f29369-2) ... Selecting previously unselected package golang-google-genproto-dev. Preparing to unpack .../103-golang-google-genproto-dev_0.0~git20200413.b5235f6-1_all.deb ... Unpacking golang-google-genproto-dev (0.0~git20200413.b5235f6-1) ... Selecting previously unselected package golang-google-grpc-dev. Preparing to unpack .../104-golang-google-grpc-dev_1.27.1-1_all.deb ... Unpacking golang-google-grpc-dev (1.27.1-1) ... Selecting previously unselected package golang-github-go-kit-kit-dev. Preparing to unpack .../105-golang-github-go-kit-kit-dev_0.6.0-3_all.deb ... Unpacking golang-github-go-kit-kit-dev (0.6.0-3) ... Selecting previously unselected package golang-github-julienschmidt-httprouter-dev. Preparing to unpack .../106-golang-github-julienschmidt-httprouter-dev_1.3.0-1_all.deb ... Unpacking golang-github-julienschmidt-httprouter-dev (1.3.0-1) ... Selecting previously unselected package golang-github-jpillora-backoff-dev. Preparing to unpack .../107-golang-github-jpillora-backoff-dev_1.0.0-1.1_all.deb ... Unpacking golang-github-jpillora-backoff-dev (1.0.0-1.1) ... Selecting previously unselected package golang-github-mwitkow-go-conntrack-dev. Preparing to unpack .../108-golang-github-mwitkow-go-conntrack-dev_0.0~git20190716.2f06839-2_all.deb ... Unpacking golang-github-mwitkow-go-conntrack-dev (0.0~git20190716.2f06839-2) ... Selecting previously unselected package golang-gopkg-alecthomas-kingpin.v2-dev. Preparing to unpack .../109-golang-gopkg-alecthomas-kingpin.v2-dev_2.2.6-3_all.deb ... Unpacking golang-gopkg-alecthomas-kingpin.v2-dev (2.2.6-3) ... Selecting previously unselected package golang-gopkg-yaml.v2-dev. Preparing to unpack .../110-golang-gopkg-yaml.v2-dev_2.4.0-1_all.deb ... Unpacking golang-gopkg-yaml.v2-dev (2.4.0-1) ... Selecting previously unselected package golang-protobuf-extensions-dev. Preparing to unpack .../111-golang-protobuf-extensions-dev_1.0.1-1_all.deb ... Unpacking golang-protobuf-extensions-dev (1.0.1-1) ... Selecting previously unselected package golang-github-prometheus-common-dev. Preparing to unpack .../112-golang-github-prometheus-common-dev_0.15.0-2_all.deb ... Unpacking golang-github-prometheus-common-dev (0.15.0-2) ... Selecting previously unselected package golang-golang-x-sync-dev. Preparing to unpack .../113-golang-golang-x-sync-dev_0.0~git20210220.036812b-1_all.deb ... Unpacking golang-golang-x-sync-dev (0.0~git20210220.036812b-1) ... Selecting previously unselected package golang-github-prometheus-procfs-dev. Preparing to unpack .../114-golang-github-prometheus-procfs-dev_0.3.0-2_all.deb ... Unpacking golang-github-prometheus-procfs-dev (0.3.0-2) ... Selecting previously unselected package golang-github-prometheus-client-golang-dev. Preparing to unpack .../115-golang-github-prometheus-client-golang-dev_1.9.0-2_all.deb ... Unpacking golang-github-prometheus-client-golang-dev (1.9.0-2) ... Selecting previously unselected package golang-github-armon-go-metrics-dev. Preparing to unpack .../116-golang-github-armon-go-metrics-dev_0.3.4-1_all.deb ... Unpacking golang-github-armon-go-metrics-dev (0.3.4-1) ... Selecting previously unselected package golang-github-armon-go-radix-dev. Preparing to unpack .../117-golang-github-armon-go-radix-dev_1.0.0-1_all.deb ... Unpacking golang-github-armon-go-radix-dev (1.0.0-1) ... Selecting previously unselected package golang-github-jmespath-go-jmespath-dev. Preparing to unpack .../118-golang-github-jmespath-go-jmespath-dev_0.4.0-1_all.deb ... Unpacking golang-github-jmespath-go-jmespath-dev (0.4.0-1) ... Selecting previously unselected package golang-github-aws-aws-sdk-go-dev. Preparing to unpack .../119-golang-github-aws-aws-sdk-go-dev_1.36.33-1_all.deb ... Unpacking golang-github-aws-aws-sdk-go-dev (1.36.33-1) ... Selecting previously unselected package golang-github-dimchansky-utfbom-dev. Preparing to unpack .../120-golang-github-dimchansky-utfbom-dev_1.1.1-1_all.deb ... Unpacking golang-github-dimchansky-utfbom-dev (1.1.1-1) ... Selecting previously unselected package golang-github-mitchellh-go-homedir-dev. Preparing to unpack .../121-golang-github-mitchellh-go-homedir-dev_1.1.0-1_all.deb ... Unpacking golang-github-mitchellh-go-homedir-dev (1.1.0-1) ... Selecting previously unselected package golang-golang-x-term-dev. Preparing to unpack .../122-golang-golang-x-term-dev_0.0~git20201210.2321bbc-1_all.deb ... Unpacking golang-golang-x-term-dev (0.0~git20201210.2321bbc-1) ... Selecting previously unselected package golang-golang-x-crypto-dev. Preparing to unpack .../123-golang-golang-x-crypto-dev_1%3a0.0~git20201221.eec23a3-1_all.deb ... Unpacking golang-golang-x-crypto-dev (1:0.0~git20201221.eec23a3-1) ... Selecting previously unselected package golang-github-azure-go-autorest-dev. Preparing to unpack .../124-golang-github-azure-go-autorest-dev_14.1.1-1_all.deb ... Unpacking golang-github-azure-go-autorest-dev (14.1.1-1) ... Selecting previously unselected package golang-github-bgentry-speakeasy-dev. Preparing to unpack .../125-golang-github-bgentry-speakeasy-dev_0.1.0-2_all.deb ... Unpacking golang-github-bgentry-speakeasy-dev (0.1.0-2) ... Selecting previously unselected package golang-github-boltdb-bolt-dev. Preparing to unpack .../126-golang-github-boltdb-bolt-dev_1.3.1-7_all.deb ... Unpacking golang-github-boltdb-bolt-dev (1.3.1-7) ... Selecting previously unselected package golang-github-google-go-querystring-dev. Preparing to unpack .../127-golang-github-google-go-querystring-dev_1.0.0-1_all.deb ... Unpacking golang-github-google-go-querystring-dev (1.0.0-1) ... Selecting previously unselected package golang-github-dghubble-sling-dev. Preparing to unpack .../128-golang-github-dghubble-sling-dev_1.3.0-1_all.deb ... Unpacking golang-github-dghubble-sling-dev (1.3.0-1) ... Selecting previously unselected package golang-github-ghodss-yaml-dev. Preparing to unpack .../129-golang-github-ghodss-yaml-dev_1.0.0-1.1_all.deb ... Unpacking golang-github-ghodss-yaml-dev (1.0.0-1.1) ... Selecting previously unselected package golang-github-rogpeppe-fastuuid-dev. Preparing to unpack .../130-golang-github-rogpeppe-fastuuid-dev_0.0~git20150106.0.6724a57-2.1_all.deb ... Unpacking golang-github-rogpeppe-fastuuid-dev (0.0~git20150106.0.6724a57-2.1) ... Selecting previously unselected package golang-github-grpc-ecosystem-grpc-gateway-dev. Preparing to unpack .../131-golang-github-grpc-ecosystem-grpc-gateway-dev_1.6.4-2_all.deb ... Unpacking golang-github-grpc-ecosystem-grpc-gateway-dev (1.6.4-2) ... Selecting previously unselected package golang-github-census-instrumentation-opencensus-proto-dev. Preparing to unpack .../132-golang-github-census-instrumentation-opencensus-proto-dev_0.2.1+dfsg1-2_all.deb ... Unpacking golang-github-census-instrumentation-opencensus-proto-dev (0.2.1+dfsg1-2) ... Selecting previously unselected package libsystemd-dev:i386. Preparing to unpack .../133-libsystemd-dev_247.3-6_i386.deb ... Unpacking libsystemd-dev:i386 (247.3-6) ... Selecting previously unselected package libglib2.0-0:i386. Preparing to unpack .../134-libglib2.0-0_2.66.8-1_i386.deb ... Unpacking libglib2.0-0:i386 (2.66.8-1) ... Selecting previously unselected package pkg-config. Preparing to unpack .../135-pkg-config_0.29.2-1_i386.deb ... Unpacking pkg-config (0.29.2-1) ... Selecting previously unselected package golang-github-coreos-go-systemd-dev. Preparing to unpack .../136-golang-github-coreos-go-systemd-dev_22.1.0-3_all.deb ... Unpacking golang-github-coreos-go-systemd-dev (22.1.0-3) ... Selecting previously unselected package golang-github-coreos-pkg-dev. Preparing to unpack .../137-golang-github-coreos-pkg-dev_4-3_all.deb ... Unpacking golang-github-coreos-pkg-dev (4-3) ... Selecting previously unselected package golang-github-jonboulle-clockwork-dev. Preparing to unpack .../138-golang-github-jonboulle-clockwork-dev_0.1.0-4.1_all.deb ... Unpacking golang-github-jonboulle-clockwork-dev (0.1.0-4.1) ... Selecting previously unselected package golang-github-pquerna-cachecontrol-dev. Preparing to unpack .../139-golang-github-pquerna-cachecontrol-dev_0.0~git20171018.0dec1b3-1.1_all.deb ... Unpacking golang-github-pquerna-cachecontrol-dev (0.0~git20171018.0dec1b3-1.1) ... Selecting previously unselected package golang-gopkg-square-go-jose.v2-dev. Preparing to unpack .../140-golang-gopkg-square-go-jose.v2-dev_2.5.1-2_all.deb ... Unpacking golang-gopkg-square-go-jose.v2-dev (2.5.1-2) ... Selecting previously unselected package golang-github-coreos-go-oidc-dev. Preparing to unpack .../141-golang-github-coreos-go-oidc-dev_2.1.0-2_all.deb ... Unpacking golang-github-coreos-go-oidc-dev (2.1.0-2) ... Selecting previously unselected package golang-github-creack-pty-dev. Preparing to unpack .../142-golang-github-creack-pty-dev_1.1.11-1_all.deb ... Unpacking golang-github-creack-pty-dev (1.1.11-1) ... Selecting previously unselected package golang-github-digitalocean-godo-dev. Preparing to unpack .../143-golang-github-digitalocean-godo-dev_1.37.0-1_all.deb ... Unpacking golang-github-digitalocean-godo-dev (1.37.0-1) ... Selecting previously unselected package golang-github-docker-go-connections-dev. Preparing to unpack .../144-golang-github-docker-go-connections-dev_0.4.0-3_all.deb ... Unpacking golang-github-docker-go-connections-dev (0.4.0-3) ... Selecting previously unselected package golang-github-docopt-docopt-go-dev. Preparing to unpack .../145-golang-github-docopt-docopt-go-dev_0.6.2+git20180111.ee0de3b-1_all.deb ... Unpacking golang-github-docopt-docopt-go-dev (0.6.2+git20180111.ee0de3b-1) ... Selecting previously unselected package golang-github-elazarl-go-bindata-assetfs-dev. Preparing to unpack .../146-golang-github-elazarl-go-bindata-assetfs-dev_1.0.0-1.1_all.deb ... Unpacking golang-github-elazarl-go-bindata-assetfs-dev (1.0.0-1.1) ... Selecting previously unselected package golang-github-go-test-deep-dev. Preparing to unpack .../147-golang-github-go-test-deep-dev_1.0.3-1_all.deb ... Unpacking golang-github-go-test-deep-dev (1.0.3-1) ... Selecting previously unselected package golang-github-gogo-protobuf-dev. Preparing to unpack .../148-golang-github-gogo-protobuf-dev_1.3.2-1_all.deb ... Unpacking golang-github-gogo-protobuf-dev (1.3.2-1) ... Selecting previously unselected package golang-github-golang-groupcache-dev. Preparing to unpack .../149-golang-github-golang-groupcache-dev_0.0~git20200121.8c9f03a-1_all.deb ... Unpacking golang-github-golang-groupcache-dev (0.0~git20200121.8c9f03a-1) ... Selecting previously unselected package golang-github-golang-snappy-dev. Preparing to unpack .../150-golang-github-golang-snappy-dev_0.0.2-2_all.deb ... Unpacking golang-github-golang-snappy-dev (0.0.2-2) ... Selecting previously unselected package golang-github-google-btree-dev. Preparing to unpack .../151-golang-github-google-btree-dev_1.0.0-1_all.deb ... Unpacking golang-github-google-btree-dev (1.0.0-1) ... Selecting previously unselected package golang-github-google-gofuzz-dev. Preparing to unpack .../152-golang-github-google-gofuzz-dev_1.2.0-1_all.deb ... Unpacking golang-github-google-gofuzz-dev (1.2.0-1) ... Selecting previously unselected package golang-github-google-uuid-dev. Preparing to unpack .../153-golang-github-google-uuid-dev_1.2.0-1_all.deb ... Unpacking golang-github-google-uuid-dev (1.2.0-1) ... Selecting previously unselected package golang-github-googleapis-gax-go-dev. Preparing to unpack .../154-golang-github-googleapis-gax-go-dev_2.0.5-1_all.deb ... Unpacking golang-github-googleapis-gax-go-dev (2.0.5-1) ... Selecting previously unselected package golang-github-googleapis-gnostic-dev. Preparing to unpack .../155-golang-github-googleapis-gnostic-dev_0.2.0-2_all.deb ... Unpacking golang-github-googleapis-gnostic-dev (0.2.0-2) ... Selecting previously unselected package golang-github-hashicorp-errwrap-dev. Preparing to unpack .../156-golang-github-hashicorp-errwrap-dev_1.1.0-1_all.deb ... Unpacking golang-github-hashicorp-errwrap-dev (1.1.0-1) ... Selecting previously unselected package golang-github-hashicorp-go-bexpr-dev. Preparing to unpack .../157-golang-github-hashicorp-go-bexpr-dev_0.1.2-2_all.deb ... Unpacking golang-github-hashicorp-go-bexpr-dev (0.1.2-2) ... Selecting previously unselected package golang-github-hashicorp-go-checkpoint-dev. Preparing to unpack .../158-golang-github-hashicorp-go-checkpoint-dev_0.5.0-1_all.deb ... Unpacking golang-github-hashicorp-go-checkpoint-dev (0.5.0-1) ... Selecting previously unselected package golang-github-denverdino-aliyungo-dev. Preparing to unpack .../159-golang-github-denverdino-aliyungo-dev_0.0~git20180921.13fa8aa-2_all.deb ... Unpacking golang-github-denverdino-aliyungo-dev (0.0~git20180921.13fa8aa-2) ... Selecting previously unselected package golang-github-gophercloud-gophercloud-dev. Preparing to unpack .../160-golang-github-gophercloud-gophercloud-dev_0.12.0-1_all.deb ... Unpacking golang-github-gophercloud-gophercloud-dev (0.12.0-1) ... Selecting previously unselected package golang-github-hashicorp-go-multierror-dev. Preparing to unpack .../161-golang-github-hashicorp-go-multierror-dev_1.1.0-1_all.deb ... Unpacking golang-github-hashicorp-go-multierror-dev (1.1.0-1) ... Selecting previously unselected package golang-github-miekg-dns-dev. Preparing to unpack .../162-golang-github-miekg-dns-dev_1.1.35-1_all.deb ... Unpacking golang-github-miekg-dns-dev (1.1.35-1) ... Selecting previously unselected package golang-github-hashicorp-mdns-dev. Preparing to unpack .../163-golang-github-hashicorp-mdns-dev_1.0.3-2_all.deb ... Unpacking golang-github-hashicorp-mdns-dev (1.0.3-2) ... Selecting previously unselected package golang-github-packethost-packngo-dev. Preparing to unpack .../164-golang-github-packethost-packngo-dev_0.2.0-2_all.deb ... Unpacking golang-github-packethost-packngo-dev (0.2.0-2) ... Selecting previously unselected package golang-github-vmware-govmomi-dev. Preparing to unpack .../165-golang-github-vmware-govmomi-dev_0.23.0-1_all.deb ... Unpacking golang-github-vmware-govmomi-dev (0.23.0-1) ... Selecting previously unselected package golang-go.opencensus-dev. Preparing to unpack .../166-golang-go.opencensus-dev_0.22.4-2_all.deb ... Unpacking golang-go.opencensus-dev (0.22.4-2) ... Selecting previously unselected package golang-google-api-dev. Preparing to unpack .../167-golang-google-api-dev_0.28.0-2_all.deb ... Unpacking golang-google-api-dev (0.28.0-2) ... Selecting previously unselected package golang-github-hashicorp-go-discover-dev. Preparing to unpack .../168-golang-github-hashicorp-go-discover-dev_0.0+git20190905.34a6505-2_all.deb ... Unpacking golang-github-hashicorp-go-discover-dev (0.0+git20190905.34a6505-2) ... Selecting previously unselected package golang-github-hashicorp-go-memdb-dev. Preparing to unpack .../169-golang-github-hashicorp-go-memdb-dev_1.2.1-1_all.deb ... Unpacking golang-github-hashicorp-go-memdb-dev (1.2.1-1) ... Selecting previously unselected package golang-github-vmihailenco-tagparser-dev. Preparing to unpack .../170-golang-github-vmihailenco-tagparser-dev_0.1.1-2_all.deb ... Unpacking golang-github-vmihailenco-tagparser-dev (0.1.1-2) ... Selecting previously unselected package golang-gopkg-vmihailenco-msgpack.v2-dev. Preparing to unpack .../171-golang-gopkg-vmihailenco-msgpack.v2-dev_4.3.1-2_all.deb ... Unpacking golang-gopkg-vmihailenco-msgpack.v2-dev (4.3.1-2) ... Selecting previously unselected package golang-gopkg-tomb.v2-dev. Preparing to unpack .../172-golang-gopkg-tomb.v2-dev_0.0~git20161208.d5d1b58-3_all.deb ... Unpacking golang-gopkg-tomb.v2-dev (0.0~git20161208.d5d1b58-3) ... Selecting previously unselected package libsasl2-modules-db:i386. Preparing to unpack .../173-libsasl2-modules-db_2.1.27+dfsg-2.1_i386.deb ... Unpacking libsasl2-modules-db:i386 (2.1.27+dfsg-2.1) ... Selecting previously unselected package libsasl2-2:i386. Preparing to unpack .../174-libsasl2-2_2.1.27+dfsg-2.1_i386.deb ... Unpacking libsasl2-2:i386 (2.1.27+dfsg-2.1) ... Selecting previously unselected package libsasl2-dev. Preparing to unpack .../175-libsasl2-dev_2.1.27+dfsg-2.1_i386.deb ... Unpacking libsasl2-dev (2.1.27+dfsg-2.1) ... Selecting previously unselected package golang-github-kr-text-dev. Preparing to unpack .../176-golang-github-kr-text-dev_0.2.0-1_all.deb ... Unpacking golang-github-kr-text-dev (0.2.0-1) ... Selecting previously unselected package golang-github-kr-pretty-dev. Preparing to unpack .../177-golang-github-kr-pretty-dev_0.2.1+git20200831.59b4212-1_all.deb ... Unpacking golang-github-kr-pretty-dev (0.2.1+git20200831.59b4212-1) ... Selecting previously unselected package golang-gopkg-check.v1-dev. Preparing to unpack .../178-golang-gopkg-check.v1-dev_0.0+git20200902.038fdea-1_all.deb ... Unpacking golang-gopkg-check.v1-dev (0.0+git20200902.038fdea-1) ... Selecting previously unselected package golang-gopkg-mgo.v2-dev. Preparing to unpack .../179-golang-gopkg-mgo.v2-dev_2016.08.01-7_all.deb ... Unpacking golang-gopkg-mgo.v2-dev (2016.08.01-7) ... Selecting previously unselected package golang-github-hashicorp-go-msgpack-dev. Preparing to unpack .../180-golang-github-hashicorp-go-msgpack-dev_0.5.5-1_all.deb ... Unpacking golang-github-hashicorp-go-msgpack-dev (0.5.5-1) ... Selecting previously unselected package golang-github-hashicorp-raft-dev. Preparing to unpack .../181-golang-github-hashicorp-raft-dev_1.1.2-1_all.deb ... Unpacking golang-github-hashicorp-raft-dev (1.1.2-1) ... Selecting previously unselected package golang-github-mitchellh-reflectwalk-dev. Preparing to unpack .../182-golang-github-mitchellh-reflectwalk-dev_1.0.1-1_all.deb ... Unpacking golang-github-mitchellh-reflectwalk-dev (1.0.1-1) ... Selecting previously unselected package golang-github-mitchellh-copystructure-dev. Preparing to unpack .../183-golang-github-mitchellh-copystructure-dev_0.0~git20161013.0.5af94ae-2.1_all.deb ... Unpacking golang-github-mitchellh-copystructure-dev (0.0~git20161013.0.5af94ae-2.1) ... Selecting previously unselected package golang-github-hashicorp-go-raftchunking-dev. Preparing to unpack .../184-golang-github-hashicorp-go-raftchunking-dev_0.6.2-2_all.deb ... Unpacking golang-github-hashicorp-go-raftchunking-dev (0.6.2-2) ... Selecting previously unselected package golang-github-hashicorp-go-sockaddr-dev. Preparing to unpack .../185-golang-github-hashicorp-go-sockaddr-dev_0.0~git20170627.41949a1+ds-2_all.deb ... Unpacking golang-github-hashicorp-go-sockaddr-dev (0.0~git20170627.41949a1+ds-2) ... Selecting previously unselected package golang-github-hashicorp-go-syslog-dev. Preparing to unpack .../186-golang-github-hashicorp-go-syslog-dev_1.0.0-1_all.deb ... Unpacking golang-github-hashicorp-go-syslog-dev (1.0.0-1) ... Selecting previously unselected package golang-github-hashicorp-go-version-dev. Preparing to unpack .../187-golang-github-hashicorp-go-version-dev_1.2.0-1_all.deb ... Unpacking golang-github-hashicorp-go-version-dev (1.2.0-1) ... Selecting previously unselected package golang-github-hashicorp-hcl-dev. Preparing to unpack .../188-golang-github-hashicorp-hcl-dev_1.0.0-1.1_all.deb ... Unpacking golang-github-hashicorp-hcl-dev (1.0.0-1.1) ... Selecting previously unselected package golang-github-mitchellh-mapstructure-dev. Preparing to unpack .../189-golang-github-mitchellh-mapstructure-dev_1.3.3-1_all.deb ... Unpacking golang-github-mitchellh-mapstructure-dev (1.3.3-1) ... Selecting previously unselected package golang-github-hashicorp-hil-dev. Preparing to unpack .../190-golang-github-hashicorp-hil-dev_0.0~git20160711.1e86c6b-1_all.deb ... Unpacking golang-github-hashicorp-hil-dev (0.0~git20160711.1e86c6b-1) ... Selecting previously unselected package golang-github-hashicorp-logutils-dev. Preparing to unpack .../191-golang-github-hashicorp-logutils-dev_1.0.0-1_all.deb ... Unpacking golang-github-hashicorp-logutils-dev (1.0.0-1) ... Selecting previously unselected package golang-github-hashicorp-memberlist-dev. Preparing to unpack .../192-golang-github-hashicorp-memberlist-dev_0.2.2-1_all.deb ... Unpacking golang-github-hashicorp-memberlist-dev (0.2.2-1) ... Selecting previously unselected package golang-github-hashicorp-net-rpc-msgpackrpc-dev. Preparing to unpack .../193-golang-github-hashicorp-net-rpc-msgpackrpc-dev_0.0~git20151116.0.a14192a-1.1_all.deb ... Unpacking golang-github-hashicorp-net-rpc-msgpackrpc-dev (0.0~git20151116.0.a14192a-1.1) ... Selecting previously unselected package golang-github-hashicorp-raft-boltdb-dev. Preparing to unpack .../194-golang-github-hashicorp-raft-boltdb-dev_0.0~git20171010.6e5ba93-3_all.deb ... Unpacking golang-github-hashicorp-raft-boltdb-dev (0.0~git20171010.6e5ba93-3) ... Selecting previously unselected package golang-github-posener-complete-dev. Preparing to unpack .../195-golang-github-posener-complete-dev_1.2.3-2_all.deb ... Unpacking golang-github-posener-complete-dev (1.2.3-2) ... Selecting previously unselected package golang-github-mitchellh-cli-dev. Preparing to unpack .../196-golang-github-mitchellh-cli-dev_1.1.1-1_all.deb ... Unpacking golang-github-mitchellh-cli-dev (1.1.1-1) ... Selecting previously unselected package golang-github-ryanuber-columnize-dev. Preparing to unpack .../197-golang-github-ryanuber-columnize-dev_2.1.1-2_all.deb ... Unpacking golang-github-ryanuber-columnize-dev (2.1.1-2) ... Selecting previously unselected package golang-github-hashicorp-serf-dev. Preparing to unpack .../198-golang-github-hashicorp-serf-dev_0.9.4~ds1-1_all.deb ... Unpacking golang-github-hashicorp-serf-dev (0.9.4~ds1-1) ... Selecting previously unselected package golang-github-hashicorp-yamux-dev. Preparing to unpack .../199-golang-github-hashicorp-yamux-dev_0.0+git20190923.df201c7-1_all.deb ... Unpacking golang-github-hashicorp-yamux-dev (0.0+git20190923.df201c7-1) ... Selecting previously unselected package golang-github-imdario-mergo-dev. Preparing to unpack .../200-golang-github-imdario-mergo-dev_0.3.8-3_all.deb ... Unpacking golang-github-imdario-mergo-dev (0.3.8-3) ... Selecting previously unselected package golang-github-mitchellh-go-testing-interface-dev. Preparing to unpack .../201-golang-github-mitchellh-go-testing-interface-dev_1.14.1-1_all.deb ... Unpacking golang-github-mitchellh-go-testing-interface-dev (1.14.1-1) ... Selecting previously unselected package golang-github-mitchellh-hashstructure-dev. Preparing to unpack .../202-golang-github-mitchellh-hashstructure-dev_1.0.0-1.1_all.deb ... Unpacking golang-github-mitchellh-hashstructure-dev (1.0.0-1.1) ... Selecting previously unselected package golang-github-nytimes-gziphandler-dev. Preparing to unpack .../203-golang-github-nytimes-gziphandler-dev_1.1.1-1_all.deb ... Unpacking golang-github-nytimes-gziphandler-dev (1.1.1-1) ... Selecting previously unselected package golang-github-patrickmn-go-cache-dev. Preparing to unpack .../204-golang-github-patrickmn-go-cache-dev_2.1.0-1.1_all.deb ... Unpacking golang-github-patrickmn-go-cache-dev (2.1.0-1.1) ... Selecting previously unselected package golang-github-pierrec-lz4-dev. Preparing to unpack .../205-golang-github-pierrec-lz4-dev_2.5.2-1_all.deb ... Unpacking golang-github-pierrec-lz4-dev (2.5.2-1) ... Selecting previously unselected package golang-github-ryanuber-go-glob-dev. Preparing to unpack .../206-golang-github-ryanuber-go-glob-dev_1.0.0-2_all.deb ... Unpacking golang-github-ryanuber-go-glob-dev (1.0.0-2) ... Selecting previously unselected package golang-github-shirou-gopsutil-dev. Preparing to unpack .../207-golang-github-shirou-gopsutil-dev_2.19.11-4_all.deb ... Unpacking golang-github-shirou-gopsutil-dev (2.19.11-4) ... Selecting previously unselected package golang-gopkg-inf.v0-dev. Preparing to unpack .../208-golang-gopkg-inf.v0-dev_0.9.1-1_all.deb ... Unpacking golang-gopkg-inf.v0-dev (0.9.1-1) ... Selecting previously unselected package golang-k8s-sigs-yaml-dev. Preparing to unpack .../209-golang-k8s-sigs-yaml-dev_1.2.0-3_all.deb ... Unpacking golang-k8s-sigs-yaml-dev (1.2.0-3) ... Selecting previously unselected package mockery. Preparing to unpack .../210-mockery_0.0~git20181123.e78b021-3+b6_i386.deb ... Unpacking mockery (0.0~git20181123.e78b021-3+b6) ... Selecting previously unselected package golang-github-hashicorp-go-rootcerts-dev. Preparing to unpack .../211-golang-github-hashicorp-go-rootcerts-dev_1.0.2-2_all.deb ... Unpacking golang-github-hashicorp-go-rootcerts-dev (1.0.2-2) ... Setting up golang-github-dimchansky-utfbom-dev (1.1.1-1) ... Setting up libpipeline1:i386 (1.5.3-1) ... Setting up golang-github-ryanuber-go-glob-dev (1.0.0-2) ... Setting up golang-gopkg-yaml.v2-dev (2.4.0-1) ... Setting up golang-github-hashicorp-go-uuid-dev (1.0.2-1) ... Setting up golang-github-mitchellh-go-homedir-dev (1.1.0-1) ... Setting up golang-github-google-go-querystring-dev (1.0.0-1) ... Setting up golang-github-imdario-mergo-dev (0.3.8-3) ... Setting up golang-github-mitchellh-mapstructure-dev (1.3.3-1) ... Setting up bsdextrautils (2.36.1-8) ... update-alternatives: using /usr/bin/write.ul to provide /usr/bin/write (write) in auto mode Setting up golang-dbus-dev (5.0.3-2) ... Setting up golang-github-creack-pty-dev (1.1.11-1) ... Setting up libicu67:i386 (67.1-7) ... Setting up golang-github-golang-mock-dev (1.3.1-2) ... Setting up golang-github-stretchr-objx-dev (0.3.0-1) ... Setting up golang-github-mitchellh-hashstructure-dev (1.0.0-1.1) ... Setting up libmagic-mgc (1:5.39-3) ... Setting up golang-github-pkg-errors-dev (0.9.1-1) ... Setting up golang-github-hashicorp-golang-lru-dev (0.5.4-2) ... Setting up golang-1.15-src (1.15.9-6) ... Setting up golang-github-google-gofuzz-dev (1.2.0-1) ... Setting up libarchive-zip-perl (1.68-1) ... Setting up libglib2.0-0:i386 (2.66.8-1) ... No schema files found: doing nothing. Setting up golang-github-ryanuber-columnize-dev (2.1.1-2) ... Setting up golang-gopkg-yaml.v3-dev (3.0.0~git20200121.a6ecf24-3) ... Setting up libdebhelper-perl (13.3.4) ... Setting up golang-golang-x-sys-dev (0.0~git20210124.22da62e-1) ... Setting up libmagic1:i386 (1:5.39-3) ... Setting up golang-github-hashicorp-go-syslog-dev (1.0.0-1) ... Setting up golang-github-golang-snappy-dev (0.0.2-2) ... Setting up golang-github-pmezard-go-difflib-dev (1.0.0-3) ... Setting up golang-github-modern-go-concurrent-dev (1.0.3-1.1) ... Setting up gettext-base (0.21-4) ... Setting up golang-github-circonus-labs-circonusllhist-dev (0.0~git20191022.ec08cde-1) ... Setting up mockery (0.0~git20181123.e78b021-3+b6) ... Setting up libprotobuf23:i386 (3.12.4-1) ... Setting up golang-golang-x-term-dev (0.0~git20201210.2321bbc-1) ... Setting up golang-github-jonboulle-clockwork-dev (0.1.0-4.1) ... Setting up golang-github-mitchellh-go-testing-interface-dev (1.14.1-1) ... Setting up file (1:5.39-3) ... Setting up golang-github-google-btree-dev (1.0.0-1) ... Setting up golang-github-go-stack-stack-dev (1.8.0-1) ... Setting up golang-github-beorn7-perks-dev (1.0.1-1) ... Setting up libcap2:i386 (1:2.44-1) ... Setting up golang-github-mitchellh-reflectwalk-dev (1.0.1-1) ... Setting up golang-github-hashicorp-go-cleanhttp-dev (0.5.2-1) ... Setting up golang-github-hashicorp-errwrap-dev (1.1.0-1) ... Setting up libsasl2-modules-db:i386 (2.1.27+dfsg-2.1) ... Setting up libcap2-bin (1:2.44-1) ... Setting up golang-github-cespare-xxhash-dev (2.1.1-1) ... Setting up golang-gopkg-tomb.v2-dev (0.0~git20161208.d5d1b58-3) ... Setting up golang-github-bgentry-speakeasy-dev (0.1.0-2) ... Setting up golang-github-jpillora-backoff-dev (1.0.0-1.1) ... Setting up golang-github-davecgh-go-spew-dev (1.1.1-2) ... Setting up libprotobuf-lite23:i386 (3.12.4-1) ... Setting up golang-github-pierrec-lz4-dev (2.5.2-1) ... Setting up autotools-dev (20180224.1+nmu1) ... Setting up golang-github-pascaldekloe-goe-dev (0.1.0-2) ... Setting up golang-github-go-logfmt-logfmt-dev (0.5.0-2) ... Setting up golang-github-kr-text-dev (0.2.0-1) ... Setting up golang-github-stretchr-testify-dev (1.6.1-2) ... Setting up golang-github-go-test-deep-dev (1.0.3-1) ... Setting up bash-completion (1:2.11-2) ... Setting up golang-github-hashicorp-go-immutable-radix-dev (1.3.0-1) ... Setting up golang-github-boltdb-bolt-dev (1.3.1-7) ... Setting up libprotoc23:i386 (3.12.4-1) ... Setting up libncurses6:i386 (6.2+20201114-2) ... Setting up libsigsegv2:i386 (2.13-1) ... Setting up golang-k8s-sigs-yaml-dev (1.2.0-3) ... Setting up golang-github-patrickmn-go-cache-dev (2.1.0-1.1) ... Setting up libmnl0:i386 (1.0.4-3) ... Setting up golang-golang-x-sync-dev (0.0~git20210220.036812b-1) ... Setting up autopoint (0.21-4) ... Setting up pkg-config (0.29.2-1) ... Setting up golang-github-hashicorp-hcl-dev (1.0.0-1.1) ... Setting up libxtables12:i386 (1.8.7-1) ... Setting up golang-glog-dev (0.0~git20160126.23def4e-3) ... Setting up libsasl2-2:i386 (2.1.27+dfsg-2.1) ... Setting up golang-github-julienschmidt-httprouter-dev (1.3.0-1) ... Setting up golang-github-hashicorp-go-multierror-dev (1.1.0-1) ... Setting up golang-github-rogpeppe-fastuuid-dev (0.0~git20150106.0.6724a57-2.1) ... Setting up zlib1g-dev:i386 (1:1.2.11.dfsg-2) ... Setting up golang-github-tv42-httpunix-dev (0.0~git20150427.b75d861-2) ... Setting up golang-github-shirou-gopsutil-dev (2.19.11-4) ... Setting up golang-github-hashicorp-go-version-dev (1.2.0-1) ... Setting up libmd0:i386 (1.0.3-3) ... Setting up golang-gopkg-inf.v0-dev (0.9.1-1) ... Setting up sensible-utils (0.0.14) ... Setting up golang-golang-x-text-dev (0.3.6-1) ... Setting up golang-github-google-uuid-dev (1.2.0-1) ... Setting up golang-github-hashicorp-hil-dev (0.0~git20160711.1e86c6b-1) ... Setting up libuchardet0:i386 (0.0.7-1) ... Setting up golang-github-prometheus-procfs-dev (0.3.0-2) ... Setting up golang-github-alecthomas-units-dev (0.0~git20201120.1786d5e-1) ... Setting up golang-github-modern-go-reflect2-dev (1.0.1-1) ... Setting up libsub-override-perl (0.09-2) ... Setting up golang-github-dgrijalva-jwt-go-dev (3.2.0-3) ... Setting up golang-github-vmware-govmomi-dev (0.23.0-1) ... Setting up golang-github-armon-go-radix-dev (1.0.0-1) ... Setting up golang-github-datadog-datadog-go-dev (2.1.0-3) ... Setting up golang-github-docopt-docopt-go-dev (0.6.2+git20180111.ee0de3b-1) ... Setting up golang-golang-x-xerrors-dev (0.0~git20191204.9bdfabe-1) ... Setting up golang-github-ghodss-yaml-dev (1.0.0-1.1) ... Setting up golang-src:i386 (2:1.15~1) ... Setting up openssl (1.1.1k-1) ... Setting up libbsd0:i386 (0.11.3-1) ... Setting up golang-github-pquerna-cachecontrol-dev (0.0~git20171018.0dec1b3-1.1) ... Setting up golang-1.15-go (1.15.9-6) ... Setting up libelf1:i386 (0.183-1) ... Setting up golang-github-vmihailenco-tagparser-dev (0.1.1-2) ... Setting up golang-github-armon-circbuf-dev (0.0~git20190214.5111143-1) ... Setting up libxml2:i386 (2.9.10+dfsg-6.7) ... Setting up libsystemd-dev:i386 (247.3-6) ... Setting up golang-github-jmespath-go-jmespath-dev (0.4.0-1) ... Setting up golang-github-hashicorp-yamux-dev (0.0+git20190923.df201c7-1) ... Setting up libprocps8:i386 (2:3.3.17-5) ... Setting up golang-github-hashicorp-go-rootcerts-dev (1.0.2-2) ... Setting up golang-github-hashicorp-logutils-dev (1.0.0-1) ... Setting up golang-github-kr-pretty-dev (0.2.1+git20200831.59b4212-1) ... Setting up libfile-stripnondeterminism-perl (1.12.0-1) ... Setting up golang-github-google-go-cmp-dev (0.5.4-1) ... Setting up golang-github-mattn-go-isatty-dev (0.0.12-1) ... Setting up golang-github-sirupsen-logrus-dev (1.7.0-2) ... Setting up golang-github-opentracing-opentracing-go-dev (1.2.0-1) ... Setting up golang-github-hashicorp-go-memdb-dev (1.2.1-1) ... Setting up golang-github-hashicorp-go-bexpr-dev (0.1.2-2) ... Setting up gettext (0.21-4) ... Setting up protobuf-compiler (3.12.4-1) ... Setting up golang-gopkg-vmihailenco-msgpack.v2-dev (4.3.1-2) ... Setting up golang-gopkg-alecthomas-kingpin.v2-dev (2.2.6-3) ... Setting up libtool (2.4.6-15) ... Setting up golang-go (2:1.15~1) ... Setting up golang-github-mattn-go-colorable-dev (0.1.7-1) ... Setting up golang-github-posener-complete-dev (1.2.3-2) ... Setting up golang-github-nytimes-gziphandler-dev (1.1.1-1) ... Setting up m4 (1.4.18-5) ... Setting up golang-github-json-iterator-go-dev (1.1.10-2) ... Setting up golang-gopkg-check.v1-dev (0.0+git20200902.038fdea-1) ... Setting up golang-github-mitchellh-copystructure-dev (0.0~git20161013.0.5af94ae-2.1) ... Setting up golang-any:i386 (2:1.15~1) ... Setting up intltool-debian (0.35.0+20060710.5) ... Setting up libprotobuf-dev:i386 (3.12.4-1) ... Setting up ca-certificates (20210119) ... Updating certificates in /etc/ssl/certs... 129 added, 0 removed; done. Setting up libsasl2-dev (2.1.27+dfsg-2.1) ... Setting up golang-gopkg-mgo.v2-dev (2016.08.01-7) ... Setting up golang-goprotobuf-dev (1.3.4-2+b6) ... Setting up golang-github-elazarl-go-bindata-assetfs-dev (1.0.0-1.1) ... Setting up golang-github-coreos-go-systemd-dev (22.1.0-3) ... Setting up golang-golang-x-net-dev (1:0.0+git20210119.5f4716e+dfsg-4) ... Setting up autoconf (2.69-14) ... Setting up dh-strip-nondeterminism (1.12.0-1) ... Setting up dwz (0.13+20210201-1) ... Setting up groff-base (1.22.4-6) ... Setting up procps (2:3.3.17-5) ... Setting up golang-golang-x-crypto-dev (1:0.0~git20201221.eec23a3-1) ... Setting up golang-github-prometheus-client-model-dev (0.2.0-2) ... Setting up golang-golang-x-oauth2-dev (0.0~git20190604.0f29369-2) ... Setting up libbpf0:i386 (1:0.3-2) ... Setting up golang-github-aws-aws-sdk-go-dev (1.36.33-1) ... Setting up golang-github-hashicorp-go-checkpoint-dev (0.5.0-1) ... Setting up automake (1:1.16.3-2) ... update-alternatives: using /usr/bin/automake-1.16 to provide /usr/bin/automake (automake) in auto mode Setting up golang-golang-x-time-dev (0.0+git20200630.3af7569-1) ... Setting up golang-github-digitalocean-godo-dev (1.37.0-1) ... Setting up golang-github-gophercloud-gophercloud-dev (0.12.0-1) ... Setting up golang-github-gogo-protobuf-dev (1.3.2-1) ... Setting up golang-github-fatih-color-dev (1.7.0-1) ... Setting up golang-github-miekg-dns-dev (1.1.35-1) ... Setting up iproute2 (5.10.0-4) ... Setting up golang-github-golang-groupcache-dev (0.0~git20200121.8c9f03a-1) ... Setting up golang-github-hashicorp-go-msgpack-dev (0.5.5-1) ... Setting up po-debconf (1.0.21+nmu1) ... Setting up golang-github-coreos-pkg-dev (4-3) ... Setting up golang-protobuf-extensions-dev (1.0.1-1) ... Setting up golang-github-dghubble-sling-dev (1.3.0-1) ... Setting up golang-google-cloud-compute-metadata-dev (0.56.0-1) ... Setting up golang-github-docker-go-connections-dev (0.4.0-3) ... Setting up man-db (2.9.4-2) ... Not building database; man-db/auto-update is not 'true'. Setting up golang-github-packethost-packngo-dev (0.2.0-2) ... Setting up golang-github-denverdino-aliyungo-dev (0.0~git20180921.13fa8aa-2) ... Setting up dh-autoreconf (20) ... Setting up golang-golang-x-oauth2-google-dev (0.0~git20190604.0f29369-2) ... Setting up golang-gopkg-square-go-jose.v2-dev (2.5.1-2) ... Setting up golang-github-azure-go-autorest-dev (14.1.1-1) ... Setting up golang-github-mitchellh-cli-dev (1.1.1-1) ... Setting up golang-github-googleapis-gnostic-dev (0.2.0-2) ... Setting up golang-github-hashicorp-net-rpc-msgpackrpc-dev (0.0~git20151116.0.a14192a-1.1) ... Setting up golang-github-hashicorp-go-hclog-dev (0.11.0-1) ... Setting up golang-github-hashicorp-mdns-dev (1.0.3-2) ... Setting up golang-github-hashicorp-go-sockaddr-dev (0.0~git20170627.41949a1+ds-2) ... Setting up debhelper (13.3.4) ... Setting up golang-github-coreos-go-oidc-dev (2.1.0-2) ... Setting up golang-github-hashicorp-go-retryablehttp-dev (0.6.4-2) ... Setting up dh-golang (1.51) ... Setting up golang-github-circonus-labs-circonus-gometrics-dev (2.3.1-3) ... Setting up golang-github-mwitkow-go-conntrack-dev (0.0~git20190716.2f06839-2) ... Setting up golang-google-genproto-dev (0.0~git20200413.b5235f6-1) ... Setting up golang-github-prometheus-client-golang-dev (1.9.0-2) ... Setting up golang-github-armon-go-metrics-dev (0.3.4-1) ... Setting up golang-google-grpc-dev (1.27.1-1) ... Setting up golang-github-grpc-ecosystem-grpc-gateway-dev (1.6.4-2) ... Setting up golang-go.opencensus-dev (0.22.4-2) ... Setting up golang-github-hashicorp-raft-dev (1.1.2-1) ... Setting up golang-github-go-kit-kit-dev (0.6.0-3) ... Setting up golang-github-googleapis-gax-go-dev (2.0.5-1) ... Setting up golang-github-hashicorp-memberlist-dev (0.2.2-1) ... Setting up golang-github-hashicorp-go-raftchunking-dev (0.6.2-2) ... Setting up golang-github-census-instrumentation-opencensus-proto-dev (0.2.1+dfsg1-2) ... Setting up golang-github-prometheus-common-dev (0.15.0-2) ... Setting up golang-google-api-dev (0.28.0-2) ... Setting up golang-github-hashicorp-raft-boltdb-dev (0.0~git20171010.6e5ba93-3) ... Setting up golang-github-hashicorp-serf-dev (0.9.4~ds1-1) ... Setting up golang-github-hashicorp-go-discover-dev (0.0+git20190905.34a6505-2) ... Processing triggers for libc-bin (2.31-13) ... Processing triggers for ca-certificates (20210119) ... Updating certificates in /etc/ssl/certs... 0 added, 0 removed; done. Running hooks in /etc/ca-certificates/update.d... done. Reading package lists... Building dependency tree... Reading state information... Reading extended state information... Initializing package states... Writing extended state information... Building tag database... -> Finished parsing the build-deps Reading package lists... Building dependency tree... Reading state information... fakeroot is already the newest version (1.25.3-1.1). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. I: Building the package hostname: Name or service not known I: Running cd /build/consul-1.8.7+dfsg1/ && env PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path" HOME="/nonexistent/second-build" dpkg-buildpackage -us -uc -b && env PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path" HOME="/nonexistent/second-build" dpkg-genchanges -S > ../consul_1.8.7+dfsg1-2_source.changes dpkg-buildpackage: info: source package consul dpkg-buildpackage: info: source version 1.8.7+dfsg1-2 dpkg-buildpackage: info: source distribution unstable dpkg-buildpackage: info: source changed by Valentin Vidic dpkg-source --before-build . dpkg-buildpackage: info: host architecture i386 fakeroot debian/rules clean dh clean --buildsystem=golang --with=golang,bash-completion --builddirectory=_build dh_auto_clean -O--buildsystem=golang -O--builddirectory=_build dh_autoreconf_clean -O--buildsystem=golang -O--builddirectory=_build debian/rules override_dh_clean make[1]: Entering directory '/build/consul-1.8.7+dfsg1' dh_clean ## Remove Files-Excluded (when built from checkout or non-DFSG tarball): rm -f -rv `perl -0nE 'say $1 if m{^Files\-Excluded\:\s*(.*?)(?:\n\n|Files:|Comment:)}sm;' debian/copyright` find vendor -type d -empty -delete -print vendor/github.com/davecgh vendor/github.com/digitalocean vendor/github.com/docker vendor/github.com/Azure vendor/github.com/joyent vendor/github.com/spf13 vendor/github.com/json-iterator vendor/github.com/gophercloud vendor/github.com/pierrec vendor/github.com/coreos vendor/github.com/dgrijalva vendor/github.com/patrickmn vendor/github.com/shirou vendor/github.com/gogo vendor/github.com/StackExchange vendor/github.com/imdario vendor/github.com/modern-go vendor/github.com/golang vendor/github.com/armon vendor/github.com/pquerna vendor/github.com/mattn vendor/github.com/Microsoft vendor/github.com/prometheus vendor/github.com/boltdb vendor/github.com/DataDog vendor/github.com/renier vendor/github.com/cespare vendor/github.com/ryanuber vendor/github.com/stretchr vendor/github.com/nicolai86 vendor/github.com/sean- vendor/github.com/konsorten vendor/github.com/pmezard vendor/github.com/beorn7 vendor/github.com/sirupsen vendor/github.com/census-instrumentation vendor/github.com/pascaldekloe vendor/github.com/miekg vendor/github.com/pkg vendor/github.com/googleapis vendor/github.com/softlayer vendor/github.com/denverdino vendor/github.com/vmware vendor/github.com/jmespath vendor/github.com/fatih vendor/github.com/matttproud vendor/github.com/packethost vendor/github.com/dimchansky vendor/github.com/circonus-labs vendor/github.com/bgentry vendor/github.com/aws vendor/github.com/kr vendor/github.com/posener vendor/github.com/go-ole vendor/github.com/tv42 vendor/github.com/elazarl vendor/github.com/NYTimes vendor/golang.org vendor/gopkg.in rm -f -r test/integration make[1]: Leaving directory '/build/consul-1.8.7+dfsg1' debian/rules build dh build --buildsystem=golang --with=golang,bash-completion --builddirectory=_build dh_update_autotools_config -O--buildsystem=golang -O--builddirectory=_build dh_autoreconf -O--buildsystem=golang -O--builddirectory=_build dh_auto_configure -O--buildsystem=golang -O--builddirectory=_build debian/rules override_dh_auto_build make[1]: Entering directory '/build/consul-1.8.7+dfsg1' export GOPATH=/build/consul-1.8.7+dfsg1/_build \ GIT_COMMIT=1.8.7+dfsg1 \ GIT_COMMIT_YEAR=2021 \ && /usr/bin/make -C _build/src/github.com/hashicorp/consul --makefile=/build/consul-1.8.7+dfsg1/GNUmakefile proto make[2]: Entering directory '/build/consul-1.8.7+dfsg1/_build/src/github.com/hashicorp/consul' bash: line 1: git: command not found bash: line 1: git: command not found Generated all protobuf Go files make[2]: Leaving directory '/build/consul-1.8.7+dfsg1/_build/src/github.com/hashicorp/consul' dh_auto_build -v cd _build && go version go version go1.15.9 linux/386 cd _build && go env GO111MODULE="off" GOARCH="386" GOBIN="" GOCACHE="/build/consul-1.8.7+dfsg1/_build/go-build" GOENV="/build/consul-1.8.7+dfsg1/debian/tmp/.config/go/env" GOEXE="" GOFLAGS="" GOHOSTARCH="386" GOHOSTOS="linux" GOINSECURE="" GOMODCACHE="/build/consul-1.8.7+dfsg1/_build/pkg/mod" GONOPROXY="" GONOSUMDB="" GOOS="linux" GOPATH="/build/consul-1.8.7+dfsg1/_build" GOPRIVATE="" GOPROXY="off" GOROOT="/usr/lib/go-1.15" GOSUMDB="sum.golang.org" GOTMPDIR="" GOTOOLDIR="/usr/lib/go-1.15/pkg/tool/linux_386" GCCGO="gccgo" GO386="387" AR="ar" CC="gcc" CXX="g++" CGO_ENABLED="1" GOMOD="" CGO_CFLAGS="-g -O2 -fdebug-prefix-map=/build/consul-1.8.7+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security" CGO_CPPFLAGS="-Wdate-time -D_FORTIFY_SOURCE=2" CGO_CXXFLAGS="-g -O2 -fdebug-prefix-map=/build/consul-1.8.7+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security" CGO_FFLAGS="-g -O2 -fdebug-prefix-map=/build/consul-1.8.7+dfsg1=. -fstack-protector-strong" CGO_LDFLAGS="-Wl,-z,relro" PKG_CONFIG="pkg-config" GOGCCFLAGS="-fPIC -m32 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build285295994=/tmp/go-build -gno-record-gcc-switches" dh_auto_build: warning: github.com/hashicorp/consul/agent/routine-leak-checker contains no non-test Go files, removing it from build cd _build && go generate -v github.com/hashicorp/consul github.com/hashicorp/consul/acl github.com/hashicorp/consul/agent github.com/hashicorp/consul/agent/ae github.com/hashicorp/consul/agent/auto-config github.com/hashicorp/consul/agent/cache github.com/hashicorp/consul/agent/cache-types github.com/hashicorp/consul/agent/checks github.com/hashicorp/consul/agent/config github.com/hashicorp/consul/agent/connect github.com/hashicorp/consul/agent/connect/ca github.com/hashicorp/consul/agent/consul github.com/hashicorp/consul/agent/consul/authmethod github.com/hashicorp/consul/agent/consul/authmethod/kubeauth github.com/hashicorp/consul/agent/consul/authmethod/ssoauth github.com/hashicorp/consul/agent/consul/authmethod/testauth github.com/hashicorp/consul/agent/consul/autopilot github.com/hashicorp/consul/agent/consul/discoverychain github.com/hashicorp/consul/agent/consul/fsm github.com/hashicorp/consul/agent/consul/prepared_query github.com/hashicorp/consul/agent/consul/state github.com/hashicorp/consul/agent/consul/wanfed github.com/hashicorp/consul/agent/debug github.com/hashicorp/consul/agent/dns github.com/hashicorp/consul/agent/exec github.com/hashicorp/consul/agent/local github.com/hashicorp/consul/agent/metadata github.com/hashicorp/consul/agent/mock github.com/hashicorp/consul/agent/pool github.com/hashicorp/consul/agent/proxycfg github.com/hashicorp/consul/agent/router github.com/hashicorp/consul/agent/structs github.com/hashicorp/consul/agent/systemd github.com/hashicorp/consul/agent/token github.com/hashicorp/consul/agent/xds github.com/hashicorp/consul/agent/xds/proxysupport github.com/hashicorp/consul/api github.com/hashicorp/consul/api/watch github.com/hashicorp/consul/command github.com/hashicorp/consul/command/acl github.com/hashicorp/consul/command/acl/agenttokens github.com/hashicorp/consul/command/acl/authmethod github.com/hashicorp/consul/command/acl/authmethod/create github.com/hashicorp/consul/command/acl/authmethod/delete github.com/hashicorp/consul/command/acl/authmethod/list github.com/hashicorp/consul/command/acl/authmethod/read github.com/hashicorp/consul/command/acl/authmethod/update github.com/hashicorp/consul/command/acl/bindingrule github.com/hashicorp/consul/command/acl/bindingrule/create github.com/hashicorp/consul/command/acl/bindingrule/delete github.com/hashicorp/consul/command/acl/bindingrule/list github.com/hashicorp/consul/command/acl/bindingrule/read github.com/hashicorp/consul/command/acl/bindingrule/update github.com/hashicorp/consul/command/acl/bootstrap github.com/hashicorp/consul/command/acl/policy github.com/hashicorp/consul/command/acl/policy/create github.com/hashicorp/consul/command/acl/policy/delete github.com/hashicorp/consul/command/acl/policy/list github.com/hashicorp/consul/command/acl/policy/read github.com/hashicorp/consul/command/acl/policy/update github.com/hashicorp/consul/command/acl/role github.com/hashicorp/consul/command/acl/role/create github.com/hashicorp/consul/command/acl/role/delete github.com/hashicorp/consul/command/acl/role/list github.com/hashicorp/consul/command/acl/role/read github.com/hashicorp/consul/command/acl/role/update github.com/hashicorp/consul/command/acl/rules github.com/hashicorp/consul/command/acl/token github.com/hashicorp/consul/command/acl/token/clone github.com/hashicorp/consul/command/acl/token/create github.com/hashicorp/consul/command/acl/token/delete github.com/hashicorp/consul/command/acl/token/list github.com/hashicorp/consul/command/acl/token/read github.com/hashicorp/consul/command/acl/token/update github.com/hashicorp/consul/command/agent github.com/hashicorp/consul/command/catalog github.com/hashicorp/consul/command/catalog/list/dc github.com/hashicorp/consul/command/catalog/list/nodes github.com/hashicorp/consul/command/catalog/list/services github.com/hashicorp/consul/command/config github.com/hashicorp/consul/command/config/delete github.com/hashicorp/consul/command/config/list github.com/hashicorp/consul/command/config/read github.com/hashicorp/consul/command/config/write github.com/hashicorp/consul/command/connect github.com/hashicorp/consul/command/connect/ca github.com/hashicorp/consul/command/connect/ca/get github.com/hashicorp/consul/command/connect/ca/set github.com/hashicorp/consul/command/connect/envoy github.com/hashicorp/consul/command/connect/envoy/pipe-bootstrap github.com/hashicorp/consul/command/connect/expose github.com/hashicorp/consul/command/connect/proxy github.com/hashicorp/consul/command/debug github.com/hashicorp/consul/command/event github.com/hashicorp/consul/command/exec github.com/hashicorp/consul/command/flags github.com/hashicorp/consul/command/forceleave github.com/hashicorp/consul/command/helpers github.com/hashicorp/consul/command/info github.com/hashicorp/consul/command/intention github.com/hashicorp/consul/command/intention/check github.com/hashicorp/consul/command/intention/create github.com/hashicorp/consul/command/intention/delete github.com/hashicorp/consul/command/intention/finder github.com/hashicorp/consul/command/intention/get github.com/hashicorp/consul/command/intention/match github.com/hashicorp/consul/command/join github.com/hashicorp/consul/command/keygen github.com/hashicorp/consul/command/keyring github.com/hashicorp/consul/command/kv github.com/hashicorp/consul/command/kv/del github.com/hashicorp/consul/command/kv/exp github.com/hashicorp/consul/command/kv/get github.com/hashicorp/consul/command/kv/imp github.com/hashicorp/consul/command/kv/impexp github.com/hashicorp/consul/command/kv/put github.com/hashicorp/consul/command/leave github.com/hashicorp/consul/command/lock github.com/hashicorp/consul/command/login github.com/hashicorp/consul/command/logout github.com/hashicorp/consul/command/maint github.com/hashicorp/consul/command/members github.com/hashicorp/consul/command/monitor github.com/hashicorp/consul/command/operator github.com/hashicorp/consul/command/operator/autopilot github.com/hashicorp/consul/command/operator/autopilot/get github.com/hashicorp/consul/command/operator/autopilot/set github.com/hashicorp/consul/command/operator/raft github.com/hashicorp/consul/command/operator/raft/listpeers github.com/hashicorp/consul/command/operator/raft/removepeer github.com/hashicorp/consul/command/reload github.com/hashicorp/consul/command/rtt github.com/hashicorp/consul/command/services github.com/hashicorp/consul/command/services/deregister github.com/hashicorp/consul/command/services/register github.com/hashicorp/consul/command/snapshot github.com/hashicorp/consul/command/snapshot/inspect github.com/hashicorp/consul/command/snapshot/restore github.com/hashicorp/consul/command/snapshot/save github.com/hashicorp/consul/command/tls github.com/hashicorp/consul/command/tls/ca github.com/hashicorp/consul/command/tls/ca/create github.com/hashicorp/consul/command/tls/cert github.com/hashicorp/consul/command/tls/cert/create github.com/hashicorp/consul/command/validate github.com/hashicorp/consul/command/version github.com/hashicorp/consul/command/watch github.com/hashicorp/consul/connect github.com/hashicorp/consul/connect/certgen github.com/hashicorp/consul/connect/proxy github.com/hashicorp/consul/internal/go-sso/oidcauth github.com/hashicorp/consul/internal/go-sso/oidcauth/internal/strutil github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcauthtest github.com/hashicorp/consul/ipaddr github.com/hashicorp/consul/lib github.com/hashicorp/consul/lib/decode github.com/hashicorp/consul/lib/file github.com/hashicorp/consul/lib/semaphore github.com/hashicorp/consul/lib/stringslice github.com/hashicorp/consul/lib/template github.com/hashicorp/consul/logging github.com/hashicorp/consul/logging/monitor github.com/hashicorp/consul/proto github.com/hashicorp/consul/proto/pbacl github.com/hashicorp/consul/proto/pbautoconf github.com/hashicorp/consul/proto/pbcommon github.com/hashicorp/consul/proto/pbconfig github.com/hashicorp/consul/proto/pbconnect github.com/hashicorp/consul/sdk/freeport github.com/hashicorp/consul/sdk/testutil github.com/hashicorp/consul/sdk/testutil/retry github.com/hashicorp/consul/sentinel github.com/hashicorp/consul/service_os github.com/hashicorp/consul/snapshot github.com/hashicorp/consul/testrpc github.com/hashicorp/consul/tlsutil github.com/hashicorp/consul/types github.com/hashicorp/consul/version src/github.com/hashicorp/consul/main.go src/github.com/hashicorp/consul/main_test.go src/github.com/hashicorp/consul/acl/acl.go src/github.com/hashicorp/consul/acl/acl_oss.go src/github.com/hashicorp/consul/acl/acl_test.go src/github.com/hashicorp/consul/acl/authorizer.go src/github.com/hashicorp/consul/acl/authorizer_oss.go src/github.com/hashicorp/consul/acl/authorizer_test.go src/github.com/hashicorp/consul/acl/chained_authorizer.go src/github.com/hashicorp/consul/acl/chained_authorizer_test.go src/github.com/hashicorp/consul/acl/errors.go src/github.com/hashicorp/consul/acl/policy.go src/github.com/hashicorp/consul/acl/policy_authorizer.go src/github.com/hashicorp/consul/acl/policy_authorizer_oss.go src/github.com/hashicorp/consul/acl/policy_authorizer_test.go src/github.com/hashicorp/consul/acl/policy_merger.go src/github.com/hashicorp/consul/acl/policy_merger_oss.go src/github.com/hashicorp/consul/acl/policy_oss.go src/github.com/hashicorp/consul/acl/policy_test.go src/github.com/hashicorp/consul/acl/static_authorizer.go src/github.com/hashicorp/consul/acl/static_authorizer_test.go src/github.com/hashicorp/consul/agent/acl.go src/github.com/hashicorp/consul/agent/acl_endpoint.go src/github.com/hashicorp/consul/agent/acl_endpoint_legacy.go src/github.com/hashicorp/consul/agent/acl_endpoint_legacy_test.go src/github.com/hashicorp/consul/agent/acl_endpoint_test.go src/github.com/hashicorp/consul/agent/acl_test.go src/github.com/hashicorp/consul/agent/agent.go src/github.com/hashicorp/consul/agent/agent_endpoint.go src/github.com/hashicorp/consul/agent/agent_endpoint_test.go src/github.com/hashicorp/consul/agent/agent_oss.go src/github.com/hashicorp/consul/agent/agent_test.go src/github.com/hashicorp/consul/agent/bindata_assetfs.go src/github.com/hashicorp/consul/agent/catalog_endpoint.go src/github.com/hashicorp/consul/agent/catalog_endpoint_test.go src/github.com/hashicorp/consul/agent/check.go src/github.com/hashicorp/consul/agent/config_endpoint.go src/github.com/hashicorp/consul/agent/config_endpoint_test.go src/github.com/hashicorp/consul/agent/connect_auth.go src/github.com/hashicorp/consul/agent/connect_ca_endpoint.go src/github.com/hashicorp/consul/agent/connect_ca_endpoint_test.go src/github.com/hashicorp/consul/agent/coordinate_endpoint.go src/github.com/hashicorp/consul/agent/coordinate_endpoint_test.go src/github.com/hashicorp/consul/agent/denylist.go src/github.com/hashicorp/consul/agent/denylist_test.go src/github.com/hashicorp/consul/agent/discovery_chain_endpoint.go src/github.com/hashicorp/consul/agent/discovery_chain_endpoint_test.go src/github.com/hashicorp/consul/agent/dns.go src/github.com/hashicorp/consul/agent/dns_oss.go src/github.com/hashicorp/consul/agent/dns_test.go src/github.com/hashicorp/consul/agent/enterprise_delegate_oss.go src/github.com/hashicorp/consul/agent/event_endpoint.go src/github.com/hashicorp/consul/agent/event_endpoint_test.go src/github.com/hashicorp/consul/agent/federation_state_endpoint.go src/github.com/hashicorp/consul/agent/health_endpoint.go src/github.com/hashicorp/consul/agent/health_endpoint_test.go src/github.com/hashicorp/consul/agent/http.go src/github.com/hashicorp/consul/agent/http_decode_test.go src/github.com/hashicorp/consul/agent/http_oss.go src/github.com/hashicorp/consul/agent/http_oss_test.go src/github.com/hashicorp/consul/agent/http_register.go src/github.com/hashicorp/consul/agent/http_test.go src/github.com/hashicorp/consul/agent/intentions_endpoint.go src/github.com/hashicorp/consul/agent/intentions_endpoint_test.go src/github.com/hashicorp/consul/agent/keyring.go src/github.com/hashicorp/consul/agent/keyring_test.go src/github.com/hashicorp/consul/agent/kvs_endpoint.go src/github.com/hashicorp/consul/agent/kvs_endpoint_test.go src/github.com/hashicorp/consul/agent/nodeid.go src/github.com/hashicorp/consul/agent/nodeid_test.go src/github.com/hashicorp/consul/agent/notify.go src/github.com/hashicorp/consul/agent/notify_test.go src/github.com/hashicorp/consul/agent/operator_endpoint.go src/github.com/hashicorp/consul/agent/operator_endpoint_test.go src/github.com/hashicorp/consul/agent/prepared_query_endpoint.go src/github.com/hashicorp/consul/agent/prepared_query_endpoint_test.go src/github.com/hashicorp/consul/agent/remote_exec.go src/github.com/hashicorp/consul/agent/remote_exec_test.go src/github.com/hashicorp/consul/agent/retry_join.go src/github.com/hashicorp/consul/agent/service_checks_test.go src/github.com/hashicorp/consul/agent/service_manager.go src/github.com/hashicorp/consul/agent/service_manager_test.go src/github.com/hashicorp/consul/agent/session_endpoint.go src/github.com/hashicorp/consul/agent/session_endpoint_test.go src/github.com/hashicorp/consul/agent/setup.go src/github.com/hashicorp/consul/agent/sidecar_service.go src/github.com/hashicorp/consul/agent/sidecar_service_test.go src/github.com/hashicorp/consul/agent/signal_unix.go src/github.com/hashicorp/consul/agent/snapshot_endpoint.go src/github.com/hashicorp/consul/agent/snapshot_endpoint_test.go src/github.com/hashicorp/consul/agent/status_endpoint.go src/github.com/hashicorp/consul/agent/status_endpoint_test.go src/github.com/hashicorp/consul/agent/testagent.go src/github.com/hashicorp/consul/agent/testagent_test.go src/github.com/hashicorp/consul/agent/translate_addr.go src/github.com/hashicorp/consul/agent/txn_endpoint.go src/github.com/hashicorp/consul/agent/txn_endpoint_test.go src/github.com/hashicorp/consul/agent/ui_endpoint.go src/github.com/hashicorp/consul/agent/ui_endpoint_test.go src/github.com/hashicorp/consul/agent/user_event.go src/github.com/hashicorp/consul/agent/user_event_test.go src/github.com/hashicorp/consul/agent/util.go src/github.com/hashicorp/consul/agent/util_test.go src/github.com/hashicorp/consul/agent/watch_handler.go src/github.com/hashicorp/consul/agent/watch_handler_test.go src/github.com/hashicorp/consul/agent/ae/ae.go src/github.com/hashicorp/consul/agent/ae/ae_test.go src/github.com/hashicorp/consul/agent/ae/trigger.go src/github.com/hashicorp/consul/agent/auto-config/auto_config.go src/github.com/hashicorp/consul/agent/auto-config/auto_config_test.go src/github.com/hashicorp/consul/agent/auto-config/auto_encrypt.go src/github.com/hashicorp/consul/agent/auto-config/auto_encrypt_test.go src/github.com/hashicorp/consul/agent/auto-config/config.go src/github.com/hashicorp/consul/agent/auto-config/config_translate.go src/github.com/hashicorp/consul/agent/auto-config/config_translate_test.go src/github.com/hashicorp/consul/agent/auto-config/mock_test.go src/github.com/hashicorp/consul/agent/auto-config/persist.go src/github.com/hashicorp/consul/agent/auto-config/run.go src/github.com/hashicorp/consul/agent/auto-config/server_addr.go src/github.com/hashicorp/consul/agent/auto-config/tls.go src/github.com/hashicorp/consul/agent/auto-config/tls_test.go src/github.com/hashicorp/consul/agent/cache/cache.go Generating mock for: Request in file: /build/consul-1.8.7+dfsg1/_build/src/github.com/hashicorp/consul/agent/cache/mock_Request.go Generating mock for: Type in file: /build/consul-1.8.7+dfsg1/_build/src/github.com/hashicorp/consul/agent/cache/mock_Type.go src/github.com/hashicorp/consul/agent/cache/cache_test.go src/github.com/hashicorp/consul/agent/cache/entry.go src/github.com/hashicorp/consul/agent/cache/entry_test.go src/github.com/hashicorp/consul/agent/cache/mock_Request.go src/github.com/hashicorp/consul/agent/cache/mock_Type.go src/github.com/hashicorp/consul/agent/cache/request.go src/github.com/hashicorp/consul/agent/cache/testing.go src/github.com/hashicorp/consul/agent/cache/type.go src/github.com/hashicorp/consul/agent/cache/watch.go src/github.com/hashicorp/consul/agent/cache/watch_test.go src/github.com/hashicorp/consul/agent/cache-types/catalog_datacenters.go src/github.com/hashicorp/consul/agent/cache-types/catalog_datacenters_test.go src/github.com/hashicorp/consul/agent/cache-types/catalog_list_services.go src/github.com/hashicorp/consul/agent/cache-types/catalog_list_services_test.go src/github.com/hashicorp/consul/agent/cache-types/catalog_service_list.go src/github.com/hashicorp/consul/agent/cache-types/catalog_service_list_test.go src/github.com/hashicorp/consul/agent/cache-types/catalog_services.go src/github.com/hashicorp/consul/agent/cache-types/catalog_services_test.go src/github.com/hashicorp/consul/agent/cache-types/config_entry.go src/github.com/hashicorp/consul/agent/cache-types/config_entry_test.go src/github.com/hashicorp/consul/agent/cache-types/connect_ca_leaf.go src/github.com/hashicorp/consul/agent/cache-types/connect_ca_leaf_oss.go src/github.com/hashicorp/consul/agent/cache-types/connect_ca_leaf_test.go src/github.com/hashicorp/consul/agent/cache-types/connect_ca_root.go src/github.com/hashicorp/consul/agent/cache-types/connect_ca_root_test.go src/github.com/hashicorp/consul/agent/cache-types/discovery_chain.go src/github.com/hashicorp/consul/agent/cache-types/discovery_chain_test.go src/github.com/hashicorp/consul/agent/cache-types/federation_state_list_gateways.go src/github.com/hashicorp/consul/agent/cache-types/federation_state_list_gateways_test.go src/github.com/hashicorp/consul/agent/cache-types/gateway_services.go src/github.com/hashicorp/consul/agent/cache-types/gateway_services_test.go src/github.com/hashicorp/consul/agent/cache-types/health_services.go src/github.com/hashicorp/consul/agent/cache-types/health_services_test.go src/github.com/hashicorp/consul/agent/cache-types/intention_match.go src/github.com/hashicorp/consul/agent/cache-types/intention_match_test.go src/github.com/hashicorp/consul/agent/cache-types/mock_RPC.go src/github.com/hashicorp/consul/agent/cache-types/node_services.go src/github.com/hashicorp/consul/agent/cache-types/node_services_test.go src/github.com/hashicorp/consul/agent/cache-types/options.go src/github.com/hashicorp/consul/agent/cache-types/prepared_query.go src/github.com/hashicorp/consul/agent/cache-types/prepared_query_test.go src/github.com/hashicorp/consul/agent/cache-types/resolved_service_config.go src/github.com/hashicorp/consul/agent/cache-types/resolved_service_config_test.go src/github.com/hashicorp/consul/agent/cache-types/rpc.go Generating mock for: Agent in file: /build/consul-1.8.7+dfsg1/_build/src/github.com/hashicorp/consul/agent/cache-types/mock_Agent.go Generating mock for: RPC in file: /build/consul-1.8.7+dfsg1/_build/src/github.com/hashicorp/consul/agent/cache-types/mock_RPC.go src/github.com/hashicorp/consul/agent/cache-types/service_checks.go src/github.com/hashicorp/consul/agent/cache-types/service_checks_test.go src/github.com/hashicorp/consul/agent/cache-types/service_dump.go src/github.com/hashicorp/consul/agent/cache-types/service_dump_test.go src/github.com/hashicorp/consul/agent/cache-types/testing.go src/github.com/hashicorp/consul/agent/checks/alias.go src/github.com/hashicorp/consul/agent/checks/alias_test.go src/github.com/hashicorp/consul/agent/checks/check.go src/github.com/hashicorp/consul/agent/checks/check_test.go src/github.com/hashicorp/consul/agent/checks/docker.go src/github.com/hashicorp/consul/agent/checks/docker_unix.go src/github.com/hashicorp/consul/agent/checks/grpc.go src/github.com/hashicorp/consul/agent/checks/grpc_test.go src/github.com/hashicorp/consul/agent/config/agent_limits.go src/github.com/hashicorp/consul/agent/config/agent_limits_test.go src/github.com/hashicorp/consul/agent/config/builder.go src/github.com/hashicorp/consul/agent/config/builder_oss.go src/github.com/hashicorp/consul/agent/config/builder_oss_test.go src/github.com/hashicorp/consul/agent/config/builder_test.go src/github.com/hashicorp/consul/agent/config/config.go src/github.com/hashicorp/consul/agent/config/config_oss.go src/github.com/hashicorp/consul/agent/config/default.go src/github.com/hashicorp/consul/agent/config/default_oss.go src/github.com/hashicorp/consul/agent/config/doc.go src/github.com/hashicorp/consul/agent/config/flags.go src/github.com/hashicorp/consul/agent/config/flags_test.go src/github.com/hashicorp/consul/agent/config/flagset.go src/github.com/hashicorp/consul/agent/config/limits.go src/github.com/hashicorp/consul/agent/config/merge.go src/github.com/hashicorp/consul/agent/config/merge_test.go src/github.com/hashicorp/consul/agent/config/runtime.go src/github.com/hashicorp/consul/agent/config/runtime_oss.go src/github.com/hashicorp/consul/agent/config/runtime_oss_test.go src/github.com/hashicorp/consul/agent/config/runtime_test.go src/github.com/hashicorp/consul/agent/config/segment_oss.go src/github.com/hashicorp/consul/agent/config/segment_oss_test.go src/github.com/hashicorp/consul/agent/connect/common_names.go src/github.com/hashicorp/consul/agent/connect/common_names_test.go src/github.com/hashicorp/consul/agent/connect/csr.go src/github.com/hashicorp/consul/agent/connect/generate.go src/github.com/hashicorp/consul/agent/connect/generate_test.go src/github.com/hashicorp/consul/agent/connect/parsing.go src/github.com/hashicorp/consul/agent/connect/sni.go src/github.com/hashicorp/consul/agent/connect/sni_test.go src/github.com/hashicorp/consul/agent/connect/testing_ca.go src/github.com/hashicorp/consul/agent/connect/testing_ca_test.go src/github.com/hashicorp/consul/agent/connect/testing_spiffe.go src/github.com/hashicorp/consul/agent/connect/uri.go src/github.com/hashicorp/consul/agent/connect/uri_agent.go src/github.com/hashicorp/consul/agent/connect/uri_agent_test.go src/github.com/hashicorp/consul/agent/connect/uri_service.go src/github.com/hashicorp/consul/agent/connect/uri_service_oss.go src/github.com/hashicorp/consul/agent/connect/uri_service_test.go src/github.com/hashicorp/consul/agent/connect/uri_signing.go src/github.com/hashicorp/consul/agent/connect/uri_signing_test.go src/github.com/hashicorp/consul/agent/connect/uri_test.go src/github.com/hashicorp/consul/agent/connect/ca/common.go src/github.com/hashicorp/consul/agent/connect/ca/mock_Provider.go src/github.com/hashicorp/consul/agent/connect/ca/provider.go Generating mock for: Provider in file: /build/consul-1.8.7+dfsg1/_build/src/github.com/hashicorp/consul/agent/connect/ca/mock_Provider.go src/github.com/hashicorp/consul/agent/connect/ca/provider_aws.go src/github.com/hashicorp/consul/agent/connect/ca/provider_aws_test.go src/github.com/hashicorp/consul/agent/connect/ca/provider_consul.go src/github.com/hashicorp/consul/agent/connect/ca/provider_consul_config.go src/github.com/hashicorp/consul/agent/connect/ca/provider_consul_test.go src/github.com/hashicorp/consul/agent/connect/ca/provider_test.go src/github.com/hashicorp/consul/agent/connect/ca/provider_vault.go src/github.com/hashicorp/consul/agent/connect/ca/provider_vault_test.go src/github.com/hashicorp/consul/agent/connect/ca/testing.go src/github.com/hashicorp/consul/agent/consul/acl.go src/github.com/hashicorp/consul/agent/consul/acl_authmethod.go src/github.com/hashicorp/consul/agent/consul/acl_authmethod_oss.go src/github.com/hashicorp/consul/agent/consul/acl_authmethod_test.go src/github.com/hashicorp/consul/agent/consul/acl_client.go src/github.com/hashicorp/consul/agent/consul/acl_endpoint.go src/github.com/hashicorp/consul/agent/consul/acl_endpoint_legacy.go src/github.com/hashicorp/consul/agent/consul/acl_endpoint_oss.go src/github.com/hashicorp/consul/agent/consul/acl_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/acl_oss.go src/github.com/hashicorp/consul/agent/consul/acl_oss_test.go src/github.com/hashicorp/consul/agent/consul/acl_replication.go src/github.com/hashicorp/consul/agent/consul/acl_replication_legacy.go src/github.com/hashicorp/consul/agent/consul/acl_replication_legacy_test.go src/github.com/hashicorp/consul/agent/consul/acl_replication_test.go src/github.com/hashicorp/consul/agent/consul/acl_replication_types.go src/github.com/hashicorp/consul/agent/consul/acl_server.go src/github.com/hashicorp/consul/agent/consul/acl_server_oss.go src/github.com/hashicorp/consul/agent/consul/acl_test.go src/github.com/hashicorp/consul/agent/consul/acl_token_exp.go src/github.com/hashicorp/consul/agent/consul/acl_token_exp_test.go src/github.com/hashicorp/consul/agent/consul/auto_config_endpoint.go src/github.com/hashicorp/consul/agent/consul/auto_config_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/auto_encrypt_endpoint.go src/github.com/hashicorp/consul/agent/consul/auto_encrypt_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/autopilot.go src/github.com/hashicorp/consul/agent/consul/autopilot_oss.go src/github.com/hashicorp/consul/agent/consul/autopilot_test.go src/github.com/hashicorp/consul/agent/consul/catalog_endpoint.go src/github.com/hashicorp/consul/agent/consul/catalog_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/client.go src/github.com/hashicorp/consul/agent/consul/client_serf.go src/github.com/hashicorp/consul/agent/consul/client_test.go src/github.com/hashicorp/consul/agent/consul/cluster_test.go src/github.com/hashicorp/consul/agent/consul/config.go src/github.com/hashicorp/consul/agent/consul/config_endpoint.go src/github.com/hashicorp/consul/agent/consul/config_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/config_replication.go src/github.com/hashicorp/consul/agent/consul/config_replication_test.go src/github.com/hashicorp/consul/agent/consul/connect_ca_endpoint.go src/github.com/hashicorp/consul/agent/consul/connect_ca_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/consul_ca_delegate.go src/github.com/hashicorp/consul/agent/consul/coordinate_endpoint.go src/github.com/hashicorp/consul/agent/consul/coordinate_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/discovery_chain_endpoint.go src/github.com/hashicorp/consul/agent/consul/discovery_chain_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/enterprise_client_oss.go src/github.com/hashicorp/consul/agent/consul/enterprise_config_oss.go src/github.com/hashicorp/consul/agent/consul/enterprise_server_oss.go src/github.com/hashicorp/consul/agent/consul/federation_state_endpoint.go src/github.com/hashicorp/consul/agent/consul/federation_state_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/federation_state_replication.go src/github.com/hashicorp/consul/agent/consul/federation_state_replication_test.go src/github.com/hashicorp/consul/agent/consul/filter.go src/github.com/hashicorp/consul/agent/consul/filter_test.go src/github.com/hashicorp/consul/agent/consul/flood.go src/github.com/hashicorp/consul/agent/consul/gateway_locator.go src/github.com/hashicorp/consul/agent/consul/gateway_locator_test.go src/github.com/hashicorp/consul/agent/consul/health_endpoint.go src/github.com/hashicorp/consul/agent/consul/health_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/helper_test.go src/github.com/hashicorp/consul/agent/consul/intention_endpoint.go src/github.com/hashicorp/consul/agent/consul/intention_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/internal_endpoint.go src/github.com/hashicorp/consul/agent/consul/internal_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/issue_test.go src/github.com/hashicorp/consul/agent/consul/kvs_endpoint.go src/github.com/hashicorp/consul/agent/consul/kvs_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/leader.go src/github.com/hashicorp/consul/agent/consul/leader_connect.go src/github.com/hashicorp/consul/agent/consul/leader_connect_ca.go src/github.com/hashicorp/consul/agent/consul/leader_connect_ca_test.go src/github.com/hashicorp/consul/agent/consul/leader_connect_test.go src/github.com/hashicorp/consul/agent/consul/leader_federation_state_ae.go src/github.com/hashicorp/consul/agent/consul/leader_federation_state_ae_test.go src/github.com/hashicorp/consul/agent/consul/leader_routine_manager.go src/github.com/hashicorp/consul/agent/consul/leader_routine_manager_test.go src/github.com/hashicorp/consul/agent/consul/leader_test.go src/github.com/hashicorp/consul/agent/consul/logging.go src/github.com/hashicorp/consul/agent/consul/logging_test.go src/github.com/hashicorp/consul/agent/consul/merge.go src/github.com/hashicorp/consul/agent/consul/merge_test.go src/github.com/hashicorp/consul/agent/consul/operator_autopilot_endpoint.go src/github.com/hashicorp/consul/agent/consul/operator_autopilot_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/operator_endpoint.go src/github.com/hashicorp/consul/agent/consul/operator_raft_endpoint.go src/github.com/hashicorp/consul/agent/consul/operator_raft_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/options.go src/github.com/hashicorp/consul/agent/consul/prepared_query_endpoint.go src/github.com/hashicorp/consul/agent/consul/prepared_query_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/raft_rpc.go src/github.com/hashicorp/consul/agent/consul/replication.go src/github.com/hashicorp/consul/agent/consul/replication_test.go src/github.com/hashicorp/consul/agent/consul/rpc.go src/github.com/hashicorp/consul/agent/consul/rpc_test.go src/github.com/hashicorp/consul/agent/consul/rtt.go src/github.com/hashicorp/consul/agent/consul/rtt_test.go src/github.com/hashicorp/consul/agent/consul/segment_oss.go src/github.com/hashicorp/consul/agent/consul/serf_test.go src/github.com/hashicorp/consul/agent/consul/server.go src/github.com/hashicorp/consul/agent/consul/server_connect.go src/github.com/hashicorp/consul/agent/consul/server_lookup.go src/github.com/hashicorp/consul/agent/consul/server_lookup_test.go src/github.com/hashicorp/consul/agent/consul/server_oss.go src/github.com/hashicorp/consul/agent/consul/server_serf.go src/github.com/hashicorp/consul/agent/consul/server_test.go src/github.com/hashicorp/consul/agent/consul/session_endpoint.go src/github.com/hashicorp/consul/agent/consul/session_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/session_timers.go src/github.com/hashicorp/consul/agent/consul/session_timers_test.go src/github.com/hashicorp/consul/agent/consul/session_ttl.go src/github.com/hashicorp/consul/agent/consul/session_ttl_test.go src/github.com/hashicorp/consul/agent/consul/snapshot_endpoint.go src/github.com/hashicorp/consul/agent/consul/snapshot_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/stats_fetcher.go src/github.com/hashicorp/consul/agent/consul/stats_fetcher_test.go src/github.com/hashicorp/consul/agent/consul/status_endpoint.go src/github.com/hashicorp/consul/agent/consul/status_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/txn_endpoint.go src/github.com/hashicorp/consul/agent/consul/txn_endpoint_test.go src/github.com/hashicorp/consul/agent/consul/util.go src/github.com/hashicorp/consul/agent/consul/util_test.go src/github.com/hashicorp/consul/agent/consul/authmethod/authmethods.go src/github.com/hashicorp/consul/agent/consul/authmethod/authmethods_oss.go src/github.com/hashicorp/consul/agent/consul/authmethod/testing.go src/github.com/hashicorp/consul/agent/consul/authmethod/kubeauth/k8s.go src/github.com/hashicorp/consul/agent/consul/authmethod/kubeauth/k8s_oss.go src/github.com/hashicorp/consul/agent/consul/authmethod/kubeauth/k8s_test.go src/github.com/hashicorp/consul/agent/consul/authmethod/kubeauth/testing.go src/github.com/hashicorp/consul/agent/consul/authmethod/ssoauth/sso.go src/github.com/hashicorp/consul/agent/consul/authmethod/ssoauth/sso_oss.go src/github.com/hashicorp/consul/agent/consul/authmethod/ssoauth/sso_test.go src/github.com/hashicorp/consul/agent/consul/authmethod/testauth/testing.go src/github.com/hashicorp/consul/agent/consul/authmethod/testauth/testing_oss.go src/github.com/hashicorp/consul/agent/consul/autopilot/autopilot.go src/github.com/hashicorp/consul/agent/consul/autopilot/autopilot_test.go src/github.com/hashicorp/consul/agent/consul/autopilot/promotion.go src/github.com/hashicorp/consul/agent/consul/autopilot/promotion_test.go src/github.com/hashicorp/consul/agent/consul/autopilot/structs.go src/github.com/hashicorp/consul/agent/consul/autopilot/structs_test.go src/github.com/hashicorp/consul/agent/consul/discoverychain/compile.go src/github.com/hashicorp/consul/agent/consul/discoverychain/compile_oss.go src/github.com/hashicorp/consul/agent/consul/discoverychain/compile_test.go src/github.com/hashicorp/consul/agent/consul/discoverychain/string_stack.go src/github.com/hashicorp/consul/agent/consul/discoverychain/string_stack_test.go src/github.com/hashicorp/consul/agent/consul/discoverychain/testing.go src/github.com/hashicorp/consul/agent/consul/fsm/commands_oss.go src/github.com/hashicorp/consul/agent/consul/fsm/commands_oss_test.go src/github.com/hashicorp/consul/agent/consul/fsm/fsm.go src/github.com/hashicorp/consul/agent/consul/fsm/fsm_test.go src/github.com/hashicorp/consul/agent/consul/fsm/snapshot.go src/github.com/hashicorp/consul/agent/consul/fsm/snapshot_oss.go src/github.com/hashicorp/consul/agent/consul/fsm/snapshot_oss_test.go src/github.com/hashicorp/consul/agent/consul/prepared_query/template.go src/github.com/hashicorp/consul/agent/consul/prepared_query/template_test.go src/github.com/hashicorp/consul/agent/consul/prepared_query/walk.go src/github.com/hashicorp/consul/agent/consul/prepared_query/walk_oss_test.go src/github.com/hashicorp/consul/agent/consul/prepared_query/walk_test.go src/github.com/hashicorp/consul/agent/consul/state/acl.go src/github.com/hashicorp/consul/agent/consul/state/acl_oss.go src/github.com/hashicorp/consul/agent/consul/state/acl_test.go src/github.com/hashicorp/consul/agent/consul/state/autopilot.go src/github.com/hashicorp/consul/agent/consul/state/autopilot_test.go src/github.com/hashicorp/consul/agent/consul/state/catalog.go src/github.com/hashicorp/consul/agent/consul/state/catalog_oss.go src/github.com/hashicorp/consul/agent/consul/state/catalog_test.go src/github.com/hashicorp/consul/agent/consul/state/config_entry.go src/github.com/hashicorp/consul/agent/consul/state/config_entry_oss.go src/github.com/hashicorp/consul/agent/consul/state/config_entry_test.go src/github.com/hashicorp/consul/agent/consul/state/connect_ca.go src/github.com/hashicorp/consul/agent/consul/state/connect_ca_test.go src/github.com/hashicorp/consul/agent/consul/state/coordinate.go src/github.com/hashicorp/consul/agent/consul/state/coordinate_test.go src/github.com/hashicorp/consul/agent/consul/state/delay.go src/github.com/hashicorp/consul/agent/consul/state/delay_test.go src/github.com/hashicorp/consul/agent/consul/state/federation_state.go src/github.com/hashicorp/consul/agent/consul/state/graveyard.go src/github.com/hashicorp/consul/agent/consul/state/graveyard_oss.go src/github.com/hashicorp/consul/agent/consul/state/graveyard_test.go src/github.com/hashicorp/consul/agent/consul/state/index_connect.go src/github.com/hashicorp/consul/agent/consul/state/index_connect_test.go src/github.com/hashicorp/consul/agent/consul/state/index_service_kind.go src/github.com/hashicorp/consul/agent/consul/state/intention.go src/github.com/hashicorp/consul/agent/consul/state/intention_test.go src/github.com/hashicorp/consul/agent/consul/state/kvs.go src/github.com/hashicorp/consul/agent/consul/state/kvs_oss.go src/github.com/hashicorp/consul/agent/consul/state/kvs_test.go src/github.com/hashicorp/consul/agent/consul/state/operations_oss.go src/github.com/hashicorp/consul/agent/consul/state/prepared_query.go src/github.com/hashicorp/consul/agent/consul/state/prepared_query_index.go src/github.com/hashicorp/consul/agent/consul/state/prepared_query_index_test.go src/github.com/hashicorp/consul/agent/consul/state/prepared_query_test.go src/github.com/hashicorp/consul/agent/consul/state/schema.go src/github.com/hashicorp/consul/agent/consul/state/schema_test.go src/github.com/hashicorp/consul/agent/consul/state/session.go src/github.com/hashicorp/consul/agent/consul/state/session_oss.go src/github.com/hashicorp/consul/agent/consul/state/session_test.go src/github.com/hashicorp/consul/agent/consul/state/state_store.go src/github.com/hashicorp/consul/agent/consul/state/state_store_oss_test.go src/github.com/hashicorp/consul/agent/consul/state/state_store_test.go src/github.com/hashicorp/consul/agent/consul/state/tombstone_gc.go src/github.com/hashicorp/consul/agent/consul/state/tombstone_gc_test.go src/github.com/hashicorp/consul/agent/consul/state/txn.go src/github.com/hashicorp/consul/agent/consul/state/txn_test.go src/github.com/hashicorp/consul/agent/consul/wanfed/pool.go src/github.com/hashicorp/consul/agent/consul/wanfed/wanfed.go src/github.com/hashicorp/consul/agent/consul/wanfed/wanfed_test.go src/github.com/hashicorp/consul/agent/debug/host.go src/github.com/hashicorp/consul/agent/debug/host_test.go src/github.com/hashicorp/consul/agent/dns/dns.go src/github.com/hashicorp/consul/agent/exec/exec.go src/github.com/hashicorp/consul/agent/exec/exec_unix.go src/github.com/hashicorp/consul/agent/local/state.go src/github.com/hashicorp/consul/agent/local/testing.go src/github.com/hashicorp/consul/agent/local/state_test.go src/github.com/hashicorp/consul/agent/metadata/build.go src/github.com/hashicorp/consul/agent/metadata/build_test.go src/github.com/hashicorp/consul/agent/metadata/server.go src/github.com/hashicorp/consul/agent/metadata/server_internal_test.go src/github.com/hashicorp/consul/agent/metadata/server_test.go src/github.com/hashicorp/consul/agent/mock/notify.go src/github.com/hashicorp/consul/agent/pool/conn.go src/github.com/hashicorp/consul/agent/pool/peek.go src/github.com/hashicorp/consul/agent/pool/peek_test.go src/github.com/hashicorp/consul/agent/pool/peeked_conn.go src/github.com/hashicorp/consul/agent/pool/pool.go src/github.com/hashicorp/consul/agent/proxycfg/manager.go src/github.com/hashicorp/consul/agent/proxycfg/manager_test.go src/github.com/hashicorp/consul/agent/proxycfg/proxycfg.go src/github.com/hashicorp/consul/agent/proxycfg/snapshot.go src/github.com/hashicorp/consul/agent/proxycfg/state.go src/github.com/hashicorp/consul/agent/proxycfg/state_test.go src/github.com/hashicorp/consul/agent/proxycfg/testing.go src/github.com/hashicorp/consul/agent/router/manager.go src/github.com/hashicorp/consul/agent/router/manager_internal_test.go src/github.com/hashicorp/consul/agent/router/router.go src/github.com/hashicorp/consul/agent/router/router_test.go src/github.com/hashicorp/consul/agent/router/serf_adapter.go src/github.com/hashicorp/consul/agent/router/serf_flooder.go src/github.com/hashicorp/consul/agent/router/manager_test.go src/github.com/hashicorp/consul/agent/structs/acl.go src/github.com/hashicorp/consul/agent/structs/acl_cache.go src/github.com/hashicorp/consul/agent/structs/acl_cache_test.go src/github.com/hashicorp/consul/agent/structs/acl_legacy.go src/github.com/hashicorp/consul/agent/structs/acl_legacy_test.go src/github.com/hashicorp/consul/agent/structs/acl_oss.go src/github.com/hashicorp/consul/agent/structs/acl_test.go src/github.com/hashicorp/consul/agent/structs/auto_encrypt.go src/github.com/hashicorp/consul/agent/structs/catalog.go src/github.com/hashicorp/consul/agent/structs/check_definition.go src/github.com/hashicorp/consul/agent/structs/check_definition_test.go src/github.com/hashicorp/consul/agent/structs/check_type.go src/github.com/hashicorp/consul/agent/structs/config_entry.go src/github.com/hashicorp/consul/agent/structs/config_entry_discoverychain.go src/github.com/hashicorp/consul/agent/structs/config_entry_discoverychain_oss.go src/github.com/hashicorp/consul/agent/structs/config_entry_discoverychain_test.go src/github.com/hashicorp/consul/agent/structs/config_entry_gateways.go src/github.com/hashicorp/consul/agent/structs/config_entry_gateways_test.go src/github.com/hashicorp/consul/agent/structs/config_entry_oss.go src/github.com/hashicorp/consul/agent/structs/config_entry_oss_test.go src/github.com/hashicorp/consul/agent/structs/config_entry_test.go src/github.com/hashicorp/consul/agent/structs/connect.go src/github.com/hashicorp/consul/agent/structs/connect_ca.go src/github.com/hashicorp/consul/agent/structs/connect_ca_test.go src/github.com/hashicorp/consul/agent/structs/connect_oss.go src/github.com/hashicorp/consul/agent/structs/connect_proxy_config.go src/github.com/hashicorp/consul/agent/structs/connect_proxy_config_oss.go src/github.com/hashicorp/consul/agent/structs/connect_proxy_config_test.go src/github.com/hashicorp/consul/agent/structs/discovery_chain.go src/github.com/hashicorp/consul/agent/structs/discovery_chain_oss.go src/github.com/hashicorp/consul/agent/structs/errors.go src/github.com/hashicorp/consul/agent/structs/federation_state.go src/github.com/hashicorp/consul/agent/structs/intention.go src/github.com/hashicorp/consul/agent/structs/intention_oss.go src/github.com/hashicorp/consul/agent/structs/intention_test.go src/github.com/hashicorp/consul/agent/structs/operator.go src/github.com/hashicorp/consul/agent/structs/prepared_query.go src/github.com/hashicorp/consul/agent/structs/prepared_query_test.go src/github.com/hashicorp/consul/agent/structs/protobuf_compat.go src/github.com/hashicorp/consul/agent/structs/sanitize_oss.go src/github.com/hashicorp/consul/agent/structs/service_definition.go src/github.com/hashicorp/consul/agent/structs/service_definition_test.go src/github.com/hashicorp/consul/agent/structs/snapshot.go src/github.com/hashicorp/consul/agent/structs/structs.go src/github.com/hashicorp/consul/agent/structs/structs_filtering_test.go src/github.com/hashicorp/consul/agent/structs/structs_oss.go src/github.com/hashicorp/consul/agent/structs/structs_test.go src/github.com/hashicorp/consul/agent/structs/testing.go src/github.com/hashicorp/consul/agent/structs/testing_catalog.go src/github.com/hashicorp/consul/agent/structs/testing_connect_proxy_config.go src/github.com/hashicorp/consul/agent/structs/testing_intention.go src/github.com/hashicorp/consul/agent/structs/testing_service_definition.go src/github.com/hashicorp/consul/agent/structs/txn.go src/github.com/hashicorp/consul/agent/systemd/notify.go src/github.com/hashicorp/consul/agent/token/store.go src/github.com/hashicorp/consul/agent/token/store_oss.go src/github.com/hashicorp/consul/agent/token/store_test.go src/github.com/hashicorp/consul/agent/xds/clusters.go src/github.com/hashicorp/consul/agent/xds/clusters_test.go src/github.com/hashicorp/consul/agent/xds/config.go src/github.com/hashicorp/consul/agent/xds/config_test.go src/github.com/hashicorp/consul/agent/xds/endpoints.go src/github.com/hashicorp/consul/agent/xds/endpoints_test.go src/github.com/hashicorp/consul/agent/xds/envoy_versioning.go src/github.com/hashicorp/consul/agent/xds/envoy_versioning_test.go src/github.com/hashicorp/consul/agent/xds/failover_math.go src/github.com/hashicorp/consul/agent/xds/failover_math_test.go src/github.com/hashicorp/consul/agent/xds/golden_test.go src/github.com/hashicorp/consul/agent/xds/listeners.go src/github.com/hashicorp/consul/agent/xds/listeners_test.go src/github.com/hashicorp/consul/agent/xds/naming.go src/github.com/hashicorp/consul/agent/xds/response.go src/github.com/hashicorp/consul/agent/xds/routes.go src/github.com/hashicorp/consul/agent/xds/routes_test.go src/github.com/hashicorp/consul/agent/xds/server.go src/github.com/hashicorp/consul/agent/xds/server_oss.go src/github.com/hashicorp/consul/agent/xds/server_test.go src/github.com/hashicorp/consul/agent/xds/testing.go src/github.com/hashicorp/consul/agent/xds/xds.go src/github.com/hashicorp/consul/agent/xds/proxysupport/proxysupport.go src/github.com/hashicorp/consul/api/acl.go src/github.com/hashicorp/consul/api/acl_test.go src/github.com/hashicorp/consul/api/agent.go src/github.com/hashicorp/consul/api/agent_test.go src/github.com/hashicorp/consul/api/api.go src/github.com/hashicorp/consul/api/api_test.go src/github.com/hashicorp/consul/api/catalog.go src/github.com/hashicorp/consul/api/catalog_test.go src/github.com/hashicorp/consul/api/config_entry.go src/github.com/hashicorp/consul/api/config_entry_discoverychain.go src/github.com/hashicorp/consul/api/config_entry_discoverychain_test.go src/github.com/hashicorp/consul/api/config_entry_gateways.go src/github.com/hashicorp/consul/api/config_entry_gateways_test.go src/github.com/hashicorp/consul/api/config_entry_test.go src/github.com/hashicorp/consul/api/connect.go src/github.com/hashicorp/consul/api/connect_ca.go src/github.com/hashicorp/consul/api/connect_ca_test.go src/github.com/hashicorp/consul/api/connect_intention.go src/github.com/hashicorp/consul/api/connect_intention_test.go src/github.com/hashicorp/consul/api/coordinate.go src/github.com/hashicorp/consul/api/coordinate_test.go src/github.com/hashicorp/consul/api/debug.go src/github.com/hashicorp/consul/api/debug_test.go src/github.com/hashicorp/consul/api/discovery_chain.go src/github.com/hashicorp/consul/api/discovery_chain_test.go src/github.com/hashicorp/consul/api/event.go src/github.com/hashicorp/consul/api/event_test.go src/github.com/hashicorp/consul/api/health.go src/github.com/hashicorp/consul/api/health_test.go src/github.com/hashicorp/consul/api/kv.go src/github.com/hashicorp/consul/api/kv_test.go src/github.com/hashicorp/consul/api/lock.go src/github.com/hashicorp/consul/api/lock_test.go src/github.com/hashicorp/consul/api/namespace.go src/github.com/hashicorp/consul/api/operator.go src/github.com/hashicorp/consul/api/operator_area.go src/github.com/hashicorp/consul/api/operator_autopilot.go src/github.com/hashicorp/consul/api/operator_autopilot_test.go src/github.com/hashicorp/consul/api/operator_keyring.go src/github.com/hashicorp/consul/api/operator_keyring_test.go src/github.com/hashicorp/consul/api/operator_license.go src/github.com/hashicorp/consul/api/operator_raft.go src/github.com/hashicorp/consul/api/operator_raft_test.go src/github.com/hashicorp/consul/api/operator_segment.go src/github.com/hashicorp/consul/api/oss_test.go src/github.com/hashicorp/consul/api/prepared_query.go src/github.com/hashicorp/consul/api/prepared_query_test.go src/github.com/hashicorp/consul/api/raw.go src/github.com/hashicorp/consul/api/semaphore.go src/github.com/hashicorp/consul/api/semaphore_test.go src/github.com/hashicorp/consul/api/session.go src/github.com/hashicorp/consul/api/session_test.go src/github.com/hashicorp/consul/api/snapshot.go src/github.com/hashicorp/consul/api/snapshot_test.go src/github.com/hashicorp/consul/api/status.go src/github.com/hashicorp/consul/api/status_test.go src/github.com/hashicorp/consul/api/txn.go src/github.com/hashicorp/consul/api/txn_test.go src/github.com/hashicorp/consul/api/watch/funcs.go src/github.com/hashicorp/consul/api/watch/plan.go src/github.com/hashicorp/consul/api/watch/plan_test.go src/github.com/hashicorp/consul/api/watch/watch.go src/github.com/hashicorp/consul/api/watch/watch_test.go src/github.com/hashicorp/consul/api/watch/funcs_test.go src/github.com/hashicorp/consul/command/commands_oss.go src/github.com/hashicorp/consul/command/registry.go src/github.com/hashicorp/consul/command/acl/acl.go src/github.com/hashicorp/consul/command/acl/acl_helpers.go src/github.com/hashicorp/consul/command/acl/agenttokens/agent_tokens.go src/github.com/hashicorp/consul/command/acl/agenttokens/agent_tokens_test.go src/github.com/hashicorp/consul/command/acl/authmethod/authmethod.go src/github.com/hashicorp/consul/command/acl/authmethod/formatter.go src/github.com/hashicorp/consul/command/acl/authmethod/create/authmethod_create.go src/github.com/hashicorp/consul/command/acl/authmethod/create/authmethod_create_oss.go src/github.com/hashicorp/consul/command/acl/authmethod/create/authmethod_create_test.go src/github.com/hashicorp/consul/command/acl/authmethod/delete/authmethod_delete.go src/github.com/hashicorp/consul/command/acl/authmethod/delete/authmethod_delete_test.go src/github.com/hashicorp/consul/command/acl/authmethod/list/authmethod_list.go src/github.com/hashicorp/consul/command/acl/authmethod/list/authmethod_list_test.go src/github.com/hashicorp/consul/command/acl/authmethod/read/authmethod_read.go src/github.com/hashicorp/consul/command/acl/authmethod/read/authmethod_read_test.go src/github.com/hashicorp/consul/command/acl/authmethod/update/authmethod_update.go src/github.com/hashicorp/consul/command/acl/authmethod/update/authmethod_update_oss.go src/github.com/hashicorp/consul/command/acl/authmethod/update/authmethod_update_test.go src/github.com/hashicorp/consul/command/acl/bindingrule/bindingrule.go src/github.com/hashicorp/consul/command/acl/bindingrule/formatter.go src/github.com/hashicorp/consul/command/acl/bindingrule/create/bindingrule_create.go src/github.com/hashicorp/consul/command/acl/bindingrule/create/bindingrule_create_test.go src/github.com/hashicorp/consul/command/acl/bindingrule/delete/bindingrule_delete.go src/github.com/hashicorp/consul/command/acl/bindingrule/delete/bindingrule_delete_test.go src/github.com/hashicorp/consul/command/acl/bindingrule/list/bindingrule_list.go src/github.com/hashicorp/consul/command/acl/bindingrule/list/bindingrule_list_test.go src/github.com/hashicorp/consul/command/acl/bindingrule/read/bindingrule_read.go src/github.com/hashicorp/consul/command/acl/bindingrule/read/bindingrule_read_test.go src/github.com/hashicorp/consul/command/acl/bindingrule/update/bindingrule_update.go src/github.com/hashicorp/consul/command/acl/bindingrule/update/bindingrule_update_test.go src/github.com/hashicorp/consul/command/acl/bootstrap/bootstrap.go src/github.com/hashicorp/consul/command/acl/bootstrap/bootstrap_test.go src/github.com/hashicorp/consul/command/acl/policy/formatter.go src/github.com/hashicorp/consul/command/acl/policy/policy.go src/github.com/hashicorp/consul/command/acl/policy/create/policy_create.go src/github.com/hashicorp/consul/command/acl/policy/create/policy_create_test.go src/github.com/hashicorp/consul/command/acl/policy/delete/policy_delete.go src/github.com/hashicorp/consul/command/acl/policy/delete/policy_delete_test.go src/github.com/hashicorp/consul/command/acl/policy/list/policy_list.go src/github.com/hashicorp/consul/command/acl/policy/list/policy_list_test.go src/github.com/hashicorp/consul/command/acl/policy/read/policy_read.go src/github.com/hashicorp/consul/command/acl/policy/read/policy_read_test.go src/github.com/hashicorp/consul/command/acl/policy/update/policy_update.go src/github.com/hashicorp/consul/command/acl/policy/update/policy_update_test.go src/github.com/hashicorp/consul/command/acl/role/formatter.go src/github.com/hashicorp/consul/command/acl/role/formatter_test.go src/github.com/hashicorp/consul/command/acl/role/role.go src/github.com/hashicorp/consul/command/acl/role/create/role_create.go src/github.com/hashicorp/consul/command/acl/role/create/role_create_test.go src/github.com/hashicorp/consul/command/acl/role/delete/role_delete.go src/github.com/hashicorp/consul/command/acl/role/delete/role_delete_test.go src/github.com/hashicorp/consul/command/acl/role/list/role_list.go src/github.com/hashicorp/consul/command/acl/role/list/role_list_test.go src/github.com/hashicorp/consul/command/acl/role/read/role_read.go src/github.com/hashicorp/consul/command/acl/role/read/role_read_test.go src/github.com/hashicorp/consul/command/acl/role/update/role_update.go src/github.com/hashicorp/consul/command/acl/role/update/role_update_test.go src/github.com/hashicorp/consul/command/acl/rules/translate.go src/github.com/hashicorp/consul/command/acl/rules/translate_test.go src/github.com/hashicorp/consul/command/acl/token/formatter.go src/github.com/hashicorp/consul/command/acl/token/formatter_test.go src/github.com/hashicorp/consul/command/acl/token/token.go src/github.com/hashicorp/consul/command/acl/token/clone/token_clone.go src/github.com/hashicorp/consul/command/acl/token/clone/token_clone_test.go src/github.com/hashicorp/consul/command/acl/token/create/token_create.go src/github.com/hashicorp/consul/command/acl/token/create/token_create_test.go src/github.com/hashicorp/consul/command/acl/token/delete/token_delete.go src/github.com/hashicorp/consul/command/acl/token/delete/token_delete_test.go src/github.com/hashicorp/consul/command/acl/token/list/token_list.go src/github.com/hashicorp/consul/command/acl/token/list/token_list_test.go src/github.com/hashicorp/consul/command/acl/token/read/token_read.go src/github.com/hashicorp/consul/command/acl/token/read/token_read_test.go src/github.com/hashicorp/consul/command/acl/token/update/token_update.go src/github.com/hashicorp/consul/command/acl/token/update/token_update_test.go src/github.com/hashicorp/consul/command/agent/agent.go src/github.com/hashicorp/consul/command/agent/agent_test.go src/github.com/hashicorp/consul/command/catalog/catalog.go src/github.com/hashicorp/consul/command/catalog/catalog_test.go src/github.com/hashicorp/consul/command/catalog/list/dc/catalog_list_datacenters.go src/github.com/hashicorp/consul/command/catalog/list/dc/catalog_list_datacenters_test.go src/github.com/hashicorp/consul/command/catalog/list/nodes/catalog_list_nodes.go src/github.com/hashicorp/consul/command/catalog/list/nodes/catalog_list_nodes_test.go src/github.com/hashicorp/consul/command/catalog/list/services/catalog_list_services.go src/github.com/hashicorp/consul/command/catalog/list/services/catalog_list_services_test.go src/github.com/hashicorp/consul/command/config/config.go src/github.com/hashicorp/consul/command/config/delete/config_delete.go src/github.com/hashicorp/consul/command/config/delete/config_delete_test.go src/github.com/hashicorp/consul/command/config/list/config_list.go src/github.com/hashicorp/consul/command/config/list/config_list_test.go src/github.com/hashicorp/consul/command/config/read/config_read.go src/github.com/hashicorp/consul/command/config/read/config_read_test.go src/github.com/hashicorp/consul/command/config/write/config_write.go src/github.com/hashicorp/consul/command/config/write/config_write_test.go src/github.com/hashicorp/consul/command/config/write/decode_shim.go src/github.com/hashicorp/consul/command/connect/connect.go src/github.com/hashicorp/consul/command/connect/connect_test.go src/github.com/hashicorp/consul/command/connect/ca/ca.go src/github.com/hashicorp/consul/command/connect/ca/ca_test.go src/github.com/hashicorp/consul/command/connect/ca/get/connect_ca_get.go src/github.com/hashicorp/consul/command/connect/ca/get/connect_ca_get_test.go src/github.com/hashicorp/consul/command/connect/ca/set/connect_ca_set.go src/github.com/hashicorp/consul/command/connect/ca/set/connect_ca_set_test.go src/github.com/hashicorp/consul/command/connect/envoy/bootstrap_config.go src/github.com/hashicorp/consul/command/connect/envoy/bootstrap_config_test.go src/github.com/hashicorp/consul/command/connect/envoy/bootstrap_tpl.go src/github.com/hashicorp/consul/command/connect/envoy/envoy.go src/github.com/hashicorp/consul/command/connect/envoy/envoy_test.go src/github.com/hashicorp/consul/command/connect/envoy/exec_test.go src/github.com/hashicorp/consul/command/connect/envoy/exec_unix.go src/github.com/hashicorp/consul/command/connect/envoy/flags.go src/github.com/hashicorp/consul/command/connect/envoy/flags_test.go src/github.com/hashicorp/consul/command/connect/envoy/pipe-bootstrap/connect_envoy_pipe-bootstrap.go src/github.com/hashicorp/consul/command/connect/envoy/pipe-bootstrap/connect_envoy_pipe-bootstrap_test.go src/github.com/hashicorp/consul/command/connect/expose/expose.go src/github.com/hashicorp/consul/command/connect/expose/expose_test.go src/github.com/hashicorp/consul/command/connect/proxy/flag_upstreams.go src/github.com/hashicorp/consul/command/connect/proxy/flag_upstreams_test.go src/github.com/hashicorp/consul/command/connect/proxy/proxy.go src/github.com/hashicorp/consul/command/connect/proxy/proxy_test.go src/github.com/hashicorp/consul/command/connect/proxy/register.go src/github.com/hashicorp/consul/command/connect/proxy/register_test.go src/github.com/hashicorp/consul/command/debug/debug.go src/github.com/hashicorp/consul/command/debug/debug_test.go src/github.com/hashicorp/consul/command/event/event.go src/github.com/hashicorp/consul/command/event/event_test.go src/github.com/hashicorp/consul/command/exec/exec.go src/github.com/hashicorp/consul/command/exec/exec_test.go src/github.com/hashicorp/consul/command/flags/config.go src/github.com/hashicorp/consul/command/flags/config_test.go src/github.com/hashicorp/consul/command/flags/flag_map_value.go src/github.com/hashicorp/consul/command/flags/flag_map_value_test.go src/github.com/hashicorp/consul/command/flags/flag_slice_value.go src/github.com/hashicorp/consul/command/flags/flag_slice_value_test.go src/github.com/hashicorp/consul/command/flags/http.go src/github.com/hashicorp/consul/command/flags/http_test.go src/github.com/hashicorp/consul/command/flags/merge.go src/github.com/hashicorp/consul/command/flags/usage.go src/github.com/hashicorp/consul/command/forceleave/forceleave.go src/github.com/hashicorp/consul/command/forceleave/forceleave_test.go src/github.com/hashicorp/consul/command/helpers/helpers.go src/github.com/hashicorp/consul/command/info/info.go src/github.com/hashicorp/consul/command/info/info_test.go src/github.com/hashicorp/consul/command/intention/intention.go src/github.com/hashicorp/consul/command/intention/intention_test.go src/github.com/hashicorp/consul/command/intention/check/check.go src/github.com/hashicorp/consul/command/intention/check/check_test.go src/github.com/hashicorp/consul/command/intention/create/create.go src/github.com/hashicorp/consul/command/intention/create/create_test.go src/github.com/hashicorp/consul/command/intention/delete/delete.go src/github.com/hashicorp/consul/command/intention/delete/delete_test.go src/github.com/hashicorp/consul/command/intention/finder/finder.go src/github.com/hashicorp/consul/command/intention/finder/finder_test.go src/github.com/hashicorp/consul/command/intention/get/get.go src/github.com/hashicorp/consul/command/intention/get/get_test.go src/github.com/hashicorp/consul/command/intention/match/match.go src/github.com/hashicorp/consul/command/intention/match/match_test.go src/github.com/hashicorp/consul/command/join/join.go src/github.com/hashicorp/consul/command/join/join_test.go src/github.com/hashicorp/consul/command/keygen/keygen.go src/github.com/hashicorp/consul/command/keygen/keygen_test.go src/github.com/hashicorp/consul/command/keyring/keyring.go src/github.com/hashicorp/consul/command/keyring/keyring_test.go src/github.com/hashicorp/consul/command/kv/kv.go src/github.com/hashicorp/consul/command/kv/kv_test.go src/github.com/hashicorp/consul/command/kv/del/kv_delete.go src/github.com/hashicorp/consul/command/kv/del/kv_delete_test.go src/github.com/hashicorp/consul/command/kv/exp/kv_export.go src/github.com/hashicorp/consul/command/kv/exp/kv_export_test.go src/github.com/hashicorp/consul/command/kv/get/kv_get.go src/github.com/hashicorp/consul/command/kv/get/kv_get_test.go src/github.com/hashicorp/consul/command/kv/imp/kv_import.go src/github.com/hashicorp/consul/command/kv/imp/kv_import_test.go src/github.com/hashicorp/consul/command/kv/impexp/kvimpexp.go src/github.com/hashicorp/consul/command/kv/put/kv_put.go src/github.com/hashicorp/consul/command/kv/put/kv_put_test.go src/github.com/hashicorp/consul/command/leave/leave.go src/github.com/hashicorp/consul/command/leave/leave_test.go src/github.com/hashicorp/consul/command/lock/lock.go src/github.com/hashicorp/consul/command/lock/lock_test.go src/github.com/hashicorp/consul/command/lock/util_unix.go src/github.com/hashicorp/consul/command/login/login.go src/github.com/hashicorp/consul/command/login/login_oss.go src/github.com/hashicorp/consul/command/login/login_test.go src/github.com/hashicorp/consul/command/logout/logout.go src/github.com/hashicorp/consul/command/logout/logout_test.go src/github.com/hashicorp/consul/command/maint/maint.go src/github.com/hashicorp/consul/command/maint/maint_test.go src/github.com/hashicorp/consul/command/members/members.go src/github.com/hashicorp/consul/command/members/members_test.go src/github.com/hashicorp/consul/command/monitor/monitor.go src/github.com/hashicorp/consul/command/monitor/monitor_test.go src/github.com/hashicorp/consul/command/operator/operator.go src/github.com/hashicorp/consul/command/operator/operator_test.go src/github.com/hashicorp/consul/command/operator/autopilot/operator_autopilot.go src/github.com/hashicorp/consul/command/operator/autopilot/operator_autopilot_test.go src/github.com/hashicorp/consul/command/operator/autopilot/get/operator_autopilot_get.go src/github.com/hashicorp/consul/command/operator/autopilot/get/operator_autopilot_get_test.go src/github.com/hashicorp/consul/command/operator/autopilot/set/operator_autopilot_set.go src/github.com/hashicorp/consul/command/operator/autopilot/set/operator_autopilot_set_test.go src/github.com/hashicorp/consul/command/operator/raft/operator_raft.go src/github.com/hashicorp/consul/command/operator/raft/operator_raft_test.go src/github.com/hashicorp/consul/command/operator/raft/listpeers/operator_raft_list.go src/github.com/hashicorp/consul/command/operator/raft/listpeers/operator_raft_list_test.go src/github.com/hashicorp/consul/command/operator/raft/removepeer/operator_raft_remove.go src/github.com/hashicorp/consul/command/operator/raft/removepeer/operator_raft_remove_test.go src/github.com/hashicorp/consul/command/reload/reload.go src/github.com/hashicorp/consul/command/reload/reload_test.go src/github.com/hashicorp/consul/command/rtt/rtt.go src/github.com/hashicorp/consul/command/rtt/rtt_test.go src/github.com/hashicorp/consul/command/services/config.go src/github.com/hashicorp/consul/command/services/config_test.go src/github.com/hashicorp/consul/command/services/services.go src/github.com/hashicorp/consul/command/services/services_test.go src/github.com/hashicorp/consul/command/services/deregister/deregister.go src/github.com/hashicorp/consul/command/services/deregister/deregister_test.go src/github.com/hashicorp/consul/command/services/register/register.go src/github.com/hashicorp/consul/command/services/register/register_test.go src/github.com/hashicorp/consul/command/snapshot/snapshot_command.go src/github.com/hashicorp/consul/command/snapshot/snapshot_command_test.go src/github.com/hashicorp/consul/command/snapshot/inspect/snapshot_inspect.go src/github.com/hashicorp/consul/command/snapshot/inspect/snapshot_inspect_test.go src/github.com/hashicorp/consul/command/snapshot/restore/snapshot_restore.go src/github.com/hashicorp/consul/command/snapshot/restore/snapshot_restore_test.go src/github.com/hashicorp/consul/command/snapshot/save/snapshot_save.go src/github.com/hashicorp/consul/command/snapshot/save/snapshot_save_test.go src/github.com/hashicorp/consul/command/tls/tls.go src/github.com/hashicorp/consul/command/tls/tls_test.go src/github.com/hashicorp/consul/command/tls/ca/tls_ca.go src/github.com/hashicorp/consul/command/tls/ca/tls_ca_test.go src/github.com/hashicorp/consul/command/tls/ca/create/tls_ca_create.go src/github.com/hashicorp/consul/command/tls/ca/create/tls_ca_create_test.go src/github.com/hashicorp/consul/command/tls/cert/tls_cert.go src/github.com/hashicorp/consul/command/tls/cert/tls_cert_test.go src/github.com/hashicorp/consul/command/tls/cert/create/tls_cert_create.go src/github.com/hashicorp/consul/command/tls/cert/create/tls_cert_create_test.go src/github.com/hashicorp/consul/command/validate/validate.go src/github.com/hashicorp/consul/command/validate/validate_test.go src/github.com/hashicorp/consul/command/version/formatter.go src/github.com/hashicorp/consul/command/version/formatter_test.go src/github.com/hashicorp/consul/command/version/version.go src/github.com/hashicorp/consul/command/version/version_test.go src/github.com/hashicorp/consul/command/watch/watch.go src/github.com/hashicorp/consul/command/watch/watch_test.go src/github.com/hashicorp/consul/connect/example_test.go src/github.com/hashicorp/consul/connect/resolver.go src/github.com/hashicorp/consul/connect/resolver_test.go src/github.com/hashicorp/consul/connect/service.go src/github.com/hashicorp/consul/connect/service_test.go src/github.com/hashicorp/consul/connect/testing.go src/github.com/hashicorp/consul/connect/tls.go src/github.com/hashicorp/consul/connect/tls_test.go src/github.com/hashicorp/consul/connect/certgen/certgen.go src/github.com/hashicorp/consul/connect/proxy/config.go src/github.com/hashicorp/consul/connect/proxy/config_test.go src/github.com/hashicorp/consul/connect/proxy/conn.go src/github.com/hashicorp/consul/connect/proxy/conn_test.go src/github.com/hashicorp/consul/connect/proxy/listener.go src/github.com/hashicorp/consul/connect/proxy/listener_test.go src/github.com/hashicorp/consul/connect/proxy/proxy.go src/github.com/hashicorp/consul/connect/proxy/proxy_test.go src/github.com/hashicorp/consul/connect/proxy/testing.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/auth.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/config.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/config_test.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/jwt.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/jwt_test.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/oidc.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/oidc_test.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcjwt.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcjwt_test.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/util.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/util_test.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/internal/strutil/util.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/internal/strutil/util_test.go src/github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcauthtest/testing.go src/github.com/hashicorp/consul/ipaddr/detect.go src/github.com/hashicorp/consul/ipaddr/detect_test.go src/github.com/hashicorp/consul/ipaddr/ipaddr.go src/github.com/hashicorp/consul/ipaddr/ipaddr_test.go src/github.com/hashicorp/consul/lib/cluster.go src/github.com/hashicorp/consul/lib/cluster_test.go src/github.com/hashicorp/consul/lib/eof.go src/github.com/hashicorp/consul/lib/json.go src/github.com/hashicorp/consul/lib/map_walker.go src/github.com/hashicorp/consul/lib/map_walker_test.go src/github.com/hashicorp/consul/lib/math.go src/github.com/hashicorp/consul/lib/path.go src/github.com/hashicorp/consul/lib/rand.go src/github.com/hashicorp/consul/lib/retry.go src/github.com/hashicorp/consul/lib/retry_test.go src/github.com/hashicorp/consul/lib/rtt.go src/github.com/hashicorp/consul/lib/rtt_test.go src/github.com/hashicorp/consul/lib/serf.go src/github.com/hashicorp/consul/lib/stop_context.go src/github.com/hashicorp/consul/lib/stop_context_test.go src/github.com/hashicorp/consul/lib/telemetry.go src/github.com/hashicorp/consul/lib/telemetry_test.go src/github.com/hashicorp/consul/lib/testing_httpserver.go src/github.com/hashicorp/consul/lib/translate.go src/github.com/hashicorp/consul/lib/translate_test.go src/github.com/hashicorp/consul/lib/useragent.go src/github.com/hashicorp/consul/lib/useragent_test.go src/github.com/hashicorp/consul/lib/uuid.go src/github.com/hashicorp/consul/lib/math_test.go src/github.com/hashicorp/consul/lib/decode/decode.go src/github.com/hashicorp/consul/lib/decode/decode_test.go src/github.com/hashicorp/consul/lib/file/atomic.go src/github.com/hashicorp/consul/lib/file/atomic_test.go src/github.com/hashicorp/consul/lib/semaphore/semaphore.go src/github.com/hashicorp/consul/lib/semaphore/semaphore_test.go src/github.com/hashicorp/consul/lib/stringslice/stringslice.go src/github.com/hashicorp/consul/lib/stringslice/stringslice_test.go src/github.com/hashicorp/consul/lib/template/hil.go src/github.com/hashicorp/consul/lib/template/hil_test.go src/github.com/hashicorp/consul/logging/gated_writer.go src/github.com/hashicorp/consul/logging/gated_writer_test.go src/github.com/hashicorp/consul/logging/grpc.go src/github.com/hashicorp/consul/logging/grpc_test.go src/github.com/hashicorp/consul/logging/log_levels.go src/github.com/hashicorp/consul/logging/logfile.go src/github.com/hashicorp/consul/logging/logfile_test.go src/github.com/hashicorp/consul/logging/logger.go src/github.com/hashicorp/consul/logging/logger_test.go src/github.com/hashicorp/consul/logging/names.go src/github.com/hashicorp/consul/logging/syslog.go src/github.com/hashicorp/consul/logging/monitor/monitor.go src/github.com/hashicorp/consul/logging/monitor/monitor_test.go src/github.com/hashicorp/consul/proto/translate.go src/github.com/hashicorp/consul/proto/translate_test.go src/github.com/hashicorp/consul/proto/pbacl/acl.pb.binary.go src/github.com/hashicorp/consul/proto/pbacl/acl.pb.go src/github.com/hashicorp/consul/proto/pbautoconf/auto_config.go src/github.com/hashicorp/consul/proto/pbautoconf/auto_config.pb.binary.go src/github.com/hashicorp/consul/proto/pbautoconf/auto_config.pb.go src/github.com/hashicorp/consul/proto/pbcommon/common.go src/github.com/hashicorp/consul/proto/pbcommon/common.pb.binary.go src/github.com/hashicorp/consul/proto/pbcommon/common.pb.go src/github.com/hashicorp/consul/proto/pbcommon/common_oss.pb.binary.go src/github.com/hashicorp/consul/proto/pbcommon/common_oss.pb.go src/github.com/hashicorp/consul/proto/pbconfig/config.pb.binary.go src/github.com/hashicorp/consul/proto/pbconfig/config.pb.go src/github.com/hashicorp/consul/proto/pbconnect/connect.pb.binary.go src/github.com/hashicorp/consul/proto/pbconnect/connect.pb.go src/github.com/hashicorp/consul/sdk/freeport/ephemeral_linux.go src/github.com/hashicorp/consul/sdk/freeport/ephemeral_linux_test.go src/github.com/hashicorp/consul/sdk/freeport/freeport.go src/github.com/hashicorp/consul/sdk/freeport/freeport_test.go src/github.com/hashicorp/consul/sdk/freeport/systemlimit.go src/github.com/hashicorp/consul/sdk/testutil/assertions.go src/github.com/hashicorp/consul/sdk/testutil/io.go src/github.com/hashicorp/consul/sdk/testutil/server.go src/github.com/hashicorp/consul/sdk/testutil/server_methods.go src/github.com/hashicorp/consul/sdk/testutil/server_wrapper.go src/github.com/hashicorp/consul/sdk/testutil/testlog.go src/github.com/hashicorp/consul/sdk/testutil/retry/retry.go src/github.com/hashicorp/consul/sdk/testutil/retry/retry_test.go src/github.com/hashicorp/consul/sentinel/evaluator.go src/github.com/hashicorp/consul/sentinel/scope.go src/github.com/hashicorp/consul/sentinel/sentinel_oss.go src/github.com/hashicorp/consul/service_os/service.go src/github.com/hashicorp/consul/snapshot/archive.go src/github.com/hashicorp/consul/snapshot/archive_test.go src/github.com/hashicorp/consul/snapshot/snapshot.go src/github.com/hashicorp/consul/snapshot/snapshot_test.go src/github.com/hashicorp/consul/testrpc/wait.go src/github.com/hashicorp/consul/tlsutil/config.go src/github.com/hashicorp/consul/tlsutil/config_test.go src/github.com/hashicorp/consul/tlsutil/generate.go src/github.com/hashicorp/consul/tlsutil/generate_test.go src/github.com/hashicorp/consul/types/area.go src/github.com/hashicorp/consul/types/checks.go src/github.com/hashicorp/consul/types/node_id.go src/github.com/hashicorp/consul/version/version.go cd _build && go install -trimpath -v -p 7 github.com/hashicorp/consul github.com/hashicorp/consul/acl github.com/hashicorp/consul/agent github.com/hashicorp/consul/agent/ae github.com/hashicorp/consul/agent/auto-config github.com/hashicorp/consul/agent/cache github.com/hashicorp/consul/agent/cache-types github.com/hashicorp/consul/agent/checks github.com/hashicorp/consul/agent/config github.com/hashicorp/consul/agent/connect github.com/hashicorp/consul/agent/connect/ca github.com/hashicorp/consul/agent/consul github.com/hashicorp/consul/agent/consul/authmethod github.com/hashicorp/consul/agent/consul/authmethod/kubeauth github.com/hashicorp/consul/agent/consul/authmethod/ssoauth github.com/hashicorp/consul/agent/consul/authmethod/testauth github.com/hashicorp/consul/agent/consul/autopilot github.com/hashicorp/consul/agent/consul/discoverychain github.com/hashicorp/consul/agent/consul/fsm github.com/hashicorp/consul/agent/consul/prepared_query github.com/hashicorp/consul/agent/consul/state github.com/hashicorp/consul/agent/consul/wanfed github.com/hashicorp/consul/agent/debug github.com/hashicorp/consul/agent/dns github.com/hashicorp/consul/agent/exec github.com/hashicorp/consul/agent/local github.com/hashicorp/consul/agent/metadata github.com/hashicorp/consul/agent/mock github.com/hashicorp/consul/agent/pool github.com/hashicorp/consul/agent/proxycfg github.com/hashicorp/consul/agent/router github.com/hashicorp/consul/agent/structs github.com/hashicorp/consul/agent/systemd github.com/hashicorp/consul/agent/token github.com/hashicorp/consul/agent/xds github.com/hashicorp/consul/agent/xds/proxysupport github.com/hashicorp/consul/api github.com/hashicorp/consul/api/watch github.com/hashicorp/consul/command github.com/hashicorp/consul/command/acl github.com/hashicorp/consul/command/acl/agenttokens github.com/hashicorp/consul/command/acl/authmethod github.com/hashicorp/consul/command/acl/authmethod/create github.com/hashicorp/consul/command/acl/authmethod/delete github.com/hashicorp/consul/command/acl/authmethod/list github.com/hashicorp/consul/command/acl/authmethod/read github.com/hashicorp/consul/command/acl/authmethod/update github.com/hashicorp/consul/command/acl/bindingrule github.com/hashicorp/consul/command/acl/bindingrule/create github.com/hashicorp/consul/command/acl/bindingrule/delete github.com/hashicorp/consul/command/acl/bindingrule/list github.com/hashicorp/consul/command/acl/bindingrule/read github.com/hashicorp/consul/command/acl/bindingrule/update github.com/hashicorp/consul/command/acl/bootstrap github.com/hashicorp/consul/command/acl/policy github.com/hashicorp/consul/command/acl/policy/create github.com/hashicorp/consul/command/acl/policy/delete github.com/hashicorp/consul/command/acl/policy/list github.com/hashicorp/consul/command/acl/policy/read github.com/hashicorp/consul/command/acl/policy/update github.com/hashicorp/consul/command/acl/role github.com/hashicorp/consul/command/acl/role/create github.com/hashicorp/consul/command/acl/role/delete github.com/hashicorp/consul/command/acl/role/list github.com/hashicorp/consul/command/acl/role/read github.com/hashicorp/consul/command/acl/role/update github.com/hashicorp/consul/command/acl/rules github.com/hashicorp/consul/command/acl/token github.com/hashicorp/consul/command/acl/token/clone github.com/hashicorp/consul/command/acl/token/create github.com/hashicorp/consul/command/acl/token/delete github.com/hashicorp/consul/command/acl/token/list github.com/hashicorp/consul/command/acl/token/read github.com/hashicorp/consul/command/acl/token/update github.com/hashicorp/consul/command/agent github.com/hashicorp/consul/command/catalog github.com/hashicorp/consul/command/catalog/list/dc github.com/hashicorp/consul/command/catalog/list/nodes github.com/hashicorp/consul/command/catalog/list/services github.com/hashicorp/consul/command/config github.com/hashicorp/consul/command/config/delete github.com/hashicorp/consul/command/config/list github.com/hashicorp/consul/command/config/read github.com/hashicorp/consul/command/config/write github.com/hashicorp/consul/command/connect github.com/hashicorp/consul/command/connect/ca github.com/hashicorp/consul/command/connect/ca/get github.com/hashicorp/consul/command/connect/ca/set github.com/hashicorp/consul/command/connect/envoy github.com/hashicorp/consul/command/connect/envoy/pipe-bootstrap github.com/hashicorp/consul/command/connect/expose github.com/hashicorp/consul/command/connect/proxy github.com/hashicorp/consul/command/debug github.com/hashicorp/consul/command/event github.com/hashicorp/consul/command/exec github.com/hashicorp/consul/command/flags github.com/hashicorp/consul/command/forceleave github.com/hashicorp/consul/command/helpers github.com/hashicorp/consul/command/info github.com/hashicorp/consul/command/intention github.com/hashicorp/consul/command/intention/check github.com/hashicorp/consul/command/intention/create github.com/hashicorp/consul/command/intention/delete github.com/hashicorp/consul/command/intention/finder github.com/hashicorp/consul/command/intention/get github.com/hashicorp/consul/command/intention/match github.com/hashicorp/consul/command/join github.com/hashicorp/consul/command/keygen github.com/hashicorp/consul/command/keyring github.com/hashicorp/consul/command/kv github.com/hashicorp/consul/command/kv/del github.com/hashicorp/consul/command/kv/exp github.com/hashicorp/consul/command/kv/get github.com/hashicorp/consul/command/kv/imp github.com/hashicorp/consul/command/kv/impexp github.com/hashicorp/consul/command/kv/put github.com/hashicorp/consul/command/leave github.com/hashicorp/consul/command/lock github.com/hashicorp/consul/command/login github.com/hashicorp/consul/command/logout github.com/hashicorp/consul/command/maint github.com/hashicorp/consul/command/members github.com/hashicorp/consul/command/monitor github.com/hashicorp/consul/command/operator github.com/hashicorp/consul/command/operator/autopilot github.com/hashicorp/consul/command/operator/autopilot/get github.com/hashicorp/consul/command/operator/autopilot/set github.com/hashicorp/consul/command/operator/raft github.com/hashicorp/consul/command/operator/raft/listpeers github.com/hashicorp/consul/command/operator/raft/removepeer github.com/hashicorp/consul/command/reload github.com/hashicorp/consul/command/rtt github.com/hashicorp/consul/command/services github.com/hashicorp/consul/command/services/deregister github.com/hashicorp/consul/command/services/register github.com/hashicorp/consul/command/snapshot github.com/hashicorp/consul/command/snapshot/inspect github.com/hashicorp/consul/command/snapshot/restore github.com/hashicorp/consul/command/snapshot/save github.com/hashicorp/consul/command/tls github.com/hashicorp/consul/command/tls/ca github.com/hashicorp/consul/command/tls/ca/create github.com/hashicorp/consul/command/tls/cert github.com/hashicorp/consul/command/tls/cert/create github.com/hashicorp/consul/command/validate github.com/hashicorp/consul/command/version github.com/hashicorp/consul/command/watch github.com/hashicorp/consul/connect github.com/hashicorp/consul/connect/certgen github.com/hashicorp/consul/connect/proxy github.com/hashicorp/consul/internal/go-sso/oidcauth github.com/hashicorp/consul/internal/go-sso/oidcauth/internal/strutil github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcauthtest github.com/hashicorp/consul/ipaddr github.com/hashicorp/consul/lib github.com/hashicorp/consul/lib/decode github.com/hashicorp/consul/lib/file github.com/hashicorp/consul/lib/semaphore github.com/hashicorp/consul/lib/stringslice github.com/hashicorp/consul/lib/template github.com/hashicorp/consul/logging github.com/hashicorp/consul/logging/monitor github.com/hashicorp/consul/proto github.com/hashicorp/consul/proto/pbacl github.com/hashicorp/consul/proto/pbautoconf github.com/hashicorp/consul/proto/pbcommon github.com/hashicorp/consul/proto/pbconfig github.com/hashicorp/consul/proto/pbconnect github.com/hashicorp/consul/sdk/freeport github.com/hashicorp/consul/sdk/testutil github.com/hashicorp/consul/sdk/testutil/retry github.com/hashicorp/consul/sentinel github.com/hashicorp/consul/service_os github.com/hashicorp/consul/snapshot github.com/hashicorp/consul/testrpc github.com/hashicorp/consul/tlsutil github.com/hashicorp/consul/types github.com/hashicorp/consul/version internal/unsafeheader unicode/utf8 math/bits internal/race runtime/internal/atomic internal/cpu runtime/internal/sys sync/atomic unicode encoding unicode/utf16 container/list runtime/internal/math internal/testlog math internal/nettrace internal/bytealg crypto/internal/subtle runtime/cgo crypto/subtle vendor/golang.org/x/crypto/cryptobyte/asn1 vendor/golang.org/x/crypto/internal/subtle github.com/circonus-labs/circonus-gometrics/api/config golang.org/x/sys/internal/unsafeheader golang.org/x/net/internal/iana github.com/hashicorp/consul/lib/stringslice github.com/hashicorp/consul/types google.golang.org/grpc/serviceconfig github.com/aws/aws-sdk-go/aws/client/metadata github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/selection github.com/hashicorp/consul/vendor/k8s.io/utils/integer github.com/hashicorp/consul/internal/go-sso/oidcauth/internal/strutil github.com/golang/groupcache/lru go.opencensus.io go.opencensus.io/trace/internal go.opencensus.io/internal/tagencoding github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/pkg/wellknown runtime github.com/hashicorp/consul/agent/xds/proxysupport github.com/hashicorp/consul/service_os github.com/aws/aws-sdk-go/internal/sdkmath internal/reflectlite sync internal/singleflight google.golang.org/grpc/internal/buffer math/rand google.golang.org/grpc/internal/grpcsync github.com/aws/aws-sdk-go/internal/sync/singleflight github.com/hashicorp/consul/agent/token errors sort io strconv internal/oserror github.com/hashicorp/golang-lru/simplelru github.com/hashicorp/hcl/hcl/strconv vendor/golang.org/x/net/dns/dnsmessage syscall container/heap github.com/gogo/protobuf/sortkeys github.com/beorn7/perks/quantile hash bytes strings text/tabwriter hash/crc32 crypto/internal/randutil crypto/hmac hash/crc64 reflect crypto crypto/rc4 vendor/golang.org/x/crypto/hkdf github.com/armon/go-radix regexp/syntax bufio github.com/hashicorp/go-immutable-radix vendor/golang.org/x/text/transform path github.com/prometheus/common/internal/bitbucket.org/ww/goautoneg html encoding/base32 hash/fnv internal/syscall/unix time internal/syscall/execenv github.com/kr/text google.golang.org/grpc/encoding golang.org/x/text/transform github.com/aws/aws-sdk-go/internal/sdkio github.com/aws/aws-sdk-go/internal/strings github.com/aws/aws-sdk-go/internal/sdkuri github.com/ryanuber/go-glob golang.org/x/crypto/pbkdf2 regexp internal/poll google.golang.org/grpc/backoff context google.golang.org/grpc/internal/grpcrand google.golang.org/grpc/keepalive github.com/aws/aws-sdk-go/internal/sdkrand github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/clock google.golang.org/grpc/internal/backoff internal/fmtsort encoding/binary github.com/hashicorp/errwrap github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/sets github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/version google.golang.org/grpc/tap github.com/hashicorp/consul/lib/semaphore github.com/hashicorp/consul/agent/dns google.golang.org/api/internal/third_party/uritemplates golang.org/x/net/context os crypto/md5 encoding/base64 golang.org/x/crypto/blake2b crypto/cipher crypto/sha512 crypto/ed25519/internal/edwards25519 crypto/sha1 crypto/aes crypto/des crypto/sha256 encoding/pem vendor/golang.org/x/crypto/chacha20 vendor/golang.org/x/crypto/poly1305 fmt net path/filepath os/signal vendor/golang.org/x/crypto/chacha20poly1305 github.com/cespare/xxhash runtime/debug google.golang.org/grpc/internal/envconfig golang.org/x/sys/unix io/ioutil os/exec github.com/aws/aws-sdk-go/internal/shareddefaults github.com/prometheus/procfs/internal/util github.com/golang/snappy encoding/json github.com/hashicorp/hcl/hcl/token log compress/flate github.com/hashicorp/hcl/hcl/ast github.com/hashicorp/hcl/hcl/scanner github.com/hashicorp/hcl/json/token github.com/hashicorp/hcl/json/scanner math/big github.com/hashicorp/hcl/hcl/parser github.com/hashicorp/hcl/json/parser compress/gzip github.com/hashicorp/hcl/hcl/printer github.com/hashicorp/hcl encoding/hex net/url vendor/golang.org/x/crypto/curve25519 vendor/golang.org/x/text/unicode/bidi github.com/hashicorp/consul/acl vendor/golang.org/x/text/unicode/norm vendor/golang.org/x/text/secure/bidirule vendor/golang.org/x/net/http2/hpack mime mime/quotedprintable github.com/pkg/errors net/http/internal github.com/circonus-labs/circonusllhist crypto/rand github.com/golang/protobuf/proto crypto/elliptic encoding/asn1 crypto/dsa crypto/ed25519 crypto/rsa vendor/golang.org/x/net/idna github.com/prometheus/common/model github.com/prometheus/procfs/internal/fs vendor/golang.org/x/crypto/cryptobyte crypto/x509/pkix github.com/mitchellh/go-testing-interface github.com/hashicorp/consul/version github.com/hashicorp/go-uuid encoding/gob go/token crypto/ecdsa text/template/parse compress/lzw github.com/google/btree github.com/hashicorp/go-multierror golang.org/x/crypto/ed25519 golang.org/x/net/bpf github.com/hashicorp/memberlist/vendor/github.com/sean-/seed github.com/mitchellh/reflectwalk github.com/davecgh/go-spew/spew github.com/mitchellh/copystructure github.com/pmezard/go-difflib/difflib text/template github.com/stretchr/objx flag gopkg.in/yaml.v3 golang.org/x/time/rate github.com/mattn/go-isatty github.com/golang/protobuf/ptypes/any crypto/x509 net/textproto vendor/golang.org/x/net/http/httpproxy github.com/DataDog/datadog-go/statsd github.com/golang/protobuf/ptypes/duration vendor/golang.org/x/net/http/httpguts mime/multipart github.com/golang/protobuf/ptypes/timestamp github.com/matttproud/golang_protobuf_extensions/pbutil github.com/golang/protobuf/ptypes github.com/prometheus/client_model/go github.com/prometheus/procfs github.com/hashicorp/consul/ipaddr github.com/hashicorp/consul/sdk/freeport html/template github.com/hashicorp/go-sockaddr github.com/prometheus/client_golang/prometheus/internal golang.org/x/net/internal/socket github.com/hashicorp/yamux crypto/tls github.com/mitchellh/mapstructure golang.org/x/net/ipv4 golang.org/x/net/ipv6 github.com/mattn/go-colorable github.com/fatih/color github.com/hashicorp/go-hclog log/syslog github.com/hashicorp/go-version runtime/trace github.com/hashicorp/go-syslog github.com/hashicorp/consul/lib/decode testing github.com/hashicorp/golang-lru github.com/mitchellh/hashstructure github.com/bgentry/speakeasy os/user github.com/hashicorp/consul/command/helpers github.com/armon/circbuf github.com/golang/protobuf/ptypes/struct github.com/hashicorp/consul/logging golang.org/x/net/internal/socks github.com/hashicorp/consul/agent/exec github.com/golang/protobuf/jsonpb golang.org/x/net/internal/timeseries google.golang.org/grpc/grpclog golang.org/x/net/proxy google.golang.org/grpc/credentials/internal google.golang.org/grpc/metadata google.golang.org/grpc/attributes google.golang.org/grpc/connectivity google.golang.org/grpc/codes google.golang.org/grpc/encoding/proto google.golang.org/grpc/internal google.golang.org/grpc/internal/balancerload google.golang.org/grpc/binarylog/grpc_binarylog_v1 google.golang.org/genproto/googleapis/rpc/status golang.org/x/text/unicode/norm golang.org/x/text/unicode/bidi golang.org/x/net/http2/hpack google.golang.org/grpc/status net/http/httptrace github.com/hashicorp/go-rootcerts github.com/miekg/dns google.golang.org/grpc/credentials net/http google.golang.org/grpc/internal/binarylog google.golang.org/grpc/resolver google.golang.org/grpc/internal/channelz google.golang.org/grpc/balancer google.golang.org/grpc/internal/resolver/dns google.golang.org/grpc/internal/resolver/passthrough google.golang.org/grpc/balancer/base golang.org/x/text/secure/bidirule google.golang.org/grpc/balancer/roundrobin google.golang.org/grpc/internal/syscall google.golang.org/grpc/peer google.golang.org/grpc/stats golang.org/x/net/idna google.golang.org/grpc/naming github.com/aws/aws-sdk-go/aws/awserr github.com/jmespath/go-jmespath encoding/xml github.com/aws/aws-sdk-go/internal/ini golang.org/x/net/http/httpguts github.com/posener/complete/cmd/install github.com/aws/aws-sdk-go/aws/endpoints github.com/aws/aws-sdk-go/aws/credentials github.com/aws/aws-sdk-go/aws/awsutil github.com/posener/complete/cmd github.com/hashicorp/hil/ast github.com/aws/aws-sdk-go/aws/credentials/processcreds github.com/posener/complete github.com/hashicorp/hil github.com/gogo/protobuf/proto github.com/hashicorp/go-memdb github.com/mitchellh/cli github.com/hashicorp/consul/sdk/testutil/retry github.com/hashicorp/consul/vendor/github.com/hashicorp/vault/sdk/helper/consts github.com/hashicorp/consul/vendor/github.com/hashicorp/vault/sdk/helper/hclutil github.com/pierrec/lz4/internal/xxh32 github.com/hashicorp/consul/vendor/github.com/hashicorp/vault/sdk/helper/strutil gopkg.in/square/go-jose.v2/cipher github.com/pierrec/lz4 github.com/hashicorp/consul/vendor/github.com/hashicorp/vault/sdk/helper/parseutil gopkg.in/square/go-jose.v2/json github.com/hashicorp/go-bexpr github.com/hashicorp/consul/vendor/github.com/hashicorp/vault/sdk/helper/compressutil github.com/hashicorp/consul/vendor/github.com/hashicorp/vault/sdk/helper/jsonutil github.com/google/gofuzz/bytesource github.com/google/gofuzz gopkg.in/inf.v0 gopkg.in/square/go-jose.v2 github.com/hashicorp/consul/vendor/k8s.io/apimachinery/third_party/forked/golang/reflect github.com/hashicorp/consul/vendor/github.com/coredns/coredns/plugin/pkg/dnsutil github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/fields github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/errors github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/validation/field github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/conversion github.com/hashicorp/consul/vendor/k8s.io/klog github.com/armon/go-metrics github.com/hashicorp/go-cleanhttp github.com/hashicorp/go-retryablehttp github.com/tv42/httpunix expvar github.com/prometheus/common/expfmt github.com/armon/go-metrics/datadog github.com/hashicorp/serf/coordinate net/rpc github.com/circonus-labs/circonus-gometrics/api net/http/httptest github.com/NYTimes/gziphandler github.com/hashicorp/consul/api github.com/stretchr/testify/assert github.com/elazarl/go-bindata-assetfs github.com/hashicorp/go-msgpack/codec github.com/prometheus/client_golang/prometheus github.com/docker/go-connections/sockets golang.org/x/net/trace github.com/circonus-labs/circonus-gometrics/checkmgr github.com/circonus-labs/circonus-gometrics github.com/stretchr/testify/mock github.com/stretchr/testify/require golang.org/x/net/http2 net/http/httputil github.com/prometheus/client_golang/prometheus/push github.com/hashicorp/raft github.com/hashicorp/memberlist github.com/armon/go-metrics/circonus github.com/hashicorp/consul/command/flags github.com/armon/go-metrics/prometheus github.com/aws/aws-sdk-go/aws github.com/gogo/protobuf/protoc-gen-gogo/descriptor github.com/hashicorp/consul/command/acl/agenttokens github.com/hashicorp/consul/command/acl/authmethod github.com/hashicorp/consul/command/acl/authmethod/delete github.com/hashicorp/consul/command/acl/authmethod/create github.com/hashicorp/consul/command/acl/authmethod/list github.com/hashicorp/consul/command/acl/authmethod/read github.com/hashicorp/consul/command/acl/authmethod/update github.com/hashicorp/consul/command/acl/bindingrule github.com/hashicorp/consul/command/acl/token github.com/hashicorp/consul/command/acl/policy github.com/hashicorp/consul/command/acl/bindingrule/create github.com/hashicorp/consul/command/acl/bindingrule/list github.com/hashicorp/serf/serf github.com/hashicorp/consul/command/acl/bootstrap github.com/hashicorp/consul/command/acl/policy/list github.com/hashicorp/consul/command/acl/role github.com/hashicorp/consul/command/acl/token/list google.golang.org/grpc/internal/transport github.com/hashicorp/consul/command/acl/role/list github.com/aws/aws-sdk-go/aws/request github.com/gogo/protobuf/gogoproto gopkg.in/square/go-jose.v2/jwt github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/api/resource github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/validation github.com/hashicorp/consul/proto/pbacl go/scanner github.com/hashicorp/consul/vendor/github.com/hashicorp/vault/api github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/labels github.com/aws/aws-sdk-go/aws/client github.com/hashicorp/consul/lib github.com/hashicorp/consul/agent/consul/autopilot github.com/aws/aws-sdk-go/aws/corehandlers github.com/aws/aws-sdk-go/private/protocol github.com/aws/aws-sdk-go/aws/csm github.com/hashicorp/consul/agent/ae github.com/hashicorp/consul/agent/cache github.com/aws/aws-sdk-go/aws/ec2metadata go/ast google.golang.org/grpc internal/lazyregexp github.com/aws/aws-sdk-go/aws/credentials/ec2rolecreds github.com/aws/aws-sdk-go/private/protocol/rest github.com/aws/aws-sdk-go/private/protocol/query/queryutil github.com/hashicorp/consul/agent/structs github.com/aws/aws-sdk-go/private/protocol/xml/xmlutil github.com/aws/aws-sdk-go/private/protocol/json/jsonutil github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/conversion/queryparams github.com/aws/aws-sdk-go/aws/signer/v4 github.com/aws/aws-sdk-go/aws/credentials/endpointcreds github.com/aws/aws-sdk-go/private/protocol/jsonrpc github.com/aws/aws-sdk-go/private/protocol/query go/doc github.com/aws/aws-sdk-go/aws/defaults go/parser github.com/aws/aws-sdk-go/service/sts github.com/aws/aws-sdk-go/service/acmpca github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime/schema github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/json github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/naming github.com/aws/aws-sdk-go/service/sts/stsiface github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/runtime github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/types google.golang.org/grpc/health/grpc_health_v1 github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/intstr github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/net github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime github.com/aws/aws-sdk-go/aws/credentials/stscreds github.com/googleapis/gnostic/extensions gopkg.in/yaml.v2 github.com/modern-go/concurrent github.com/aws/aws-sdk-go/aws/session github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/framer github.com/modern-go/reflect2 github.com/hashicorp/consul/vendor/k8s.io/client-go/pkg/version golang.org/x/term golang.org/x/net/context/ctxhttp golang.org/x/oauth2/internal golang.org/x/crypto/ssh/terminal github.com/hashicorp/consul/vendor/k8s.io/client-go/util/connrotation github.com/hashicorp/consul/vendor/k8s.io/client-go/tools/metrics github.com/hashicorp/consul/vendor/k8s.io/client-go/util/keyutil github.com/hashicorp/consul/vendor/k8s.io/client-go/util/flowcontrol golang.org/x/oauth2 github.com/hashicorp/consul/vendor/k8s.io/client-go/util/cert github.com/pquerna/cachecontrol/cacheobject github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/watch github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime/serializer/recognizer github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming github.com/hashicorp/consul/vendor/k8s.io/client-go/tools/clientcmd/api github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/apis/meta/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/transport github.com/pquerna/cachecontrol github.com/googleapis/gnostic/compiler sigs.k8s.io/yaml github.com/coreos/go-oidc github.com/googleapis/gnostic/OpenAPIv2 github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/util/yaml github.com/hashicorp/consul/vendor/github.com/mitchellh/pointerstructure github.com/json-iterator/go github.com/patrickmn/go-cache github.com/hashicorp/go-raftchunking/types github.com/hashicorp/net-rpc-msgpackrpc github.com/hashicorp/go-raftchunking github.com/hashicorp/consul/lib/template github.com/gogo/protobuf/types github.com/hashicorp/consul/proto/pbconfig github.com/hashicorp/consul/internal/go-sso/oidcauth github.com/hashicorp/consul/command/acl github.com/hashicorp/consul/agent/connect github.com/hashicorp/consul/command/acl/bindingrule/delete github.com/hashicorp/consul/command/acl/bindingrule/read github.com/hashicorp/consul/command/acl/bindingrule/update github.com/hashicorp/consul/command/acl/policy/create github.com/hashicorp/consul/command/acl/policy/delete github.com/hashicorp/consul/command/acl/policy/read github.com/hashicorp/consul/command/acl/policy/update github.com/hashicorp/consul/command/acl/role/create github.com/hashicorp/consul/command/acl/role/delete github.com/hashicorp/consul/command/acl/role/read github.com/hashicorp/consul/command/acl/role/update github.com/hashicorp/consul/command/acl/rules github.com/hashicorp/consul/command/acl/token/clone github.com/hashicorp/consul/command/acl/token/create github.com/hashicorp/consul/command/acl/token/delete github.com/hashicorp/consul/command/acl/token/read github.com/hashicorp/consul/command/acl/token/update github.com/hashicorp/consul/agent/checks github.com/hashicorp/consul/agent/consul/discoverychain github.com/hashicorp/consul/agent/consul/prepared_query github.com/hashicorp/consul/agent/consul/authmethod github.com/hashicorp/consul/vendor/k8s.io/api/authentication/v1 github.com/hashicorp/consul/vendor/k8s.io/api/core/v1 github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/api/errors github.com/hashicorp/consul/agent/consul/state github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime/serializer/json github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime/serializer/protobuf github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/apis/meta/v1/unstructured github.com/hashicorp/consul/vendor/k8s.io/api/admissionregistration/v1 github.com/hashicorp/consul/vendor/k8s.io/api/admissionregistration/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/auditregistration/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/authentication/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime/serializer/versioning github.com/hashicorp/consul/vendor/k8s.io/api/authorization/v1 github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/runtime/serializer github.com/hashicorp/consul/vendor/k8s.io/api/authorization/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/certificates/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/coordination/v1 github.com/hashicorp/consul/vendor/k8s.io/api/coordination/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/rbac/v1 github.com/hashicorp/consul/vendor/k8s.io/api/rbac/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/rbac/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/pkg/apis/clientauthentication github.com/hashicorp/consul/vendor/k8s.io/client-go/rest/watch github.com/hashicorp/consul/vendor/k8s.io/apimachinery/pkg/api/meta github.com/hashicorp/consul/vendor/k8s.io/client-go/pkg/apis/clientauthentication/v1alpha1 github.com/hashicorp/consul/agent/connect/ca github.com/hashicorp/consul/vendor/k8s.io/client-go/pkg/apis/clientauthentication/v1beta1 github.com/hashicorp/consul/agent/consul/authmethod/ssoauth github.com/hashicorp/consul/vendor/k8s.io/client-go/plugin/pkg/client/auth/exec github.com/hashicorp/consul/agent/consul/fsm github.com/hashicorp/consul/tlsutil github.com/hashicorp/consul/agent/metadata github.com/hashicorp/consul/agent/router github.com/hashicorp/consul/vendor/k8s.io/client-go/rest github.com/hashicorp/consul/proto github.com/hashicorp/consul/agent/pool github.com/hashicorp/consul/proto/pbcommon github.com/hashicorp/consul/vendor/github.com/hashicorp/go-connlimit archive/tar github.com/boltdb/bolt github.com/hashicorp/consul/agent/consul/wanfed golang.org/x/sync/singleflight github.com/hashicorp/consul/agent/local github.com/hashicorp/go-sockaddr/template github.com/hashicorp/consul/proto/pbconnect github.com/denverdino/aliyungo/util github.com/aws/aws-sdk-go/private/protocol/ec2query github.com/hashicorp/consul/snapshot cloud.google.com/go/compute/metadata github.com/aws/aws-sdk-go/service/ec2 github.com/denverdino/aliyungo/common golang.org/x/oauth2/jws github.com/hashicorp/consul/proto/pbautoconf github.com/hashicorp/raft-boltdb google.golang.org/api/googleapi golang.org/x/oauth2/jwt github.com/googleapis/gax-go/v2 golang.org/x/oauth2/google go.opencensus.io/internal go.opencensus.io/trace/tracestate github.com/denverdino/aliyungo/ecs google.golang.org/api/internal/gensupport go.opencensus.io/resource go.opencensus.io/trace go.opencensus.io/metric/metricdata runtime/pprof google.golang.org/api/internal go.opencensus.io/trace/propagation google.golang.org/api/option go.opencensus.io/metric/metricproducer go.opencensus.io/plugin/ochttp/propagation/b3 google.golang.org/api/googleapi/transport google.golang.org/api/option/internaloption google.golang.org/api/transport/cert google.golang.org/api/transport/http/internal/propagation github.com/hashicorp/mdns go.opencensus.io/tag github.com/gophercloud/gophercloud github.com/packethost/packngo github.com/hashicorp/go-discover/provider/aliyun go.opencensus.io/stats/internal github.com/hashicorp/go-discover/provider/mdns go.opencensus.io/stats github.com/shirou/gopsutil/internal/common github.com/hashicorp/consul/agent/systemd go.opencensus.io/stats/view github.com/golang/protobuf/protoc-gen-go/descriptor go.opencensus.io/plugin/ochttp github.com/shirou/gopsutil/cpu github.com/gophercloud/gophercloud/pagination github.com/gophercloud/gophercloud/openstack/identity/v3/tokens github.com/gophercloud/gophercloud/openstack/utils github.com/hashicorp/go-discover/provider/packet github.com/gophercloud/gophercloud/openstack/identity/v2/tenants github.com/gophercloud/gophercloud/openstack/compute/v2/servers github.com/gophercloud/gophercloud/openstack/identity/v3/extensions/ec2tokens github.com/gophercloud/gophercloud/openstack/identity/v3/extensions/oauth1 github.com/shirou/gopsutil/disk github.com/gophercloud/gophercloud/openstack/identity/v2/tokens google.golang.org/api/transport/http github.com/shirou/gopsutil/host github.com/shirou/gopsutil/mem github.com/gophercloud/gophercloud/openstack net/mail github.com/hashicorp/consul/vendor/github.com/envoyproxy/protoc-gen-validate/validate github.com/hashicorp/consul/agent/debug google.golang.org/api/compute/v1 github.com/golang/protobuf/ptypes/wrappers github.com/hashicorp/go-discover/provider/os github.com/hashicorp/consul/vendor/github.com/cncf/udpa/go/udpa/annotations github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/annotations github.com/golang/protobuf/ptypes/empty google.golang.org/genproto/googleapis/api/annotations github.com/census-instrumentation/opencensus-proto/gen-go/resource/v1 github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/pkg/conversion github.com/census-instrumentation/opencensus-proto/gen-go/trace/v1 github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/type/metadata/v2 github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/type github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/config/listener/v2 github.com/hashicorp/consul/api/watch github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/type/tracing/v2 github.com/hashicorp/consul/lib/file github.com/hashicorp/consul/logging/monitor github.com/hashicorp/consul/sdk/testutil github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/type/matcher github.com/imdario/mergo github.com/prometheus/client_golang/prometheus/promhttp internal/profile github.com/hashicorp/go-checkpoint github.com/hashicorp/consul/command/catalog github.com/hashicorp/consul/command/catalog/list/dc github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/api/v2/core github.com/ryanuber/columnize github.com/hashicorp/consul/command/catalog/list/services github.com/hashicorp/consul/command/catalog/list/nodes net/http/pprof github.com/hashicorp/consul/command/config github.com/hashicorp/consul/command/config/delete github.com/hashicorp/consul/command/config/list github.com/hashicorp/consul/command/config/read github.com/hashicorp/consul/command/config/write github.com/hashicorp/consul/command/connect github.com/hashicorp/consul/command/connect/ca github.com/hashicorp/consul/command/connect/ca/get github.com/hashicorp/consul/command/connect/ca/set github.com/hashicorp/consul/connect github.com/hashicorp/consul/command/connect/envoy/pipe-bootstrap github.com/hashicorp/consul/command/intention/finder github.com/hashicorp/consul/vendor/k8s.io/api/apps/v1 github.com/hashicorp/consul/vendor/k8s.io/api/apps/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/apps/v1beta2 github.com/hashicorp/consul/vendor/k8s.io/api/autoscaling/v1 github.com/hashicorp/consul/vendor/k8s.io/api/autoscaling/v2beta1 github.com/hashicorp/consul/vendor/k8s.io/api/autoscaling/v2beta2 github.com/hashicorp/consul/vendor/k8s.io/api/batch/v1 github.com/hashicorp/consul/vendor/k8s.io/api/discovery/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/events/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/batch/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/batch/v2alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/extensions/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/networking/v1 github.com/hashicorp/consul/vendor/k8s.io/api/networking/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/node/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/node/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/policy/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/scheduling/v1 github.com/hashicorp/consul/vendor/k8s.io/api/scheduling/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/scheduling/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/api/settings/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/storage/v1 github.com/hashicorp/consul/vendor/k8s.io/api/storage/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/api/storage/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/tools/reference github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/api/v2/auth github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/api/v2/cluster github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/api/v2/endpoint github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/api/v2/route github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/config/filter/network/ext_authz/v2 github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/api/v2/listener github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/service/auth/v2 github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/config/trace/v2 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/scheme github.com/hashicorp/consul/connect/proxy github.com/hashicorp/consul/command/intention/create github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/service/auth/v2alpha github.com/hashicorp/consul/vendor/k8s.io/client-go/discovery github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/admissionregistration/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/admissionregistration/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/apps/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/apps/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/apps/v1beta2 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/auditregistration/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/authentication/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/authentication/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/authorization/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/authorization/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/autoscaling/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/autoscaling/v2beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/autoscaling/v2beta2 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/batch/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/batch/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/batch/v2alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/certificates/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/coordination/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/coordination/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/core/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/discovery/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/events/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/extensions/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/networking/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/networking/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/node/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/node/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/policy/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/rbac/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/rbac/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/rbac/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/scheduling/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/scheduling/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/scheduling/v1beta1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/settings/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/storage/v1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/storage/v1alpha1 github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes/typed/storage/v1beta1 github.com/hashicorp/go-discover/provider/gce github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/config/filter/accesslog/v2 github.com/hashicorp/consul/command/connect/proxy github.com/hashicorp/consul/command/debug github.com/hashicorp/consul/command/event github.com/hashicorp/consul/command/exec github.com/hashicorp/go-discover/provider/aws github.com/hashicorp/consul/command/forceleave github.com/hashicorp/consul/vendor/k8s.io/client-go/kubernetes github.com/hashicorp/consul/command/info github.com/hashicorp/consul/command/intention github.com/hashicorp/consul/command/intention/check github.com/hashicorp/consul/command/intention/delete github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/config/filter/network/tcp_proxy/v2 github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/api/v2 github.com/hashicorp/consul/command/intention/get github.com/hashicorp/consul/command/intention/match github.com/hashicorp/go-discover github.com/hashicorp/consul/command/join github.com/hashicorp/consul/command/keygen github.com/hashicorp/consul/command/kv github.com/hashicorp/consul/command/kv/del github.com/hashicorp/consul/command/kv/impexp github.com/hashicorp/consul/command/kv/get github.com/hashicorp/consul/command/kv/exp github.com/hashicorp/consul/command/kv/put github.com/hashicorp/consul/command/kv/imp github.com/hashicorp/consul/command/leave github.com/hashicorp/consul/command/logout github.com/hashicorp/consul/command/login github.com/hashicorp/consul/command/maint github.com/hashicorp/consul/command/members github.com/hashicorp/consul/command/monitor github.com/hashicorp/consul/command/operator github.com/hashicorp/consul/command/operator/autopilot github.com/hashicorp/consul/command/operator/autopilot/get github.com/hashicorp/consul/command/operator/autopilot/set github.com/hashicorp/consul/command/operator/raft github.com/hashicorp/consul/command/operator/raft/listpeers github.com/hashicorp/consul/command/operator/raft/removepeer github.com/hashicorp/consul/command/reload github.com/hashicorp/consul/command/rtt github.com/hashicorp/consul/command/snapshot github.com/hashicorp/consul/command/snapshot/inspect github.com/hashicorp/consul/command/snapshot/restore github.com/hashicorp/consul/vendor/github.com/rboyer/safeio github.com/hashicorp/consul/command/tls github.com/hashicorp/consul/command/tls/ca github.com/hashicorp/consul/command/tls/ca/create github.com/hashicorp/consul/command/snapshot/save github.com/hashicorp/consul/command/tls/cert github.com/hashicorp/consul/command/tls/cert/create github.com/hashicorp/consul/agent/consul/authmethod/testauth github.com/hashicorp/consul/agent/mock github.com/hashicorp/consul/connect/certgen github.com/hashicorp/consul/agent/consul/authmethod/kubeauth github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcauthtest github.com/hashicorp/consul/sentinel github.com/hashicorp/consul/testrpc github.com/hashicorp/consul/agent/consul github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/config/filter/network/http_connection_manager/v2 github.com/hashicorp/consul/vendor/github.com/envoyproxy/go-control-plane/envoy/service/discovery/v2 github.com/hashicorp/consul/command/version github.com/hashicorp/consul/agent/cache-types github.com/hashicorp/consul/agent/config github.com/hashicorp/consul/agent/proxycfg github.com/hashicorp/consul/agent/xds github.com/hashicorp/consul/command/services github.com/hashicorp/consul/command/validate github.com/hashicorp/consul/agent/auto-config github.com/hashicorp/consul/command/services/deregister github.com/hashicorp/consul/command/services/register github.com/hashicorp/consul/command/connect/envoy github.com/hashicorp/consul/agent github.com/hashicorp/consul/command/agent github.com/hashicorp/consul/command/connect/expose github.com/hashicorp/consul/command/lock github.com/hashicorp/consul/command/keyring github.com/hashicorp/consul/command/watch github.com/hashicorp/consul/command github.com/hashicorp/consul make[1]: Leaving directory '/build/consul-1.8.7+dfsg1' debian/rules override_dh_auto_test make[1]: Entering directory '/build/consul-1.8.7+dfsg1' PATH="/build/consul-1.8.7+dfsg1/_build/bin:${PATH}" \ DH_GOLANG_EXCLUDES="test/integration api agent/cache agent/checks agent/connect agent/consul agent/proxycfg agent/routine-leak-checker command/debug command/tls command/flags command/monitor" \ dh_auto_test -v --max-parallel=4 -- -short -failfast -timeout 8m cd _build && go test -vet=off -v -p 4 -short -failfast -timeout 8m github.com/hashicorp/consul github.com/hashicorp/consul/acl github.com/hashicorp/consul/agent github.com/hashicorp/consul/agent/ae github.com/hashicorp/consul/agent/auto-config github.com/hashicorp/consul/agent/config github.com/hashicorp/consul/agent/debug github.com/hashicorp/consul/agent/dns github.com/hashicorp/consul/agent/exec github.com/hashicorp/consul/agent/local github.com/hashicorp/consul/agent/metadata github.com/hashicorp/consul/agent/mock github.com/hashicorp/consul/agent/pool github.com/hashicorp/consul/agent/router github.com/hashicorp/consul/agent/structs github.com/hashicorp/consul/agent/systemd github.com/hashicorp/consul/agent/token github.com/hashicorp/consul/agent/xds github.com/hashicorp/consul/agent/xds/proxysupport github.com/hashicorp/consul/command github.com/hashicorp/consul/command/acl github.com/hashicorp/consul/command/acl/agenttokens github.com/hashicorp/consul/command/acl/authmethod github.com/hashicorp/consul/command/acl/authmethod/create github.com/hashicorp/consul/command/acl/authmethod/delete github.com/hashicorp/consul/command/acl/authmethod/list github.com/hashicorp/consul/command/acl/authmethod/read github.com/hashicorp/consul/command/acl/authmethod/update github.com/hashicorp/consul/command/acl/bindingrule github.com/hashicorp/consul/command/acl/bindingrule/create github.com/hashicorp/consul/command/acl/bindingrule/delete github.com/hashicorp/consul/command/acl/bindingrule/list github.com/hashicorp/consul/command/acl/bindingrule/read github.com/hashicorp/consul/command/acl/bindingrule/update github.com/hashicorp/consul/command/acl/bootstrap github.com/hashicorp/consul/command/acl/policy github.com/hashicorp/consul/command/acl/policy/create github.com/hashicorp/consul/command/acl/policy/delete github.com/hashicorp/consul/command/acl/policy/list github.com/hashicorp/consul/command/acl/policy/read github.com/hashicorp/consul/command/acl/policy/update github.com/hashicorp/consul/command/acl/role github.com/hashicorp/consul/command/acl/role/create github.com/hashicorp/consul/command/acl/role/delete github.com/hashicorp/consul/command/acl/role/list github.com/hashicorp/consul/command/acl/role/read github.com/hashicorp/consul/command/acl/role/update github.com/hashicorp/consul/command/acl/rules github.com/hashicorp/consul/command/acl/token github.com/hashicorp/consul/command/acl/token/clone github.com/hashicorp/consul/command/acl/token/create github.com/hashicorp/consul/command/acl/token/delete github.com/hashicorp/consul/command/acl/token/list github.com/hashicorp/consul/command/acl/token/read github.com/hashicorp/consul/command/acl/token/update github.com/hashicorp/consul/command/agent github.com/hashicorp/consul/command/catalog github.com/hashicorp/consul/command/catalog/list/dc github.com/hashicorp/consul/command/catalog/list/nodes github.com/hashicorp/consul/command/catalog/list/services github.com/hashicorp/consul/command/config github.com/hashicorp/consul/command/config/delete github.com/hashicorp/consul/command/config/list github.com/hashicorp/consul/command/config/read github.com/hashicorp/consul/command/config/write github.com/hashicorp/consul/command/connect github.com/hashicorp/consul/command/connect/ca github.com/hashicorp/consul/command/connect/ca/get github.com/hashicorp/consul/command/connect/ca/set github.com/hashicorp/consul/command/connect/envoy github.com/hashicorp/consul/command/connect/envoy/pipe-bootstrap github.com/hashicorp/consul/command/connect/expose github.com/hashicorp/consul/command/connect/proxy github.com/hashicorp/consul/command/event github.com/hashicorp/consul/command/exec github.com/hashicorp/consul/command/forceleave github.com/hashicorp/consul/command/helpers github.com/hashicorp/consul/command/info github.com/hashicorp/consul/command/intention github.com/hashicorp/consul/command/intention/check github.com/hashicorp/consul/command/intention/create github.com/hashicorp/consul/command/intention/delete github.com/hashicorp/consul/command/intention/finder github.com/hashicorp/consul/command/intention/get github.com/hashicorp/consul/command/intention/match github.com/hashicorp/consul/command/join github.com/hashicorp/consul/command/keygen github.com/hashicorp/consul/command/keyring github.com/hashicorp/consul/command/kv github.com/hashicorp/consul/command/kv/del github.com/hashicorp/consul/command/kv/exp github.com/hashicorp/consul/command/kv/get github.com/hashicorp/consul/command/kv/imp github.com/hashicorp/consul/command/kv/impexp github.com/hashicorp/consul/command/kv/put github.com/hashicorp/consul/command/leave github.com/hashicorp/consul/command/lock github.com/hashicorp/consul/command/login github.com/hashicorp/consul/command/logout github.com/hashicorp/consul/command/maint github.com/hashicorp/consul/command/members github.com/hashicorp/consul/command/operator github.com/hashicorp/consul/command/operator/autopilot github.com/hashicorp/consul/command/operator/autopilot/get github.com/hashicorp/consul/command/operator/autopilot/set github.com/hashicorp/consul/command/operator/raft github.com/hashicorp/consul/command/operator/raft/listpeers github.com/hashicorp/consul/command/operator/raft/removepeer github.com/hashicorp/consul/command/reload github.com/hashicorp/consul/command/rtt github.com/hashicorp/consul/command/services github.com/hashicorp/consul/command/services/deregister github.com/hashicorp/consul/command/services/register github.com/hashicorp/consul/command/snapshot github.com/hashicorp/consul/command/snapshot/inspect github.com/hashicorp/consul/command/snapshot/restore github.com/hashicorp/consul/command/snapshot/save github.com/hashicorp/consul/command/validate github.com/hashicorp/consul/command/version github.com/hashicorp/consul/command/watch github.com/hashicorp/consul/connect github.com/hashicorp/consul/connect/certgen github.com/hashicorp/consul/connect/proxy github.com/hashicorp/consul/internal/go-sso/oidcauth github.com/hashicorp/consul/internal/go-sso/oidcauth/internal/strutil github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcauthtest github.com/hashicorp/consul/ipaddr github.com/hashicorp/consul/lib github.com/hashicorp/consul/lib/decode github.com/hashicorp/consul/lib/file github.com/hashicorp/consul/lib/semaphore github.com/hashicorp/consul/lib/stringslice github.com/hashicorp/consul/lib/template github.com/hashicorp/consul/logging github.com/hashicorp/consul/logging/monitor github.com/hashicorp/consul/proto github.com/hashicorp/consul/proto/pbacl github.com/hashicorp/consul/proto/pbautoconf github.com/hashicorp/consul/proto/pbcommon github.com/hashicorp/consul/proto/pbconfig github.com/hashicorp/consul/proto/pbconnect github.com/hashicorp/consul/sdk/freeport github.com/hashicorp/consul/sdk/testutil github.com/hashicorp/consul/sdk/testutil/retry github.com/hashicorp/consul/sentinel github.com/hashicorp/consul/service_os github.com/hashicorp/consul/snapshot github.com/hashicorp/consul/testrpc github.com/hashicorp/consul/tlsutil github.com/hashicorp/consul/types github.com/hashicorp/consul/version testing: warning: no tests to run PASS ok github.com/hashicorp/consul 0.060s [no tests to run] === RUN TestACL === RUN TestACL/DenyAll === RUN TestACL/DenyAll/DenyACLRead === RUN TestACL/DenyAll/DenyACLWrite === RUN TestACL/DenyAll/DenyAgentRead === RUN TestACL/DenyAll/DenyAgentWrite === RUN TestACL/DenyAll/DenyEventRead === RUN TestACL/DenyAll/DenyEventWrite === RUN TestACL/DenyAll/DenyIntentionDefaultAllow === RUN TestACL/DenyAll/DenyIntentionRead === RUN TestACL/DenyAll/DenyIntentionWrite === RUN TestACL/DenyAll/DenyKeyRead === RUN TestACL/DenyAll/DenyKeyringRead === RUN TestACL/DenyAll/DenyKeyringWrite === RUN TestACL/DenyAll/DenyKeyWrite === RUN TestACL/DenyAll/DenyNodeRead === RUN TestACL/DenyAll/DenyNodeWrite === RUN TestACL/DenyAll/DenyOperatorRead === RUN TestACL/DenyAll/DenyOperatorWrite === RUN TestACL/DenyAll/DenyPreparedQueryRead === RUN TestACL/DenyAll/DenyPreparedQueryWrite === RUN TestACL/DenyAll/DenyServiceRead === RUN TestACL/DenyAll/DenyServiceWrite === RUN TestACL/DenyAll/DenySessionRead === RUN TestACL/DenyAll/DenySessionWrite === RUN TestACL/DenyAll/DenySnapshot === RUN TestACL/AllowAll === RUN TestACL/AllowAll/DenyACLRead === RUN TestACL/AllowAll/DenyACLWrite === RUN TestACL/AllowAll/AllowAgentRead === RUN TestACL/AllowAll/AllowAgentWrite === RUN TestACL/AllowAll/AllowEventRead === RUN TestACL/AllowAll/AllowEventWrite === RUN TestACL/AllowAll/AllowIntentionDefaultAllow === RUN TestACL/AllowAll/AllowIntentionRead === RUN TestACL/AllowAll/AllowIntentionWrite === RUN TestACL/AllowAll/AllowKeyRead === RUN TestACL/AllowAll/AllowKeyringRead === RUN TestACL/AllowAll/AllowKeyringWrite === RUN TestACL/AllowAll/AllowKeyWrite === RUN TestACL/AllowAll/AllowNodeRead === RUN TestACL/AllowAll/AllowNodeWrite === RUN TestACL/AllowAll/AllowOperatorRead === RUN TestACL/AllowAll/AllowOperatorWrite === RUN TestACL/AllowAll/AllowPreparedQueryRead === RUN TestACL/AllowAll/AllowPreparedQueryWrite === RUN TestACL/AllowAll/AllowServiceRead === RUN TestACL/AllowAll/AllowServiceWrite === RUN TestACL/AllowAll/AllowSessionRead === RUN TestACL/AllowAll/AllowSessionWrite === RUN TestACL/AllowAll/DenySnapshot === RUN TestACL/ManageAll === RUN TestACL/ManageAll/AllowACLRead === RUN TestACL/ManageAll/AllowACLWrite === RUN TestACL/ManageAll/AllowAgentRead === RUN TestACL/ManageAll/AllowAgentWrite === RUN TestACL/ManageAll/AllowEventRead === RUN TestACL/ManageAll/AllowEventWrite === RUN TestACL/ManageAll/AllowIntentionDefaultAllow === RUN TestACL/ManageAll/AllowIntentionRead === RUN TestACL/ManageAll/AllowIntentionWrite === RUN TestACL/ManageAll/AllowKeyRead === RUN TestACL/ManageAll/AllowKeyringRead === RUN TestACL/ManageAll/AllowKeyringWrite === RUN TestACL/ManageAll/AllowKeyWrite === RUN TestACL/ManageAll/AllowNodeRead === RUN TestACL/ManageAll/AllowNodeWrite === RUN TestACL/ManageAll/AllowOperatorRead === RUN TestACL/ManageAll/AllowOperatorWrite === RUN TestACL/ManageAll/AllowPreparedQueryRead === RUN TestACL/ManageAll/AllowPreparedQueryWrite === RUN TestACL/ManageAll/AllowServiceRead === RUN TestACL/ManageAll/AllowServiceWrite === RUN TestACL/ManageAll/AllowSessionRead === RUN TestACL/ManageAll/AllowSessionWrite === RUN TestACL/ManageAll/AllowSnapshot === RUN TestACL/AgentBasicDefaultDeny === RUN TestACL/AgentBasicDefaultDeny/DefaultReadDenied.Prefix(ro) === RUN TestACL/AgentBasicDefaultDeny/DefaultWriteDenied.Prefix(ro) === RUN TestACL/AgentBasicDefaultDeny/ROReadAllowed.Prefix(root) === RUN TestACL/AgentBasicDefaultDeny/ROWriteDenied.Prefix(root) === RUN TestACL/AgentBasicDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro) === RUN TestACL/AgentBasicDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro) === RUN TestACL/AgentBasicDefaultDeny/RWReadAllowed.Prefix(root-rw) === RUN TestACL/AgentBasicDefaultDeny/RWWriteDenied.Prefix(root-rw) === RUN TestACL/AgentBasicDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-sub) === RUN TestACL/AgentBasicDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-sub) === RUN TestACL/AgentBasicDefaultDeny/DenyReadDenied.Prefix(root-nope) === RUN TestACL/AgentBasicDefaultDeny/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/AgentBasicDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-sub) === RUN TestACL/AgentBasicDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-sub) === RUN TestACL/AgentBasicDefaultAllow === RUN TestACL/AgentBasicDefaultAllow/DefaultReadDenied.Prefix(ro) === RUN TestACL/AgentBasicDefaultAllow/DefaultWriteDenied.Prefix(ro) === RUN TestACL/AgentBasicDefaultAllow/ROReadAllowed.Prefix(root) === RUN TestACL/AgentBasicDefaultAllow/ROWriteDenied.Prefix(root) === RUN TestACL/AgentBasicDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro) === RUN TestACL/AgentBasicDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro) === RUN TestACL/AgentBasicDefaultAllow/RWReadAllowed.Prefix(root-rw) === RUN TestACL/AgentBasicDefaultAllow/RWWriteDenied.Prefix(root-rw) === RUN TestACL/AgentBasicDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-sub) === RUN TestACL/AgentBasicDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-sub) === RUN TestACL/AgentBasicDefaultAllow/DenyReadDenied.Prefix(root-nope) === RUN TestACL/AgentBasicDefaultAllow/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/AgentBasicDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-sub) === RUN TestACL/AgentBasicDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-sub) === RUN TestACL/PreparedQueryDefaultAllow === RUN TestACL/PreparedQueryDefaultAllow/ReadAllowed.Prefix(foo) === RUN TestACL/PreparedQueryDefaultAllow/WriteAllowed.Prefix(foo) === RUN TestACL/PreparedQueryDefaultAllow/ReadDenied.Prefix(other) === RUN TestACL/PreparedQueryDefaultAllow/WriteDenied.Prefix(other) === RUN TestACL/AgentNestedDefaultDeny === RUN TestACL/AgentNestedDefaultDeny/DefaultReadDenied.Prefix(nope) === RUN TestACL/AgentNestedDefaultDeny/DefaultWriteDenied.Prefix(nope) === RUN TestACL/AgentNestedDefaultDeny/DenyReadDenied.Prefix(root-nope) === RUN TestACL/AgentNestedDefaultDeny/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/AgentNestedDefaultDeny/ROReadAllowed.Prefix(root-ro) === RUN TestACL/AgentNestedDefaultDeny/ROWriteDenied.Prefix(root-ro) === RUN TestACL/AgentNestedDefaultDeny/RWReadAllowed.Prefix(root-rw) === RUN TestACL/AgentNestedDefaultDeny/RWWriteAllowed.Prefix(root-rw) === RUN TestACL/AgentNestedDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-prefix) === RUN TestACL/AgentNestedDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-prefix) === RUN TestACL/AgentNestedDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro-prefix) === RUN TestACL/AgentNestedDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro-prefix) === RUN TestACL/AgentNestedDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-prefix) === RUN TestACL/AgentNestedDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-prefix) === RUN TestACL/AgentNestedDefaultDeny/ChildDenyReadDenied.Prefix(child-nope) === RUN TestACL/AgentNestedDefaultDeny/ChildDenyWriteDenied.Prefix(child-nope) === RUN TestACL/AgentNestedDefaultDeny/ChildROReadAllowed.Prefix(child-ro) === RUN TestACL/AgentNestedDefaultDeny/ChildROWriteDenied.Prefix(child-ro) === RUN TestACL/AgentNestedDefaultDeny/ChildRWReadAllowed.Prefix(child-rw) === RUN TestACL/AgentNestedDefaultDeny/ChildRWWriteAllowed.Prefix(child-rw) === RUN TestACL/AgentNestedDefaultDeny/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) === RUN TestACL/AgentNestedDefaultDeny/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) === RUN TestACL/AgentNestedDefaultDeny/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) === RUN TestACL/AgentNestedDefaultDeny/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) === RUN TestACL/AgentNestedDefaultDeny/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) === RUN TestACL/AgentNestedDefaultDeny/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) === RUN TestACL/AgentNestedDefaultDeny/ChildOverrideReadAllowed.Prefix(override) === RUN TestACL/AgentNestedDefaultDeny/ChildOverrideWriteAllowed.Prefix(override) === RUN TestACL/AgentNestedDefaultAllow === RUN TestACL/AgentNestedDefaultAllow/DefaultReadAllowed.Prefix(nope) === RUN TestACL/AgentNestedDefaultAllow/DefaultWriteAllowed.Prefix(nope) === RUN TestACL/AgentNestedDefaultAllow/DenyReadDenied.Prefix(root-nope) === RUN TestACL/AgentNestedDefaultAllow/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/AgentNestedDefaultAllow/ROReadAllowed.Prefix(root-ro) === RUN TestACL/AgentNestedDefaultAllow/ROWriteDenied.Prefix(root-ro) === RUN TestACL/AgentNestedDefaultAllow/RWReadAllowed.Prefix(root-rw) === RUN TestACL/AgentNestedDefaultAllow/RWWriteAllowed.Prefix(root-rw) === RUN TestACL/AgentNestedDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-prefix) === RUN TestACL/AgentNestedDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-prefix) === RUN TestACL/AgentNestedDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro-prefix) === RUN TestACL/AgentNestedDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro-prefix) === RUN TestACL/AgentNestedDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-prefix) === RUN TestACL/AgentNestedDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-prefix) === RUN TestACL/AgentNestedDefaultAllow/ChildDenyReadDenied.Prefix(child-nope) === RUN TestACL/AgentNestedDefaultAllow/ChildDenyWriteDenied.Prefix(child-nope) === RUN TestACL/AgentNestedDefaultAllow/ChildROReadAllowed.Prefix(child-ro) === RUN TestACL/AgentNestedDefaultAllow/ChildROWriteDenied.Prefix(child-ro) === RUN TestACL/AgentNestedDefaultAllow/ChildRWReadAllowed.Prefix(child-rw) === RUN TestACL/AgentNestedDefaultAllow/ChildRWWriteAllowed.Prefix(child-rw) === RUN TestACL/AgentNestedDefaultAllow/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) === RUN TestACL/AgentNestedDefaultAllow/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) === RUN TestACL/AgentNestedDefaultAllow/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) === RUN TestACL/AgentNestedDefaultAllow/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) === RUN TestACL/AgentNestedDefaultAllow/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) === RUN TestACL/AgentNestedDefaultAllow/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) === RUN TestACL/AgentNestedDefaultAllow/ChildOverrideReadAllowed.Prefix(override) === RUN TestACL/AgentNestedDefaultAllow/ChildOverrideWriteAllowed.Prefix(override) === RUN TestACL/KeyringDefaultAllowPolicyDeny === RUN TestACL/KeyringDefaultAllowPolicyDeny/ReadDenied === RUN TestACL/KeyringDefaultAllowPolicyDeny/WriteDenied === RUN TestACL/KeyringDefaultAllowPolicyRead === RUN TestACL/KeyringDefaultAllowPolicyRead/ReadAllowed === RUN TestACL/KeyringDefaultAllowPolicyRead/WriteDenied === RUN TestACL/KeyringDefaultAllowPolicyWrite === RUN TestACL/KeyringDefaultAllowPolicyWrite/ReadAllowed === RUN TestACL/KeyringDefaultAllowPolicyWrite/WriteAllowed === RUN TestACL/KeyringDefaultAllowPolicyNone === RUN TestACL/KeyringDefaultAllowPolicyNone/ReadAllowed === RUN TestACL/KeyringDefaultAllowPolicyNone/WriteAllowed === RUN TestACL/KeyringDefaultDenyPolicyDeny === RUN TestACL/KeyringDefaultDenyPolicyDeny/ReadDenied === RUN TestACL/KeyringDefaultDenyPolicyDeny/WriteDenied === RUN TestACL/KeyringDefaultDenyPolicyRead === RUN TestACL/KeyringDefaultDenyPolicyRead/ReadAllowed === RUN TestACL/KeyringDefaultDenyPolicyRead/WriteDenied === RUN TestACL/KeyringDefaultDenyPolicyWrite === RUN TestACL/KeyringDefaultDenyPolicyWrite/ReadAllowed === RUN TestACL/KeyringDefaultDenyPolicyWrite/WriteAllowed === RUN TestACL/KeyringDefaultDenyPolicyNone === RUN TestACL/KeyringDefaultDenyPolicyNone/ReadDenied === RUN TestACL/KeyringDefaultDenyPolicyNone/WriteDenied === RUN TestACL/OperatorDefaultAllowPolicyDeny === RUN TestACL/OperatorDefaultAllowPolicyDeny/ReadDenied === RUN TestACL/OperatorDefaultAllowPolicyDeny/WriteDenied === RUN TestACL/OperatorDefaultAllowPolicyRead === RUN TestACL/OperatorDefaultAllowPolicyRead/ReadAllowed === RUN TestACL/OperatorDefaultAllowPolicyRead/WriteDenied === RUN TestACL/OperatorDefaultAllowPolicyWrite === RUN TestACL/OperatorDefaultAllowPolicyWrite/ReadAllowed === RUN TestACL/OperatorDefaultAllowPolicyWrite/WriteAllowed === RUN TestACL/OperatorDefaultAllowPolicyNone === RUN TestACL/OperatorDefaultAllowPolicyNone/ReadAllowed === RUN TestACL/OperatorDefaultAllowPolicyNone/WriteAllowed === RUN TestACL/OperatorDefaultDenyPolicyDeny === RUN TestACL/OperatorDefaultDenyPolicyDeny/ReadDenied === RUN TestACL/OperatorDefaultDenyPolicyDeny/WriteDenied === RUN TestACL/OperatorDefaultDenyPolicyRead === RUN TestACL/OperatorDefaultDenyPolicyRead/ReadAllowed === RUN TestACL/OperatorDefaultDenyPolicyRead/WriteDenied === RUN TestACL/OperatorDefaultDenyPolicyWrite === RUN TestACL/OperatorDefaultDenyPolicyWrite/ReadAllowed === RUN TestACL/OperatorDefaultDenyPolicyWrite/WriteAllowed === RUN TestACL/OperatorDefaultDenyPolicyNone === RUN TestACL/OperatorDefaultDenyPolicyNone/ReadDenied === RUN TestACL/OperatorDefaultDenyPolicyNone/WriteDenied === RUN TestACL/NodeDefaultDeny === RUN TestACL/NodeDefaultDeny/DefaultReadDenied.Prefix(nope) === RUN TestACL/NodeDefaultDeny/DefaultWriteDenied.Prefix(nope) === RUN TestACL/NodeDefaultDeny/DenyReadDenied.Prefix(root-nope) === RUN TestACL/NodeDefaultDeny/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/NodeDefaultDeny/ROReadAllowed.Prefix(root-ro) === RUN TestACL/NodeDefaultDeny/ROWriteDenied.Prefix(root-ro) === RUN TestACL/NodeDefaultDeny/RWReadAllowed.Prefix(root-rw) === RUN TestACL/NodeDefaultDeny/RWWriteAllowed.Prefix(root-rw) === RUN TestACL/NodeDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-prefix) === RUN TestACL/NodeDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-prefix) === RUN TestACL/NodeDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro-prefix) === RUN TestACL/NodeDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro-prefix) === RUN TestACL/NodeDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-prefix) === RUN TestACL/NodeDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-prefix) === RUN TestACL/NodeDefaultDeny/ChildDenyReadDenied.Prefix(child-nope) === RUN TestACL/NodeDefaultDeny/ChildDenyWriteDenied.Prefix(child-nope) === RUN TestACL/NodeDefaultDeny/ChildROReadAllowed.Prefix(child-ro) === RUN TestACL/NodeDefaultDeny/ChildROWriteDenied.Prefix(child-ro) === RUN TestACL/NodeDefaultDeny/ChildRWReadAllowed.Prefix(child-rw) === RUN TestACL/NodeDefaultDeny/ChildRWWriteAllowed.Prefix(child-rw) === RUN TestACL/NodeDefaultDeny/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) === RUN TestACL/NodeDefaultDeny/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) === RUN TestACL/NodeDefaultDeny/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) === RUN TestACL/NodeDefaultDeny/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) === RUN TestACL/NodeDefaultDeny/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) === RUN TestACL/NodeDefaultDeny/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) === RUN TestACL/NodeDefaultDeny/ChildOverrideReadAllowed.Prefix(override) === RUN TestACL/NodeDefaultDeny/ChildOverrideWriteAllowed.Prefix(override) === RUN TestACL/NodeDefaultAllow === RUN TestACL/NodeDefaultAllow/DefaultReadAllowed.Prefix(nope) === RUN TestACL/NodeDefaultAllow/DefaultWriteAllowed.Prefix(nope) === RUN TestACL/NodeDefaultAllow/DenyReadDenied.Prefix(root-nope) === RUN TestACL/NodeDefaultAllow/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/NodeDefaultAllow/ROReadAllowed.Prefix(root-ro) === RUN TestACL/NodeDefaultAllow/ROWriteDenied.Prefix(root-ro) === RUN TestACL/NodeDefaultAllow/RWReadAllowed.Prefix(root-rw) === RUN TestACL/NodeDefaultAllow/RWWriteAllowed.Prefix(root-rw) === RUN TestACL/NodeDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-prefix) === RUN TestACL/NodeDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-prefix) === RUN TestACL/NodeDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro-prefix) === RUN TestACL/NodeDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro-prefix) === RUN TestACL/NodeDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-prefix) === RUN TestACL/NodeDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-prefix) === RUN TestACL/NodeDefaultAllow/ChildDenyReadDenied.Prefix(child-nope) === RUN TestACL/NodeDefaultAllow/ChildDenyWriteDenied.Prefix(child-nope) === RUN TestACL/NodeDefaultAllow/ChildROReadAllowed.Prefix(child-ro) === RUN TestACL/NodeDefaultAllow/ChildROWriteDenied.Prefix(child-ro) === RUN TestACL/NodeDefaultAllow/ChildRWReadAllowed.Prefix(child-rw) === RUN TestACL/NodeDefaultAllow/ChildRWWriteAllowed.Prefix(child-rw) === RUN TestACL/NodeDefaultAllow/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) === RUN TestACL/NodeDefaultAllow/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) === RUN TestACL/NodeDefaultAllow/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) === RUN TestACL/NodeDefaultAllow/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) === RUN TestACL/NodeDefaultAllow/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) === RUN TestACL/NodeDefaultAllow/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) === RUN TestACL/NodeDefaultAllow/ChildOverrideReadAllowed.Prefix(override) === RUN TestACL/NodeDefaultAllow/ChildOverrideWriteAllowed.Prefix(override) === RUN TestACL/SessionDefaultDeny === RUN TestACL/SessionDefaultDeny/DefaultReadDenied.Prefix(nope) === RUN TestACL/SessionDefaultDeny/DefaultWriteDenied.Prefix(nope) === RUN TestACL/SessionDefaultDeny/DenyReadDenied.Prefix(root-nope) === RUN TestACL/SessionDefaultDeny/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/SessionDefaultDeny/ROReadAllowed.Prefix(root-ro) === RUN TestACL/SessionDefaultDeny/ROWriteDenied.Prefix(root-ro) === RUN TestACL/SessionDefaultDeny/RWReadAllowed.Prefix(root-rw) === RUN TestACL/SessionDefaultDeny/RWWriteAllowed.Prefix(root-rw) === RUN TestACL/SessionDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-prefix) === RUN TestACL/SessionDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-prefix) === RUN TestACL/SessionDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro-prefix) === RUN TestACL/SessionDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro-prefix) === RUN TestACL/SessionDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-prefix) === RUN TestACL/SessionDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-prefix) === RUN TestACL/SessionDefaultDeny/ChildDenyReadDenied.Prefix(child-nope) === RUN TestACL/SessionDefaultDeny/ChildDenyWriteDenied.Prefix(child-nope) === RUN TestACL/SessionDefaultDeny/ChildROReadAllowed.Prefix(child-ro) === RUN TestACL/SessionDefaultDeny/ChildROWriteDenied.Prefix(child-ro) === RUN TestACL/SessionDefaultDeny/ChildRWReadAllowed.Prefix(child-rw) === RUN TestACL/SessionDefaultDeny/ChildRWWriteAllowed.Prefix(child-rw) === RUN TestACL/SessionDefaultDeny/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) === RUN TestACL/SessionDefaultDeny/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) === RUN TestACL/SessionDefaultDeny/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) === RUN TestACL/SessionDefaultDeny/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) === RUN TestACL/SessionDefaultDeny/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) === RUN TestACL/SessionDefaultDeny/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) === RUN TestACL/SessionDefaultDeny/ChildOverrideReadAllowed.Prefix(override) === RUN TestACL/SessionDefaultDeny/ChildOverrideWriteAllowed.Prefix(override) === RUN TestACL/SessionDefaultAllow === RUN TestACL/SessionDefaultAllow/DefaultReadAllowed.Prefix(nope) === RUN TestACL/SessionDefaultAllow/DefaultWriteAllowed.Prefix(nope) === RUN TestACL/SessionDefaultAllow/DenyReadDenied.Prefix(root-nope) === RUN TestACL/SessionDefaultAllow/DenyWriteDenied.Prefix(root-nope) === RUN TestACL/SessionDefaultAllow/ROReadAllowed.Prefix(root-ro) === RUN TestACL/SessionDefaultAllow/ROWriteDenied.Prefix(root-ro) === RUN TestACL/SessionDefaultAllow/RWReadAllowed.Prefix(root-rw) === RUN TestACL/SessionDefaultAllow/RWWriteAllowed.Prefix(root-rw) === RUN TestACL/SessionDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-prefix) === RUN TestACL/SessionDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-prefix) === RUN TestACL/SessionDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro-prefix) === RUN TestACL/SessionDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro-prefix) === RUN TestACL/SessionDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-prefix) === RUN TestACL/SessionDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-prefix) === RUN TestACL/SessionDefaultAllow/ChildDenyReadDenied.Prefix(child-nope) === RUN TestACL/SessionDefaultAllow/ChildDenyWriteDenied.Prefix(child-nope) === RUN TestACL/SessionDefaultAllow/ChildROReadAllowed.Prefix(child-ro) === RUN TestACL/SessionDefaultAllow/ChildROWriteDenied.Prefix(child-ro) === RUN TestACL/SessionDefaultAllow/ChildRWReadAllowed.Prefix(child-rw) === RUN TestACL/SessionDefaultAllow/ChildRWWriteAllowed.Prefix(child-rw) === RUN TestACL/SessionDefaultAllow/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) === RUN TestACL/SessionDefaultAllow/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) === RUN TestACL/SessionDefaultAllow/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) === RUN TestACL/SessionDefaultAllow/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) === RUN TestACL/SessionDefaultAllow/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) === RUN TestACL/SessionDefaultAllow/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) === RUN TestACL/SessionDefaultAllow/ChildOverrideReadAllowed.Prefix(override) === RUN TestACL/SessionDefaultAllow/ChildOverrideWriteAllowed.Prefix(override) === RUN TestACL/Parent === RUN TestACL/Parent/KeyReadDenied.Prefix(other) === RUN TestACL/Parent/KeyWriteDenied.Prefix(other) === RUN TestACL/Parent/KeyWritePrefixDenied.Prefix(other) === RUN TestACL/Parent/KeyReadAllowed.Prefix(foo/test) === RUN TestACL/Parent/KeyWriteAllowed.Prefix(foo/test) === RUN TestACL/Parent/KeyWritePrefixAllowed.Prefix(foo/test) === RUN TestACL/Parent/KeyReadAllowed.Prefix(foo/priv/test) === RUN TestACL/Parent/KeyWriteDenied.Prefix(foo/priv/test) === RUN TestACL/Parent/KeyWritePrefixDenied.Prefix(foo/priv/test) === RUN TestACL/Parent/KeyReadDenied.Prefix(bar/any) === RUN TestACL/Parent/KeyWriteDenied.Prefix(bar/any) === RUN TestACL/Parent/KeyWritePrefixDenied.Prefix(bar/any) === RUN TestACL/Parent/KeyReadAllowed.Prefix(zip/test) === RUN TestACL/Parent/KeyWriteDenied.Prefix(zip/test) === RUN TestACL/Parent/KeyWritePrefixDenied.Prefix(zip/test) === RUN TestACL/Parent/ServiceReadDenied.Prefix(fail) === RUN TestACL/Parent/ServiceWriteDenied.Prefix(fail) === RUN TestACL/Parent/ServiceReadAllowed.Prefix(other) === RUN TestACL/Parent/ServiceWriteAllowed.Prefix(other) === RUN TestACL/Parent/ServiceReadAllowed.Prefix(foo) === RUN TestACL/Parent/ServiceWriteDenied.Prefix(foo) === RUN TestACL/Parent/ServiceReadDenied.Prefix(bar) === RUN TestACL/Parent/ServiceWriteDenied.Prefix(bar) === RUN TestACL/Parent/PreparedQueryReadAllowed.Prefix(foo) === RUN TestACL/Parent/PreparedQueryWriteDenied.Prefix(foo) === RUN TestACL/Parent/PreparedQueryReadAllowed.Prefix(foobar) === RUN TestACL/Parent/PreparedQueryWriteDenied.Prefix(foobar) === RUN TestACL/Parent/PreparedQueryReadDenied.Prefix(bar) === RUN TestACL/Parent/PreparedQueryWriteDenied.Prefix(bar) === RUN TestACL/Parent/PreparedQueryReadDenied.Prefix(barbaz) === RUN TestACL/Parent/PreparedQueryWriteDenied.Prefix(barbaz) === RUN TestACL/Parent/PreparedQueryReadDenied.Prefix(baz) === RUN TestACL/Parent/PreparedQueryWriteDenied.Prefix(baz) === RUN TestACL/Parent/PreparedQueryReadDenied.Prefix(nope) === RUN TestACL/Parent/PreparedQueryWriteDenied.Prefix(nope) === RUN TestACL/Parent/ACLReadDenied === RUN TestACL/Parent/ACLWriteDenied === RUN TestACL/Parent/SnapshotDenied === RUN TestACL/Parent/IntentionDefaultAllowDenied === RUN TestACL/ComplexDefaultAllow === RUN TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(other) === RUN TestACL/ComplexDefaultAllow/KeyWriteAllowed.Prefix(other) === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixAllowed.Prefix(other) === RUN TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(other) === RUN TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(foo/test) === RUN TestACL/ComplexDefaultAllow/KeyWriteAllowed.Prefix(foo/test) === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixAllowed.Prefix(foo/test) === RUN TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(foo/test) === RUN TestACL/ComplexDefaultAllow/KeyReadDenied.Prefix(foo/priv/test) === RUN TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(foo/priv/test) === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(foo/priv/test) === RUN TestACL/ComplexDefaultAllow/KeyListDenied.Prefix(foo/priv/test) === RUN TestACL/ComplexDefaultAllow/KeyReadDenied.Prefix(bar/any) === RUN TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(bar/any) === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(bar/any) === RUN TestACL/ComplexDefaultAllow/KeyListDenied.Prefix(bar/any) === RUN TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(zip/test) === RUN TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(zip/test) === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(zip/test) === RUN TestACL/ComplexDefaultAllow/KeyListDenied.Prefix(zip/test) === RUN TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(foo/) === RUN TestACL/ComplexDefaultAllow/KeyWriteAllowed.Prefix(foo/) === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(foo/) === RUN TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(foo/) === RUN TestACL/ComplexDefaultAllow/KeyReadAllowed === RUN TestACL/ComplexDefaultAllow/KeyWriteAllowed === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixDenied === RUN TestACL/ComplexDefaultAllow/KeyListAllowed === RUN TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(zap/test) === RUN TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(zap/test) === RUN TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(zap/test) === RUN TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(zap/test) === RUN TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(other) === RUN TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(other) === RUN TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/IntentionReadDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/IntentionReadDenied.Prefix(barfo) === RUN TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(barfo) === RUN TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(barfoo) === RUN TestACL/ComplexDefaultAllow/IntentionWriteAllowed.Prefix(barfoo) === RUN TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(barfoo2) === RUN TestACL/ComplexDefaultAllow/IntentionWriteAllowed.Prefix(barfoo2) === RUN TestACL/ComplexDefaultAllow/IntentionReadDenied.Prefix(intbaz) === RUN TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(intbaz) === RUN TestACL/ComplexDefaultAllow/IntentionDefaultAllowAllowed === RUN TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(other) === RUN TestACL/ComplexDefaultAllow/ServiceWriteAllowed.Prefix(other) === RUN TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/ServiceReadDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/ServiceReadDenied.Prefix(barfo) === RUN TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(barfo) === RUN TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(barfoo) === RUN TestACL/ComplexDefaultAllow/ServiceWriteAllowed.Prefix(barfoo) === RUN TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(barfoo2) === RUN TestACL/ComplexDefaultAllow/ServiceWriteAllowed.Prefix(barfoo2) === RUN TestACL/ComplexDefaultAllow/EventReadAllowed.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/EventWriteAllowed.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/EventReadAllowed.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/EventWriteAllowed.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/EventReadDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/EventWriteDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/EventReadDenied.Prefix(barbaz) === RUN TestACL/ComplexDefaultAllow/EventWriteDenied.Prefix(barbaz) === RUN TestACL/ComplexDefaultAllow/EventReadAllowed.Prefix(baz) === RUN TestACL/ComplexDefaultAllow/EventWriteDenied.Prefix(baz) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(foo) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(foobar) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(bar) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadDenied.Prefix(barbaz) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(barbaz) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(baz) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(baz) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(nope) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(nope) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(zoo) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(zoo) === RUN TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(zookeeper) === RUN TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(zookeeper) === RUN TestACL/ExactMatchPrecedence === RUN TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/AgentReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/AgentWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/AgentReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/AgentWriteDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/KeyReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/KeyWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/KeyReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/KeyWriteDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/NodeReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/NodeWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/NodeReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/NodeWriteDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/ServiceReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/ServiceWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/ServiceReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/ServiceWriteDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(fo)#01 === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(fo)#01 === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(for)#01 === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(for)#01 === RUN TestACL/ExactMatchPrecedence/NodeReadAllowed.Prefix(foo)#01 === RUN TestACL/ExactMatchPrecedence/NodeWriteAllowed.Prefix(foo)#01 === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot)#01 === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot)#01 === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot2)#01 === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot2)#01 === RUN TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(food)#01 === RUN TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(food)#01 === RUN TestACL/ExactMatchPrecedence/NodeReadDenied.Prefix(football)#01 === RUN TestACL/ExactMatchPrecedence/NodeWriteDenied.Prefix(football)#01 === RUN TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/IntentionReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/IntentionWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/IntentionReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/IntentionWriteDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/SessionReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/SessionWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/SessionReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/SessionWriteDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/EventReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/EventWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/EventReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/EventWriteDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(fo) === RUN TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(for) === RUN TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(for) === RUN TestACL/ExactMatchPrecedence/PreparedQueryReadAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/PreparedQueryWriteAllowed.Prefix(foo) === RUN TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(foot) === RUN TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(foot2) === RUN TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(food) === RUN TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(food) === RUN TestACL/ExactMatchPrecedence/PreparedQueryReadDenied.Prefix(football) === RUN TestACL/ExactMatchPrecedence/PreparedQueryWriteDenied.Prefix(football) === RUN TestACL/ACLRead === RUN TestACL/ACLRead/ReadAllowed === RUN TestACL/ACLRead/WriteDenied === RUN TestACL/ACLRead#01 === RUN TestACL/ACLRead#01/ReadAllowed === RUN TestACL/ACLRead#01/WriteAllowed === RUN TestACL/KeyWritePrefixDefaultDeny === RUN TestACL/KeyWritePrefixDefaultDeny/DeniedTopLevelPrefix.Prefix(foo) === RUN TestACL/KeyWritePrefixDefaultDeny/AllowedTopLevelPrefix.Prefix(baz/) === RUN TestACL/KeyWritePrefixDefaultDeny/AllowedPrefixWithNestedWrite.Prefix(foo/) === RUN TestACL/KeyWritePrefixDefaultDeny/DenyPrefixWithNestedRead.Prefix(bar/) === RUN TestACL/KeyWritePrefixDefaultDeny/DenyNoPrefixMatch.Prefix(te) === RUN TestACL/KeyWritePrefixDefaultAllow === RUN TestACL/KeyWritePrefixDefaultAllow/KeyWritePrefixDenied.Prefix(foo) === RUN TestACL/KeyWritePrefixDefaultAllow/KeyWritePrefixAllowed.Prefix(bar) --- PASS: TestACL (0.04s) --- PASS: TestACL/DenyAll (0.00s) --- PASS: TestACL/DenyAll/DenyACLRead (0.00s) --- PASS: TestACL/DenyAll/DenyACLWrite (0.00s) --- PASS: TestACL/DenyAll/DenyAgentRead (0.00s) --- PASS: TestACL/DenyAll/DenyAgentWrite (0.00s) --- PASS: TestACL/DenyAll/DenyEventRead (0.00s) --- PASS: TestACL/DenyAll/DenyEventWrite (0.00s) --- PASS: TestACL/DenyAll/DenyIntentionDefaultAllow (0.00s) --- PASS: TestACL/DenyAll/DenyIntentionRead (0.00s) --- PASS: TestACL/DenyAll/DenyIntentionWrite (0.00s) --- PASS: TestACL/DenyAll/DenyKeyRead (0.00s) --- PASS: TestACL/DenyAll/DenyKeyringRead (0.00s) --- PASS: TestACL/DenyAll/DenyKeyringWrite (0.00s) --- PASS: TestACL/DenyAll/DenyKeyWrite (0.00s) --- PASS: TestACL/DenyAll/DenyNodeRead (0.00s) --- PASS: TestACL/DenyAll/DenyNodeWrite (0.00s) --- PASS: TestACL/DenyAll/DenyOperatorRead (0.00s) --- PASS: TestACL/DenyAll/DenyOperatorWrite (0.00s) --- PASS: TestACL/DenyAll/DenyPreparedQueryRead (0.00s) --- PASS: TestACL/DenyAll/DenyPreparedQueryWrite (0.00s) --- PASS: TestACL/DenyAll/DenyServiceRead (0.00s) --- PASS: TestACL/DenyAll/DenyServiceWrite (0.00s) --- PASS: TestACL/DenyAll/DenySessionRead (0.00s) --- PASS: TestACL/DenyAll/DenySessionWrite (0.00s) --- PASS: TestACL/DenyAll/DenySnapshot (0.00s) --- PASS: TestACL/AllowAll (0.00s) --- PASS: TestACL/AllowAll/DenyACLRead (0.00s) --- PASS: TestACL/AllowAll/DenyACLWrite (0.00s) --- PASS: TestACL/AllowAll/AllowAgentRead (0.00s) --- PASS: TestACL/AllowAll/AllowAgentWrite (0.00s) --- PASS: TestACL/AllowAll/AllowEventRead (0.00s) --- PASS: TestACL/AllowAll/AllowEventWrite (0.00s) --- PASS: TestACL/AllowAll/AllowIntentionDefaultAllow (0.00s) --- PASS: TestACL/AllowAll/AllowIntentionRead (0.00s) --- PASS: TestACL/AllowAll/AllowIntentionWrite (0.00s) --- PASS: TestACL/AllowAll/AllowKeyRead (0.00s) --- PASS: TestACL/AllowAll/AllowKeyringRead (0.00s) --- PASS: TestACL/AllowAll/AllowKeyringWrite (0.00s) --- PASS: TestACL/AllowAll/AllowKeyWrite (0.00s) --- PASS: TestACL/AllowAll/AllowNodeRead (0.00s) --- PASS: TestACL/AllowAll/AllowNodeWrite (0.00s) --- PASS: TestACL/AllowAll/AllowOperatorRead (0.00s) --- PASS: TestACL/AllowAll/AllowOperatorWrite (0.00s) --- PASS: TestACL/AllowAll/AllowPreparedQueryRead (0.00s) --- PASS: TestACL/AllowAll/AllowPreparedQueryWrite (0.00s) --- PASS: TestACL/AllowAll/AllowServiceRead (0.00s) --- PASS: TestACL/AllowAll/AllowServiceWrite (0.00s) --- PASS: TestACL/AllowAll/AllowSessionRead (0.00s) --- PASS: TestACL/AllowAll/AllowSessionWrite (0.00s) --- PASS: TestACL/AllowAll/DenySnapshot (0.00s) --- PASS: TestACL/ManageAll (0.00s) --- PASS: TestACL/ManageAll/AllowACLRead (0.00s) --- PASS: TestACL/ManageAll/AllowACLWrite (0.00s) --- PASS: TestACL/ManageAll/AllowAgentRead (0.00s) --- PASS: TestACL/ManageAll/AllowAgentWrite (0.00s) --- PASS: TestACL/ManageAll/AllowEventRead (0.00s) --- PASS: TestACL/ManageAll/AllowEventWrite (0.00s) --- PASS: TestACL/ManageAll/AllowIntentionDefaultAllow (0.00s) --- PASS: TestACL/ManageAll/AllowIntentionRead (0.00s) --- PASS: TestACL/ManageAll/AllowIntentionWrite (0.00s) --- PASS: TestACL/ManageAll/AllowKeyRead (0.00s) --- PASS: TestACL/ManageAll/AllowKeyringRead (0.00s) --- PASS: TestACL/ManageAll/AllowKeyringWrite (0.00s) --- PASS: TestACL/ManageAll/AllowKeyWrite (0.00s) --- PASS: TestACL/ManageAll/AllowNodeRead (0.00s) --- PASS: TestACL/ManageAll/AllowNodeWrite (0.00s) --- PASS: TestACL/ManageAll/AllowOperatorRead (0.00s) --- PASS: TestACL/ManageAll/AllowOperatorWrite (0.00s) --- PASS: TestACL/ManageAll/AllowPreparedQueryRead (0.00s) --- PASS: TestACL/ManageAll/AllowPreparedQueryWrite (0.00s) --- PASS: TestACL/ManageAll/AllowServiceRead (0.00s) --- PASS: TestACL/ManageAll/AllowServiceWrite (0.00s) --- PASS: TestACL/ManageAll/AllowSessionRead (0.00s) --- PASS: TestACL/ManageAll/AllowSessionWrite (0.00s) --- PASS: TestACL/ManageAll/AllowSnapshot (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/DefaultReadDenied.Prefix(ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/DefaultWriteDenied.Prefix(ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/ROReadAllowed.Prefix(root) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/ROWriteDenied.Prefix(root) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/RWWriteDenied.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-sub) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-sub) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-sub) (0.00s) --- PASS: TestACL/AgentBasicDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-sub) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/DefaultReadDenied.Prefix(ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/DefaultWriteDenied.Prefix(ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/ROReadAllowed.Prefix(root) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/ROWriteDenied.Prefix(root) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/RWWriteDenied.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-sub) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-sub) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-sub) (0.00s) --- PASS: TestACL/AgentBasicDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-sub) (0.00s) --- PASS: TestACL/PreparedQueryDefaultAllow (0.00s) --- PASS: TestACL/PreparedQueryDefaultAllow/ReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/PreparedQueryDefaultAllow/WriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/PreparedQueryDefaultAllow/ReadDenied.Prefix(other) (0.00s) --- PASS: TestACL/PreparedQueryDefaultAllow/WriteDenied.Prefix(other) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/DefaultReadDenied.Prefix(nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/DefaultWriteDenied.Prefix(nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ROReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ROWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/RWWriteAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildDenyReadDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildDenyWriteDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildROReadAllowed.Prefix(child-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildROWriteDenied.Prefix(child-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildRWReadAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildRWWriteAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildOverrideReadAllowed.Prefix(override) (0.00s) --- PASS: TestACL/AgentNestedDefaultDeny/ChildOverrideWriteAllowed.Prefix(override) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/DefaultReadAllowed.Prefix(nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/DefaultWriteAllowed.Prefix(nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ROReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ROWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/RWWriteAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildDenyReadDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildDenyWriteDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildROReadAllowed.Prefix(child-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildROWriteDenied.Prefix(child-ro) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildRWReadAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildRWWriteAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildOverrideReadAllowed.Prefix(override) (0.00s) --- PASS: TestACL/AgentNestedDefaultAllow/ChildOverrideWriteAllowed.Prefix(override) (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyDeny (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyDeny/ReadDenied (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyDeny/WriteDenied (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyRead (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyRead/ReadAllowed (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyRead/WriteDenied (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyWrite (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyWrite/ReadAllowed (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyWrite/WriteAllowed (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyNone (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyNone/ReadAllowed (0.00s) --- PASS: TestACL/KeyringDefaultAllowPolicyNone/WriteAllowed (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyDeny (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyDeny/ReadDenied (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyDeny/WriteDenied (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyRead (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyRead/ReadAllowed (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyRead/WriteDenied (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyWrite (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyWrite/ReadAllowed (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyWrite/WriteAllowed (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyNone (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyNone/ReadDenied (0.00s) --- PASS: TestACL/KeyringDefaultDenyPolicyNone/WriteDenied (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyDeny (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyDeny/ReadDenied (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyDeny/WriteDenied (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyRead (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyRead/ReadAllowed (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyRead/WriteDenied (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyWrite (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyWrite/ReadAllowed (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyWrite/WriteAllowed (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyNone (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyNone/ReadAllowed (0.00s) --- PASS: TestACL/OperatorDefaultAllowPolicyNone/WriteAllowed (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyDeny (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyDeny/ReadDenied (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyDeny/WriteDenied (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyRead (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyRead/ReadAllowed (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyRead/WriteDenied (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyWrite (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyWrite/ReadAllowed (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyWrite/WriteAllowed (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyNone (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyNone/ReadDenied (0.00s) --- PASS: TestACL/OperatorDefaultDenyPolicyNone/WriteDenied (0.00s) --- PASS: TestACL/NodeDefaultDeny (0.00s) --- PASS: TestACL/NodeDefaultDeny/DefaultReadDenied.Prefix(nope) (0.00s) --- PASS: TestACL/NodeDefaultDeny/DefaultWriteDenied.Prefix(nope) (0.00s) --- PASS: TestACL/NodeDefaultDeny/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/NodeDefaultDeny/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ROReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ROWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/NodeDefaultDeny/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/NodeDefaultDeny/RWWriteAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/NodeDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildDenyReadDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildDenyWriteDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildROReadAllowed.Prefix(child-ro) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildROWriteDenied.Prefix(child-ro) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildRWReadAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildRWWriteAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildOverrideReadAllowed.Prefix(override) (0.00s) --- PASS: TestACL/NodeDefaultDeny/ChildOverrideWriteAllowed.Prefix(override) (0.00s) --- PASS: TestACL/NodeDefaultAllow (0.00s) --- PASS: TestACL/NodeDefaultAllow/DefaultReadAllowed.Prefix(nope) (0.00s) --- PASS: TestACL/NodeDefaultAllow/DefaultWriteAllowed.Prefix(nope) (0.00s) --- PASS: TestACL/NodeDefaultAllow/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/NodeDefaultAllow/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ROReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ROWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/NodeDefaultAllow/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/NodeDefaultAllow/RWWriteAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/NodeDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildDenyReadDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildDenyWriteDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildROReadAllowed.Prefix(child-ro) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildROWriteDenied.Prefix(child-ro) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildRWReadAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildRWWriteAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildOverrideReadAllowed.Prefix(override) (0.00s) --- PASS: TestACL/NodeDefaultAllow/ChildOverrideWriteAllowed.Prefix(override) (0.00s) --- PASS: TestACL/SessionDefaultDeny (0.01s) --- PASS: TestACL/SessionDefaultDeny/DefaultReadDenied.Prefix(nope) (0.00s) --- PASS: TestACL/SessionDefaultDeny/DefaultWriteDenied.Prefix(nope) (0.00s) --- PASS: TestACL/SessionDefaultDeny/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/SessionDefaultDeny/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ROReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ROWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/SessionDefaultDeny/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/SessionDefaultDeny/RWWriteAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/SessionDefaultDeny/DenySuffixReadDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/DenySuffixWriteDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ROSuffixReadAllowed.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ROSuffixWriteDenied.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/RWSuffixReadAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/RWSuffixWriteAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildDenyReadDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildDenyWriteDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildROReadAllowed.Prefix(child-ro) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildROWriteDenied.Prefix(child-ro) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildRWReadAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildRWWriteAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildOverrideReadAllowed.Prefix(override) (0.00s) --- PASS: TestACL/SessionDefaultDeny/ChildOverrideWriteAllowed.Prefix(override) (0.00s) --- PASS: TestACL/SessionDefaultAllow (0.00s) --- PASS: TestACL/SessionDefaultAllow/DefaultReadAllowed.Prefix(nope) (0.00s) --- PASS: TestACL/SessionDefaultAllow/DefaultWriteAllowed.Prefix(nope) (0.00s) --- PASS: TestACL/SessionDefaultAllow/DenyReadDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/SessionDefaultAllow/DenyWriteDenied.Prefix(root-nope) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ROReadAllowed.Prefix(root-ro) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ROWriteDenied.Prefix(root-ro) (0.00s) --- PASS: TestACL/SessionDefaultAllow/RWReadAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/SessionDefaultAllow/RWWriteAllowed.Prefix(root-rw) (0.00s) --- PASS: TestACL/SessionDefaultAllow/DenySuffixReadDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/DenySuffixWriteDenied.Prefix(root-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ROSuffixReadAllowed.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ROSuffixWriteDenied.Prefix(root-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/RWSuffixReadAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/RWSuffixWriteAllowed.Prefix(root-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildDenyReadDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildDenyWriteDenied.Prefix(child-nope) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildROReadAllowed.Prefix(child-ro) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildROWriteDenied.Prefix(child-ro) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildRWReadAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildRWWriteAllowed.Prefix(child-rw) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildDenySuffixReadDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildDenySuffixWriteDenied.Prefix(child-nope-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildROSuffixReadAllowed.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildROSuffixWriteDenied.Prefix(child-ro-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildRWSuffixReadAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildRWSuffixWriteAllowed.Prefix(child-rw-prefix) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildOverrideReadAllowed.Prefix(override) (0.00s) --- PASS: TestACL/SessionDefaultAllow/ChildOverrideWriteAllowed.Prefix(override) (0.00s) --- PASS: TestACL/Parent (0.00s) --- PASS: TestACL/Parent/KeyReadDenied.Prefix(other) (0.00s) --- PASS: TestACL/Parent/KeyWriteDenied.Prefix(other) (0.00s) --- PASS: TestACL/Parent/KeyWritePrefixDenied.Prefix(other) (0.00s) --- PASS: TestACL/Parent/KeyReadAllowed.Prefix(foo/test) (0.00s) --- PASS: TestACL/Parent/KeyWriteAllowed.Prefix(foo/test) (0.00s) --- PASS: TestACL/Parent/KeyWritePrefixAllowed.Prefix(foo/test) (0.00s) --- PASS: TestACL/Parent/KeyReadAllowed.Prefix(foo/priv/test) (0.00s) --- PASS: TestACL/Parent/KeyWriteDenied.Prefix(foo/priv/test) (0.00s) --- PASS: TestACL/Parent/KeyWritePrefixDenied.Prefix(foo/priv/test) (0.00s) --- PASS: TestACL/Parent/KeyReadDenied.Prefix(bar/any) (0.00s) --- PASS: TestACL/Parent/KeyWriteDenied.Prefix(bar/any) (0.00s) --- PASS: TestACL/Parent/KeyWritePrefixDenied.Prefix(bar/any) (0.00s) --- PASS: TestACL/Parent/KeyReadAllowed.Prefix(zip/test) (0.00s) --- PASS: TestACL/Parent/KeyWriteDenied.Prefix(zip/test) (0.00s) --- PASS: TestACL/Parent/KeyWritePrefixDenied.Prefix(zip/test) (0.00s) --- PASS: TestACL/Parent/ServiceReadDenied.Prefix(fail) (0.00s) --- PASS: TestACL/Parent/ServiceWriteDenied.Prefix(fail) (0.00s) --- PASS: TestACL/Parent/ServiceReadAllowed.Prefix(other) (0.00s) --- PASS: TestACL/Parent/ServiceWriteAllowed.Prefix(other) (0.00s) --- PASS: TestACL/Parent/ServiceReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/Parent/ServiceWriteDenied.Prefix(foo) (0.00s) --- PASS: TestACL/Parent/ServiceReadDenied.Prefix(bar) (0.00s) --- PASS: TestACL/Parent/ServiceWriteDenied.Prefix(bar) (0.00s) --- PASS: TestACL/Parent/PreparedQueryReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/Parent/PreparedQueryWriteDenied.Prefix(foo) (0.00s) --- PASS: TestACL/Parent/PreparedQueryReadAllowed.Prefix(foobar) (0.00s) --- PASS: TestACL/Parent/PreparedQueryWriteDenied.Prefix(foobar) (0.00s) --- PASS: TestACL/Parent/PreparedQueryReadDenied.Prefix(bar) (0.00s) --- PASS: TestACL/Parent/PreparedQueryWriteDenied.Prefix(bar) (0.00s) --- PASS: TestACL/Parent/PreparedQueryReadDenied.Prefix(barbaz) (0.00s) --- PASS: TestACL/Parent/PreparedQueryWriteDenied.Prefix(barbaz) (0.00s) --- PASS: TestACL/Parent/PreparedQueryReadDenied.Prefix(baz) (0.00s) --- PASS: TestACL/Parent/PreparedQueryWriteDenied.Prefix(baz) (0.00s) --- PASS: TestACL/Parent/PreparedQueryReadDenied.Prefix(nope) (0.00s) --- PASS: TestACL/Parent/PreparedQueryWriteDenied.Prefix(nope) (0.00s) --- PASS: TestACL/Parent/ACLReadDenied (0.00s) --- PASS: TestACL/Parent/ACLWriteDenied (0.00s) --- PASS: TestACL/Parent/SnapshotDenied (0.00s) --- PASS: TestACL/Parent/IntentionDefaultAllowDenied (0.00s) --- PASS: TestACL/ComplexDefaultAllow (0.01s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteAllowed.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixAllowed.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(foo/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteAllowed.Prefix(foo/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixAllowed.Prefix(foo/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(foo/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadDenied.Prefix(foo/priv/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(foo/priv/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(foo/priv/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListDenied.Prefix(foo/priv/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadDenied.Prefix(bar/any) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(bar/any) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(bar/any) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListDenied.Prefix(bar/any) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(zip/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(zip/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(zip/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListDenied.Prefix(zip/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(foo/) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteAllowed.Prefix(foo/) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(foo/) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(foo/) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadAllowed (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteAllowed (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixDenied (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListAllowed (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyReadAllowed.Prefix(zap/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWriteDenied.Prefix(zap/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyWritePrefixDenied.Prefix(zap/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/KeyListAllowed.Prefix(zap/test) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadDenied.Prefix(barfo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(barfo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(barfoo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteAllowed.Prefix(barfoo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadAllowed.Prefix(barfoo2) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteAllowed.Prefix(barfoo2) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionReadDenied.Prefix(intbaz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionWriteDenied.Prefix(intbaz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/IntentionDefaultAllowAllowed (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceWriteAllowed.Prefix(other) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceReadDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceReadDenied.Prefix(barfo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceWriteDenied.Prefix(barfo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(barfoo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceWriteAllowed.Prefix(barfoo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceReadAllowed.Prefix(barfoo2) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/ServiceWriteAllowed.Prefix(barfoo2) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventReadAllowed.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventWriteAllowed.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventReadDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventWriteDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventReadDenied.Prefix(barbaz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventWriteDenied.Prefix(barbaz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventReadAllowed.Prefix(baz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/EventWriteDenied.Prefix(baz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(foobar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(bar) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadDenied.Prefix(barbaz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(barbaz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(baz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(baz) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(nope) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteDenied.Prefix(nope) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(zoo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(zoo) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryReadAllowed.Prefix(zookeeper) (0.00s) --- PASS: TestACL/ComplexDefaultAllow/PreparedQueryWriteAllowed.Prefix(zookeeper) (0.00s) --- PASS: TestACL/ExactMatchPrecedence (0.01s) --- PASS: TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/AgentWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/KeyWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/ServiceWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(fo)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(fo)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(for)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(for)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadAllowed.Prefix(foo)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWriteAllowed.Prefix(foo)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(foot2)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(foot2)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadPrefixAllowed.Prefix(food)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWritePrefixDenied.Prefix(food)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeReadDenied.Prefix(football)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/NodeWriteDenied.Prefix(football)#01 (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/IntentionWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/SessionWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/EventWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryReadAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryReadDenied.Prefix(football) (0.00s) --- PASS: TestACL/ExactMatchPrecedence/PreparedQueryWriteDenied.Prefix(football) (0.00s) --- PASS: TestACL/ACLRead (0.00s) --- PASS: TestACL/ACLRead/ReadAllowed (0.00s) --- PASS: TestACL/ACLRead/WriteDenied (0.00s) --- PASS: TestACL/ACLRead#01 (0.00s) --- PASS: TestACL/ACLRead#01/ReadAllowed (0.00s) --- PASS: TestACL/ACLRead#01/WriteAllowed (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultDeny (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultDeny/DeniedTopLevelPrefix.Prefix(foo) (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultDeny/AllowedTopLevelPrefix.Prefix(baz/) (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultDeny/AllowedPrefixWithNestedWrite.Prefix(foo/) (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultDeny/DenyPrefixWithNestedRead.Prefix(bar/) (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultDeny/DenyNoPrefixMatch.Prefix(te) (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultAllow (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultAllow/KeyWritePrefixDenied.Prefix(foo) (0.00s) --- PASS: TestACL/KeyWritePrefixDefaultAllow/KeyWritePrefixAllowed.Prefix(bar) (0.00s) === RUN TestRootAuthorizer --- PASS: TestRootAuthorizer (0.00s) === RUN TestACLEnforce === RUN TestACLEnforce/RuleNoneRequireRead === RUN TestACLEnforce/RuleNoneRequireWrite === RUN TestACLEnforce/RuleNoneRequireList === RUN TestACLEnforce/RuleReadRequireRead === RUN TestACLEnforce/RuleReadRequireWrite === RUN TestACLEnforce/RuleReadRequireList === RUN TestACLEnforce/RuleListRequireRead === RUN TestACLEnforce/RuleListRequireWrite === RUN TestACLEnforce/RuleListRequireList === RUN TestACLEnforce/RuleWritetRequireRead === RUN TestACLEnforce/RuleWritetRequireWrite === RUN TestACLEnforce/RuleWritetRequireList === RUN TestACLEnforce/RuleDenyRequireRead === RUN TestACLEnforce/RuleDenyRequireWrite === RUN TestACLEnforce/RuleDenyRequireList --- PASS: TestACLEnforce (0.01s) --- PASS: TestACLEnforce/RuleNoneRequireRead (0.00s) --- PASS: TestACLEnforce/RuleNoneRequireWrite (0.00s) --- PASS: TestACLEnforce/RuleNoneRequireList (0.00s) --- PASS: TestACLEnforce/RuleReadRequireRead (0.00s) --- PASS: TestACLEnforce/RuleReadRequireWrite (0.00s) --- PASS: TestACLEnforce/RuleReadRequireList (0.00s) --- PASS: TestACLEnforce/RuleListRequireRead (0.00s) --- PASS: TestACLEnforce/RuleListRequireWrite (0.00s) --- PASS: TestACLEnforce/RuleListRequireList (0.00s) --- PASS: TestACLEnforce/RuleWritetRequireRead (0.00s) --- PASS: TestACLEnforce/RuleWritetRequireWrite (0.00s) --- PASS: TestACLEnforce/RuleWritetRequireList (0.00s) --- PASS: TestACLEnforce/RuleDenyRequireRead (0.00s) --- PASS: TestACLEnforce/RuleDenyRequireWrite (0.00s) --- PASS: TestACLEnforce/RuleDenyRequireList (0.00s) === RUN TestACL_Enforce === PAUSE TestACL_Enforce === RUN TestChainedAuthorizer === PAUSE TestChainedAuthorizer === RUN TestPolicyAuthorizer === PAUSE TestPolicyAuthorizer === RUN TestAnyAllowed === PAUSE TestAnyAllowed === RUN TestAllAllowed === PAUSE TestAllAllowed === RUN TestPolicySourceParse === RUN TestPolicySourceParse/Legacy_Basic === RUN TestPolicySourceParse/Legacy_(JSON) === RUN TestPolicySourceParse/Service_No_Intentions_(Legacy) === RUN TestPolicySourceParse/Service_Intentions_(Legacy) === RUN TestPolicySourceParse/Service_Intention:_invalid_value_(Legacy) === RUN TestPolicySourceParse/Bad_Policy_-_ACL === RUN TestPolicySourceParse/Bad_Policy_-_Agent === RUN TestPolicySourceParse/Bad_Policy_-_Agent_Prefix === RUN TestPolicySourceParse/Bad_Policy_-_Key === RUN TestPolicySourceParse/Bad_Policy_-_Key_Prefix === RUN TestPolicySourceParse/Bad_Policy_-_Node === RUN TestPolicySourceParse/Bad_Policy_-_Node_Prefix === RUN TestPolicySourceParse/Bad_Policy_-_Service === RUN TestPolicySourceParse/Bad_Policy_-_Service_Prefix === RUN TestPolicySourceParse/Bad_Policy_-_Session === RUN TestPolicySourceParse/Bad_Policy_-_Session_Prefix === RUN TestPolicySourceParse/Bad_Policy_-_Event === RUN TestPolicySourceParse/Bad_Policy_-_Event_Prefix === RUN TestPolicySourceParse/Bad_Policy_-_Prepared_Query === RUN TestPolicySourceParse/Bad_Policy_-_Prepared_Query_Prefix === RUN TestPolicySourceParse/Bad_Policy_-_Keyring === RUN TestPolicySourceParse/Bad_Policy_-_Operator === RUN TestPolicySourceParse/Keyring_Empty === RUN TestPolicySourceParse/Operator_Empty --- PASS: TestPolicySourceParse (0.01s) --- PASS: TestPolicySourceParse/Legacy_Basic (0.00s) --- PASS: TestPolicySourceParse/Legacy_(JSON) (0.00s) --- PASS: TestPolicySourceParse/Service_No_Intentions_(Legacy) (0.00s) --- PASS: TestPolicySourceParse/Service_Intentions_(Legacy) (0.00s) --- PASS: TestPolicySourceParse/Service_Intention:_invalid_value_(Legacy) (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_ACL (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Agent (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Agent_Prefix (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Key (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Key_Prefix (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Node (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Node_Prefix (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Service (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Service_Prefix (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Session (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Session_Prefix (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Event (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Event_Prefix (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Prepared_Query (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Prepared_Query_Prefix (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Keyring (0.00s) --- PASS: TestPolicySourceParse/Bad_Policy_-_Operator (0.00s) --- PASS: TestPolicySourceParse/Keyring_Empty (0.00s) --- PASS: TestPolicySourceParse/Operator_Empty (0.00s) === RUN TestMergePolicies === RUN TestMergePolicies/Agents === RUN TestMergePolicies/Events === RUN TestMergePolicies/Node === RUN TestMergePolicies/Keys === RUN TestMergePolicies/Services === RUN TestMergePolicies/Sessions === RUN TestMergePolicies/Prepared_Queries === RUN TestMergePolicies/Write_Precedence === RUN TestMergePolicies/Deny_Precedence === RUN TestMergePolicies/Read_Precedence --- PASS: TestMergePolicies (0.01s) --- PASS: TestMergePolicies/Agents (0.00s) --- PASS: TestMergePolicies/Events (0.00s) --- PASS: TestMergePolicies/Node (0.00s) --- PASS: TestMergePolicies/Keys (0.00s) --- PASS: TestMergePolicies/Services (0.00s) --- PASS: TestMergePolicies/Sessions (0.00s) --- PASS: TestMergePolicies/Prepared_Queries (0.00s) --- PASS: TestMergePolicies/Write_Precedence (0.00s) --- PASS: TestMergePolicies/Deny_Precedence (0.00s) --- PASS: TestMergePolicies/Read_Precedence (0.00s) === RUN TestRulesTranslate --- PASS: TestRulesTranslate (0.00s) === RUN TestRulesTranslate_GH5493 --- PASS: TestRulesTranslate_GH5493 (0.00s) === RUN TestPrecedence === RUN TestPrecedence/Deny_Over_Write === RUN TestPrecedence/Deny_Over_List === RUN TestPrecedence/Deny_Over_Read === RUN TestPrecedence/Deny_Over_Unknown === RUN TestPrecedence/Write_Over_List === RUN TestPrecedence/Write_Over_Read === RUN TestPrecedence/Write_Over_Unknown === RUN TestPrecedence/List_Over_Read === RUN TestPrecedence/List_Over_Unknown === RUN TestPrecedence/Read_Over_Unknown === RUN TestPrecedence/Write_Over_Deny === RUN TestPrecedence/List_Over_Deny === RUN TestPrecedence/Read_Over_Deny === RUN TestPrecedence/Deny_Over_Unknown#01 === RUN TestPrecedence/List_Over_Write === RUN TestPrecedence/Read_Over_Write === RUN TestPrecedence/Unknown_Over_Write === RUN TestPrecedence/Read_Over_List === RUN TestPrecedence/Unknown_Over_List === RUN TestPrecedence/Unknown_Over_Read --- PASS: TestPrecedence (0.00s) --- PASS: TestPrecedence/Deny_Over_Write (0.00s) --- PASS: TestPrecedence/Deny_Over_List (0.00s) --- PASS: TestPrecedence/Deny_Over_Read (0.00s) --- PASS: TestPrecedence/Deny_Over_Unknown (0.00s) --- PASS: TestPrecedence/Write_Over_List (0.00s) --- PASS: TestPrecedence/Write_Over_Read (0.00s) --- PASS: TestPrecedence/Write_Over_Unknown (0.00s) --- PASS: TestPrecedence/List_Over_Read (0.00s) --- PASS: TestPrecedence/List_Over_Unknown (0.00s) --- PASS: TestPrecedence/Read_Over_Unknown (0.00s) --- PASS: TestPrecedence/Write_Over_Deny (0.00s) --- PASS: TestPrecedence/List_Over_Deny (0.00s) --- PASS: TestPrecedence/Read_Over_Deny (0.00s) --- PASS: TestPrecedence/Deny_Over_Unknown#01 (0.00s) --- PASS: TestPrecedence/List_Over_Write (0.00s) --- PASS: TestPrecedence/Read_Over_Write (0.00s) --- PASS: TestPrecedence/Unknown_Over_Write (0.00s) --- PASS: TestPrecedence/Read_Over_List (0.00s) --- PASS: TestPrecedence/Unknown_Over_List (0.00s) --- PASS: TestPrecedence/Unknown_Over_Read (0.00s) === RUN TestStaticAuthorizer === PAUSE TestStaticAuthorizer === CONT TestACL_Enforce === RUN TestACL_Enforce/acl/read/Deny === CONT TestAllAllowed === CONT TestACL_Enforce/acl/read/Deny authorizer_test.go:618: PASS: ACLRead(*acl.AuthorizerContext) === CONT TestAnyAllowed === CONT TestPolicyAuthorizer === RUN TestAllAllowed/prefix-read-allowed === RUN TestPolicyAuthorizer/Intention_Wildcards_-_any_default === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_any_default === RUN TestPolicyAuthorizer/Defaults === PAUSE TestPolicyAuthorizer/Defaults === RUN TestPolicyAuthorizer/Prefer_Exact_Matches === RUN TestAllAllowed/prefix-deny === RUN TestAllAllowed/prefix-allow-other-write-exact === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches === RUN TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied === RUN TestAllAllowed/prefix-allow-other-list-exact === RUN TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed === RUN TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed === CONT TestStaticAuthorizer === RUN TestPolicyAuthorizer/Intention_Wildcards_-_all_default === RUN TestStaticAuthorizer/AllowAll === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_all_default === PAUSE TestStaticAuthorizer/AllowAll === CONT TestPolicyAuthorizer/Intention_Wildcards_-_any_default === RUN TestStaticAuthorizer/DenyAll === PAUSE TestStaticAuthorizer/DenyAll === RUN TestStaticAuthorizer/ManageAll === PAUSE TestStaticAuthorizer/ManageAll === CONT TestStaticAuthorizer/AllowAll === RUN TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AnyDefault.Prefix(*) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AnyDefault.Prefix(*) === RUN TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AllDenied.Prefix(*) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AllDenied.Prefix(*) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AnyDefault.Prefix(*) === CONT TestChainedAuthorizer === RUN TestChainedAuthorizer/No_Authorizers === PAUSE TestChainedAuthorizer/No_Authorizers === RUN TestChainedAuthorizer/Authorizer_Defaults === PAUSE TestChainedAuthorizer/Authorizer_Defaults === RUN TestChainedAuthorizer/Authorizer_No_Defaults === PAUSE TestChainedAuthorizer/Authorizer_No_Defaults === RUN TestChainedAuthorizer/First_Found === RUN TestACL_Enforce/acl/read/Allow === PAUSE TestChainedAuthorizer/First_Found === CONT TestChainedAuthorizer/No_Authorizers === CONT TestACL_Enforce/acl/read/Allow authorizer_test.go:618: PASS: ACLRead(*acl.AuthorizerContext) === RUN TestACL_Enforce/acl/write/Deny === RUN TestAllAllowed/prefix-allow-other-read-prefix === RUN TestAllAllowed/prefix-allow-other-read-exact === CONT TestACL_Enforce/acl/write/Deny authorizer_test.go:618: PASS: ACLWrite(*acl.AuthorizerContext) === RUN TestAllAllowed/prefix-allow-other-deny-exact === RUN TestACL_Enforce/acl/write/Allow === RUN TestAllAllowed/no-rules-default === RUN TestAllAllowed/prefix-write-allowed === CONT TestACL_Enforce/acl/write/Allow authorizer_test.go:618: PASS: ACLWrite(*acl.AuthorizerContext) === RUN TestACL_Enforce/acl/list/Deny === RUN TestAllAllowed/prefix-list-allowed === RUN TestAllAllowed/prefix-allow-other-write-prefix === RUN TestACL_Enforce/operator/read/Deny === RUN TestAllAllowed/prefix-allow-other-list-prefix === RUN TestAllAllowed/prefix-allow-other-deny-prefix === CONT TestACL_Enforce/operator/read/Deny authorizer_test.go:618: PASS: OperatorRead(*acl.AuthorizerContext) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed --- PASS: TestAllAllowed (0.00s) --- PASS: TestAllAllowed/prefix-read-allowed (0.00s) --- PASS: TestAllAllowed/prefix-deny (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-write-exact (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-list-exact (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-read-prefix (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-read-exact (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-deny-exact (0.00s) --- PASS: TestAllAllowed/no-rules-default (0.00s) --- PASS: TestAllAllowed/prefix-write-allowed (0.00s) --- PASS: TestAllAllowed/prefix-list-allowed (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-write-prefix (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-list-prefix (0.00s) --- PASS: TestAllAllowed/prefix-allow-other-deny-prefix (0.00s) === RUN TestACL_Enforce/operator/read/Allow authorizer_test.go:618: PASS: OperatorRead(*acl.AuthorizerContext) === RUN TestACL_Enforce/operator/write/Deny authorizer_test.go:618: PASS: OperatorWrite(*acl.AuthorizerContext) === RUN TestACL_Enforce/operator/write/Allow authorizer_test.go:618: PASS: OperatorWrite(*acl.AuthorizerContext) === RUN TestACL_Enforce/operator/list/Deny === RUN TestACL_Enforce/keyring/read/Deny authorizer_test.go:618: PASS: KeyringRead(*acl.AuthorizerContext) === RUN TestACL_Enforce/keyring/read/Allow authorizer_test.go:618: PASS: KeyringRead(*acl.AuthorizerContext) === RUN TestACL_Enforce/keyring/write/Deny authorizer_test.go:618: PASS: KeyringWrite(*acl.AuthorizerContext) === RUN TestACL_Enforce/keyring/write/Allow authorizer_test.go:618: PASS: KeyringWrite(*acl.AuthorizerContext) === RUN TestACL_Enforce/keyring/list/Deny === RUN TestACL_Enforce/agent/foo/read/Deny authorizer_test.go:618: PASS: AgentRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/agent/foo/read/Allow authorizer_test.go:618: PASS: AgentRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/agent/foo/write/Deny === RUN TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AnyAllowed.Prefix(*) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AnyAllowed.Prefix(*) === RUN TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AllAllowed.Prefix(*) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_all_default === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AllAllowed.Prefix(*) === CONT TestACL_Enforce/agent/foo/write/Deny authorizer_test.go:618: PASS: AgentWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/agent/foo/write/Allow === RUN TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AnyAllowed.Prefix(*) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AnyAllowed.Prefix(*) === RUN TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AllDefault.Prefix(*) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AllDefault.Prefix(*) === CONT TestStaticAuthorizer/DenyAll === CONT TestACL_Enforce/agent/foo/write/Allow authorizer_test.go:618: PASS: AgentWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/agent/foo/list/Deny === RUN TestACL_Enforce/event/foo/read/Deny === CONT TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AllDenied.Prefix(*) === CONT TestPolicyAuthorizer/Defaults === RUN TestPolicyAuthorizer/Defaults/DefaultACLRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultACLRead.Prefix(foo) === CONT TestACL_Enforce/event/foo/read/Deny authorizer_test.go:618: PASS: EventRead(string,*acl.AuthorizerContext) === CONT TestChainedAuthorizer/Authorizer_No_Defaults === RUN TestACL_Enforce/event/foo/read/Allow === CONT TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AnyAllowed.Prefix(*) === CONT TestACL_Enforce/event/foo/read/Allow authorizer_test.go:618: PASS: EventRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/event/foo/write/Deny === CONT TestChainedAuthorizer/Authorizer_Defaults === CONT TestACL_Enforce/event/foo/write/Deny authorizer_test.go:618: PASS: EventWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/event/foo/write/Allow === CONT TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed === RUN TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AnyAllowed.Prefix(*) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AnyAllowed.Prefix(*) === RUN TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AllDenied.Prefix(*) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AllDenied.Prefix(*) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AnyAllowed.Prefix(*) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied === RUN TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AnyAllowed.Prefix(*) === CONT TestACL_Enforce/event/foo/write/Allow authorizer_test.go:618: PASS: EventWrite(string,*acl.AuthorizerContext) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AnyAllowed.Prefix(*) === RUN TestACL_Enforce/event/foo/list/Deny === CONT TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AllDefault.Prefix(*) === RUN TestACL_Enforce/intention/foo/read/Deny === CONT TestPolicyAuthorizer/Prefer_Exact_Matches === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(for) === CONT TestACL_Enforce/intention/foo/read/Deny authorizer_test.go:618: PASS: IntentionRead(string,*acl.AuthorizerContext) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(for) === RUN TestACL_Enforce/intention/foo/read/Allow === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot2) === CONT TestACL_Enforce/intention/foo/read/Allow authorizer_test.go:618: PASS: IntentionRead(string,*acl.AuthorizerContext) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(food) === RUN TestACL_Enforce/intention/foo/write/Deny === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(for) === CONT TestACL_Enforce/intention/foo/write/Deny authorizer_test.go:618: PASS: IntentionWrite(string,*acl.AuthorizerContext) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(for) === RUN TestACL_Enforce/intention/foo/write/Allow === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot2) === CONT TestACL_Enforce/intention/foo/write/Allow authorizer_test.go:618: PASS: IntentionWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/intention/foo/list/Deny === RUN TestACL_Enforce/node/foo/read/Deny === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo) === CONT TestACL_Enforce/node/foo/read/Deny authorizer_test.go:618: PASS: NodeRead(string,*acl.AuthorizerContext) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo) === RUN TestACL_Enforce/node/foo/read/Allow === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2) === CONT TestACL_Enforce/node/foo/read/Allow authorizer_test.go:618: PASS: NodeRead(string,*acl.AuthorizerContext) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2) === CONT TestChainedAuthorizer/First_Found === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot) --- PASS: TestChainedAuthorizer (0.00s) --- PASS: TestChainedAuthorizer/No_Authorizers (0.00s) --- PASS: TestChainedAuthorizer/Authorizer_No_Defaults (0.00s) --- PASS: TestChainedAuthorizer/Authorizer_Defaults (0.00s) --- PASS: TestChainedAuthorizer/First_Found (0.00s) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AllAllowed.Prefix(*) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AllDenied.Prefix(*) === CONT TestStaticAuthorizer/ManageAll === RUN TestAnyAllowed/prefix-deny-other-read-exact === RUN TestAnyAllowed/prefix-deny-other-deny-prefix === RUN TestAnyAllowed/prefix-deny-other-deny-exact === RUN TestACL_Enforce/node/foo/write/Deny authorizer_test.go:618: PASS: NodeWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/node/foo/write/Allow authorizer_test.go:618: PASS: NodeWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/node/foo/list/Deny === RUN TestACL_Enforce/query/foo/read/Deny authorizer_test.go:618: PASS: PreparedQueryRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/query/foo/read/Allow authorizer_test.go:618: PASS: PreparedQueryRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/query/foo/write/Deny authorizer_test.go:618: PASS: PreparedQueryWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/query/foo/write/Allow authorizer_test.go:618: PASS: PreparedQueryWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/query/foo/list/Deny === RUN TestACL_Enforce/service/foo/read/Deny authorizer_test.go:618: PASS: ServiceRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/service/foo/read/Allow --- PASS: TestStaticAuthorizer (0.00s) --- PASS: TestStaticAuthorizer/AllowAll (0.00s) --- PASS: TestStaticAuthorizer/DenyAll (0.00s) --- PASS: TestStaticAuthorizer/ManageAll (0.01s) === RUN TestPolicyAuthorizer/Defaults/DefaultACLWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AnyAllowed.Prefix(*) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Defaults/DefaultACLWrite.Prefix(foo) === CONT TestACL_Enforce/service/foo/read/Allow authorizer_test.go:618: PASS: ServiceRead(string,*acl.AuthorizerContext) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Defaults/DefaultAgentRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultAgentRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultAgentWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(food) === RUN TestAnyAllowed/no-rules-default === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Defaults/DefaultAgentWrite.Prefix(foo) === RUN TestAnyAllowed/prefix-read-allowed === RUN TestPolicyAuthorizer/Defaults/DefaultEventRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultEventRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultEventWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultEventWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultIntentionDefaultAllow.Prefix(foo) === RUN TestAnyAllowed/prefix-deny === PAUSE TestPolicyAuthorizer/Defaults/DefaultIntentionDefaultAllow.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultIntentionRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultIntentionRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultIntentionWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultIntentionWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultKeyRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultKeyRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultKeyList.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultKeyList.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultKeyringRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultKeyringRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultKeyringWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultKeyringWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultKeyWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultKeyWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultKeyWritePrefix.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultKeyWritePrefix.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultNodeRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultNodeRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultNodeWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultNodeWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultOperatorRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultOperatorRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultOperatorWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultOperatorWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultPreparedQueryRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultPreparedQueryRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultPreparedQueryWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultPreparedQueryWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultServiceRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultServiceRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultServiceWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultServiceWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultSessionRead.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultSessionRead.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultSessionWrite.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultSessionWrite.Prefix(foo) === RUN TestPolicyAuthorizer/Defaults/DefaultSnapshot.Prefix(foo) === PAUSE TestPolicyAuthorizer/Defaults/DefaultSnapshot.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultACLRead.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football)#01 === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football)#01 === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(fo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(fo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(for) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(for) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteAllowed.Prefix(foo) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteAllowed.Prefix(foo) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot2) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot2) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(food) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(food) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadDenied.Prefix(football) === RUN TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(fo) === CONT TestPolicyAuthorizer/Defaults/DefaultSnapshot.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultSessionWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultSessionRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultServiceWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultServiceRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultPreparedQueryWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultPreparedQueryRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultOperatorWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultOperatorRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultNodeWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultNodeRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultKeyWritePrefix.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultKeyWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultKeyringWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultKeyringRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultKeyList.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultKeyRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultIntentionWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultIntentionRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultIntentionDefaultAllow.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultEventWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(for) === CONT TestPolicyAuthorizer/Defaults/DefaultEventRead.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultAgentWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Defaults/DefaultAgentRead.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo) === RUN TestAnyAllowed/prefix-deny-other-write-prefix === CONT TestPolicyAuthorizer/Defaults/DefaultACLWrite.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for) === RUN TestAnyAllowed/prefix-deny-other-write-exact === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for) === RUN TestAnyAllowed/prefix-deny-other-list-prefix === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo) === RUN TestAnyAllowed/prefix-deny-other-list-exact === RUN TestAnyAllowed/prefix-deny-other-read-prefix === RUN TestAnyAllowed/prefix-write-allowed === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo) === RUN TestAnyAllowed/prefix-list-allowed === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteDenied.Prefix(football) --- PASS: TestAnyAllowed (0.07s) --- PASS: TestAnyAllowed/prefix-deny-other-read-exact (0.00s) --- PASS: TestAnyAllowed/prefix-deny-other-deny-prefix (0.00s) --- PASS: TestAnyAllowed/prefix-deny-other-deny-exact (0.01s) --- PASS: TestAnyAllowed/no-rules-default (0.00s) --- PASS: TestAnyAllowed/prefix-read-allowed (0.00s) --- PASS: TestAnyAllowed/prefix-deny (0.00s) --- PASS: TestAnyAllowed/prefix-deny-other-write-prefix (0.00s) --- PASS: TestAnyAllowed/prefix-deny-other-write-exact (0.00s) --- PASS: TestAnyAllowed/prefix-deny-other-list-prefix (0.00s) --- PASS: TestAnyAllowed/prefix-deny-other-list-exact (0.00s) --- PASS: TestAnyAllowed/prefix-deny-other-read-prefix (0.00s) --- PASS: TestAnyAllowed/prefix-write-allowed (0.00s) --- PASS: TestAnyAllowed/prefix-list-allowed (0.00s) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(food) === RUN TestACL_Enforce/service/foo/write/Deny === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(for) === CONT TestACL_Enforce/service/foo/write/Deny authorizer_test.go:618: PASS: ServiceWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/service/foo/write/Allow === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(fo) === CONT TestACL_Enforce/service/foo/write/Allow authorizer_test.go:618: PASS: ServiceWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/session/foo/list/Deny === RUN TestACL_Enforce/session/foo/read/Deny === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(fo) === CONT TestACL_Enforce/session/foo/read/Deny authorizer_test.go:618: PASS: SessionRead(string,*acl.AuthorizerContext) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo)#01 === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadDenied.Prefix(football) === RUN TestACL_Enforce/session/foo/read/Allow === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot) === RUN TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AllDenied.Prefix(*) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteAllowed.Prefix(foo) === CONT TestACL_Enforce/session/foo/read/Allow authorizer_test.go:618: PASS: SessionRead(string,*acl.AuthorizerContext) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(for) === RUN TestACL_Enforce/session/foo/write/Deny === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadAllowed.Prefix(foo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(for) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(fo) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadDenied.Prefix(football) === PAUSE TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AllDenied.Prefix(*) === CONT TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AnyAllowed.Prefix(*) === CONT TestACL_Enforce/session/foo/write/Deny authorizer_test.go:618: PASS: SessionWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/session/foo/write/Allow === CONT TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AllDenied.Prefix(*) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot) === CONT TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(food) === CONT TestACL_Enforce/session/foo/write/Allow authorizer_test.go:618: PASS: SessionWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/session/foo/list/Deny#01 === RUN TestACL_Enforce/key/foo/read/Deny --- PASS: TestPolicyAuthorizer (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_any_default (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AnyDefault.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_any_default/AllDenied.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_all_default (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AnyAllowed.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_all_default/AllDefault.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AnyAllowed.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_all_allowed/AllAllowed.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AnyAllowed.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_prefix_allowed/AllDenied.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults (0.06s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultACLRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultSnapshot.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultSessionWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultSessionRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultServiceWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultServiceRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultPreparedQueryWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultPreparedQueryRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultOperatorWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultOperatorRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultNodeWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultNodeRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultKeyWritePrefix.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultKeyWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultKeyringWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultKeyringRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultKeyList.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultKeyRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultIntentionWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultIntentionRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultIntentionDefaultAllow.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultEventRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultAgentWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultAgentRead.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultACLWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Defaults/DefaultEventWrite.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied (0.07s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AnyAllowed.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Intention_Wildcards_-_prefix_denied/AllDenied.Prefix(*) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches (0.06s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/EventReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/IntentionReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteAllowed.Prefix(foo)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadAllowed.Prefix(foo)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(for)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(for)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(fo)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(fo)#01 (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/KeyReadPrefixAllowed.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWriteDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWriteAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot2) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadAllowed.Prefix(foo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(for) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentWritePrefixDenied.Prefix(fo) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadDenied.Prefix(football) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/PreparedQueryWritePrefixDenied.Prefix(food) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/SessionReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/AgentReadPrefixAllowed.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/NodeWritePrefixDenied.Prefix(foot) (0.00s) --- PASS: TestPolicyAuthorizer/Prefer_Exact_Matches/ServiceReadPrefixAllowed.Prefix(food) (0.00s) === CONT TestACL_Enforce/key/foo/read/Deny authorizer_test.go:618: PASS: KeyRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/key/foo/read/Allow authorizer_test.go:618: PASS: KeyRead(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/key/foo/write/Deny authorizer_test.go:618: PASS: KeyWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/key/foo/write/Allow authorizer_test.go:618: PASS: KeyWrite(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/key/foo/list/Deny authorizer_test.go:618: PASS: KeyList(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/key/foo/list/Allow authorizer_test.go:618: PASS: KeyList(string,*acl.AuthorizerContext) === RUN TestACL_Enforce/key/foo/deny/Deny === RUN TestACL_Enforce/not-a-real-resource/read/Deny --- PASS: TestACL_Enforce (0.08s) --- PASS: TestACL_Enforce/acl/read/Deny (0.00s) --- PASS: TestACL_Enforce/acl/read/Allow (0.00s) --- PASS: TestACL_Enforce/acl/write/Deny (0.00s) --- PASS: TestACL_Enforce/acl/write/Allow (0.00s) --- PASS: TestACL_Enforce/acl/list/Deny (0.00s) --- PASS: TestACL_Enforce/operator/read/Deny (0.00s) --- PASS: TestACL_Enforce/operator/read/Allow (0.00s) --- PASS: TestACL_Enforce/operator/write/Deny (0.00s) --- PASS: TestACL_Enforce/operator/write/Allow (0.00s) --- PASS: TestACL_Enforce/operator/list/Deny (0.00s) --- PASS: TestACL_Enforce/keyring/read/Deny (0.00s) --- PASS: TestACL_Enforce/keyring/read/Allow (0.00s) --- PASS: TestACL_Enforce/keyring/write/Deny (0.00s) --- PASS: TestACL_Enforce/keyring/write/Allow (0.00s) --- PASS: TestACL_Enforce/keyring/list/Deny (0.00s) --- PASS: TestACL_Enforce/agent/foo/read/Deny (0.00s) --- PASS: TestACL_Enforce/agent/foo/read/Allow (0.00s) --- PASS: TestACL_Enforce/agent/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/agent/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/agent/foo/list/Deny (0.00s) --- PASS: TestACL_Enforce/event/foo/read/Deny (0.00s) --- PASS: TestACL_Enforce/event/foo/read/Allow (0.00s) --- PASS: TestACL_Enforce/event/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/event/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/event/foo/list/Deny (0.00s) --- PASS: TestACL_Enforce/intention/foo/read/Deny (0.00s) --- PASS: TestACL_Enforce/intention/foo/read/Allow (0.00s) --- PASS: TestACL_Enforce/intention/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/intention/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/intention/foo/list/Deny (0.00s) --- PASS: TestACL_Enforce/node/foo/read/Deny (0.00s) --- PASS: TestACL_Enforce/node/foo/read/Allow (0.00s) --- PASS: TestACL_Enforce/node/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/node/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/node/foo/list/Deny (0.00s) --- PASS: TestACL_Enforce/query/foo/read/Deny (0.00s) --- PASS: TestACL_Enforce/query/foo/read/Allow (0.00s) --- PASS: TestACL_Enforce/query/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/query/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/query/foo/list/Deny (0.00s) --- PASS: TestACL_Enforce/service/foo/read/Deny (0.00s) --- PASS: TestACL_Enforce/service/foo/read/Allow (0.04s) --- PASS: TestACL_Enforce/service/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/service/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/session/foo/list/Deny (0.00s) --- PASS: TestACL_Enforce/session/foo/read/Deny (0.01s) --- PASS: TestACL_Enforce/session/foo/read/Allow (0.00s) --- PASS: TestACL_Enforce/session/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/session/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/session/foo/list/Deny#01 (0.00s) --- PASS: TestACL_Enforce/key/foo/read/Deny (0.00s) --- PASS: TestACL_Enforce/key/foo/read/Allow (0.00s) --- PASS: TestACL_Enforce/key/foo/write/Deny (0.00s) --- PASS: TestACL_Enforce/key/foo/write/Allow (0.00s) --- PASS: TestACL_Enforce/key/foo/list/Deny (0.00s) --- PASS: TestACL_Enforce/key/foo/list/Allow (0.00s) --- PASS: TestACL_Enforce/key/foo/deny/Deny (0.00s) --- PASS: TestACL_Enforce/not-a-real-resource/read/Deny (0.00s) PASS ok github.com/hashicorp/consul/acl 0.200s === RUN TestACL_Legacy_Disabled_Response === PAUSE TestACL_Legacy_Disabled_Response === RUN TestACL_Legacy_Update === PAUSE TestACL_Legacy_Update === RUN TestACL_Legacy_UpdateUpsert === PAUSE TestACL_Legacy_UpdateUpsert === RUN TestACL_Legacy_Destroy === PAUSE TestACL_Legacy_Destroy === RUN TestACL_Legacy_Clone === PAUSE TestACL_Legacy_Clone === RUN TestACL_Legacy_Get === PAUSE TestACL_Legacy_Get === RUN TestACL_Legacy_List === PAUSE TestACL_Legacy_List === RUN TestACLReplicationStatus === PAUSE TestACLReplicationStatus === RUN TestACL_Disabled_Response === PAUSE TestACL_Disabled_Response === RUN TestACL_Bootstrap === PAUSE TestACL_Bootstrap === RUN TestACL_HTTP === PAUSE TestACL_HTTP === RUN TestACL_LoginProcedure_HTTP === PAUSE TestACL_LoginProcedure_HTTP === RUN TestACLEndpoint_LoginLogout_jwt === PAUSE TestACLEndpoint_LoginLogout_jwt === RUN TestACL_Authorize === PAUSE TestACL_Authorize === RUN TestACL_Version8EnabledByDefault === PAUSE TestACL_Version8EnabledByDefault === RUN TestACL_AgentMasterToken === PAUSE TestACL_AgentMasterToken === RUN TestACL_RootAuthorizersDenied === PAUSE TestACL_RootAuthorizersDenied === RUN TestACL_vetServiceRegister === PAUSE TestACL_vetServiceRegister === RUN TestACL_vetServiceUpdate === PAUSE TestACL_vetServiceUpdate === RUN TestACL_vetCheckRegister === PAUSE TestACL_vetCheckRegister === RUN TestACL_vetCheckUpdate === PAUSE TestACL_vetCheckUpdate === RUN TestACL_filterMembers === PAUSE TestACL_filterMembers === RUN TestACL_filterServices === PAUSE TestACL_filterServices === RUN TestACL_filterChecks === PAUSE TestACL_filterChecks === RUN TestACL_ResolveIdentity === PAUSE TestACL_ResolveIdentity === RUN TestAgent_Services === PAUSE TestAgent_Services === RUN TestAgent_ServicesFiltered === PAUSE TestAgent_ServicesFiltered === RUN TestAgent_Services_ExternalConnectProxy === PAUSE TestAgent_Services_ExternalConnectProxy === RUN TestAgent_Services_Sidecar === PAUSE TestAgent_Services_Sidecar === RUN TestAgent_Services_MeshGateway === PAUSE TestAgent_Services_MeshGateway === RUN TestAgent_Services_TerminatingGateway === PAUSE TestAgent_Services_TerminatingGateway === RUN TestAgent_Services_ACLFilter === PAUSE TestAgent_Services_ACLFilter === RUN TestAgent_Service agent_endpoint_test.go:310: DM-skipped --- SKIP: TestAgent_Service (0.00s) === RUN TestAgent_Checks === PAUSE TestAgent_Checks === RUN TestAgent_ChecksWithFilter === PAUSE TestAgent_ChecksWithFilter === RUN TestAgent_HealthServiceByID === PAUSE TestAgent_HealthServiceByID === RUN TestAgent_HealthServiceByName === PAUSE TestAgent_HealthServiceByName === RUN TestAgent_HealthServicesACLEnforcement === PAUSE TestAgent_HealthServicesACLEnforcement === RUN TestAgent_Checks_ACLFilter === PAUSE TestAgent_Checks_ACLFilter === RUN TestAgent_Self === PAUSE TestAgent_Self === RUN TestAgent_Self_ACLDeny === PAUSE TestAgent_Self_ACLDeny === RUN TestAgent_Metrics_ACLDeny === PAUSE TestAgent_Metrics_ACLDeny === RUN TestAgent_Reload === PAUSE TestAgent_Reload === RUN TestAgent_ReloadDoesNotTriggerWatch [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:29:35.624Z [WARN] TestAgent_ReloadDoesNotTriggerWatch: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:35.565Z [INFO] TestAgent_ReloadDoesNotTriggerWatch: Watch not yet populated, retrying 2021-10-05T16:29:34.564Z [INFO] TestAgent_ReloadDoesNotTriggerWatch: Consul is now ready 2021-10-05T16:29:34.122Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:34.150Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:34.347 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:eda9219b-0d2f-b31a-275b-066696eb17b0 Address:127.0.0.1:29405}]" 29:34.349 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-eda9219b-0d2f-b31a-275b-066696eb17b0.dc1 127.0.0.1 29:34.350 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-eda9219b-0d2f-b31a-275b-066696eb17b0 127.0.0.1 2021-10-05T16:29:34.350Z [INFO] agent.router: Initializing LAN area manager 29:34.356 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29405 [Follower]" leader= 29:34.357 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-eda9219b-0d2f-b31a-275b-066696eb17b0.dc1 area=wan 29:34.358 [INFO] TestAgent.server: Adding LAN server: server="Node-eda9219b-0d2f-b31a-275b-066696eb17b0 (Addr: tcp/127.0.0.1:29405) (DC: dc1)" 29:34.358 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=tcp 29:34.358 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=udp 29:34.364 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29401 network=tcp 29:34.364 [INFO] TestAgent: started state syncer 29:34.364 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29406 network=tcp 29:34.408 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:34.408 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29405 [Candidate]" term=2 29:34.436 [DEBUG] TestAgent.server.raft: votes: needed=1 29:34.436 [DEBUG] TestAgent.server.raft: vote granted: from=eda9219b-0d2f-b31a-275b-066696eb17b0 term=2 tally=1 29:34.436 [INFO] TestAgent.server.raft: election won: tally=1 29:34.436 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29405 [Leader]" 29:34.436 [INFO] TestAgent.server: cluster leadership acquired 29:34.436 [INFO] TestAgent.server: New leader elected: payload=Node-eda9219b-0d2f-b31a-275b-066696eb17b0 29:34.446 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29405 29:34.471 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:34.536 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:34.536 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:34.536 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:34.536 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:34.536 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:34.536 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-eda9219b-0d2f-b31a-275b-066696eb17b0 29:34.536 [INFO] TestAgent.server: member joined, marking health alive: member=Node-eda9219b-0d2f-b31a-275b-066696eb17b0 29:34.556 [INFO] TestAgent.server: federation state anti-entropy synced 29:34.564 [DEBUG] TestAgent: Check status updated: check=red-is-dead status=passing 29:34.598 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:34.606 [INFO] TestAgent: Synced node info 29:34.608 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/service/redis?dc=dc1 from=127.0.0.1:60580 latency=242.265873ms 29:34.614 [INFO] TestAgent: Synced service: service=redis 29:34.614 [DEBUG] TestAgent: Check in sync: check=red-is-dead 29:34.614 [DEBUG] TestAgent: Node info in sync 29:34.614 [DEBUG] TestAgent: Service in sync: service=redis 29:34.614 [DEBUG] TestAgent: Check in sync: check=red-is-dead 29:34.639 [DEBUG] TestAgent: watch handler output: watch_handler=[bash, -c, "(cat ; echo CONSUL_INDEX $CONSUL_INDEX) | tee '/tmp/rexec738890493.atomic' ; mv '/tmp/rexec738890493.atomic' '/tmp/rexec738890493'"] output="[] CONSUL_INDEX 12 " 29:34.640 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/service/redis?dc=dc1&index=12 from=127.0.0.1:60580 latency=1.183746ms 29:34.664 [DEBUG] TestAgent: watch handler output: watch_handler=[bash, -c, "(cat ; echo CONSUL_INDEX $CONSUL_INDEX) | tee '/tmp/rexec738890493.atomic' ; mv '/tmp/rexec738890493.atomic' '/tmp/rexec738890493'"] output="[{"Node":{"ID":"eda9219b-0d2f-b31a-275b-066696eb17b0","Node":"Node-eda9219b-0d2f-b31a-275b-066696eb17b0","Address":"127.0.0.1","Datacenter":"dc1","TaggedAddresses":{"lan":"127.0.0.1","lan_ipv4":"127.0.0.1","wan":"127.0.0.1","wan_ipv4":"127.0.0.1"},"Meta":{"consul-network-segment":""},"CreateIndex":10,"ModifyIndex":12},"Service":{"ID":"redis","Service":"redis","Tags":[],"Meta":null,"Port":0,"Address":"","Weights":{"Passing":1,"Warning":1},"EnableTagOverride":false,"CreateIndex":13,"ModifyIndex":13,"Proxy":{"MeshGateway":{},"Expose":{}},"Connect":{}},"Checks":[{"Node":"Node-eda9219b-0d2f-b31a-275b-066696eb17b0","CheckID":"serfHealth","Name":"Serf Health Status","Status":"passing","Notes":"","Output":"Agent alive and reachable","ServiceID":"","ServiceName":"","ServiceTags":[],"Type":"","Definition":{"Interval":"0s","Timeout":"0s","DeregisterCriticalServiceAfter":"0s","HTTP":"","Header":null,"Method":"","Body":"","TLSSkipVerify":false,"TCP":""},"CreateIndex":10,"ModifyIndex":10},{"Node":"Node-eda9219b-0d2f-b31a-275b-066696eb17b0","CheckID":"red-is-dead","Name":"Service 'redis' check","Status":"passing","Notes":"initial check","Output":"testing-agent-reload-001","ServiceID":"redis","ServiceName":"redis","ServiceTags":[],"Type":"ttl","Definition":{"Interval":"0s","Timeout":"0s","DeregisterCriticalServiceAfter":"0s","HTTP":"","Header":null,"Method":"","Body":"","TLSSkipVerify":false,"TCP":""},"CreateIndex":13,"ModifyIndex":13}]}] CONSUL_INDEX 13 " 29:35.625 [INFO] TestAgent: Requesting shutdown 29:35.625 [INFO] TestAgent.server: shutting down server 29:35.625 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:35.626 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:35.634 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:35.639Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:35.639Z [INFO] agent.router.manager: shutting down 29:35.639 [INFO] TestAgent: consul server down 29:35.639 [INFO] TestAgent: shutdown complete 29:35.639 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=tcp 29:35.639 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=udp 29:35.639 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29401 network=tcp 29:36.140 [INFO] TestAgent: Waiting for endpoints to shut down 29:36.140 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ReloadDoesNotTriggerWatch (2.12s) === RUN TestAgent_Reload_ACLDeny === PAUSE TestAgent_Reload_ACLDeny === RUN TestAgent_Members === PAUSE TestAgent_Members === RUN TestAgent_Members_WAN === PAUSE TestAgent_Members_WAN === RUN TestAgent_Members_ACLFilter === PAUSE TestAgent_Members_ACLFilter === RUN TestAgent_Join === PAUSE TestAgent_Join === RUN TestAgent_Join_WAN === PAUSE TestAgent_Join_WAN === RUN TestAgent_Join_ACLDeny === PAUSE TestAgent_Join_ACLDeny === RUN TestAgent_JoinLANNotify === PAUSE TestAgent_JoinLANNotify === RUN TestAgent_Leave === PAUSE TestAgent_Leave === RUN TestAgent_Leave_ACLDeny === PAUSE TestAgent_Leave_ACLDeny === RUN TestAgent_ForceLeave === PAUSE TestAgent_ForceLeave === RUN TestOpenMetricsMimeTypeHeaders === PAUSE TestOpenMetricsMimeTypeHeaders === RUN TestAgent_ForceLeave_ACLDeny === PAUSE TestAgent_ForceLeave_ACLDeny === RUN TestAgent_ForceLeavePrune === PAUSE TestAgent_ForceLeavePrune === RUN TestAgent_RegisterCheck === PAUSE TestAgent_RegisterCheck === RUN TestAgent_RegisterCheck_Scripts === PAUSE TestAgent_RegisterCheck_Scripts === RUN TestAgent_RegisterCheckScriptsExecDisable === PAUSE TestAgent_RegisterCheckScriptsExecDisable === RUN TestAgent_RegisterCheckScriptsExecRemoteDisable === PAUSE TestAgent_RegisterCheckScriptsExecRemoteDisable === RUN TestAgent_RegisterCheck_Passing === PAUSE TestAgent_RegisterCheck_Passing === RUN TestAgent_RegisterCheck_BadStatus === PAUSE TestAgent_RegisterCheck_BadStatus === RUN TestAgent_RegisterCheck_ACLDeny === PAUSE TestAgent_RegisterCheck_ACLDeny === RUN TestAgent_DeregisterCheck === PAUSE TestAgent_DeregisterCheck === RUN TestAgent_DeregisterCheckACLDeny === PAUSE TestAgent_DeregisterCheckACLDeny === RUN TestAgent_PassCheck === PAUSE TestAgent_PassCheck === RUN TestAgent_PassCheck_ACLDeny === PAUSE TestAgent_PassCheck_ACLDeny === RUN TestAgent_WarnCheck === PAUSE TestAgent_WarnCheck === RUN TestAgent_WarnCheck_ACLDeny === PAUSE TestAgent_WarnCheck_ACLDeny === RUN TestAgent_FailCheck === PAUSE TestAgent_FailCheck === RUN TestAgent_FailCheck_ACLDeny === PAUSE TestAgent_FailCheck_ACLDeny === RUN TestAgent_UpdateCheck agent_endpoint_test.go:2582: DM-skipped --- SKIP: TestAgent_UpdateCheck (0.00s) === RUN TestAgent_UpdateCheck_ACLDeny === PAUSE TestAgent_UpdateCheck_ACLDeny === RUN TestAgent_RegisterService === RUN TestAgent_RegisterService/normal === PAUSE TestAgent_RegisterService/normal === RUN TestAgent_RegisterService/service_manager === PAUSE TestAgent_RegisterService/service_manager === CONT TestAgent_RegisterService/normal === CONT TestAgent_RegisterService/service_manager 2021-10-05T16:29:36.160Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:36.188Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:36.259 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c3d324f5-53c8-8241-6121-58f404b971e4 Address:127.0.0.1:29412}]" 29:36.259 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29412 [Follower]" leader= 29:36.260 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c3d324f5-53c8-8241-6121-58f404b971e4.dc1 127.0.0.1 29:36.265 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c3d324f5-53c8-8241-6121-58f404b971e4 127.0.0.1 2021-10-05T16:29:36.265Z [INFO] agent.router: Initializing LAN area manager 29:36.265 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=udp 29:36.265 [INFO] TestAgent.server: Adding LAN server: server="Node-c3d324f5-53c8-8241-6121-58f404b971e4 (Addr: tcp/127.0.0.1:29412) (DC: dc1)" 29:36.265 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c3d324f5-53c8-8241-6121-58f404b971e4.dc1 area=wan 29:36.265 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=tcp 29:36.266 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29408 network=tcp 29:36.266 [INFO] TestAgent: started state syncer 29:36.266 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29413 network=tcp 29:36.316 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:36.316 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29412 [Candidate]" term=2 29:36.325 [DEBUG] TestAgent.server.raft: votes: needed=1 29:36.325 [DEBUG] TestAgent.server.raft: vote granted: from=c3d324f5-53c8-8241-6121-58f404b971e4 term=2 tally=1 29:36.325 [INFO] TestAgent.server.raft: election won: tally=1 29:36.325 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29412 [Leader]" 29:36.326 [INFO] TestAgent.server: cluster leadership acquired 29:36.326 [INFO] TestAgent.server: New leader elected: payload=Node-c3d324f5-53c8-8241-6121-58f404b971e4 29:36.332 [INFO] TestAgent: Synced node info 29:36.332 [DEBUG] TestAgent: Node info in sync 29:36.332 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29412 29:36.372 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:36.395 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:36.395 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:36.395 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:36.395 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:36.395 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:36.395 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c3d324f5-53c8-8241-6121-58f404b971e4 29:36.396 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c3d324f5-53c8-8241-6121-58f404b971e4 29:36.436 [INFO] TestAgent.server: federation state anti-entropy synced 29:36.504 [DEBUG] TestAgent: Node info in sync 29:36.517 [INFO] TestAgent: Synced service: service=test 29:36.517 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:36.517 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:36.517 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:36.517 [INFO] TestAgent: Requesting shutdown 29:36.517 [INFO] TestAgent.server: shutting down server 29:36.517 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:36.517 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:36.517 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:36.517 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:36.517 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:36.517 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:36.517 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:36.517 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:36.518 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:36.518 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:36.528 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:36.536Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:36.536Z [INFO] agent.router.manager: shutting down 29:36.536 [INFO] TestAgent: consul server down 29:36.536 [INFO] TestAgent: shutdown complete 29:36.536 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=tcp 29:36.536 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=udp 29:36.536 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29408 network=tcp 29:37.037 [INFO] TestAgent: Waiting for endpoints to shut down 29:37.037 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:36.192Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:36.229Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:36.316 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:90462246-0a5c-a9fb-96b4-ebb04ecdf915 Address:127.0.0.1:29419}]" 29:36.316 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29419 [Follower]" leader= 29:36.317 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-90462246-0a5c-a9fb-96b4-ebb04ecdf915.dc1 127.0.0.1 29:36.318 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-90462246-0a5c-a9fb-96b4-ebb04ecdf915 127.0.0.1 2021-10-05T16:29:36.318Z [INFO] agent.router: Initializing LAN area manager 29:36.318 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29414 network=udp 29:36.318 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-90462246-0a5c-a9fb-96b4-ebb04ecdf915.dc1 area=wan 29:36.318 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29414 network=tcp 29:36.318 [INFO] TestAgent.server: Adding LAN server: server="Node-90462246-0a5c-a9fb-96b4-ebb04ecdf915 (Addr: tcp/127.0.0.1:29419) (DC: dc1)" 29:36.319 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29415 network=tcp 29:36.319 [INFO] TestAgent: started state syncer 29:36.319 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29420 network=tcp 29:36.382 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:36.382 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29419 [Candidate]" term=2 29:36.420 [DEBUG] TestAgent.server.raft: votes: needed=1 29:36.420 [DEBUG] TestAgent.server.raft: vote granted: from=90462246-0a5c-a9fb-96b4-ebb04ecdf915 term=2 tally=1 29:36.420 [INFO] TestAgent.server.raft: election won: tally=1 29:36.420 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29419 [Leader]" 29:36.420 [INFO] TestAgent.server: cluster leadership acquired 29:36.420 [INFO] TestAgent.server: New leader elected: payload=Node-90462246-0a5c-a9fb-96b4-ebb04ecdf915 29:36.444 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29419 29:36.491 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:36.540 [INFO] TestAgent: Synced node info 29:36.540 [DEBUG] TestAgent: Node info in sync 29:36.564 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:36.564 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:36.564 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:36.564 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:36.564 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:36.564 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-90462246-0a5c-a9fb-96b4-ebb04ecdf915 29:36.564 [INFO] TestAgent.server: member joined, marking health alive: member=Node-90462246-0a5c-a9fb-96b4-ebb04ecdf915 29:36.607 [INFO] TestAgent.server: federation state anti-entropy synced 29:36.708 [DEBUG] TestAgent: Node info in sync 29:36.729 [INFO] TestAgent: Synced service: service=test 29:36.729 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:36.729 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:36.729 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:36.729 [INFO] TestAgent: Requesting shutdown 29:36.729 [INFO] TestAgent.server: shutting down server 29:36.729 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:36.729 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:36.729 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:36.729 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:36.729 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:36.729 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:36.729 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:36.729 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:36.729 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:36.729 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:36.736 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:36.736Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:36.736Z [INFO] agent.router.manager: shutting down 29:36.736 [INFO] TestAgent: consul server down 29:36.736 [INFO] TestAgent: shutdown complete 29:36.736 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29414 network=tcp 29:36.736 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29414 network=udp 29:36.736 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29415 network=tcp 29:37.240 [INFO] TestAgent: Waiting for endpoints to shut down 29:37.240 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService (0.00s) --- PASS: TestAgent_RegisterService/normal (0.90s) --- PASS: TestAgent_RegisterService/service_manager (1.10s) === RUN TestAgent_RegisterService_ReRegister === RUN TestAgent_RegisterService_ReRegister/normal === PAUSE TestAgent_RegisterService_ReRegister/normal === RUN TestAgent_RegisterService_ReRegister/service_manager === PAUSE TestAgent_RegisterService_ReRegister/service_manager === CONT TestAgent_RegisterService_ReRegister/normal === CONT TestAgent_RegisterService_ReRegister/service_manager 2021-10-05T16:29:37.269Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:37.308Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:37.548 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8d5ff3fe-50d1-0df3-ad32-134ac16a6085 Address:127.0.0.1:29433}]" 29:37.549 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29433 [Follower]" leader= 29:37.549 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8d5ff3fe-50d1-0df3-ad32-134ac16a6085.dc1 127.0.0.1 29:37.550 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8d5ff3fe-50d1-0df3-ad32-134ac16a6085 127.0.0.1 2021-10-05T16:29:37.550Z [INFO] agent.router: Initializing LAN area manager 29:37.551 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29428 network=udp 29:37.551 [INFO] TestAgent.server: Adding LAN server: server="Node-8d5ff3fe-50d1-0df3-ad32-134ac16a6085 (Addr: tcp/127.0.0.1:29433) (DC: dc1)" 29:37.551 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8d5ff3fe-50d1-0df3-ad32-134ac16a6085.dc1 area=wan 29:37.551 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29428 network=tcp 29:37.552 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29429 network=tcp 29:37.552 [INFO] TestAgent: started state syncer 29:37.552 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29434 network=tcp 29:37.606 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:37.606 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29433 [Candidate]" term=2 29:37.625 [DEBUG] TestAgent.server.raft: votes: needed=1 29:37.625 [DEBUG] TestAgent.server.raft: vote granted: from=8d5ff3fe-50d1-0df3-ad32-134ac16a6085 term=2 tally=1 29:37.625 [INFO] TestAgent.server.raft: election won: tally=1 29:37.625 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29433 [Leader]" 29:37.628 [INFO] TestAgent.server: cluster leadership acquired 29:37.628 [INFO] TestAgent.server: New leader elected: payload=Node-8d5ff3fe-50d1-0df3-ad32-134ac16a6085 29:37.648 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29433 29:37.678 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:37.728 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:37.728 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:37.728 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:37.728 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:37.728 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:37.728 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8d5ff3fe-50d1-0df3-ad32-134ac16a6085 29:37.728 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8d5ff3fe-50d1-0df3-ad32-134ac16a6085 29:37.758 [INFO] TestAgent.server: federation state anti-entropy synced 29:37.783 [INFO] TestAgent: Synced node info 29:37.789 [INFO] TestAgent: Synced service: service=test 29:37.789 [DEBUG] TestAgent: Check in sync: check=check_1 29:37.789 [DEBUG] TestAgent: Check in sync: check=check_2 29:37.801 [DEBUG] TestAgent: Node info in sync 29:37.818 [INFO] TestAgent: Synced service: service=test 29:37.819 [DEBUG] TestAgent: Check in sync: check=check_1 29:37.819 [DEBUG] TestAgent: Check in sync: check=check_2 29:37.819 [DEBUG] TestAgent: Check in sync: check=check_3 29:37.819 [INFO] TestAgent: Requesting shutdown 29:37.819 [INFO] TestAgent.server: shutting down server 29:37.819 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:37.819 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:37.819 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:37.819 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:37.819 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:37.819 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:37.819 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:37.819 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:37.819 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:37.819 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:37.819 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:37.828 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:37.840Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:37.840Z [INFO] agent.router.manager: shutting down 29:37.840 [INFO] TestAgent: consul server down 29:37.840 [INFO] TestAgent: shutdown complete 29:37.840 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29428 network=tcp 29:37.840 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29428 network=udp 29:37.840 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29429 network=tcp 29:38.340 [INFO] TestAgent: Waiting for endpoints to shut down 29:38.340 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:37.268Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:37.336Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:37.551 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1cee6c4e-431e-84c3-2b5e-2df2e74fadf2 Address:127.0.0.1:29426}]" 29:37.552 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1cee6c4e-431e-84c3-2b5e-2df2e74fadf2.dc1 127.0.0.1 29:37.552 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1cee6c4e-431e-84c3-2b5e-2df2e74fadf2 127.0.0.1 2021-10-05T16:29:37.552Z [INFO] agent.router: Initializing LAN area manager 29:37.553 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29421 network=udp 29:37.553 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29426 [Follower]" leader= 29:37.553 [INFO] TestAgent.server: Adding LAN server: server="Node-1cee6c4e-431e-84c3-2b5e-2df2e74fadf2 (Addr: tcp/127.0.0.1:29426) (DC: dc1)" 29:37.553 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1cee6c4e-431e-84c3-2b5e-2df2e74fadf2.dc1 area=wan 29:37.553 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29421 network=tcp 29:37.554 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29422 network=tcp 29:37.554 [INFO] TestAgent: started state syncer 29:37.554 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29427 network=tcp 29:37.616 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:37.616 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29426 [Candidate]" term=2 29:37.652 [DEBUG] TestAgent.server.raft: votes: needed=1 29:37.652 [DEBUG] TestAgent.server.raft: vote granted: from=1cee6c4e-431e-84c3-2b5e-2df2e74fadf2 term=2 tally=1 29:37.652 [INFO] TestAgent.server.raft: election won: tally=1 29:37.652 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29426 [Leader]" 29:37.656 [INFO] TestAgent.server: cluster leadership acquired 29:37.656 [INFO] TestAgent.server: New leader elected: payload=Node-1cee6c4e-431e-84c3-2b5e-2df2e74fadf2 29:37.671 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29426 29:37.690 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:37.741 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:37.741 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:37.741 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:37.741 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:37.741 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:37.741 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1cee6c4e-431e-84c3-2b5e-2df2e74fadf2 29:37.741 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1cee6c4e-431e-84c3-2b5e-2df2e74fadf2 29:37.772 [INFO] TestAgent.server: federation state anti-entropy synced 29:37.892 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:37.916 [INFO] TestAgent: Synced node info 29:37.916 [DEBUG] TestAgent: Node info in sync 29:37.936 [DEBUG] TestAgent: Node info in sync 29:37.952 [INFO] TestAgent: Synced service: service=test 29:37.952 [DEBUG] TestAgent: Check in sync: check=check_1 29:37.952 [DEBUG] TestAgent: Check in sync: check=check_2 29:37.980 [DEBUG] TestAgent: Node info in sync 29:37.996 [INFO] TestAgent: Synced service: service=test 29:37.996 [DEBUG] TestAgent: Check in sync: check=check_1 29:37.996 [DEBUG] TestAgent: Check in sync: check=check_2 29:37.996 [DEBUG] TestAgent: Check in sync: check=check_3 29:37.996 [INFO] TestAgent: Requesting shutdown 29:37.996 [INFO] TestAgent.server: shutting down server 29:37.996 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:37.996 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:37.996 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:37.996 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:37.996 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:37.996 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:37.996 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:37.997 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:37.997 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:37.997 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:38.016 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:38.024Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:38.024Z [INFO] agent.router.manager: shutting down 29:38.024 [INFO] TestAgent: consul server down 29:38.024 [INFO] TestAgent: shutdown complete 29:38.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29421 network=tcp 29:38.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29421 network=udp 29:38.024 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29422 network=tcp 29:38.526 [INFO] TestAgent: Waiting for endpoints to shut down 29:38.526 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_ReRegister (0.00s) --- PASS: TestAgent_RegisterService_ReRegister/service_manager (1.10s) --- PASS: TestAgent_RegisterService_ReRegister/normal (1.29s) === RUN TestAgent_RegisterService_ReRegister_ReplaceExistingChecks === RUN TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/normal === PAUSE TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/normal === RUN TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/service_manager === PAUSE TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/service_manager === CONT TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/normal === CONT TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/service_manager 2021-10-05T16:29:38.558Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:38.601Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:38.668 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c7bb8f77-8a31-72bd-4c31-66ed7c431b60 Address:127.0.0.1:29440}]" 29:38.669 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c7bb8f77-8a31-72bd-4c31-66ed7c431b60.dc1 127.0.0.1 29:38.670 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c7bb8f77-8a31-72bd-4c31-66ed7c431b60 127.0.0.1 2021-10-05T16:29:38.670Z [INFO] agent.router: Initializing LAN area manager 29:38.670 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29435 network=udp 29:38.670 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29440 [Follower]" leader= 29:38.671 [INFO] TestAgent.server: Adding LAN server: server="Node-c7bb8f77-8a31-72bd-4c31-66ed7c431b60 (Addr: tcp/127.0.0.1:29440) (DC: dc1)" 29:38.671 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c7bb8f77-8a31-72bd-4c31-66ed7c431b60.dc1 area=wan 29:38.671 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29435 network=tcp 29:38.671 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29436 network=tcp 29:38.671 [INFO] TestAgent: started state syncer 29:38.672 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29441 network=tcp 29:38.706 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:38.706 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29440 [Candidate]" term=2 29:38.752 [DEBUG] TestAgent.server.raft: votes: needed=1 29:38.752 [DEBUG] TestAgent.server.raft: vote granted: from=c7bb8f77-8a31-72bd-4c31-66ed7c431b60 term=2 tally=1 29:38.752 [INFO] TestAgent.server.raft: election won: tally=1 29:38.752 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29440 [Leader]" 29:38.753 [INFO] TestAgent.server: cluster leadership acquired 29:38.753 [INFO] TestAgent.server: New leader elected: payload=Node-c7bb8f77-8a31-72bd-4c31-66ed7c431b60 29:38.779 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29440 29:38.801 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:38.844 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:38.844 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:38.844 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:38.844 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:38.844 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:38.844 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c7bb8f77-8a31-72bd-4c31-66ed7c431b60 29:38.844 [INFO] TestAgent: Synced node info 29:38.844 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c7bb8f77-8a31-72bd-4c31-66ed7c431b60 29:38.849 [INFO] TestAgent.server: federation state anti-entropy synced 29:38.940 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:38.940 [DEBUG] TestAgent: Node info in sync 29:38.940 [DEBUG] TestAgent: Node info in sync 29:38.964 [DEBUG] TestAgent: Node info in sync 29:38.980 [INFO] TestAgent: Synced service: service=test 29:38.980 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:38.980 [DEBUG] TestAgent: Check in sync: check=check_2 29:38.984 [DEBUG] TestAgent: Node info in sync 29:38.997 [INFO] TestAgent: Synced service: service=test 29:38.997 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:38.997 [DEBUG] TestAgent: Check in sync: check=check_2 29:38.997 [DEBUG] TestAgent: Check in sync: check=check_3 29:39.016 [DEBUG] TestAgent: removed check: check=check_2 29:39.016 [DEBUG] TestAgent: Node info in sync 29:39.016 [DEBUG] TestAgent: Service in sync: service=test 29:39.016 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:39.036 [INFO] TestAgent: Deregistered check: check=check_2 29:39.036 [DEBUG] TestAgent: Check in sync: check=check_3 29:39.036 [INFO] TestAgent: Requesting shutdown 29:39.036 [INFO] TestAgent.server: shutting down server 29:39.036 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.036 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.036 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.036 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.036 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.036 [DEBUG] TestAgent: Node info in sync 29:39.036 [DEBUG] TestAgent: Service in sync: service=test 29:39.036 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:39.036 [DEBUG] TestAgent: Check in sync: check=check_3 29:39.036 [DEBUG] TestAgent: Node info in sync 29:39.036 [DEBUG] TestAgent: Service in sync: service=test 29:39.036 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:39.036 [DEBUG] TestAgent: Check in sync: check=check_3 29:39.036 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.036 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.036 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.036 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.036 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.043 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.060Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.060Z [INFO] agent.router.manager: shutting down 29:39.060 [INFO] TestAgent: consul server down 29:39.060 [INFO] TestAgent: shutdown complete 29:39.060 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29435 network=tcp 29:39.060 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29435 network=udp 29:39.060 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29436 network=tcp 29:39.564 [INFO] TestAgent: Waiting for endpoints to shut down 29:39.564 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:38.570Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:38.629Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:38.660 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bbe865c9-6ecd-1280-a8c9-65623840b710 Address:127.0.0.1:29447}]" 29:38.660 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29447 [Follower]" leader= 29:38.661 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bbe865c9-6ecd-1280-a8c9-65623840b710.dc1 127.0.0.1 29:38.661 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bbe865c9-6ecd-1280-a8c9-65623840b710 127.0.0.1 2021-10-05T16:29:38.661Z [INFO] agent.router: Initializing LAN area manager 29:38.662 [INFO] TestAgent.server: Adding LAN server: server="Node-bbe865c9-6ecd-1280-a8c9-65623840b710 (Addr: tcp/127.0.0.1:29447) (DC: dc1)" 29:38.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29442 network=udp 29:38.662 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bbe865c9-6ecd-1280-a8c9-65623840b710.dc1 area=wan 29:38.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29442 network=tcp 29:38.662 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29443 network=tcp 29:38.662 [INFO] TestAgent: started state syncer 29:38.663 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29448 network=tcp 29:38.720 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:38.720 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29447 [Candidate]" term=2 29:38.735 [DEBUG] TestAgent.server.raft: votes: needed=1 29:38.735 [DEBUG] TestAgent.server.raft: vote granted: from=bbe865c9-6ecd-1280-a8c9-65623840b710 term=2 tally=1 29:38.735 [INFO] TestAgent.server.raft: election won: tally=1 29:38.735 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29447 [Leader]" 29:38.736 [INFO] TestAgent.server: cluster leadership acquired 29:38.736 [INFO] TestAgent.server: New leader elected: payload=Node-bbe865c9-6ecd-1280-a8c9-65623840b710 29:38.744 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29447 29:38.758 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:38.811 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:38.811 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:38.811 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:38.811 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:38.811 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:38.811 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bbe865c9-6ecd-1280-a8c9-65623840b710 29:38.811 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bbe865c9-6ecd-1280-a8c9-65623840b710 29:38.840 [INFO] TestAgent.server: federation state anti-entropy synced 29:38.867 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:38.872 [INFO] TestAgent: Synced node info 29:39.118 [DEBUG] TestAgent: Node info in sync 29:39.143 [INFO] TestAgent: Synced service: service=test 29:39.143 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:39.143 [DEBUG] TestAgent: Check in sync: check=check_2 29:39.172 [DEBUG] TestAgent: removed check: check=check_2 29:39.172 [DEBUG] TestAgent: Node info in sync 29:39.188 [INFO] TestAgent: Synced service: service=test 29:39.188 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:39.224 [INFO] TestAgent: Deregistered check: check=check_2 29:39.224 [DEBUG] TestAgent: Check in sync: check=check_3 29:39.224 [INFO] TestAgent: Requesting shutdown 29:39.224 [INFO] TestAgent.server: shutting down server 29:39.224 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.224 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.224 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.224 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.224 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.224 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.224 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.225 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.225 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.225 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.238 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.252Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.252Z [INFO] agent.router.manager: shutting down 29:39.252 [INFO] TestAgent: consul server down 29:39.252 [INFO] TestAgent: shutdown complete 29:39.252 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29442 network=tcp 29:39.252 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29442 network=udp 29:39.252 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29443 network=tcp 29:39.753 [INFO] TestAgent: Waiting for endpoints to shut down 29:39.753 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_ReRegister_ReplaceExistingChecks (0.00s) --- PASS: TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/normal (1.04s) --- PASS: TestAgent_RegisterService_ReRegister_ReplaceExistingChecks/service_manager (1.23s) === RUN TestAgent_RegisterService_TranslateKeys === RUN TestAgent_RegisterService_TranslateKeys/normal === PAUSE TestAgent_RegisterService_TranslateKeys/normal === RUN TestAgent_RegisterService_TranslateKeys/service_manager === PAUSE TestAgent_RegisterService_TranslateKeys/service_manager === CONT TestAgent_RegisterService_TranslateKeys/normal === CONT TestAgent_RegisterService_TranslateKeys/service_manager === RUN TestAgent_RegisterService_TranslateKeys/normal/no_token === RUN TestAgent_RegisterService_TranslateKeys/normal/root_token === RUN TestAgent_RegisterService_TranslateKeys/service_manager/no_token === RUN TestAgent_RegisterService_TranslateKeys/service_manager/root_token 2021-10-05T16:29:39.775Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:39.775Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.810Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:39.810Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.878 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e3084a5d-2522-102f-fd67-09d3a28708e8 Address:127.0.0.1:29454}]" 29:39.878 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29454 [Follower]" leader= 29:39.879 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e3084a5d-2522-102f-fd67-09d3a28708e8.dc1 127.0.0.1 29:39.880 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e3084a5d-2522-102f-fd67-09d3a28708e8 127.0.0.1 2021-10-05T16:29:39.880Z [INFO] agent.router: Initializing LAN area manager 29:39.880 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29449 network=udp 29:39.880 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e3084a5d-2522-102f-fd67-09d3a28708e8.dc1 area=wan 29:39.881 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29449 network=tcp 29:39.881 [INFO] TestAgent.server: Adding LAN server: server="Node-e3084a5d-2522-102f-fd67-09d3a28708e8 (Addr: tcp/127.0.0.1:29454) (DC: dc1)" 29:39.881 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29450 network=tcp 29:39.881 [INFO] TestAgent: started state syncer 29:39.881 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29455 network=tcp 29:39.929 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.929 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29454 [Candidate]" term=2 29:39.931 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:39.948 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.948 [DEBUG] TestAgent.server.raft: vote granted: from=e3084a5d-2522-102f-fd67-09d3a28708e8 term=2 tally=1 29:39.948 [INFO] TestAgent.server.raft: election won: tally=1 29:39.948 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29454 [Leader]" 29:39.951 [INFO] TestAgent.server: cluster leadership acquired 29:39.951 [INFO] TestAgent.server: New leader elected: payload=Node-e3084a5d-2522-102f-fd67-09d3a28708e8 29:39.969 [INFO] TestAgent.server: initializing acls 29:39.973 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:39.973 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:39.981 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:39.996 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:39.996 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:39.996 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:39.996 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-e3084a5d-2522-102f-fd67-09d3a28708e8 29:39.996 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-e3084a5d-2522-102f-fd67-09d3a28708e8.dc1 29:39.998 [INFO] TestAgent.server: Updating LAN server: server="Node-e3084a5d-2522-102f-fd67-09d3a28708e8 (Addr: tcp/127.0.0.1:29454) (DC: dc1)" 29:39.998 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-e3084a5d-2522-102f-fd67-09d3a28708e8.dc1 area=wan 29:40.013 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:40.053 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:40.053 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:40.053 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:40.053 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:40.053 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:40.053 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3084a5d-2522-102f-fd67-09d3a28708e8 29:40.053 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e3084a5d-2522-102f-fd67-09d3a28708e8 29:40.060 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3084a5d-2522-102f-fd67-09d3a28708e8 29:40.068 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-e3084a5d-2522-102f-fd67-09d3a28708e8 29:40.077 [INFO] TestAgent.server: federation state anti-entropy synced 29:40.142 [INFO] TestAgent: Synced node info 29:40.159 [INFO] TestAgent: Synced service: service=test 29:40.159 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:40.159 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:40.159 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:40.160 [INFO] TestAgent: Requesting shutdown 29:40.160 [INFO] TestAgent.server: shutting down server 29:40.160 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:40.160 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:40.160 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:40.160 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:40.160 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:40.160 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:40.160 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:40.160 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:40.160 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:40.160 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:40.160 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:40.160 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:40.160 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:40.160 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:40.160 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:40.165 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:40.167Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:40.167Z [INFO] agent.router.manager: shutting down 29:40.167 [INFO] TestAgent: consul server down 29:40.167 [INFO] TestAgent: shutdown complete 29:40.167 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29449 network=tcp 29:40.167 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29449 network=udp 29:40.167 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29450 network=tcp 29:40.673 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.673 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:39.770Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:39.770Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.804Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:39.804Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.840 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f4fe148e-d4c7-990e-ce62-a1c96e643066 Address:127.0.0.1:29461}]" 29:39.841 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f4fe148e-d4c7-990e-ce62-a1c96e643066.dc1 127.0.0.1 29:39.842 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 127.0.0.1 2021-10-05T16:29:39.842Z [INFO] agent.router: Initializing LAN area manager 29:39.842 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29456 network=udp 29:39.842 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29461 [Follower]" leader= 29:39.842 [INFO] TestAgent.server: Adding LAN server: server="Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 (Addr: tcp/127.0.0.1:29461) (DC: dc1)" 29:39.842 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066.dc1 area=wan 29:39.842 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29456 network=tcp 29:39.844 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29457 network=tcp 29:39.844 [INFO] TestAgent: started state syncer 29:39.844 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29462 network=tcp 29:39.884 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.884 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29461 [Candidate]" term=2 29:39.893 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:39.914 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.914 [DEBUG] TestAgent.server.raft: vote granted: from=f4fe148e-d4c7-990e-ce62-a1c96e643066 term=2 tally=1 29:39.914 [INFO] TestAgent.server.raft: election won: tally=1 29:39.914 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29461 [Leader]" 29:39.914 [INFO] TestAgent.server: cluster leadership acquired 29:39.914 [INFO] TestAgent.server: New leader elected: payload=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 29:39.916 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 29:39.921 [INFO] TestAgent.server: initializing acls 29:39.925 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:39.925 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:39.932 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:39.947 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:39.947 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:39.947 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:39.947 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 29:39.948 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f4fe148e-d4c7-990e-ce62-a1c96e643066.dc1 29:39.951 [INFO] TestAgent.server: Updating LAN server: server="Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 (Addr: tcp/127.0.0.1:29461) (DC: dc1)" 29:39.951 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066.dc1 area=wan 29:39.967 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:40.002 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:40.002 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:40.002 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:40.002 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:40.002 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:40.002 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 29:40.002 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 29:40.012 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 29:40.036 [INFO] TestAgent.server: federation state anti-entropy synced 29:40.247 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 29:40.247 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-f4fe148e-d4c7-990e-ce62-a1c96e643066 29:40.300 [INFO] TestAgent: Synced node info 29:40.325 [INFO] TestAgent: Synced service: service=test 29:40.325 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:40.325 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:40.325 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:40.325 [INFO] TestAgent: Requesting shutdown 29:40.325 [INFO] TestAgent.server: shutting down server 29:40.325 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:40.325 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:40.325 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:40.325 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:40.325 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:40.325 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:40.325 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:40.325 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:40.325 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:40.325 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:40.325 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:40.325 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:40.325 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:40.325 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:40.340 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:40.349Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:40.349Z [INFO] agent.router.manager: shutting down 29:40.349 [INFO] TestAgent: consul server down 29:40.349 [INFO] TestAgent: shutdown complete 29:40.349 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29456 network=tcp 29:40.349 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29456 network=udp 29:40.349 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29457 network=tcp 29:40.849 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.849 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_TranslateKeys (0.00s) --- PASS: TestAgent_RegisterService_TranslateKeys/normal (0.92s) --- PASS: TestAgent_RegisterService_TranslateKeys/normal/no_token (0.00s) --- PASS: TestAgent_RegisterService_TranslateKeys/normal/root_token (0.08s) --- PASS: TestAgent_RegisterService_TranslateKeys/service_manager (1.10s) --- PASS: TestAgent_RegisterService_TranslateKeys/service_manager/no_token (0.00s) --- PASS: TestAgent_RegisterService_TranslateKeys/service_manager/root_token (0.08s) === RUN TestAgent_RegisterService_ACLDeny === RUN TestAgent_RegisterService_ACLDeny/normal === PAUSE TestAgent_RegisterService_ACLDeny/normal === RUN TestAgent_RegisterService_ACLDeny/service_manager === PAUSE TestAgent_RegisterService_ACLDeny/service_manager === CONT TestAgent_RegisterService_ACLDeny/normal === CONT TestAgent_RegisterService_ACLDeny/service_manager === RUN TestAgent_RegisterService_ACLDeny/normal/no_token === RUN TestAgent_RegisterService_ACLDeny/normal/root_token === RUN TestAgent_RegisterService_ACLDeny/service_manager/no_token === RUN TestAgent_RegisterService_ACLDeny/service_manager/root_token 2021-10-05T16:29:40.862Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:40.862Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:40.926Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:40.926Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:40.979 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:eddde1dc-2628-cafe-6c2c-6e1e8013ee55 Address:127.0.0.1:29468}]" 29:40.979 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55.dc1 127.0.0.1 29:40.980 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29468 [Follower]" leader= 29:40.980 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 127.0.0.1 2021-10-05T16:29:40.980Z [INFO] agent.router: Initializing LAN area manager 29:40.981 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29463 network=udp 29:40.981 [INFO] TestAgent.server: Adding LAN server: server="Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 (Addr: tcp/127.0.0.1:29468) (DC: dc1)" 29:40.981 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55.dc1 area=wan 29:40.981 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29463 network=tcp 29:40.981 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29464 network=tcp 29:40.981 [INFO] TestAgent: started state syncer 29:40.982 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29469 network=tcp 29:41.031 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:41.040 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:41.040 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29468 [Candidate]" term=2 29:41.066 [DEBUG] TestAgent.server.raft: votes: needed=1 29:41.066 [DEBUG] TestAgent.server.raft: vote granted: from=eddde1dc-2628-cafe-6c2c-6e1e8013ee55 term=2 tally=1 29:41.066 [INFO] TestAgent.server.raft: election won: tally=1 29:41.066 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29468 [Leader]" 29:41.068 [INFO] TestAgent.server: cluster leadership acquired 29:41.068 [INFO] TestAgent.server: New leader elected: payload=Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 29:41.078 [INFO] TestAgent.server: initializing acls 29:41.083 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:41.083 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:41.095 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:41.115 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:41.115 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:41.115 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:41.115 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 29:41.115 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55.dc1 29:41.115 [INFO] TestAgent.server: Updating LAN server: server="Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 (Addr: tcp/127.0.0.1:29468) (DC: dc1)" 29:41.115 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55.dc1 area=wan 29:41.130 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:41.171 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:41.171 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:41.171 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:41.171 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:41.171 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:41.171 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 29:41.171 [INFO] TestAgent.server: member joined, marking health alive: member=Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 29:41.197 [INFO] TestAgent: Synced node info 29:41.197 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 29:41.206 [INFO] TestAgent.server: federation state anti-entropy synced 29:41.211 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-eddde1dc-2628-cafe-6c2c-6e1e8013ee55 29:41.237 [DEBUG] TestAgent: Node info in sync 29:41.242 [INFO] TestAgent: Synced service: service=test 29:41.242 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:41.242 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:41.242 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:41.242 [INFO] TestAgent: Requesting shutdown 29:41.242 [INFO] TestAgent.server: shutting down server 29:41.242 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:41.242 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:41.242 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:41.242 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:41.242 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:41.242 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:41.242 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:41.242 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:41.242 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:41.242 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:41.242 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:41.242 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:41.242 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:41.242 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:41.246 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:41.259Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:41.259Z [INFO] agent.router.manager: shutting down 29:41.259 [INFO] TestAgent: consul server down 29:41.259 [INFO] TestAgent: shutdown complete 29:41.259 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29463 network=tcp 29:41.259 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29463 network=udp 29:41.259 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29464 network=tcp 29:41.760 [INFO] TestAgent: Waiting for endpoints to shut down 29:41.760 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:40.924Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:40.924Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:40.945Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:40.945Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:40.980 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dbd29818-72b6-1529-2a0f-448c670d20f5 Address:127.0.0.1:29475}]" 29:40.980 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29475 [Follower]" leader= 29:40.981 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dbd29818-72b6-1529-2a0f-448c670d20f5.dc1 127.0.0.1 29:40.981 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dbd29818-72b6-1529-2a0f-448c670d20f5 127.0.0.1 2021-10-05T16:29:40.981Z [INFO] agent.router: Initializing LAN area manager 29:40.982 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29470 network=udp 29:40.982 [INFO] TestAgent.server: Adding LAN server: server="Node-dbd29818-72b6-1529-2a0f-448c670d20f5 (Addr: tcp/127.0.0.1:29475) (DC: dc1)" 29:40.982 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dbd29818-72b6-1529-2a0f-448c670d20f5.dc1 area=wan 29:40.983 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29470 network=tcp 29:40.983 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29471 network=tcp 29:40.983 [INFO] TestAgent: started state syncer 29:40.983 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29476 network=tcp 29:41.026 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:41.026 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29475 [Candidate]" term=2 29:41.034 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:41.054 [DEBUG] TestAgent.server.raft: votes: needed=1 29:41.054 [DEBUG] TestAgent.server.raft: vote granted: from=dbd29818-72b6-1529-2a0f-448c670d20f5 term=2 tally=1 29:41.054 [INFO] TestAgent.server.raft: election won: tally=1 29:41.054 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29475 [Leader]" 29:41.055 [INFO] TestAgent.server: cluster leadership acquired 29:41.055 [INFO] TestAgent.server: New leader elected: payload=Node-dbd29818-72b6-1529-2a0f-448c670d20f5 29:41.065 [INFO] TestAgent.server: initializing acls 29:41.070 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:41.070 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:41.082 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:41.096 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:41.096 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:41.096 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:41.097 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-dbd29818-72b6-1529-2a0f-448c670d20f5 29:41.097 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-dbd29818-72b6-1529-2a0f-448c670d20f5.dc1 29:41.097 [INFO] TestAgent.server: Updating LAN server: server="Node-dbd29818-72b6-1529-2a0f-448c670d20f5 (Addr: tcp/127.0.0.1:29475) (DC: dc1)" 29:41.097 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-dbd29818-72b6-1529-2a0f-448c670d20f5.dc1 area=wan 29:41.122 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:41.187 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:41.187 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:41.187 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:41.187 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:41.187 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:41.187 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dbd29818-72b6-1529-2a0f-448c670d20f5 29:41.187 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dbd29818-72b6-1529-2a0f-448c670d20f5 29:41.199 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dbd29818-72b6-1529-2a0f-448c670d20f5 29:41.207 [INFO] TestAgent.server: federation state anti-entropy synced 29:41.290 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-dbd29818-72b6-1529-2a0f-448c670d20f5 29:41.290 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-dbd29818-72b6-1529-2a0f-448c670d20f5 29:41.324 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:41.337 [INFO] TestAgent: Synced node info 29:41.341 [INFO] TestAgent: Synced service: service=test 29:41.341 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:41.341 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:41.341 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:41.341 [DEBUG] TestAgent: Node info in sync 29:41.341 [DEBUG] TestAgent: Service in sync: service=test 29:41.341 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:41.341 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:41.341 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:41.342 [DEBUG] TestAgent: Node info in sync 29:41.342 [DEBUG] TestAgent: Service in sync: service=test 29:41.342 [DEBUG] TestAgent: Check in sync: check=service:test:2 29:41.342 [DEBUG] TestAgent: Check in sync: check=service:test:3 29:41.342 [DEBUG] TestAgent: Check in sync: check=service:test:1 29:41.342 [INFO] TestAgent: Requesting shutdown 29:41.342 [INFO] TestAgent.server: shutting down server 29:41.342 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:41.342 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:41.342 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:41.342 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:41.342 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:41.342 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:41.342 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:41.342 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:41.342 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:41.342 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:41.342 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:41.342 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:41.342 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:41.342 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:41.346 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:41.350Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:41.350Z [INFO] agent.router.manager: shutting down 29:41.351 [INFO] TestAgent: consul server down 29:41.351 [INFO] TestAgent: shutdown complete 29:41.351 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29470 network=tcp 29:41.351 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29470 network=udp 29:41.351 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29471 network=tcp 29:41.852 [INFO] TestAgent: Waiting for endpoints to shut down 29:41.852 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_ACLDeny (0.00s) --- PASS: TestAgent_RegisterService_ACLDeny/normal (0.91s) --- PASS: TestAgent_RegisterService_ACLDeny/normal/no_token (0.00s) --- PASS: TestAgent_RegisterService_ACLDeny/normal/root_token (0.03s) --- PASS: TestAgent_RegisterService_ACLDeny/service_manager (1.00s) --- PASS: TestAgent_RegisterService_ACLDeny/service_manager/no_token (0.00s) --- PASS: TestAgent_RegisterService_ACLDeny/service_manager/root_token (0.05s) === RUN TestAgent_RegisterService_InvalidAddress === RUN TestAgent_RegisterService_InvalidAddress/normal === PAUSE TestAgent_RegisterService_InvalidAddress/normal === RUN TestAgent_RegisterService_InvalidAddress/service_manager === PAUSE TestAgent_RegisterService_InvalidAddress/service_manager === CONT TestAgent_RegisterService_InvalidAddress/normal === CONT TestAgent_RegisterService_InvalidAddress/service_manager === RUN TestAgent_RegisterService_InvalidAddress/service_manager/addr_0.0.0.0 === RUN TestAgent_RegisterService_InvalidAddress/service_manager/addr_:: === RUN TestAgent_RegisterService_InvalidAddress/service_manager/addr_[::] 2021-10-05T16:29:41.883Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:41.904Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:41.945 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a9a19f34-fda2-008b-fc1b-b6e5871e3805 Address:127.0.0.1:29489}]" 29:41.946 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a9a19f34-fda2-008b-fc1b-b6e5871e3805.dc1 127.0.0.1 29:41.946 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a9a19f34-fda2-008b-fc1b-b6e5871e3805 127.0.0.1 2021-10-05T16:29:41.947Z [INFO] agent.router: Initializing LAN area manager 29:41.947 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29484 network=udp 29:41.947 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29489 [Follower]" leader= 29:41.947 [INFO] TestAgent.server: Adding LAN server: server="Node-a9a19f34-fda2-008b-fc1b-b6e5871e3805 (Addr: tcp/127.0.0.1:29489) (DC: dc1)" 29:41.947 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a9a19f34-fda2-008b-fc1b-b6e5871e3805.dc1 area=wan 29:41.947 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29484 network=tcp 29:41.948 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29485 network=tcp 29:41.948 [INFO] TestAgent: started state syncer 29:41.948 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29490 network=tcp 29:42.000 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:42.000 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29489 [Candidate]" term=2 29:42.024 [DEBUG] TestAgent.server.raft: votes: needed=1 29:42.024 [DEBUG] TestAgent.server.raft: vote granted: from=a9a19f34-fda2-008b-fc1b-b6e5871e3805 term=2 tally=1 29:42.024 [INFO] TestAgent.server.raft: election won: tally=1 29:42.024 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29489 [Leader]" 29:42.024 [INFO] TestAgent.server: cluster leadership acquired 29:42.025 [INFO] TestAgent.server: New leader elected: payload=Node-a9a19f34-fda2-008b-fc1b-b6e5871e3805 29:42.032 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29489 29:42.072 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:42.110 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:42.110 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:42.110 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:42.110 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:42.110 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:42.110 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a9a19f34-fda2-008b-fc1b-b6e5871e3805 29:42.110 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a9a19f34-fda2-008b-fc1b-b6e5871e3805 29:42.118 [INFO] TestAgent.server: federation state anti-entropy synced 29:42.126 [INFO] TestAgent: Requesting shutdown 29:42.126 [INFO] TestAgent.server: shutting down server 29:42.126 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:42.126 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:42.126 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:42.126 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:42.126 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:42.126 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:42.126 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:42.126 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:42.126 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:42.126 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:42.126 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:42.130 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:42.134Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:42.134Z [INFO] agent.router.manager: shutting down 29:42.135 [INFO] TestAgent: consul server down 29:42.135 [INFO] TestAgent: shutdown complete 29:42.135 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29484 network=tcp 29:42.135 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29484 network=udp 29:42.135 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29485 network=tcp 29:42.636 [INFO] TestAgent: Waiting for endpoints to shut down 29:42.636 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:41.881Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:41.901Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:41.941 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dada5e18-0f62-adb5-3050-138ed4909205 Address:127.0.0.1:29482}]" 29:41.941 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dada5e18-0f62-adb5-3050-138ed4909205.dc1 127.0.0.1 29:41.942 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dada5e18-0f62-adb5-3050-138ed4909205 127.0.0.1 2021-10-05T16:29:41.942Z [INFO] agent.router: Initializing LAN area manager 29:41.942 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29477 network=udp 29:41.942 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29482 [Follower]" leader= 29:41.942 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dada5e18-0f62-adb5-3050-138ed4909205.dc1 area=wan 29:41.942 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29477 network=tcp 29:41.943 [INFO] TestAgent.server: Adding LAN server: server="Node-dada5e18-0f62-adb5-3050-138ed4909205 (Addr: tcp/127.0.0.1:29482) (DC: dc1)" 29:41.943 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29478 network=tcp 29:41.943 [INFO] TestAgent: started state syncer 29:41.943 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29483 network=tcp 29:41.988 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:41.988 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29482 [Candidate]" term=2 29:41.998 [DEBUG] TestAgent.server.raft: votes: needed=1 29:41.998 [DEBUG] TestAgent.server.raft: vote granted: from=dada5e18-0f62-adb5-3050-138ed4909205 term=2 tally=1 29:41.998 [INFO] TestAgent.server.raft: election won: tally=1 29:41.998 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29482 [Leader]" 29:41.998 [INFO] TestAgent.server: cluster leadership acquired 29:41.999 [INFO] TestAgent.server: New leader elected: payload=Node-dada5e18-0f62-adb5-3050-138ed4909205 29:42.005 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29482 29:42.033 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:42.058 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:42.058 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:42.058 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:42.058 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:42.058 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:42.058 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dada5e18-0f62-adb5-3050-138ed4909205 29:42.058 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dada5e18-0f62-adb5-3050-138ed4909205 29:42.080 [INFO] TestAgent.server: federation state anti-entropy synced 29:42.196 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:42.212 [INFO] TestAgent: Synced node info 29:42.212 [DEBUG] TestAgent: Node info in sync 29:42.348 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:42.348 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:42.348 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:42.348 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:42.356 [DEBUG] TestAgent: Node info in sync 29:42.388 [INFO] TestAgent: Synced service: service=connect-proxy 29:42.388 [INFO] TestAgent: Requesting shutdown 29:42.388 [INFO] TestAgent.server: shutting down server 29:42.388 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:42.388 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:42.388 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:42.388 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:42.388 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:42.388 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:42.388 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:42.388 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:42.388 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:42.388 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:42.396 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:42.401Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:42.401Z [INFO] agent.router.manager: shutting down 29:42.402 [INFO] TestAgent: consul server down 29:42.402 [INFO] TestAgent: shutdown complete 29:42.402 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29477 network=tcp 29:42.402 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29477 network=udp 29:42.402 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29478 network=tcp 29:42.904 [INFO] TestAgent: Waiting for endpoints to shut down 29:42.904 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_InvalidAddress (0.00s) --- PASS: TestAgent_RegisterService_InvalidAddress/service_manager (0.78s) --- PASS: TestAgent_RegisterService_InvalidAddress/service_manager/addr_0.0.0.0 (0.00s) --- PASS: TestAgent_RegisterService_InvalidAddress/service_manager/addr_:: (0.00s) --- PASS: TestAgent_RegisterService_InvalidAddress/service_manager/addr_[::] (0.00s) --- PASS: TestAgent_RegisterService_InvalidAddress/normal (1.05s) === RUN TestAgent_RegisterService_UnmanagedConnectProxy === RUN TestAgent_RegisterService_UnmanagedConnectProxy/normal === PAUSE TestAgent_RegisterService_UnmanagedConnectProxy/normal === RUN TestAgent_RegisterService_UnmanagedConnectProxy/service_manager === PAUSE TestAgent_RegisterService_UnmanagedConnectProxy/service_manager === CONT TestAgent_RegisterService_UnmanagedConnectProxy/normal === CONT TestAgent_RegisterService_UnmanagedConnectProxy/service_manager 2021-10-05T16:29:42.966Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:43.001Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:43.134 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:aeecbdb6-6875-6ec6-e514-6fa25162a905 Address:127.0.0.1:29503}]" 29:43.135 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-aeecbdb6-6875-6ec6-e514-6fa25162a905.dc1 127.0.0.1 29:43.135 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-aeecbdb6-6875-6ec6-e514-6fa25162a905 127.0.0.1 2021-10-05T16:29:43.135Z [INFO] agent.router: Initializing LAN area manager 29:43.135 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29498 network=udp 29:43.135 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29503 [Follower]" leader= 29:43.136 [INFO] TestAgent.server: Adding LAN server: server="Node-aeecbdb6-6875-6ec6-e514-6fa25162a905 (Addr: tcp/127.0.0.1:29503) (DC: dc1)" 29:43.136 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-aeecbdb6-6875-6ec6-e514-6fa25162a905.dc1 area=wan 29:43.136 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29498 network=tcp 29:43.144 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29499 network=tcp 29:43.144 [INFO] TestAgent: started state syncer 29:43.144 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29504 network=tcp 29:43.173 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:43.173 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29503 [Candidate]" term=2 29:43.186 [DEBUG] TestAgent.server.raft: votes: needed=1 29:43.186 [DEBUG] TestAgent.server.raft: vote granted: from=aeecbdb6-6875-6ec6-e514-6fa25162a905 term=2 tally=1 29:43.186 [INFO] TestAgent.server.raft: election won: tally=1 29:43.186 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29503 [Leader]" 29:43.188 [INFO] TestAgent.server: cluster leadership acquired 29:43.188 [INFO] TestAgent.server: New leader elected: payload=Node-aeecbdb6-6875-6ec6-e514-6fa25162a905 29:43.197 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29503 29:43.214 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:43.243 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:43.243 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:43.243 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:43.243 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:43.243 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:43.243 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-aeecbdb6-6875-6ec6-e514-6fa25162a905 29:43.243 [INFO] TestAgent.server: member joined, marking health alive: member=Node-aeecbdb6-6875-6ec6-e514-6fa25162a905 29:43.262 [INFO] TestAgent.server: federation state anti-entropy synced 29:43.264 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.265 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.265 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.265 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.273 [INFO] TestAgent: Synced node info 29:43.288 [INFO] TestAgent: Synced service: service=connect-proxy 29:43.288 [INFO] TestAgent: Requesting shutdown 29:43.288 [INFO] TestAgent.server: shutting down server 29:43.288 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:43.288 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:43.288 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:43.288 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:43.288 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:43.288 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:43.288 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:43.289 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:43.289 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:43.289 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:43.289 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:43.296 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:43.304Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:43.304Z [INFO] agent.router.manager: shutting down 29:43.304 [INFO] TestAgent: consul server down 29:43.304 [INFO] TestAgent: shutdown complete 29:43.304 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29498 network=tcp 29:43.304 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29498 network=udp 29:43.304 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29499 network=tcp 29:43.808 [INFO] TestAgent: Waiting for endpoints to shut down 29:43.808 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:42.972Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:43.005Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:43.121 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7e35369e-7b77-0caa-25ac-31a25a08498e Address:127.0.0.1:29496}]" 29:43.121 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29496 [Follower]" leader= 29:43.122 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7e35369e-7b77-0caa-25ac-31a25a08498e.dc1 127.0.0.1 29:43.122 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7e35369e-7b77-0caa-25ac-31a25a08498e 127.0.0.1 2021-10-05T16:29:43.122Z [INFO] agent.router: Initializing LAN area manager 29:43.122 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29491 network=udp 29:43.123 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7e35369e-7b77-0caa-25ac-31a25a08498e.dc1 area=wan 29:43.123 [INFO] TestAgent.server: Adding LAN server: server="Node-7e35369e-7b77-0caa-25ac-31a25a08498e (Addr: tcp/127.0.0.1:29496) (DC: dc1)" 29:43.123 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29491 network=tcp 29:43.123 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29492 network=tcp 29:43.123 [INFO] TestAgent: started state syncer 29:43.123 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29497 network=tcp 29:43.178 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:43.178 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29496 [Candidate]" term=2 29:43.194 [DEBUG] TestAgent.server.raft: votes: needed=1 29:43.194 [DEBUG] TestAgent.server.raft: vote granted: from=7e35369e-7b77-0caa-25ac-31a25a08498e term=2 tally=1 29:43.194 [INFO] TestAgent.server.raft: election won: tally=1 29:43.194 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29496 [Leader]" 29:43.196 [INFO] TestAgent.server: cluster leadership acquired 29:43.196 [INFO] TestAgent.server: New leader elected: payload=Node-7e35369e-7b77-0caa-25ac-31a25a08498e 29:43.203 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29496 29:43.223 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:43.259 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:43.259 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:43.259 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:43.259 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:43.259 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:43.260 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7e35369e-7b77-0caa-25ac-31a25a08498e 29:43.260 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7e35369e-7b77-0caa-25ac-31a25a08498e 29:43.291 [INFO] TestAgent.server: federation state anti-entropy synced 29:43.301 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.302 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.302 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.302 [ERROR] TestAgent.proxycfg: watch error: service_id=connect-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:43.315 [INFO] TestAgent: Synced node info 29:43.321 [INFO] TestAgent: Synced service: service=connect-proxy 29:43.321 [INFO] TestAgent: Requesting shutdown 29:43.321 [INFO] TestAgent.server: shutting down server 29:43.321 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:43.321 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:43.321 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:43.321 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:43.321 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:43.321 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:43.321 [DEBUG] TestAgent: Node info in sync 29:43.321 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:43.322 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:43.322 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:43.327 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 29:43.329 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 29:43.329 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:43.329 [INFO] TestAgent: Synced service: service=connect-proxy 2021-10-05T16:29:43.332Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:43.332Z [INFO] agent.router.manager: shutting down 29:43.332 [INFO] TestAgent: consul server down 29:43.332 [INFO] TestAgent: shutdown complete 29:43.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29491 network=tcp 29:43.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29491 network=udp 29:43.332 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29492 network=tcp 29:43.836 [INFO] TestAgent: Waiting for endpoints to shut down 29:43.836 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_UnmanagedConnectProxy (0.00s) --- PASS: TestAgent_RegisterService_UnmanagedConnectProxy/service_manager (0.90s) --- PASS: TestAgent_RegisterService_UnmanagedConnectProxy/normal (0.93s) === RUN TestAgent_RegisterServiceDeregisterService_Sidecar === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal === PAUSE TestAgent_RegisterServiceDeregisterService_Sidecar/normal === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager === PAUSE TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager === CONT TestAgent_RegisterServiceDeregisterService_Sidecar/normal === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/sanity_check_no_sidecar_case === CONT TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/sanity_check_no_sidecar_case 2021-10-05T16:29:43.869Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:43.912Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:43.969 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c23d5368-46a2-bbf8-5130-fa52ae4529e4 Address:127.0.0.1:29517}]" 29:43.969 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29517 [Follower]" leader= 29:43.970 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c23d5368-46a2-bbf8-5130-fa52ae4529e4.dc1 127.0.0.1 29:43.971 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c23d5368-46a2-bbf8-5130-fa52ae4529e4 127.0.0.1 2021-10-05T16:29:43.971Z [INFO] agent.router: Initializing LAN area manager 29:43.971 [INFO] TestAgent.server: Adding LAN server: server="Node-c23d5368-46a2-bbf8-5130-fa52ae4529e4 (Addr: tcp/127.0.0.1:29517) (DC: dc1)" 29:43.971 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c23d5368-46a2-bbf8-5130-fa52ae4529e4.dc1 area=wan 29:43.971 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29512 network=udp 29:43.971 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29512 network=tcp 29:43.972 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29513 network=tcp 29:43.972 [INFO] TestAgent: started state syncer 29:43.972 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29518 network=tcp 29:44.014 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:44.015 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29517 [Candidate]" term=2 29:44.043 [DEBUG] TestAgent.server.raft: votes: needed=1 29:44.043 [DEBUG] TestAgent.server.raft: vote granted: from=c23d5368-46a2-bbf8-5130-fa52ae4529e4 term=2 tally=1 29:44.043 [INFO] TestAgent.server.raft: election won: tally=1 29:44.043 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29517 [Leader]" 29:44.043 [INFO] TestAgent.server: cluster leadership acquired 29:44.044 [INFO] TestAgent.server: New leader elected: payload=Node-c23d5368-46a2-bbf8-5130-fa52ae4529e4 29:44.054 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29517 29:44.073 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:44.132 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:44.132 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:44.132 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:44.132 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:44.132 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:44.132 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c23d5368-46a2-bbf8-5130-fa52ae4529e4 29:44.132 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c23d5368-46a2-bbf8-5130-fa52ae4529e4 29:44.163 [INFO] TestAgent.server: federation state anti-entropy synced 29:44.220 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:44.236 [INFO] TestAgent: Synced node info 29:44.236 [DEBUG] TestAgent: Node info in sync 29:44.402 [DEBUG] TestAgent: Node info in sync 29:44.412 [INFO] TestAgent: Synced service: service=web 29:44.412 [INFO] TestAgent: Requesting shutdown 29:44.412 [INFO] TestAgent.server: shutting down server 29:44.412 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:44.412 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:44.412 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:44.412 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:44.412 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:44.412 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:44.412 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:44.412 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:44.412 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:44.412 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:44.536 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:44.662Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:44.662Z [INFO] agent.router.manager: shutting down 29:44.662 [INFO] TestAgent: consul server down 29:44.662 [INFO] TestAgent: shutdown complete 29:44.662 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29512 network=tcp 29:44.662 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29512 network=udp 29:44.662 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29513 network=tcp 29:45.164 [INFO] TestAgent: Waiting for endpoints to shut down 29:45.164 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/default_sidecar 2021-10-05T16:29:43.862Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:43.891Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:43.930 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a2e05680-7c1f-8eb2-adb7-317ab22384d1 Address:127.0.0.1:29510}]" 29:43.931 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a2e05680-7c1f-8eb2-adb7-317ab22384d1.dc1 127.0.0.1 29:43.931 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a2e05680-7c1f-8eb2-adb7-317ab22384d1 127.0.0.1 2021-10-05T16:29:43.931Z [INFO] agent.router: Initializing LAN area manager 29:43.931 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29505 network=udp 29:43.931 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29510 [Follower]" leader= 29:43.932 [INFO] TestAgent.server: Adding LAN server: server="Node-a2e05680-7c1f-8eb2-adb7-317ab22384d1 (Addr: tcp/127.0.0.1:29510) (DC: dc1)" 29:43.932 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a2e05680-7c1f-8eb2-adb7-317ab22384d1.dc1 area=wan 29:43.932 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29505 network=tcp 29:43.933 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29506 network=tcp 29:43.933 [INFO] TestAgent: started state syncer 29:43.933 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29511 network=tcp 29:43.998 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:43.998 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29510 [Candidate]" term=2 29:44.022 [DEBUG] TestAgent.server.raft: votes: needed=1 29:44.022 [DEBUG] TestAgent.server.raft: vote granted: from=a2e05680-7c1f-8eb2-adb7-317ab22384d1 term=2 tally=1 29:44.022 [INFO] TestAgent.server.raft: election won: tally=1 29:44.022 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29510 [Leader]" 29:44.024 [INFO] TestAgent.server: cluster leadership acquired 29:44.024 [INFO] TestAgent.server: New leader elected: payload=Node-a2e05680-7c1f-8eb2-adb7-317ab22384d1 29:44.036 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29510 29:44.060 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:44.116 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:44.116 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:44.116 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:44.116 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:44.116 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:44.116 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a2e05680-7c1f-8eb2-adb7-317ab22384d1 29:44.116 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a2e05680-7c1f-8eb2-adb7-317ab22384d1 29:44.156 [INFO] TestAgent.server: federation state anti-entropy synced 29:44.348 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:44.532 [INFO] TestAgent: Synced node info 29:44.532 [DEBUG] TestAgent: Node info in sync 29:44.662 [DEBUG] TestAgent: Node info in sync 29:44.674 [INFO] TestAgent: Synced service: service=web 29:44.675 [INFO] TestAgent: Requesting shutdown 29:44.675 [INFO] TestAgent.server: shutting down server 29:44.675 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:44.675 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:44.675 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:44.675 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:44.675 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:44.675 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:44.675 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:44.675 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:44.675 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:44.675 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:44.700 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:44.720Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:44.720Z [INFO] agent.router.manager: shutting down 29:44.720 [INFO] TestAgent: consul server down 29:44.720 [INFO] TestAgent: shutdown complete 29:44.720 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29505 network=tcp 29:44.720 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29505 network=udp 29:44.720 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29506 network=tcp 29:45.221 [INFO] TestAgent: Waiting for endpoints to shut down 29:45.221 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/default_sidecar 2021-10-05T16:29:45.193Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:45.209Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:45.552 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:83fe9710-05ae-4ef8-acfb-1c90e4af383c Address:127.0.0.1:29524}]" 29:45.553 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-83fe9710-05ae-4ef8-acfb-1c90e4af383c.dc1 127.0.0.1 29:45.554 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-83fe9710-05ae-4ef8-acfb-1c90e4af383c 127.0.0.1 2021-10-05T16:29:45.554Z [INFO] agent.router: Initializing LAN area manager 29:45.554 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29519 network=udp 29:45.554 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29524 [Follower]" leader= 29:45.554 [INFO] TestAgent.server: Adding LAN server: server="Node-83fe9710-05ae-4ef8-acfb-1c90e4af383c (Addr: tcp/127.0.0.1:29524) (DC: dc1)" 29:45.554 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-83fe9710-05ae-4ef8-acfb-1c90e4af383c.dc1 area=wan 29:45.554 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29519 network=tcp 29:45.555 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29520 network=tcp 29:45.555 [INFO] TestAgent: started state syncer 29:45.555 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29525 network=tcp 29:45.621 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:45.621 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29524 [Candidate]" term=2 29:45.634 [DEBUG] TestAgent.server.raft: votes: needed=1 29:45.634 [DEBUG] TestAgent.server.raft: vote granted: from=83fe9710-05ae-4ef8-acfb-1c90e4af383c term=2 tally=1 29:45.634 [INFO] TestAgent.server.raft: election won: tally=1 29:45.634 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29524 [Leader]" 29:45.634 [INFO] TestAgent.server: cluster leadership acquired 29:45.635 [INFO] TestAgent.server: New leader elected: payload=Node-83fe9710-05ae-4ef8-acfb-1c90e4af383c 29:45.639 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29524 29:45.663 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:45.699 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:45.699 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:45.699 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:45.699 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:45.699 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:45.699 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-83fe9710-05ae-4ef8-acfb-1c90e4af383c 29:45.699 [INFO] TestAgent.server: member joined, marking health alive: member=Node-83fe9710-05ae-4ef8-acfb-1c90e4af383c 29:45.713 [INFO] TestAgent.server: federation state anti-entropy synced 29:45.725 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:45.731 [INFO] TestAgent: Synced node info 29:45.758 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 29:45.758 [DEBUG] TestAgent: Node info in sync 29:45.769 [INFO] TestAgent: Synced service: service=web 29:45.772 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:45.772 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:45.772 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:45.790 [DEBUG] TestAgent: removed service: service=web 29:45.790 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:45.790 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:45.790 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:45.790 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:45.790 [DEBUG] TestAgent: Node info in sync 29:45.790 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:45.793 [INFO] TestAgent: Deregistered service: service=web 29:45.796 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:45.796 [INFO] TestAgent: Requesting shutdown 29:45.797 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:45.797 [INFO] TestAgent.server: shutting down server 29:45.797 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:45.797 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:45.797 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:45.797 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:45.797 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:45.797 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:45.797 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:45.797 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:45.797 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:45.797 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:45.801 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:45.805Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:45.805Z [INFO] agent.router.manager: shutting down 29:45.805 [INFO] TestAgent: consul server down 29:45.806 [INFO] TestAgent: shutdown complete 29:45.806 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29519 network=tcp 29:45.806 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29519 network=udp 29:45.806 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29520 network=tcp 29:46.307 [INFO] TestAgent: Waiting for endpoints to shut down 29:46.307 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_defaults 2021-10-05T16:29:45.246Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:45.278Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:45.544 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0e824cd7-bdcf-8bde-47df-cbb432bbf526 Address:127.0.0.1:29531}]" 29:45.545 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0e824cd7-bdcf-8bde-47df-cbb432bbf526.dc1 127.0.0.1 29:45.545 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0e824cd7-bdcf-8bde-47df-cbb432bbf526 127.0.0.1 2021-10-05T16:29:45.545Z [INFO] agent.router: Initializing LAN area manager 29:45.546 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29526 network=udp 29:45.546 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29531 [Follower]" leader= 29:45.546 [INFO] TestAgent.server: Adding LAN server: server="Node-0e824cd7-bdcf-8bde-47df-cbb432bbf526 (Addr: tcp/127.0.0.1:29531) (DC: dc1)" 29:45.546 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0e824cd7-bdcf-8bde-47df-cbb432bbf526.dc1 area=wan 29:45.546 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29526 network=tcp 29:45.547 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29527 network=tcp 29:45.547 [INFO] TestAgent: started state syncer 29:45.547 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29532 network=tcp 29:45.612 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:45.612 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29531 [Candidate]" term=2 29:45.627 [DEBUG] TestAgent.server.raft: votes: needed=1 29:45.627 [DEBUG] TestAgent.server.raft: vote granted: from=0e824cd7-bdcf-8bde-47df-cbb432bbf526 term=2 tally=1 29:45.627 [INFO] TestAgent.server.raft: election won: tally=1 29:45.627 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29531 [Leader]" 29:45.627 [INFO] TestAgent.server: cluster leadership acquired 29:45.628 [INFO] TestAgent.server: New leader elected: payload=Node-0e824cd7-bdcf-8bde-47df-cbb432bbf526 29:45.640 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29531 29:45.658 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:45.691 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:45.691 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:45.691 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:45.691 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:45.691 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:45.691 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0e824cd7-bdcf-8bde-47df-cbb432bbf526 29:45.691 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0e824cd7-bdcf-8bde-47df-cbb432bbf526 29:45.706 [INFO] TestAgent.server: federation state anti-entropy synced 29:45.720 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:45.728 [INFO] TestAgent: Synced node info 29:45.746 [INFO] TestAgent: Synced service: service=web 29:45.755 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:45.755 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:45.755 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:45.968 [DEBUG] TestAgent: Node info in sync 29:45.968 [DEBUG] TestAgent: Service in sync: service=web-sidecar-proxy 29:45.968 [DEBUG] TestAgent: Service in sync: service=web 29:45.988 [INFO] TestAgent: Synced check: check=service:web-sidecar-proxy:2 29:45.988 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:45.989 [DEBUG] TestAgent: removed service: service=web 29:45.989 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:45.989 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:45.989 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:45.989 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:45.989 [DEBUG] TestAgent: Node info in sync 29:45.989 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:45.993 [INFO] TestAgent: Deregistered service: service=web 29:45.997 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:45.997 [INFO] TestAgent: Requesting shutdown 29:45.997 [INFO] TestAgent.server: shutting down server 29:45.997 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:45.997 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:45.997 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:45.997 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:45.997 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:45.997 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:45.997 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:45.997 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:45.997 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:45.997 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:46.003 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:46.009Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:46.009Z [INFO] agent.router.manager: shutting down 29:46.009 [INFO] TestAgent: consul server down 29:46.009 [INFO] TestAgent: shutdown complete 29:46.009 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29526 network=tcp 29:46.009 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29526 network=udp 29:46.009 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29527 network=tcp 29:46.510 [INFO] TestAgent: Waiting for endpoints to shut down 29:46.510 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_defaults 2021-10-05T16:29:46.330Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:46.330Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:46.386Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:46.386Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:46.461 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:15cd3c90-10f4-bd57-249c-88744a42b30d Address:127.0.0.1:29538}]" 29:46.462 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-15cd3c90-10f4-bd57-249c-88744a42b30d.dc1 127.0.0.1 29:46.463 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-15cd3c90-10f4-bd57-249c-88744a42b30d 127.0.0.1 2021-10-05T16:29:46.463Z [INFO] agent.router: Initializing LAN area manager 29:46.463 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29533 network=udp 29:46.463 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29538 [Follower]" leader= 29:46.463 [INFO] TestAgent.server: Adding LAN server: server="Node-15cd3c90-10f4-bd57-249c-88744a42b30d (Addr: tcp/127.0.0.1:29538) (DC: dc1)" 29:46.463 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-15cd3c90-10f4-bd57-249c-88744a42b30d.dc1 area=wan 29:46.463 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29533 network=tcp 29:46.464 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29534 network=tcp 29:46.464 [INFO] TestAgent: started state syncer 29:46.464 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29539 network=tcp 29:46.512 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:46.512 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29538 [Candidate]" term=2 29:46.516 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:46.550 [DEBUG] TestAgent.server.raft: votes: needed=1 29:46.550 [DEBUG] TestAgent.server.raft: vote granted: from=15cd3c90-10f4-bd57-249c-88744a42b30d term=2 tally=1 29:46.550 [INFO] TestAgent.server.raft: election won: tally=1 29:46.550 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29538 [Leader]" 29:46.550 [INFO] TestAgent.server: cluster leadership acquired 29:46.550 [INFO] TestAgent.server: New leader elected: payload=Node-15cd3c90-10f4-bd57-249c-88744a42b30d 29:46.558 [INFO] TestAgent.server: initializing acls 29:46.563 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:46.563 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:46.580 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:46.589 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:46.589 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:46.589 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:46.589 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-15cd3c90-10f4-bd57-249c-88744a42b30d 29:46.589 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-15cd3c90-10f4-bd57-249c-88744a42b30d.dc1 29:46.592 [INFO] TestAgent.server: Updating LAN server: server="Node-15cd3c90-10f4-bd57-249c-88744a42b30d (Addr: tcp/127.0.0.1:29538) (DC: dc1)" 29:46.595 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-15cd3c90-10f4-bd57-249c-88744a42b30d.dc1 area=wan 29:46.618 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:46.648 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:46.648 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:46.648 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:46.648 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:46.648 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:46.648 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-15cd3c90-10f4-bd57-249c-88744a42b30d 29:46.648 [INFO] TestAgent.server: member joined, marking health alive: member=Node-15cd3c90-10f4-bd57-249c-88744a42b30d 29:46.679 [INFO] TestAgent.server: federation state anti-entropy synced 29:46.679 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-15cd3c90-10f4-bd57-249c-88744a42b30d 29:46.684 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-15cd3c90-10f4-bd57-249c-88744a42b30d 29:46.684 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-15cd3c90-10f4-bd57-249c-88744a42b30d 29:46.742 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 29:46.760 [INFO] TestAgent: Synced node info 29:46.775 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:46.784 [INFO] TestAgent: Synced service: service=web 29:46.784 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:46.784 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:46.823 [DEBUG] TestAgent: removed service: service=web 29:46.823 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:46.823 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:46.823 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:46.823 [DEBUG] TestAgent: Node info in sync 29:46.824 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:46.832 [INFO] TestAgent: Deregistered service: service=web 29:46.848 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:46.848 [INFO] TestAgent: Requesting shutdown 29:46.848 [INFO] TestAgent.server: shutting down server 29:46.848 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:46.848 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:46.848 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:46.848 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:46.848 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:46.848 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:46.848 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:46.848 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:46.848 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:46.849 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:46.849 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:46.849 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:46.849 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:46.849 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:46.849 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:46.858 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:46.864Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:46.864Z [INFO] agent.router.manager: shutting down 29:46.864 [INFO] TestAgent: consul server down 29:46.864 [INFO] TestAgent: shutdown complete 29:46.864 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29533 network=tcp 29:46.864 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29533 network=udp 29:46.864 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29534 network=tcp 29:47.368 [INFO] TestAgent: Waiting for endpoints to shut down 29:47.368 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_denied 2021-10-05T16:29:46.531Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:46.531Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:46.547Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:46.547Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:46.581 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:92e3d203-7060-5344-eab2-ce86c26d50b4 Address:127.0.0.1:29545}]" 29:46.582 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-92e3d203-7060-5344-eab2-ce86c26d50b4.dc1 127.0.0.1 29:46.582 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29545 [Follower]" leader= 29:46.582 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-92e3d203-7060-5344-eab2-ce86c26d50b4 127.0.0.1 2021-10-05T16:29:46.582Z [INFO] agent.router: Initializing LAN area manager 29:46.582 [INFO] TestAgent.server: Adding LAN server: server="Node-92e3d203-7060-5344-eab2-ce86c26d50b4 (Addr: tcp/127.0.0.1:29545) (DC: dc1)" 29:46.582 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-92e3d203-7060-5344-eab2-ce86c26d50b4.dc1 area=wan 29:46.582 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29540 network=udp 29:46.582 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29540 network=tcp 29:46.583 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29541 network=tcp 29:46.583 [INFO] TestAgent: started state syncer 29:46.583 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29546 network=tcp 29:46.633 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:46.638 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:46.638 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29545 [Candidate]" term=2 29:46.656 [DEBUG] TestAgent.server.raft: votes: needed=1 29:46.656 [DEBUG] TestAgent.server.raft: vote granted: from=92e3d203-7060-5344-eab2-ce86c26d50b4 term=2 tally=1 29:46.656 [INFO] TestAgent.server.raft: election won: tally=1 29:46.656 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29545 [Leader]" 29:46.656 [INFO] TestAgent.server: cluster leadership acquired 29:46.657 [INFO] TestAgent.server: New leader elected: payload=Node-92e3d203-7060-5344-eab2-ce86c26d50b4 29:46.667 [INFO] TestAgent.server: initializing acls 29:46.671 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:46.671 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:46.681 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:46.696 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:46.696 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:46.696 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:46.696 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-92e3d203-7060-5344-eab2-ce86c26d50b4 29:46.696 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-92e3d203-7060-5344-eab2-ce86c26d50b4.dc1 29:46.696 [INFO] TestAgent.server: Updating LAN server: server="Node-92e3d203-7060-5344-eab2-ce86c26d50b4 (Addr: tcp/127.0.0.1:29545) (DC: dc1)" 29:46.697 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-92e3d203-7060-5344-eab2-ce86c26d50b4.dc1 area=wan 29:46.720 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:46.720 [INFO] TestAgent: Synced node info 29:46.720 [DEBUG] TestAgent: Node info in sync 29:46.747 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:46.747 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:46.747 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:46.747 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:46.747 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:46.747 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-92e3d203-7060-5344-eab2-ce86c26d50b4 29:46.747 [INFO] TestAgent.server: member joined, marking health alive: member=Node-92e3d203-7060-5344-eab2-ce86c26d50b4 29:46.767 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-92e3d203-7060-5344-eab2-ce86c26d50b4 29:46.779 [INFO] TestAgent.server: federation state anti-entropy synced 29:46.789 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-92e3d203-7060-5344-eab2-ce86c26d50b4 29:46.789 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-92e3d203-7060-5344-eab2-ce86c26d50b4 29:46.833 [DEBUG] TestAgent: Node info in sync 29:46.855 [INFO] TestAgent: Synced service: service=web 29:46.864 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:46.864 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:46.864 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:46.865 [DEBUG] TestAgent: removed service: service=web 29:46.865 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:46.865 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:46.865 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:46.865 [DEBUG] TestAgent: Node info in sync 29:46.884 [INFO] TestAgent: Deregistered service: service=web 29:46.900 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:46.900 [INFO] TestAgent: Requesting shutdown 29:46.900 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:46.900 [INFO] TestAgent.server: shutting down server 29:46.900 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:46.900 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:46.900 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:46.900 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:46.900 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:46.900 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:46.900 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:46.900 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:46.900 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:46.900 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:46.900 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:46.900 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:46.900 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:46.900 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:46.907 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:46.912Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:46.912Z [INFO] agent.router.manager: shutting down 29:46.912 [INFO] TestAgent: consul server down 29:46.912 [INFO] TestAgent: shutdown complete 29:46.912 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29540 network=tcp 29:46.912 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29540 network=udp 29:46.912 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29541 network=tcp 29:47.414 [INFO] TestAgent: Waiting for endpoints to shut down 29:47.414 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_denied 2021-10-05T16:29:47.404Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:47.404Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:47.443Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:47.443Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:47.494 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:538a415e-6eb8-1708-ec89-5302609386fa Address:127.0.0.1:29552}]" 29:47.495 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-538a415e-6eb8-1708-ec89-5302609386fa.dc1 127.0.0.1 29:47.495 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-538a415e-6eb8-1708-ec89-5302609386fa 127.0.0.1 2021-10-05T16:29:47.495Z [INFO] agent.router: Initializing LAN area manager 29:47.496 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29547 network=udp 29:47.496 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29552 [Follower]" leader= 29:47.496 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29547 network=tcp 29:47.496 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-538a415e-6eb8-1708-ec89-5302609386fa.dc1 area=wan 29:47.496 [INFO] TestAgent.server: Adding LAN server: server="Node-538a415e-6eb8-1708-ec89-5302609386fa (Addr: tcp/127.0.0.1:29552) (DC: dc1)" 29:47.496 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29548 network=tcp 29:47.496 [INFO] TestAgent: started state syncer 29:47.497 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29553 network=tcp 29:47.547 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:47.549 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:47.549 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29552 [Candidate]" term=2 29:47.569 [DEBUG] TestAgent.server.raft: votes: needed=1 29:47.569 [DEBUG] TestAgent.server.raft: vote granted: from=538a415e-6eb8-1708-ec89-5302609386fa term=2 tally=1 29:47.569 [INFO] TestAgent.server.raft: election won: tally=1 29:47.569 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29552 [Leader]" 29:47.569 [INFO] TestAgent.server: cluster leadership acquired 29:47.569 [INFO] TestAgent.server: New leader elected: payload=Node-538a415e-6eb8-1708-ec89-5302609386fa 29:47.576 [INFO] TestAgent.server: initializing acls 29:47.580 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:47.580 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:47.587 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:47.612 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:47.612 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:47.612 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:47.612 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-538a415e-6eb8-1708-ec89-5302609386fa 29:47.612 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-538a415e-6eb8-1708-ec89-5302609386fa.dc1 29:47.614 [INFO] TestAgent.server: Updating LAN server: server="Node-538a415e-6eb8-1708-ec89-5302609386fa (Addr: tcp/127.0.0.1:29552) (DC: dc1)" 29:47.614 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-538a415e-6eb8-1708-ec89-5302609386fa.dc1 area=wan 29:47.626 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:47.660 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:47.660 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:47.660 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:47.660 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:47.660 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:47.660 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-538a415e-6eb8-1708-ec89-5302609386fa 29:47.660 [INFO] TestAgent.server: member joined, marking health alive: member=Node-538a415e-6eb8-1708-ec89-5302609386fa 29:47.671 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-538a415e-6eb8-1708-ec89-5302609386fa 29:47.677 [INFO] TestAgent.server: federation state anti-entropy synced 29:47.686 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-538a415e-6eb8-1708-ec89-5302609386fa 29:47.687 [INFO] TestAgent: Requesting shutdown 29:47.687 [INFO] TestAgent.server: shutting down server 29:47.687 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:47.687 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:47.687 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:47.687 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:47.687 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:47.687 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:47.687 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:47.687 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:47.687 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:47.687 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:47.687 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:47.687 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:47.687 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:47.687 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:47.687 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:47.690 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:47.691Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:47.691Z [INFO] agent.router.manager: shutting down 29:47.691 [INFO] TestAgent: consul server down 29:47.691 [INFO] TestAgent: shutdown complete 29:47.691 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29547 network=tcp 29:47.692 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29547 network=udp 29:47.692 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29548 network=tcp 29:48.193 [INFO] TestAgent: Waiting for endpoints to shut down 29:48.193 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_but_not_for_sidecar 2021-10-05T16:29:47.446Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:47.446Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:47.475Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:47.475Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:47.504 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:60eda825-34e1-9550-c719-61050aa4fdd6 Address:127.0.0.1:29559}]" 29:47.504 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-60eda825-34e1-9550-c719-61050aa4fdd6.dc1 127.0.0.1 29:47.505 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-60eda825-34e1-9550-c719-61050aa4fdd6 127.0.0.1 2021-10-05T16:29:47.505Z [INFO] agent.router: Initializing LAN area manager 29:47.505 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29554 network=udp 29:47.505 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29559 [Follower]" leader= 29:47.506 [INFO] TestAgent.server: Adding LAN server: server="Node-60eda825-34e1-9550-c719-61050aa4fdd6 (Addr: tcp/127.0.0.1:29559) (DC: dc1)" 29:47.506 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-60eda825-34e1-9550-c719-61050aa4fdd6.dc1 area=wan 29:47.506 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29554 network=tcp 29:47.506 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29555 network=tcp 29:47.506 [INFO] TestAgent: started state syncer 29:47.506 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29560 network=tcp 29:47.556 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:47.557 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29559 [Candidate]" term=2 29:47.557 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:47.576 [DEBUG] TestAgent.server.raft: votes: needed=1 29:47.576 [DEBUG] TestAgent.server.raft: vote granted: from=60eda825-34e1-9550-c719-61050aa4fdd6 term=2 tally=1 29:47.576 [INFO] TestAgent.server.raft: election won: tally=1 29:47.576 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29559 [Leader]" 29:47.576 [INFO] TestAgent.server: cluster leadership acquired 29:47.576 [INFO] TestAgent.server: New leader elected: payload=Node-60eda825-34e1-9550-c719-61050aa4fdd6 29:47.582 [INFO] TestAgent.server: initializing acls 29:47.585 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:47.585 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:47.593 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:47.621 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:47.621 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:47.621 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:47.621 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-60eda825-34e1-9550-c719-61050aa4fdd6 29:47.622 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-60eda825-34e1-9550-c719-61050aa4fdd6.dc1 29:47.622 [INFO] TestAgent.server: Updating LAN server: server="Node-60eda825-34e1-9550-c719-61050aa4fdd6 (Addr: tcp/127.0.0.1:29559) (DC: dc1)" 29:47.622 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-60eda825-34e1-9550-c719-61050aa4fdd6.dc1 area=wan 29:47.640 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:47.683 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:47.683 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:47.683 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:47.683 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:47.683 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:47.683 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-60eda825-34e1-9550-c719-61050aa4fdd6 29:47.683 [INFO] TestAgent.server: member joined, marking health alive: member=Node-60eda825-34e1-9550-c719-61050aa4fdd6 29:47.689 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-60eda825-34e1-9550-c719-61050aa4fdd6 29:47.693 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-60eda825-34e1-9550-c719-61050aa4fdd6 29:47.693 [INFO] TestAgent: Requesting shutdown 29:47.693 [INFO] TestAgent.server: shutting down server 29:47.693 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:47.693 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:47.693 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:47.693 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:47.693 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:47.693 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:47.693 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:47.693 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:47.693 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:47.693 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:47.693 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:47.693 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:47.693 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:47.696 [INFO] TestAgent.server: federation state anti-entropy synced 29:47.696 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:47.697 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:47.698Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:47.698Z [INFO] agent.router.manager: shutting down 29:47.698 [INFO] TestAgent: consul server down 29:47.698 [INFO] TestAgent: shutdown complete 29:47.698 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29554 network=tcp 29:47.698 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29554 network=udp 29:47.698 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29555 network=tcp 29:48.199 [INFO] TestAgent: Waiting for endpoints to shut down 29:48.199 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_but_not_for_sidecar 2021-10-05T16:29:48.206Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:48.206Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:48.258Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:48.258Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:48.352 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2fdc6412-0a85-be41-a872-f85fb88884ca Address:127.0.0.1:29566}]" 29:48.352 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29566 [Follower]" leader= 29:48.353 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2fdc6412-0a85-be41-a872-f85fb88884ca.dc1 127.0.0.1 29:48.353 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2fdc6412-0a85-be41-a872-f85fb88884ca 127.0.0.1 2021-10-05T16:29:48.354Z [INFO] agent.router: Initializing LAN area manager 29:48.354 [INFO] TestAgent.server: Adding LAN server: server="Node-2fdc6412-0a85-be41-a872-f85fb88884ca (Addr: tcp/127.0.0.1:29566) (DC: dc1)" 29:48.354 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2fdc6412-0a85-be41-a872-f85fb88884ca.dc1 area=wan 29:48.354 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29561 network=udp 29:48.354 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29561 network=tcp 29:48.355 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29562 network=tcp 29:48.355 [INFO] TestAgent: started state syncer 29:48.355 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29567 network=tcp 29:48.396 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:48.396 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29566 [Candidate]" term=2 29:48.408 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:48.456 [DEBUG] TestAgent.server.raft: votes: needed=1 29:48.456 [DEBUG] TestAgent.server.raft: vote granted: from=2fdc6412-0a85-be41-a872-f85fb88884ca term=2 tally=1 29:48.456 [INFO] TestAgent.server.raft: election won: tally=1 29:48.456 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29566 [Leader]" 29:48.456 [INFO] TestAgent.server: cluster leadership acquired 29:48.456 [INFO] TestAgent.server: New leader elected: payload=Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.487 [INFO] TestAgent.server: initializing acls 29:48.500 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:48.500 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:48.509 [INFO] TestAgent.server: initializing acls 29:48.509 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:48.514 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:48.564 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:48.572 [INFO] TestAgent: Synced node info 29:48.572 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:48.572 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:48.572 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:48.572 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.572 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-2fdc6412-0a85-be41-a872-f85fb88884ca.dc1 29:48.572 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-2fdc6412-0a85-be41-a872-f85fb88884ca.dc1 area=wan 29:48.573 [INFO] TestAgent.server: Updating LAN server: server="Node-2fdc6412-0a85-be41-a872-f85fb88884ca (Addr: tcp/127.0.0.1:29566) (DC: dc1)" 29:48.580 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:48.580 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 29:48.580 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.580 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-2fdc6412-0a85-be41-a872-f85fb88884ca.dc1 29:48.580 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-2fdc6412-0a85-be41-a872-f85fb88884ca.dc1 area=wan 29:48.580 [INFO] TestAgent.server: Updating LAN server: server="Node-2fdc6412-0a85-be41-a872-f85fb88884ca (Addr: tcp/127.0.0.1:29566) (DC: dc1)" 29:48.587 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:48.640 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:48.640 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:48.640 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:48.640 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:48.640 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:48.640 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.640 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.651 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.651 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.669 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.669 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2fdc6412-0a85-be41-a872-f85fb88884ca 29:48.709 [INFO] TestAgent.server: federation state anti-entropy synced 29:48.715 [INFO] TestAgent: Requesting shutdown 29:48.715 [INFO] TestAgent.server: shutting down server 29:48.715 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:48.715 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:48.715 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:48.715 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:48.715 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:48.715 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:48.715 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:48.715 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:48.715 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:48.715 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:48.715 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:48.715 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:48.715 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:48.715 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:48.719 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:48.719Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:48.719Z [INFO] agent.router.manager: shutting down 29:48.719 [INFO] TestAgent: consul server down 29:48.719 [INFO] TestAgent: shutdown complete 29:48.719 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29561 network=tcp 29:48.719 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29561 network=udp 29:48.719 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29562 network=tcp 29:49.219 [INFO] TestAgent: Waiting for endpoints to shut down 29:49.219 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_and_sidecar_but_not_sidecar's_overridden_destination 2021-10-05T16:29:48.214Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:48.214Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:48.269Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:48.269Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:48.364 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:18d09ab7-400d-1efd-f361-697ac232fb4b Address:127.0.0.1:29573}]" 29:48.365 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-18d09ab7-400d-1efd-f361-697ac232fb4b.dc1 127.0.0.1 29:48.365 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29573 [Follower]" leader= 29:48.365 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-18d09ab7-400d-1efd-f361-697ac232fb4b 127.0.0.1 2021-10-05T16:29:48.365Z [INFO] agent.router: Initializing LAN area manager 29:48.366 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29568 network=udp 29:48.366 [INFO] TestAgent.server: Adding LAN server: server="Node-18d09ab7-400d-1efd-f361-697ac232fb4b (Addr: tcp/127.0.0.1:29573) (DC: dc1)" 29:48.366 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29568 network=tcp 29:48.366 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-18d09ab7-400d-1efd-f361-697ac232fb4b.dc1 area=wan 29:48.366 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29569 network=tcp 29:48.366 [INFO] TestAgent: started state syncer 29:48.366 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29574 network=tcp 29:48.420 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:48.436 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:48.436 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29573 [Candidate]" term=2 29:48.460 [DEBUG] TestAgent.server.raft: votes: needed=1 29:48.460 [DEBUG] TestAgent.server.raft: vote granted: from=18d09ab7-400d-1efd-f361-697ac232fb4b term=2 tally=1 29:48.460 [INFO] TestAgent.server.raft: election won: tally=1 29:48.460 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29573 [Leader]" 29:48.460 [INFO] TestAgent.server: cluster leadership acquired 29:48.460 [INFO] TestAgent.server: New leader elected: payload=Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.469 [INFO] TestAgent.server: initializing acls 29:48.484 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:48.484 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:48.509 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:48.524 [INFO] TestAgent.server: initializing acls 29:48.524 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:48.556 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:48.556 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:48.556 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:48.556 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.556 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-18d09ab7-400d-1efd-f361-697ac232fb4b.dc1 29:48.556 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-18d09ab7-400d-1efd-f361-697ac232fb4b.dc1 area=wan 29:48.557 [INFO] TestAgent.server: Updating LAN server: server="Node-18d09ab7-400d-1efd-f361-697ac232fb4b (Addr: tcp/127.0.0.1:29573) (DC: dc1)" 29:48.560 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:48.560 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 29:48.560 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.560 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-18d09ab7-400d-1efd-f361-697ac232fb4b.dc1 29:48.560 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-18d09ab7-400d-1efd-f361-697ac232fb4b.dc1 area=wan 29:48.560 [INFO] TestAgent: Synced node info 29:48.560 [INFO] TestAgent.server: Updating LAN server: server="Node-18d09ab7-400d-1efd-f361-697ac232fb4b (Addr: tcp/127.0.0.1:29573) (DC: dc1)" 29:48.572 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:48.599 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:48.599 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:48.599 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:48.599 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:48.599 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:48.599 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.599 [INFO] TestAgent.server: member joined, marking health alive: member=Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.637 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.637 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.660 [INFO] TestAgent.server: federation state anti-entropy synced 29:48.758 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.758 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-18d09ab7-400d-1efd-f361-697ac232fb4b 29:48.767 [INFO] TestAgent: Requesting shutdown 29:48.767 [INFO] TestAgent.server: shutting down server 29:48.767 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:48.767 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:48.767 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:48.767 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:48.767 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:48.767 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:48.767 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:48.767 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:48.767 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:48.767 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:48.767 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:48.767 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:48.767 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:48.767 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:48.780 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:48.784Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:48.784Z [INFO] agent.router.manager: shutting down 29:48.784 [INFO] TestAgent: consul server down 29:48.784 [INFO] TestAgent: shutdown complete 29:48.784 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29568 network=tcp 29:48.784 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29568 network=udp 29:48.784 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29569 network=tcp 29:49.286 [INFO] TestAgent: Waiting for endpoints to shut down 29:49.286 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_and_sidecar_but_not_sidecar's_overridden_destination 2021-10-05T16:29:49.232Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:49.232Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:49.243Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:49.243Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:49.302 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3fd1976a-f63f-513a-45bb-59c7eef2e263 Address:127.0.0.1:29580}]" 29:49.303 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29580 [Follower]" leader= 29:49.303 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3fd1976a-f63f-513a-45bb-59c7eef2e263.dc1 127.0.0.1 29:49.304 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 127.0.0.1 2021-10-05T16:29:49.304Z [INFO] agent.router: Initializing LAN area manager 29:49.304 [INFO] TestAgent.server: Adding LAN server: server="Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 (Addr: tcp/127.0.0.1:29580) (DC: dc1)" 29:49.304 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263.dc1 area=wan 29:49.304 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29575 network=udp 29:49.304 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29575 network=tcp 29:49.321 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29576 network=tcp 29:49.321 [INFO] TestAgent: started state syncer 29:49.321 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29581 network=tcp 29:49.349 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:49.349 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29580 [Candidate]" term=2 29:49.355 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:49.363 [DEBUG] TestAgent.server.raft: votes: needed=1 29:49.363 [DEBUG] TestAgent.server.raft: vote granted: from=3fd1976a-f63f-513a-45bb-59c7eef2e263 term=2 tally=1 29:49.363 [INFO] TestAgent.server.raft: election won: tally=1 29:49.363 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29580 [Leader]" 29:49.363 [INFO] TestAgent.server: cluster leadership acquired 29:49.364 [INFO] TestAgent.server: New leader elected: payload=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 29:49.381 [INFO] TestAgent.server: initializing acls 29:49.386 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:49.386 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:49.392 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:49.406 [INFO] TestAgent: Synced node info 29:49.406 [DEBUG] TestAgent: Node info in sync 29:49.406 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:49.406 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:49.406 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:49.406 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 29:49.406 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-3fd1976a-f63f-513a-45bb-59c7eef2e263.dc1 29:49.407 [INFO] TestAgent.server: Updating LAN server: server="Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 (Addr: tcp/127.0.0.1:29580) (DC: dc1)" 29:49.407 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263.dc1 area=wan 29:49.439 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:49.459 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:49.459 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:49.459 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:49.459 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:49.459 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:49.459 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 29:49.459 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 29:49.464 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 29:49.464 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 29:49.466 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3fd1976a-f63f-513a-45bb-59c7eef2e263 29:49.477 [INFO] TestAgent.server: federation state anti-entropy synced 29:49.478 [INFO] TestAgent: Requesting shutdown 29:49.478 [INFO] TestAgent.server: shutting down server 29:49.478 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:49.478 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:49.478 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:49.478 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:49.478 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:49.478 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:49.478 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:49.478 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:49.478 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:49.478 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:49.478 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:49.478 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:49.478 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:49.478 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:49.482 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:49.487Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:49.487Z [INFO] agent.router.manager: shutting down 29:49.487 [INFO] TestAgent: consul server down 29:49.487 [INFO] TestAgent: shutdown complete 29:49.487 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29575 network=tcp 29:49.487 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29575 network=udp 29:49.487 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29576 network=tcp 29:49.988 [INFO] TestAgent: Waiting for endpoints to shut down 29:49.988 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_but_not_for_overridden_sidecar 2021-10-05T16:29:49.323Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:49.323Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:49.343Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:49.343Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:49.382 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a75768be-6dea-aaeb-3034-79cd0b407199 Address:127.0.0.1:29587}]" 29:49.383 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a75768be-6dea-aaeb-3034-79cd0b407199.dc1 127.0.0.1 29:49.383 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a75768be-6dea-aaeb-3034-79cd0b407199 127.0.0.1 2021-10-05T16:29:49.383Z [INFO] agent.router: Initializing LAN area manager 29:49.384 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29587 [Follower]" leader= 29:49.384 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29582 network=udp 29:49.384 [INFO] TestAgent.server: Adding LAN server: server="Node-a75768be-6dea-aaeb-3034-79cd0b407199 (Addr: tcp/127.0.0.1:29587) (DC: dc1)" 29:49.384 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a75768be-6dea-aaeb-3034-79cd0b407199.dc1 area=wan 29:49.384 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29582 network=tcp 29:49.385 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29583 network=tcp 29:49.385 [INFO] TestAgent: started state syncer 29:49.385 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29588 network=tcp 29:49.434 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:49.444 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:49.444 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29587 [Candidate]" term=2 29:49.460 [DEBUG] TestAgent.server.raft: votes: needed=1 29:49.460 [DEBUG] TestAgent.server.raft: vote granted: from=a75768be-6dea-aaeb-3034-79cd0b407199 term=2 tally=1 29:49.460 [INFO] TestAgent.server.raft: election won: tally=1 29:49.460 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29587 [Leader]" 29:49.460 [INFO] TestAgent.server: cluster leadership acquired 29:49.460 [INFO] TestAgent.server: New leader elected: payload=Node-a75768be-6dea-aaeb-3034-79cd0b407199 29:49.479 [INFO] TestAgent.server: initializing acls 29:49.484 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:49.484 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:49.496 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:49.511 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:49.511 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:49.511 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:49.511 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a75768be-6dea-aaeb-3034-79cd0b407199 29:49.511 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a75768be-6dea-aaeb-3034-79cd0b407199.dc1 29:49.512 [INFO] TestAgent.server: Updating LAN server: server="Node-a75768be-6dea-aaeb-3034-79cd0b407199 (Addr: tcp/127.0.0.1:29587) (DC: dc1)" 29:49.512 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a75768be-6dea-aaeb-3034-79cd0b407199.dc1 area=wan 29:49.530 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:49.548 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:49.548 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:49.548 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:49.548 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:49.548 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:49.548 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a75768be-6dea-aaeb-3034-79cd0b407199 29:49.548 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a75768be-6dea-aaeb-3034-79cd0b407199 29:49.556 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a75768be-6dea-aaeb-3034-79cd0b407199 29:49.563 [INFO] TestAgent.server: federation state anti-entropy synced 29:49.594 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-a75768be-6dea-aaeb-3034-79cd0b407199 29:49.594 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-a75768be-6dea-aaeb-3034-79cd0b407199 29:49.604 [INFO] TestAgent: Requesting shutdown 29:49.604 [INFO] TestAgent.server: shutting down server 29:49.604 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:49.604 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:49.604 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:49.604 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:49.604 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:49.604 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:49.604 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:49.605 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:49.605 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:49.605 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:49.605 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:49.605 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:49.605 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:49.605 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:49.605 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:49.610 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:49.614Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:49.614Z [INFO] agent.router.manager: shutting down 29:49.614 [INFO] TestAgent: consul server down 29:49.614 [INFO] TestAgent: shutdown complete 29:49.614 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29582 network=tcp 29:49.614 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29582 network=udp 29:49.614 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29583 network=tcp 29:50.116 [INFO] TestAgent: Waiting for endpoints to shut down 29:50.116 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_but_not_for_overridden_sidecar 2021-10-05T16:29:50.003Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:50.004Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:50.028Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:50.028Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:50.063 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6fca75e1-699d-616e-9856-d99e52fa5c6b Address:127.0.0.1:29594}]" 29:50.063 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29594 [Follower]" leader= 29:50.064 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6fca75e1-699d-616e-9856-d99e52fa5c6b.dc1 127.0.0.1 29:50.065 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 127.0.0.1 2021-10-05T16:29:50.065Z [INFO] agent.router: Initializing LAN area manager 29:50.065 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b.dc1 area=wan 29:50.073 [INFO] TestAgent.server: Adding LAN server: server="Node-6fca75e1-699d-616e-9856-d99e52fa5c6b (Addr: tcp/127.0.0.1:29594) (DC: dc1)" 29:50.076 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29589 network=udp 29:50.076 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29589 network=tcp 29:50.077 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29590 network=tcp 29:50.077 [INFO] TestAgent: started state syncer 29:50.077 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29595 network=tcp 29:50.112 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:50.112 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29594 [Candidate]" term=2 29:50.116 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:50.160 [DEBUG] TestAgent.server.raft: votes: needed=1 29:50.160 [DEBUG] TestAgent.server.raft: vote granted: from=6fca75e1-699d-616e-9856-d99e52fa5c6b term=2 tally=1 29:50.160 [INFO] TestAgent.server.raft: election won: tally=1 29:50.160 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29594 [Leader]" 29:50.160 [INFO] TestAgent.server: cluster leadership acquired 29:50.160 [INFO] TestAgent.server: New leader elected: payload=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 29:50.168 [INFO] TestAgent.server: initializing acls 29:50.171 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:50.171 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:50.177 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:50.187 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:50.187 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:50.187 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:50.187 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 29:50.187 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-6fca75e1-699d-616e-9856-d99e52fa5c6b.dc1 29:50.187 [INFO] TestAgent.server: Updating LAN server: server="Node-6fca75e1-699d-616e-9856-d99e52fa5c6b (Addr: tcp/127.0.0.1:29594) (DC: dc1)" 29:50.188 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b.dc1 area=wan 29:50.197 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:50.234 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:50.234 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:50.234 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:50.234 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:50.234 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:50.234 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 29:50.234 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 29:50.248 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 29:50.263 [INFO] TestAgent.server: federation state anti-entropy synced 29:50.309 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 29:50.309 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-6fca75e1-699d-616e-9856-d99e52fa5c6b 29:50.322 [INFO] TestAgent: Requesting shutdown 29:50.323 [INFO] TestAgent.server: shutting down server 29:50.323 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:50.323 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:50.323 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:50.323 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:50.323 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:50.323 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:50.323 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:50.323 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:50.323 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:50.323 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:50.323 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:50.323 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:50.323 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:50.323 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:50.323 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:50.326 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:50.333Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:50.333Z [INFO] agent.router.manager: shutting down 29:50.334 [INFO] TestAgent: consul server down 29:50.334 [INFO] TestAgent: shutdown complete 29:50.334 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29589 network=tcp 29:50.334 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29589 network=udp 29:50.334 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29590 network=tcp 29:50.840 [INFO] TestAgent: Waiting for endpoints to shut down 29:50.840 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_but_and_overridden_for_sidecar 2021-10-05T16:29:50.157Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:50.157Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:50.187Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:50.187Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:50.280 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f58ae808-c3f5-c748-47d3-1ef4656dadc2 Address:127.0.0.1:29601}]" 29:50.281 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2.dc1 127.0.0.1 29:50.281 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 127.0.0.1 2021-10-05T16:29:50.281Z [INFO] agent.router: Initializing LAN area manager 29:50.281 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29596 network=udp 29:50.281 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29601 [Follower]" leader= 29:50.282 [INFO] TestAgent.server: Adding LAN server: server="Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 (Addr: tcp/127.0.0.1:29601) (DC: dc1)" 29:50.282 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2.dc1 area=wan 29:50.282 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29596 network=tcp 29:50.282 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29597 network=tcp 29:50.282 [INFO] TestAgent: started state syncer 29:50.282 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29602 network=tcp 29:50.327 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:50.327 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29601 [Candidate]" term=2 29:50.332 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:50.357 [DEBUG] TestAgent.server.raft: votes: needed=1 29:50.358 [DEBUG] TestAgent.server.raft: vote granted: from=f58ae808-c3f5-c748-47d3-1ef4656dadc2 term=2 tally=1 29:50.358 [INFO] TestAgent.server.raft: election won: tally=1 29:50.358 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29601 [Leader]" 29:50.358 [INFO] TestAgent.server: cluster leadership acquired 29:50.358 [INFO] TestAgent.server: New leader elected: payload=Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 29:50.368 [INFO] TestAgent.server: initializing acls 29:50.384 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:50.384 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:50.400 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:50.424 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:50.424 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:50.424 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:50.424 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 29:50.424 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2.dc1 29:50.425 [INFO] TestAgent.server: Updating LAN server: server="Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 (Addr: tcp/127.0.0.1:29601) (DC: dc1)" 29:50.425 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2.dc1 area=wan 29:50.442 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:50.462 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:50.462 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:50.462 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:50.462 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:50.462 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:50.462 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 29:50.462 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 29:50.469 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 29:50.474 [INFO] TestAgent.server: federation state anti-entropy synced 29:50.486 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-f58ae808-c3f5-c748-47d3-1ef4656dadc2 29:50.499 [INFO] TestAgent: Requesting shutdown 29:50.499 [INFO] TestAgent.server: shutting down server 29:50.499 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:50.499 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:50.499 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:50.499 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:50.499 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:50.499 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:50.499 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:50.499 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:50.499 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:50.499 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:50.499 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:50.499 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:50.499 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:50.499 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:50.499 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:50.504 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:50.508Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:50.508Z [INFO] agent.router.manager: shutting down 29:50.508 [INFO] TestAgent: consul server down 29:50.508 [INFO] TestAgent: shutdown complete 29:50.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29596 network=tcp 29:50.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29596 network=udp 29:50.508 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29597 network=tcp 29:51.009 [INFO] TestAgent: Waiting for endpoints to shut down 29:51.009 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_but_and_overridden_for_sidecar 2021-10-05T16:29:50.859Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:50.859Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:50.886Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:50.886Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:50.944 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3dbb1ce0-57f6-2e87-339a-64648aa2ace1 Address:127.0.0.1:29608}]" 29:50.945 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1.dc1 127.0.0.1 29:50.945 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 127.0.0.1 2021-10-05T16:29:50.945Z [INFO] agent.router: Initializing LAN area manager 29:50.946 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29603 network=udp 29:50.946 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29608 [Follower]" leader= 29:50.946 [INFO] TestAgent.server: Adding LAN server: server="Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 (Addr: tcp/127.0.0.1:29608) (DC: dc1)" 29:50.946 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1.dc1 area=wan 29:50.946 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29603 network=tcp 29:50.947 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29604 network=tcp 29:50.947 [INFO] TestAgent: started state syncer 29:50.947 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29609 network=tcp 29:50.997 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:51.009 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:51.009 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29608 [Candidate]" term=2 29:51.025 [DEBUG] TestAgent.server.raft: votes: needed=1 29:51.025 [DEBUG] TestAgent.server.raft: vote granted: from=3dbb1ce0-57f6-2e87-339a-64648aa2ace1 term=2 tally=1 29:51.025 [INFO] TestAgent.server.raft: election won: tally=1 29:51.025 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29608 [Leader]" 29:51.028 [INFO] TestAgent.server: cluster leadership acquired 29:51.028 [INFO] TestAgent.server: New leader elected: payload=Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 29:51.040 [INFO] TestAgent.server: initializing acls 29:51.044 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:51.044 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.059 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.086 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.086 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:51.086 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:51.087 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 29:51.087 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1.dc1 29:51.087 [INFO] TestAgent.server: Updating LAN server: server="Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 (Addr: tcp/127.0.0.1:29608) (DC: dc1)" 29:51.088 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1.dc1 area=wan 29:51.104 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:51.119 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:51.119 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:51.119 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:51.119 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:51.119 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:51.119 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 29:51.119 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 29:51.142 [INFO] TestAgent.server: federation state anti-entropy synced 29:51.143 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 29:51.154 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-3dbb1ce0-57f6-2e87-339a-64648aa2ace1 29:51.234 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 29:51.240 [INFO] TestAgent: Synced node info 29:51.252 [INFO] TestAgent: Synced service: service=web 29:51.257 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:51.257 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:51.257 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:51.292 [DEBUG] TestAgent: removed service: service=web 29:51.293 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:51.293 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:51.293 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:51.293 [DEBUG] TestAgent: Node info in sync 29:51.293 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:51.302 [INFO] TestAgent: Deregistered service: service=web 29:51.307 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:51.307 [INFO] TestAgent: Requesting shutdown 29:51.307 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:51.307 [INFO] TestAgent.server: shutting down server 29:51.307 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:51.307 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:51.307 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:51.307 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:51.307 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:51.307 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:51.307 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:51.307 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:51.307 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:51.307 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:51.307 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:51.307 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:51.307 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:51.307 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:51.307 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:51.316 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:51.324Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:51.324Z [INFO] agent.router.manager: shutting down 29:51.324 [INFO] TestAgent: consul server down 29:51.324 [INFO] TestAgent: shutdown complete 29:51.324 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29603 network=tcp 29:51.324 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29603 network=udp 29:51.324 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29604 network=tcp 29:51.828 [INFO] TestAgent: Waiting for endpoints to shut down 29:51.828 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_check_definition_in_sidecar 2021-10-05T16:29:51.026Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:51.026Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:51.048Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:51.048Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:51.102 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:76d577c9-9558-42da-b8f2-fe3cb97afa4a Address:127.0.0.1:29615}]" 29:51.102 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29615 [Follower]" leader= 29:51.102 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a.dc1 127.0.0.1 29:51.103 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 127.0.0.1 2021-10-05T16:29:51.103Z [INFO] agent.router: Initializing LAN area manager 29:51.103 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29610 network=udp 29:51.103 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a.dc1 area=wan 29:51.103 [INFO] TestAgent.server: Adding LAN server: server="Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a (Addr: tcp/127.0.0.1:29615) (DC: dc1)" 29:51.103 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29610 network=tcp 29:51.104 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29611 network=tcp 29:51.104 [INFO] TestAgent: started state syncer 29:51.104 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29616 network=tcp 29:51.141 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:51.141 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29615 [Candidate]" term=2 29:51.154 [DEBUG] TestAgent.server.raft: votes: needed=1 29:51.154 [DEBUG] TestAgent.server.raft: vote granted: from=76d577c9-9558-42da-b8f2-fe3cb97afa4a term=2 tally=1 29:51.154 [INFO] TestAgent.server.raft: election won: tally=1 29:51.154 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29615 [Leader]" 29:51.156 [INFO] TestAgent.server: cluster leadership acquired 29:51.156 [INFO] TestAgent.server: initializing acls 29:51.156 [INFO] TestAgent.server: New leader elected: payload=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.176 [INFO] TestAgent.server: initializing acls 29:51.176 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.177 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:51.177 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.191 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.217 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.236 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.236 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:51.236 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:51.236 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 29:51.236 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.236 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a.dc1 29:51.236 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a.dc1 area=wan 29:51.236 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.237 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.237 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a.dc1 29:51.237 [INFO] TestAgent.server: Updating LAN server: server="Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a (Addr: tcp/127.0.0.1:29615) (DC: dc1)" 29:51.237 [INFO] TestAgent.server: Updating LAN server: server="Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a (Addr: tcp/127.0.0.1:29615) (DC: dc1)" 29:51.237 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a.dc1 area=wan 29:51.266 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:51.302 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:51.302 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:51.302 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:51.302 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:51.302 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:51.303 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.303 [INFO] TestAgent.server: member joined, marking health alive: member=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.316 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.316 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.331 [INFO] TestAgent.server: federation state anti-entropy synced 29:51.349 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:51.359 [INFO] TestAgent: Synced node info 29:51.359 [DEBUG] TestAgent: Node info in sync 29:51.411 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.411 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-76d577c9-9558-42da-b8f2-fe3cb97afa4a 29:51.464 [DEBUG] TestAgent: Node info in sync 29:51.469 [INFO] TestAgent: Synced service: service=web 29:51.477 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:51.477 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:51.477 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:51.477 [DEBUG] TestAgent: removed service: service=web 29:51.478 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:51.478 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:51.478 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:51.478 [DEBUG] TestAgent: Node info in sync 29:51.482 [INFO] TestAgent: Deregistered service: service=web 29:51.489 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:51.489 [INFO] TestAgent: Requesting shutdown 29:51.489 [INFO] TestAgent.server: shutting down server 29:51.489 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:51.489 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:51.489 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:51.489 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:51.490 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:51.490 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:51.490 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:51.490 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:51.490 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:51.490 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:51.490 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:51.490 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:51.490 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:51.490 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:51.496 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:51.503Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:51.503Z [INFO] agent.router.manager: shutting down 29:51.503 [INFO] TestAgent: consul server down 29:51.503 [INFO] TestAgent: shutdown complete 29:51.503 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29610 network=tcp 29:51.503 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29610 network=udp 29:51.503 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29611 network=tcp 29:52.003 [INFO] TestAgent: Waiting for endpoints to shut down 29:52.003 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_check_definition_in_sidecar 2021-10-05T16:29:51.880Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:51.916Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:51.969 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f709500d-5a12-8f63-c481-443953c68c54 Address:127.0.0.1:29622}]" 29:51.970 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f709500d-5a12-8f63-c481-443953c68c54.dc1 127.0.0.1 29:51.970 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f709500d-5a12-8f63-c481-443953c68c54 127.0.0.1 2021-10-05T16:29:51.970Z [INFO] agent.router: Initializing LAN area manager 29:51.971 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29617 network=udp 29:51.971 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29622 [Follower]" leader= 29:51.971 [INFO] TestAgent.server: Adding LAN server: server="Node-f709500d-5a12-8f63-c481-443953c68c54 (Addr: tcp/127.0.0.1:29622) (DC: dc1)" 29:51.971 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f709500d-5a12-8f63-c481-443953c68c54.dc1 area=wan 29:51.971 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29617 network=tcp 29:51.972 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29618 network=tcp 29:51.972 [INFO] TestAgent: started state syncer 29:51.972 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29623 network=tcp 29:52.040 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:52.040 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29622 [Candidate]" term=2 29:52.057 [DEBUG] TestAgent.server.raft: votes: needed=1 29:52.057 [DEBUG] TestAgent.server.raft: vote granted: from=f709500d-5a12-8f63-c481-443953c68c54 term=2 tally=1 29:52.057 [INFO] TestAgent.server.raft: election won: tally=1 29:52.057 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29622 [Leader]" 29:52.058 [INFO] TestAgent.server: cluster leadership acquired 29:52.058 [INFO] TestAgent.server: New leader elected: payload=Node-f709500d-5a12-8f63-c481-443953c68c54 29:52.065 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29622 29:52.078 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:52.096 [INFO] TestAgent: Synced node info 29:52.096 [DEBUG] TestAgent: Node info in sync 29:52.112 [DEBUG] TestAgent: Node info in sync 29:52.123 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:52.123 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:52.123 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:52.123 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:52.123 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:52.123 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f709500d-5a12-8f63-c481-443953c68c54 29:52.123 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f709500d-5a12-8f63-c481-443953c68c54 29:52.152 [INFO] TestAgent.server: federation state anti-entropy synced 29:52.287 [INFO] TestAgent: Requesting shutdown 29:52.287 [INFO] TestAgent.server: shutting down server 29:52.287 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:52.287 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:52.287 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:52.287 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:52.287 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:52.287 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:52.287 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:52.287 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:52.287 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:52.287 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:52.301 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:52.307Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:52.307Z [INFO] agent.router.manager: shutting down 29:52.307 [INFO] TestAgent: consul server down 29:52.307 [INFO] TestAgent: shutdown complete 29:52.307 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29617 network=tcp 29:52.307 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29617 network=udp 29:52.307 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29618 network=tcp 29:52.808 [INFO] TestAgent: Waiting for endpoints to shut down 29:52.808 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_checks_definitions_in_sidecar 2021-10-05T16:29:52.019Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:52.034Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:52.120 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:046def86-ccf2-1ecd-af27-611867d0d636 Address:127.0.0.1:29629}]" 29:52.120 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-046def86-ccf2-1ecd-af27-611867d0d636.dc1 127.0.0.1 29:52.121 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-046def86-ccf2-1ecd-af27-611867d0d636 127.0.0.1 2021-10-05T16:29:52.121Z [INFO] agent.router: Initializing LAN area manager 29:52.121 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29624 network=udp 29:52.121 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29629 [Follower]" leader= 29:52.122 [INFO] TestAgent.server: Adding LAN server: server="Node-046def86-ccf2-1ecd-af27-611867d0d636 (Addr: tcp/127.0.0.1:29629) (DC: dc1)" 29:52.122 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-046def86-ccf2-1ecd-af27-611867d0d636.dc1 area=wan 29:52.122 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29624 network=tcp 29:52.122 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29625 network=tcp 29:52.122 [INFO] TestAgent: started state syncer 29:52.123 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29630 network=tcp 29:52.166 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:52.166 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29629 [Candidate]" term=2 29:52.175 [DEBUG] TestAgent.server.raft: votes: needed=1 29:52.175 [DEBUG] TestAgent.server.raft: vote granted: from=046def86-ccf2-1ecd-af27-611867d0d636 term=2 tally=1 29:52.175 [INFO] TestAgent.server.raft: election won: tally=1 29:52.175 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29629 [Leader]" 29:52.176 [INFO] TestAgent.server: cluster leadership acquired 29:52.176 [INFO] TestAgent.server: New leader elected: payload=Node-046def86-ccf2-1ecd-af27-611867d0d636 29:52.180 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29629 29:52.225 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:52.250 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:52.250 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:52.250 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:52.250 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:52.250 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:52.250 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-046def86-ccf2-1ecd-af27-611867d0d636 29:52.250 [INFO] TestAgent.server: member joined, marking health alive: member=Node-046def86-ccf2-1ecd-af27-611867d0d636 29:52.263 [INFO] TestAgent.server: federation state anti-entropy synced 29:52.301 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:52.311 [INFO] TestAgent: Synced node info 29:52.334 [INFO] TestAgent: Requesting shutdown 29:52.334 [INFO] TestAgent.server: shutting down server 29:52.334 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:52.334 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:52.334 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:52.334 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:52.334 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:52.334 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:52.334 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:52.334 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:52.334 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:52.334 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:52.340 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:52.347Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:52.347Z [INFO] agent.router.manager: shutting down 29:52.347 [INFO] TestAgent: consul server down 29:52.347 [INFO] TestAgent: shutdown complete 29:52.347 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29624 network=tcp 29:52.347 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29624 network=udp 29:52.347 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29625 network=tcp 29:52.848 [INFO] TestAgent: Waiting for endpoints to shut down 29:52.848 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_checks_definitions_in_sidecar 2021-10-05T16:29:52.864Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:52.878Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:52.909 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:18a9025f-a6f8-654b-a063-89da6a1474f9 Address:127.0.0.1:29643}]" 29:52.910 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-18a9025f-a6f8-654b-a063-89da6a1474f9.dc1 127.0.0.1 29:52.911 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-18a9025f-a6f8-654b-a063-89da6a1474f9 127.0.0.1 2021-10-05T16:29:52.911Z [INFO] agent.router: Initializing LAN area manager 29:52.911 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29638 network=udp 29:52.911 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29643 [Follower]" leader= 29:52.911 [INFO] TestAgent.server: Adding LAN server: server="Node-18a9025f-a6f8-654b-a063-89da6a1474f9 (Addr: tcp/127.0.0.1:29643) (DC: dc1)" 29:52.911 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-18a9025f-a6f8-654b-a063-89da6a1474f9.dc1 area=wan 29:52.912 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29638 network=tcp 29:52.912 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29639 network=tcp 29:52.912 [INFO] TestAgent: started state syncer 29:52.912 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29644 network=tcp 29:52.968 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:52.968 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29643 [Candidate]" term=2 29:52.996 [DEBUG] TestAgent.server.raft: votes: needed=1 29:52.996 [DEBUG] TestAgent.server.raft: vote granted: from=18a9025f-a6f8-654b-a063-89da6a1474f9 term=2 tally=1 29:52.996 [INFO] TestAgent.server.raft: election won: tally=1 29:52.996 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29643 [Leader]" 29:52.999 [INFO] TestAgent.server: cluster leadership acquired 29:53.000 [INFO] TestAgent.server: New leader elected: payload=Node-18a9025f-a6f8-654b-a063-89da6a1474f9 29:53.001 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29643 29:53.033 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:53.072 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:53.072 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:53.072 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:53.072 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:53.072 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:53.072 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-18a9025f-a6f8-654b-a063-89da6a1474f9 29:53.072 [INFO] TestAgent.server: member joined, marking health alive: member=Node-18a9025f-a6f8-654b-a063-89da6a1474f9 29:53.090 [INFO] TestAgent.server: federation state anti-entropy synced 29:53.116 [INFO] TestAgent: Requesting shutdown 29:53.116 [INFO] TestAgent.server: shutting down server 29:53.116 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:53.116 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:53.116 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:53.116 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:53.116 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:53.116 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:53.116 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:53.116 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:53.116 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:53.116 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:53.116 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:53.124 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:53.132Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:53.132Z [INFO] agent.router.manager: shutting down 29:53.132 [INFO] TestAgent: consul server down 29:53.132 [INFO] TestAgent: shutdown complete 29:53.132 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29638 network=tcp 29:53.132 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29638 network=udp 29:53.132 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29639 network=tcp 29:53.632 [INFO] TestAgent: Waiting for endpoints to shut down 29:53.632 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_check_status_in_sidecar 2021-10-05T16:29:52.826Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:52.851Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:52.909 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:849f38e0-4428-49d0-8d30-8a8eb7734157 Address:127.0.0.1:29636}]" 29:52.909 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29636 [Follower]" leader= 29:52.910 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-849f38e0-4428-49d0-8d30-8a8eb7734157.dc1 127.0.0.1 29:52.910 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-849f38e0-4428-49d0-8d30-8a8eb7734157 127.0.0.1 2021-10-05T16:29:52.910Z [INFO] agent.router: Initializing LAN area manager 29:52.911 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29631 network=udp 29:52.911 [INFO] TestAgent.server: Adding LAN server: server="Node-849f38e0-4428-49d0-8d30-8a8eb7734157 (Addr: tcp/127.0.0.1:29636) (DC: dc1)" 29:52.911 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-849f38e0-4428-49d0-8d30-8a8eb7734157.dc1 area=wan 29:52.911 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29631 network=tcp 29:52.911 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29632 network=tcp 29:52.911 [INFO] TestAgent: started state syncer 29:52.912 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29637 network=tcp 29:52.975 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:52.975 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29636 [Candidate]" term=2 29:53.011 [DEBUG] TestAgent.server.raft: votes: needed=1 29:53.011 [DEBUG] TestAgent.server.raft: vote granted: from=849f38e0-4428-49d0-8d30-8a8eb7734157 term=2 tally=1 29:53.011 [INFO] TestAgent.server.raft: election won: tally=1 29:53.011 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29636 [Leader]" 29:53.012 [INFO] TestAgent.server: cluster leadership acquired 29:53.012 [INFO] TestAgent.server: New leader elected: payload=Node-849f38e0-4428-49d0-8d30-8a8eb7734157 29:53.031 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29636 29:53.063 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:53.064 [INFO] TestAgent: Synced node info 29:53.064 [DEBUG] TestAgent: Node info in sync 29:53.080 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:53.080 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:53.080 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:53.080 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:53.080 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:53.080 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-849f38e0-4428-49d0-8d30-8a8eb7734157 29:53.080 [INFO] TestAgent.server: member joined, marking health alive: member=Node-849f38e0-4428-49d0-8d30-8a8eb7734157 29:53.092 [INFO] TestAgent.server: federation state anti-entropy synced 29:53.164 [INFO] TestAgent: Requesting shutdown 29:53.164 [INFO] TestAgent.server: shutting down server 29:53.164 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:53.164 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:53.164 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:53.165 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:53.165 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:53.165 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:53.165 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:53.165 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:53.165 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:53.165 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:53.169 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:53.172Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:53.172Z [INFO] agent.router.manager: shutting down 29:53.172 [INFO] TestAgent: consul server down 29:53.172 [INFO] TestAgent: shutdown complete 29:53.172 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29631 network=tcp 29:53.172 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29631 network=udp 29:53.172 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29632 network=tcp 29:53.673 [INFO] TestAgent: Waiting for endpoints to shut down 29:53.673 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_check_status_in_sidecar 2021-10-05T16:29:53.647Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:53.675Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:53.741 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:63388fa6-6b62-ea08-7267-439ad7451fc9 Address:127.0.0.1:29650}]" 29:53.742 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-63388fa6-6b62-ea08-7267-439ad7451fc9.dc1 127.0.0.1 29:53.742 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-63388fa6-6b62-ea08-7267-439ad7451fc9 127.0.0.1 2021-10-05T16:29:53.742Z [INFO] agent.router: Initializing LAN area manager 29:53.742 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29645 network=udp 29:53.742 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29650 [Follower]" leader= 29:53.743 [INFO] TestAgent.server: Adding LAN server: server="Node-63388fa6-6b62-ea08-7267-439ad7451fc9 (Addr: tcp/127.0.0.1:29650) (DC: dc1)" 29:53.743 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-63388fa6-6b62-ea08-7267-439ad7451fc9.dc1 area=wan 29:53.743 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29645 network=tcp 29:53.743 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29646 network=tcp 29:53.743 [INFO] TestAgent: started state syncer 29:53.743 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29651 network=tcp 29:53.793 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:53.793 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29650 [Candidate]" term=2 29:53.803 [DEBUG] TestAgent.server.raft: votes: needed=1 29:53.803 [DEBUG] TestAgent.server.raft: vote granted: from=63388fa6-6b62-ea08-7267-439ad7451fc9 term=2 tally=1 29:53.803 [INFO] TestAgent.server.raft: election won: tally=1 29:53.803 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29650 [Leader]" 29:53.804 [INFO] TestAgent.server: cluster leadership acquired 29:53.804 [INFO] TestAgent.server: New leader elected: payload=Node-63388fa6-6b62-ea08-7267-439ad7451fc9 29:53.813 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29650 29:53.826 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:53.878 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:53.878 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:53.878 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:53.878 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:53.878 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:53.878 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-63388fa6-6b62-ea08-7267-439ad7451fc9 29:53.878 [INFO] TestAgent.server: member joined, marking health alive: member=Node-63388fa6-6b62-ea08-7267-439ad7451fc9 29:53.892 [INFO] TestAgent.server: federation state anti-entropy synced 29:53.928 [INFO] TestAgent: Requesting shutdown 29:53.928 [INFO] TestAgent.server: shutting down server 29:53.928 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:53.928 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:53.928 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:53.928 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:53.928 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:53.928 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:53.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:53.928 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:53.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:53.928 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:53.928 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:53.940 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:53.948Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:53.948Z [INFO] agent.router.manager: shutting down 29:53.948 [INFO] TestAgent: consul server down 29:53.948 [INFO] TestAgent: shutdown complete 29:53.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29645 network=tcp 29:53.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29645 network=udp 29:53.948 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29646 network=tcp 29:54.452 [INFO] TestAgent: Waiting for endpoints to shut down 29:54.452 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_checks_status_in_sidecar 2021-10-05T16:29:53.688Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:53.703Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:53.768 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0d71204f-c968-ced5-1815-18e66aa25111 Address:127.0.0.1:29657}]" 29:53.768 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29657 [Follower]" leader= 29:53.769 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0d71204f-c968-ced5-1815-18e66aa25111.dc1 127.0.0.1 29:53.769 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0d71204f-c968-ced5-1815-18e66aa25111 127.0.0.1 2021-10-05T16:29:53.769Z [INFO] agent.router: Initializing LAN area manager 29:53.769 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29652 network=udp 29:53.770 [INFO] TestAgent.server: Adding LAN server: server="Node-0d71204f-c968-ced5-1815-18e66aa25111 (Addr: tcp/127.0.0.1:29657) (DC: dc1)" 29:53.770 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0d71204f-c968-ced5-1815-18e66aa25111.dc1 area=wan 29:53.770 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29652 network=tcp 29:53.770 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29653 network=tcp 29:53.770 [INFO] TestAgent: started state syncer 29:53.770 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29658 network=tcp 29:53.836 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:53.836 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29657 [Candidate]" term=2 29:53.875 [DEBUG] TestAgent.server.raft: votes: needed=1 29:53.875 [DEBUG] TestAgent.server.raft: vote granted: from=0d71204f-c968-ced5-1815-18e66aa25111 term=2 tally=1 29:53.875 [INFO] TestAgent.server.raft: election won: tally=1 29:53.875 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29657 [Leader]" 29:53.876 [INFO] TestAgent.server: cluster leadership acquired 29:53.878 [INFO] TestAgent.server: New leader elected: payload=Node-0d71204f-c968-ced5-1815-18e66aa25111 29:53.882 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29657 29:53.908 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:53.951 [INFO] TestAgent: Synced node info 29:53.951 [DEBUG] TestAgent: Node info in sync 29:53.982 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:53.982 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:53.982 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:53.982 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:53.982 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:53.982 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0d71204f-c968-ced5-1815-18e66aa25111 29:53.982 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0d71204f-c968-ced5-1815-18e66aa25111 29:54.016 [INFO] TestAgent.server: federation state anti-entropy synced 29:54.024 [INFO] TestAgent: Requesting shutdown 29:54.024 [INFO] TestAgent.server: shutting down server 29:54.024 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:54.024 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:54.024 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:54.024 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:54.024 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:54.024 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:54.024 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:54.024 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:54.024 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:54.024 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:54.035 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:54.043Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:54.043Z [INFO] agent.router.manager: shutting down 29:54.043 [INFO] TestAgent: consul server down 29:54.043 [INFO] TestAgent: shutdown complete 29:54.043 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29652 network=tcp 29:54.043 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29652 network=udp 29:54.043 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29653 network=tcp 29:54.543 [INFO] TestAgent: Waiting for endpoints to shut down 29:54.543 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_checks_status_in_sidecar 2021-10-05T16:29:54.471Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:54.487Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:54.536 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:97bc7bd2-84c2-d8ad-79a4-749cf422d77e Address:127.0.0.1:29664}]" 29:54.537 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-97bc7bd2-84c2-d8ad-79a4-749cf422d77e.dc1 127.0.0.1 29:54.537 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-97bc7bd2-84c2-d8ad-79a4-749cf422d77e 127.0.0.1 2021-10-05T16:29:54.537Z [INFO] agent.router: Initializing LAN area manager 29:54.537 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29659 network=udp 29:54.537 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29664 [Follower]" leader= 29:54.538 [INFO] TestAgent.server: Adding LAN server: server="Node-97bc7bd2-84c2-d8ad-79a4-749cf422d77e (Addr: tcp/127.0.0.1:29664) (DC: dc1)" 29:54.538 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-97bc7bd2-84c2-d8ad-79a4-749cf422d77e.dc1 area=wan 29:54.538 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29659 network=tcp 29:54.538 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29660 network=tcp 29:54.538 [INFO] TestAgent: started state syncer 29:54.538 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29665 network=tcp 29:54.584 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:54.584 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29664 [Candidate]" term=2 29:54.632 [DEBUG] TestAgent.server.raft: votes: needed=1 29:54.632 [DEBUG] TestAgent.server.raft: vote granted: from=97bc7bd2-84c2-d8ad-79a4-749cf422d77e term=2 tally=1 29:54.632 [INFO] TestAgent.server.raft: election won: tally=1 29:54.632 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29664 [Leader]" 29:54.632 [INFO] TestAgent.server: cluster leadership acquired 29:54.632 [INFO] TestAgent.server: New leader elected: payload=Node-97bc7bd2-84c2-d8ad-79a4-749cf422d77e 29:54.641 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29664 29:54.661 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:54.688 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:54.688 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:54.688 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:54.688 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:54.688 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:54.688 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-97bc7bd2-84c2-d8ad-79a4-749cf422d77e 29:54.688 [INFO] TestAgent.server: member joined, marking health alive: member=Node-97bc7bd2-84c2-d8ad-79a4-749cf422d77e 29:54.708 [INFO] TestAgent.server: federation state anti-entropy synced 29:54.820 [INFO] TestAgent: Requesting shutdown 29:54.820 [INFO] TestAgent.server: shutting down server 29:54.820 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:54.820 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:54.820 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:54.820 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:54.820 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:54.820 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:54.820 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:54.820 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:54.820 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:54.820 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:54.820 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:54.828 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:54.836Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:54.836Z [INFO] agent.router.manager: shutting down 29:54.836 [INFO] TestAgent: consul server down 29:54.836 [INFO] TestAgent: shutdown complete 29:54.836 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29659 network=tcp 29:54.836 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29659 network=udp 29:54.836 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29660 network=tcp 29:55.340 [INFO] TestAgent: Waiting for endpoints to shut down 29:55.340 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/another_service_registered_with_same_ID_as_a_sidecar_should_not_be_deregistered 2021-10-05T16:29:54.561Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:54.603Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:54.647 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6503926b-2e6a-0712-faf5-7586c43767b1 Address:127.0.0.1:29671}]" 29:54.648 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6503926b-2e6a-0712-faf5-7586c43767b1.dc1 127.0.0.1 29:54.648 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29671 [Follower]" leader= 29:54.648 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6503926b-2e6a-0712-faf5-7586c43767b1 127.0.0.1 2021-10-05T16:29:54.648Z [INFO] agent.router: Initializing LAN area manager 29:54.648 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29666 network=udp 29:54.648 [INFO] TestAgent.server: Adding LAN server: server="Node-6503926b-2e6a-0712-faf5-7586c43767b1 (Addr: tcp/127.0.0.1:29671) (DC: dc1)" 29:54.649 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6503926b-2e6a-0712-faf5-7586c43767b1.dc1 area=wan 29:54.649 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29666 network=tcp 29:54.649 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29667 network=tcp 29:54.649 [INFO] TestAgent: started state syncer 29:54.649 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29672 network=tcp 29:54.689 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:54.689 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29671 [Candidate]" term=2 29:54.707 [DEBUG] TestAgent.server.raft: votes: needed=1 29:54.707 [DEBUG] TestAgent.server.raft: vote granted: from=6503926b-2e6a-0712-faf5-7586c43767b1 term=2 tally=1 29:54.707 [INFO] TestAgent.server.raft: election won: tally=1 29:54.707 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29671 [Leader]" 29:54.708 [INFO] TestAgent.server: cluster leadership acquired 29:54.708 [INFO] TestAgent.server: New leader elected: payload=Node-6503926b-2e6a-0712-faf5-7586c43767b1 29:54.714 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29671 29:54.736 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:54.766 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:54.766 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:54.766 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:54.766 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:54.766 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:54.766 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6503926b-2e6a-0712-faf5-7586c43767b1 29:54.766 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6503926b-2e6a-0712-faf5-7586c43767b1 29:54.792 [INFO] TestAgent.server: federation state anti-entropy synced 29:54.836 [INFO] TestAgent: Requesting shutdown 29:54.836 [INFO] TestAgent.server: shutting down server 29:54.836 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:54.836 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:54.836 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:54.836 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:54.836 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:54.836 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:54.836 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:54.836 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:54.836 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:54.836 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:54.848 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:54.864Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:54.864Z [INFO] agent.router.manager: shutting down 29:54.864 [INFO] TestAgent: consul server down 29:54.864 [INFO] TestAgent: shutdown complete 29:54.864 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29666 network=tcp 29:54.864 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29666 network=udp 29:54.864 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29667 network=tcp 29:55.365 [INFO] TestAgent: Waiting for endpoints to shut down 29:55.365 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/another_service_registered_with_same_ID_as_a_sidecar_should_not_be_deregistered 2021-10-05T16:29:55.387Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:55.402Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:55.434 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:31ef9fd2-6480-7011-b105-272849477105 Address:127.0.0.1:29678}]" 29:55.434 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29678 [Follower]" leader= 29:55.435 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-31ef9fd2-6480-7011-b105-272849477105.dc1 127.0.0.1 29:55.436 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-31ef9fd2-6480-7011-b105-272849477105 127.0.0.1 2021-10-05T16:29:55.436Z [INFO] agent.router: Initializing LAN area manager 29:55.436 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-31ef9fd2-6480-7011-b105-272849477105.dc1 area=wan 29:55.436 [INFO] TestAgent.server: Adding LAN server: server="Node-31ef9fd2-6480-7011-b105-272849477105 (Addr: tcp/127.0.0.1:29678) (DC: dc1)" 29:55.436 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29673 network=udp 29:55.436 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29673 network=tcp 29:55.437 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29674 network=tcp 29:55.437 [INFO] TestAgent: started state syncer 29:55.437 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29679 network=tcp 29:55.506 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:55.506 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29678 [Candidate]" term=2 29:55.516 [DEBUG] TestAgent.server.raft: votes: needed=1 29:55.516 [DEBUG] TestAgent.server.raft: vote granted: from=31ef9fd2-6480-7011-b105-272849477105 term=2 tally=1 29:55.516 [INFO] TestAgent.server.raft: election won: tally=1 29:55.516 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29678 [Leader]" 29:55.517 [INFO] TestAgent.server: cluster leadership acquired 29:55.517 [INFO] TestAgent.server: New leader elected: payload=Node-31ef9fd2-6480-7011-b105-272849477105 29:55.528 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29678 29:55.554 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:55.598 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:55.598 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:55.598 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:55.598 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:55.599 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:55.599 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-31ef9fd2-6480-7011-b105-272849477105 29:55.599 [INFO] TestAgent.server: member joined, marking health alive: member=Node-31ef9fd2-6480-7011-b105-272849477105 29:55.612 [INFO] TestAgent.server: federation state anti-entropy synced 29:55.660 [INFO] TestAgent: Synced node info 29:55.665 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:55.670 [INFO] TestAgent: Synced service: service=web 29:55.671 [DEBUG] TestAgent: removed service: service=web 29:55.671 [DEBUG] TestAgent: Node info in sync 29:55.671 [DEBUG] TestAgent: Service in sync: service=web-sidecar-proxy 29:55.683 [INFO] TestAgent: Deregistered service: service=web 29:55.683 [INFO] TestAgent: Requesting shutdown 29:55.683 [INFO] TestAgent.server: shutting down server 29:55.683 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:55.683 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:55.683 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:55.683 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:55.683 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:55.683 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:55.683 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:55.683 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:55.683 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:55.683 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:55.683 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:55.687 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:55.691Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:55.691Z [INFO] agent.router.manager: shutting down 29:55.691 [INFO] TestAgent: consul server down 29:55.691 [INFO] TestAgent: shutdown complete 29:55.691 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29673 network=tcp 29:55.691 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29673 network=udp 29:55.691 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29674 network=tcp 29:56.191 [INFO] TestAgent: Waiting for endpoints to shut down 29:56.191 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/updates_to_sidecar_should_work 2021-10-05T16:29:55.389Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:55.416Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:55.457 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3d0a3758-4385-6722-5e77-28db26b5014a Address:127.0.0.1:29685}]" 29:55.457 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29685 [Follower]" leader= 29:55.458 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3d0a3758-4385-6722-5e77-28db26b5014a.dc1 127.0.0.1 29:55.458 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3d0a3758-4385-6722-5e77-28db26b5014a 127.0.0.1 2021-10-05T16:29:55.459Z [INFO] agent.router: Initializing LAN area manager 29:55.459 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3d0a3758-4385-6722-5e77-28db26b5014a.dc1 area=wan 29:55.459 [INFO] TestAgent.server: Adding LAN server: server="Node-3d0a3758-4385-6722-5e77-28db26b5014a (Addr: tcp/127.0.0.1:29685) (DC: dc1)" 29:55.459 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29680 network=udp 29:55.459 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29680 network=tcp 29:55.459 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29681 network=tcp 29:55.459 [INFO] TestAgent: started state syncer 29:55.460 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29686 network=tcp 29:55.517 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:55.517 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29685 [Candidate]" term=2 29:55.540 [DEBUG] TestAgent.server.raft: votes: needed=1 29:55.540 [DEBUG] TestAgent.server.raft: vote granted: from=3d0a3758-4385-6722-5e77-28db26b5014a term=2 tally=1 29:55.540 [INFO] TestAgent.server.raft: election won: tally=1 29:55.540 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29685 [Leader]" 29:55.543 [INFO] TestAgent.server: cluster leadership acquired 29:55.543 [INFO] TestAgent.server: New leader elected: payload=Node-3d0a3758-4385-6722-5e77-28db26b5014a 29:55.551 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29685 29:55.583 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:55.610 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:55.610 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:55.610 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:55.610 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:55.610 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:55.610 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3d0a3758-4385-6722-5e77-28db26b5014a 29:55.610 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3d0a3758-4385-6722-5e77-28db26b5014a 29:55.622 [INFO] TestAgent.server: federation state anti-entropy synced 29:55.663 [INFO] TestAgent: Synced node info 29:55.669 [INFO] TestAgent: Synced service: service=web 29:55.683 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:55.683 [DEBUG] TestAgent: removed service: service=web 29:55.683 [DEBUG] TestAgent: Node info in sync 29:55.690 [INFO] TestAgent: Deregistered service: service=web 29:55.690 [DEBUG] TestAgent: Service in sync: service=web-sidecar-proxy 29:55.690 [INFO] TestAgent: Requesting shutdown 29:55.690 [INFO] TestAgent.server: shutting down server 29:55.690 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:55.690 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:55.690 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:55.690 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:55.690 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:55.690 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:55.690 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:55.690 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:55.690 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:55.690 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:55.690 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:55.695 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:55.698Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:55.698Z [INFO] agent.router.manager: shutting down 29:55.698 [INFO] TestAgent: consul server down 29:55.698 [INFO] TestAgent: shutdown complete 29:55.698 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29680 network=tcp 29:55.698 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29680 network=udp 29:55.698 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29681 network=tcp 29:56.200 [INFO] TestAgent: Waiting for endpoints to shut down 29:56.200 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/updates_to_sidecar_should_work 2021-10-05T16:29:56.269Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:56.298Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:56.451 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e4789e23-ed59-5c56-30af-502c9e96678c Address:127.0.0.1:29692}]" 29:56.452 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e4789e23-ed59-5c56-30af-502c9e96678c.dc1 127.0.0.1 29:56.452 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29692 [Follower]" leader= 29:56.452 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e4789e23-ed59-5c56-30af-502c9e96678c 127.0.0.1 2021-10-05T16:29:56.452Z [INFO] agent.router: Initializing LAN area manager 29:56.452 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29687 network=udp 29:56.452 [INFO] TestAgent.server: Adding LAN server: server="Node-e4789e23-ed59-5c56-30af-502c9e96678c (Addr: tcp/127.0.0.1:29692) (DC: dc1)" 29:56.453 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e4789e23-ed59-5c56-30af-502c9e96678c.dc1 area=wan 29:56.453 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29687 network=tcp 29:56.453 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29688 network=tcp 29:56.453 [INFO] TestAgent: started state syncer 29:56.453 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29693 network=tcp 29:56.521 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:56.521 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29692 [Candidate]" term=2 29:56.572 [DEBUG] TestAgent.server.raft: votes: needed=1 29:56.572 [DEBUG] TestAgent.server.raft: vote granted: from=e4789e23-ed59-5c56-30af-502c9e96678c term=2 tally=1 29:56.572 [INFO] TestAgent.server.raft: election won: tally=1 29:56.572 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29692 [Leader]" 29:56.576 [INFO] TestAgent.server: New leader elected: payload=Node-e4789e23-ed59-5c56-30af-502c9e96678c 29:56.576 [INFO] TestAgent.server: cluster leadership acquired 29:56.604 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29692 29:56.627 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:56.654 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:56.654 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:56.654 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:56.654 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:56.654 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:56.654 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e4789e23-ed59-5c56-30af-502c9e96678c 29:56.654 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e4789e23-ed59-5c56-30af-502c9e96678c 29:56.668 [INFO] TestAgent.server: federation state anti-entropy synced 29:56.824 [INFO] TestAgent: Synced node info 29:56.830 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:56.830 [WARN] TestAgent: Check socket connection failed: check=service:web-sidecar-proxy:1 error="dial tcp 127.0.0.1:6666: connect: connection refused" 29:56.830 [WARN] TestAgent: Check is now critical: check=service:web-sidecar-proxy:1 29:56.834 [INFO] TestAgent: Synced service: service=web 29:56.834 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:56.834 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:56.835 [DEBUG] TestAgent: removed service: service=web 29:56.835 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:56.835 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:56.835 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:56.835 [DEBUG] TestAgent: Node info in sync 29:56.841 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:56.846 [INFO] TestAgent: Deregistered service: service=web 29:56.847 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:56.847 [INFO] TestAgent: Requesting shutdown 29:56.847 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:56.847 [INFO] TestAgent.server: shutting down server 29:56.847 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:56.847 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:56.847 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:56.847 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:56.847 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:56.847 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:56.847 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:56.847 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:56.847 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:56.847 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:56.847 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:56.853 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:56.853Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:56.853Z [INFO] agent.router.manager: shutting down 29:56.853 [INFO] TestAgent: consul server down 29:56.853 [INFO] TestAgent: shutdown complete 29:56.853 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29687 network=tcp 29:56.853 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29687 network=udp 29:56.853 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29688 network=tcp 29:57.356 [INFO] TestAgent: Waiting for endpoints to shut down 29:57.356 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/normal/update_that_removes_sidecar_should_NOT_deregister_it 2021-10-05T16:29:56.254Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:56.301Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:56.464 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:df097413-f517-1751-9452-88450ae3bd64 Address:127.0.0.1:29699}]" 29:56.465 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-df097413-f517-1751-9452-88450ae3bd64.dc1 127.0.0.1 29:56.465 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-df097413-f517-1751-9452-88450ae3bd64 127.0.0.1 2021-10-05T16:29:56.465Z [INFO] agent.router: Initializing LAN area manager 29:56.465 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29694 network=udp 29:56.465 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29699 [Follower]" leader= 29:56.466 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29694 network=tcp 29:56.466 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-df097413-f517-1751-9452-88450ae3bd64.dc1 area=wan 29:56.466 [INFO] TestAgent.server: Adding LAN server: server="Node-df097413-f517-1751-9452-88450ae3bd64 (Addr: tcp/127.0.0.1:29699) (DC: dc1)" 29:56.466 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29695 network=tcp 29:56.466 [INFO] TestAgent: started state syncer 29:56.466 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29700 network=tcp 29:56.508 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:56.508 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29699 [Candidate]" term=2 29:56.549 [DEBUG] TestAgent.server.raft: votes: needed=1 29:56.549 [DEBUG] TestAgent.server.raft: vote granted: from=df097413-f517-1751-9452-88450ae3bd64 term=2 tally=1 29:56.549 [INFO] TestAgent.server.raft: election won: tally=1 29:56.549 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29699 [Leader]" 29:56.549 [INFO] TestAgent.server: cluster leadership acquired 29:56.550 [INFO] TestAgent.server: New leader elected: payload=Node-df097413-f517-1751-9452-88450ae3bd64 29:56.584 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29699 29:56.628 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:56.692 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:56.692 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:56.692 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:56.692 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:56.692 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:56.692 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-df097413-f517-1751-9452-88450ae3bd64 29:56.692 [INFO] TestAgent.server: member joined, marking health alive: member=Node-df097413-f517-1751-9452-88450ae3bd64 29:56.724 [INFO] TestAgent: Synced node info 29:56.724 [DEBUG] TestAgent: Node info in sync 29:56.724 [INFO] TestAgent.server: federation state anti-entropy synced 29:56.839 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 29:56.839 [DEBUG] TestAgent: Node info in sync 29:56.867 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:56.871 [INFO] TestAgent: Synced service: service=web 29:56.871 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:1 29:56.871 [DEBUG] TestAgent: Check in sync: check=service:web-sidecar-proxy:2 29:56.892 [DEBUG] TestAgent: removed service: service=web 29:56.893 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:1 29:56.893 [DEBUG] TestAgent: removed check: check=service:web-sidecar-proxy:2 29:56.893 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:56.893 [DEBUG] TestAgent: Node info in sync 29:56.893 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:56.898 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:56.902 [INFO] TestAgent: Deregistered service: service=web 29:56.902 [INFO] TestAgent: Requesting shutdown 29:56.902 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:56.902 [INFO] TestAgent.server: shutting down server 29:56.902 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:56.902 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:56.902 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:56.902 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:56.902 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:56.902 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:56.902 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:56.902 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:56.902 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:56.902 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:56.906 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:56.906Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:56.906Z [INFO] agent.router.manager: shutting down 29:56.906 [INFO] TestAgent: consul server down 29:56.906 [INFO] TestAgent: shutdown complete 29:56.906 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29694 network=tcp 29:56.906 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29694 network=udp 29:56.906 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29695 network=tcp 29:57.406 [INFO] TestAgent: Waiting for endpoints to shut down 29:57.406 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/update_that_removes_sidecar_should_NOT_deregister_it 2021-10-05T16:29:57.383Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:57.420Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:57.558 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ef539797-a939-7ffe-2120-68bd9faaeb6e Address:127.0.0.1:29706}]" 29:57.558 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ef539797-a939-7ffe-2120-68bd9faaeb6e.dc1 127.0.0.1 29:57.559 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29706 [Follower]" leader= 29:57.559 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ef539797-a939-7ffe-2120-68bd9faaeb6e 127.0.0.1 2021-10-05T16:29:57.559Z [INFO] agent.router: Initializing LAN area manager 29:57.559 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29701 network=udp 29:57.559 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ef539797-a939-7ffe-2120-68bd9faaeb6e.dc1 area=wan 29:57.560 [INFO] TestAgent.server: Adding LAN server: server="Node-ef539797-a939-7ffe-2120-68bd9faaeb6e (Addr: tcp/127.0.0.1:29706) (DC: dc1)" 29:57.560 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29701 network=tcp 29:57.560 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29702 network=tcp 29:57.560 [INFO] TestAgent: started state syncer 29:57.560 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29707 network=tcp 29:57.596 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:57.596 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29706 [Candidate]" term=2 29:57.646 [DEBUG] TestAgent.server.raft: votes: needed=1 29:57.646 [DEBUG] TestAgent.server.raft: vote granted: from=ef539797-a939-7ffe-2120-68bd9faaeb6e term=2 tally=1 29:57.646 [INFO] TestAgent.server.raft: election won: tally=1 29:57.646 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29706 [Leader]" 29:57.648 [INFO] TestAgent.server: cluster leadership acquired 29:57.648 [INFO] TestAgent.server: New leader elected: payload=Node-ef539797-a939-7ffe-2120-68bd9faaeb6e 29:57.676 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29706 29:57.704 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:57.752 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:57.752 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:57.752 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:57.752 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:57.752 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:57.752 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ef539797-a939-7ffe-2120-68bd9faaeb6e 29:57.752 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ef539797-a939-7ffe-2120-68bd9faaeb6e 29:57.788 [INFO] TestAgent.server: federation state anti-entropy synced 29:57.824 [INFO] TestAgent: Synced node info 29:57.848 [INFO] TestAgent: Synced service: service=web 29:57.880 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:57.880 [DEBUG] TestAgent: removed service: service=web 29:57.880 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:57.880 [DEBUG] TestAgent: Node info in sync 29:57.900 [INFO] TestAgent: Deregistered service: service=web 29:57.916 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:57.916 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:57.916 [DEBUG] TestAgent: Node info in sync 29:57.916 [INFO] TestAgent: Requesting shutdown 29:57.916 [INFO] TestAgent.server: shutting down server 29:57.916 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:57.916 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:57.916 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:57.916 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:57.916 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:57.916 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:57.916 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:57.917 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:57.917 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:57.917 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:57.920 [DEBUG] TestAgent: Node info in sync 29:57.927 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:57.927Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:57.928Z [INFO] agent.router.manager: shutting down 29:57.928 [INFO] TestAgent: consul server down 29:57.928 [INFO] TestAgent: shutdown complete 29:57.928 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29701 network=tcp 29:57.928 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29701 network=udp 29:57.928 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29702 network=tcp 29:58.432 [INFO] TestAgent: Waiting for endpoints to shut down 29:58.432 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:57.452Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:57.494Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:57.570 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:737283c2-c031-6faf-91aa-ce8412bf1fc0 Address:127.0.0.1:29713}]" 29:57.570 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29713 [Follower]" leader= 29:57.571 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-737283c2-c031-6faf-91aa-ce8412bf1fc0.dc1 127.0.0.1 29:57.571 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-737283c2-c031-6faf-91aa-ce8412bf1fc0 127.0.0.1 2021-10-05T16:29:57.571Z [INFO] agent.router: Initializing LAN area manager 29:57.572 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29708 network=udp 29:57.572 [INFO] TestAgent.server: Adding LAN server: server="Node-737283c2-c031-6faf-91aa-ce8412bf1fc0 (Addr: tcp/127.0.0.1:29713) (DC: dc1)" 29:57.572 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-737283c2-c031-6faf-91aa-ce8412bf1fc0.dc1 area=wan 29:57.572 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29708 network=tcp 29:57.572 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29709 network=tcp 29:57.572 [INFO] TestAgent: started state syncer 29:57.573 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29714 network=tcp 29:57.607 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:57.607 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29713 [Candidate]" term=2 29:57.619 [DEBUG] TestAgent.server.raft: votes: needed=1 29:57.619 [DEBUG] TestAgent.server.raft: vote granted: from=737283c2-c031-6faf-91aa-ce8412bf1fc0 term=2 tally=1 29:57.619 [INFO] TestAgent.server.raft: election won: tally=1 29:57.619 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29713 [Leader]" 29:57.620 [INFO] TestAgent.server: cluster leadership acquired 29:57.620 [INFO] TestAgent.server: New leader elected: payload=Node-737283c2-c031-6faf-91aa-ce8412bf1fc0 29:57.635 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29713 29:57.651 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:57.664 [INFO] TestAgent: Synced node info 29:57.692 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:57.692 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:57.692 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:57.692 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:57.692 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:57.692 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-737283c2-c031-6faf-91aa-ce8412bf1fc0 29:57.692 [INFO] TestAgent.server: member joined, marking health alive: member=Node-737283c2-c031-6faf-91aa-ce8412bf1fc0 29:57.711 [INFO] TestAgent.server: federation state anti-entropy synced 29:57.984 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 29:57.992 [DEBUG] TestAgent: Node info in sync 29:57.999 [INFO] TestAgent: Synced service: service=web 29:58.008 [INFO] TestAgent: Synced service: service=web-sidecar-proxy 29:58.016 [DEBUG] TestAgent: removed service: service=web 29:58.016 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 29:58.016 [DEBUG] TestAgent: Node info in sync 29:58.020 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:58.034 [INFO] TestAgent: Deregistered service: service=web 29:58.040 [INFO] TestAgent: Deregistered service: service=web-sidecar-proxy 29:58.040 [INFO] TestAgent: Requesting shutdown 29:58.040 [INFO] TestAgent.server: shutting down server 29:58.040 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:58.040 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:58.040 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 29:58.040 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:58.040 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:58.040 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:58.040 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:58.040 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:58.040 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:58.040 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:58.040 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:58.058 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:58.061Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:58.061Z [INFO] agent.router.manager: shutting down 29:58.061 [INFO] TestAgent: consul server down 29:58.061 [INFO] TestAgent: shutdown complete 29:58.061 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29708 network=tcp 29:58.062 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29708 network=udp 29:58.062 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29709 network=tcp 29:58.562 [INFO] TestAgent: Waiting for endpoints to shut down 29:58.562 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar (0.00s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal (14.60s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/sanity_check_no_sidecar_case (1.38s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/default_sidecar (1.29s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_defaults (0.90s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_denied (0.79s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_but_not_for_sidecar (1.09s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_and_sidecar_but_not_sidecar's_overridden_destination (0.83s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_but_not_for_overridden_sidecar (0.89s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/ACL_OK_for_service_but_and_overridden_for_sidecar (0.99s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_check_definition_in_sidecar (0.84s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_checks_definitions_in_sidecar (0.78s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_check_status_in_sidecar (0.82s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/invalid_checks_status_in_sidecar (0.89s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/another_service_registered_with_same_ID_as_a_sidecar_should_not_be_deregistered (0.84s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/updates_to_sidecar_should_work (1.16s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/normal/update_that_removes_sidecar_should_NOT_deregister_it (1.08s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager (14.72s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/sanity_check_no_sidecar_case (1.32s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/default_sidecar (1.14s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_defaults (1.06s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_denied (0.83s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_but_not_for_sidecar (1.03s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_and_sidecar_but_not_sidecar's_overridden_destination (0.77s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_but_not_for_overridden_sidecar (0.85s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/ACL_OK_for_service_but_and_overridden_for_sidecar (0.99s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_check_definition_in_sidecar (0.98s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_checks_definitions_in_sidecar (0.87s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_check_status_in_sidecar (0.87s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/invalid_checks_status_in_sidecar (0.82s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/another_service_registered_with_same_ID_as_a_sidecar_should_not_be_deregistered (0.83s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/updates_to_sidecar_should_work (1.21s) --- PASS: TestAgent_RegisterServiceDeregisterService_Sidecar/service_manager/update_that_removes_sidecar_should_NOT_deregister_it (1.16s) === RUN TestAgent_RegisterService_UnmanagedConnectProxyInvalid === RUN TestAgent_RegisterService_UnmanagedConnectProxyInvalid/normal === PAUSE TestAgent_RegisterService_UnmanagedConnectProxyInvalid/normal === RUN TestAgent_RegisterService_UnmanagedConnectProxyInvalid/service_manager === PAUSE TestAgent_RegisterService_UnmanagedConnectProxyInvalid/service_manager === CONT TestAgent_RegisterService_UnmanagedConnectProxyInvalid/normal === CONT TestAgent_RegisterService_UnmanagedConnectProxyInvalid/service_manager 2021-10-05T16:29:58.581Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:58.625Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:58.701 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c92344dd-03f1-68bf-de3c-42bf47971e3f Address:127.0.0.1:29720}]" 29:58.701 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29720 [Follower]" leader= 29:58.702 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c92344dd-03f1-68bf-de3c-42bf47971e3f.dc1 127.0.0.1 29:58.702 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c92344dd-03f1-68bf-de3c-42bf47971e3f 127.0.0.1 2021-10-05T16:29:58.703Z [INFO] agent.router: Initializing LAN area manager 29:58.703 [INFO] TestAgent.server: Adding LAN server: server="Node-c92344dd-03f1-68bf-de3c-42bf47971e3f (Addr: tcp/127.0.0.1:29720) (DC: dc1)" 29:58.703 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c92344dd-03f1-68bf-de3c-42bf47971e3f.dc1 area=wan 29:58.703 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29715 network=udp 29:58.703 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29715 network=tcp 29:58.703 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29716 network=tcp 29:58.704 [INFO] TestAgent: started state syncer 29:58.704 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29721 network=tcp 29:58.772 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:58.772 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29720 [Candidate]" term=2 29:58.820 [DEBUG] TestAgent.server.raft: votes: needed=1 29:58.820 [DEBUG] TestAgent.server.raft: vote granted: from=c92344dd-03f1-68bf-de3c-42bf47971e3f term=2 tally=1 29:58.820 [INFO] TestAgent.server.raft: election won: tally=1 29:58.820 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29720 [Leader]" 29:58.824 [INFO] TestAgent.server: cluster leadership acquired 29:58.824 [INFO] TestAgent.server: New leader elected: payload=Node-c92344dd-03f1-68bf-de3c-42bf47971e3f 29:58.852 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29720 29:58.908 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:58.980 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:58.980 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:58.980 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:58.980 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:58.980 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:58.980 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c92344dd-03f1-68bf-de3c-42bf47971e3f 29:58.980 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c92344dd-03f1-68bf-de3c-42bf47971e3f 29:59.016 [INFO] TestAgent.server: federation state anti-entropy synced 29:59.024 [INFO] TestAgent: Requesting shutdown 29:59.024 [INFO] TestAgent.server: shutting down server 29:59.024 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:59.024 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:59.024 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:59.024 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:59.024 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:59.024 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:59.024 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:59.024 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:59.025 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:59.025 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:59.025 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:59.036 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:59.044Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:59.044Z [INFO] agent.router.manager: shutting down 29:59.044 [INFO] TestAgent: consul server down 29:59.044 [INFO] TestAgent: shutdown complete 29:59.044 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29715 network=tcp 29:59.044 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29715 network=udp 29:59.044 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29716 network=tcp 29:59.548 [INFO] TestAgent: Waiting for endpoints to shut down 29:59.548 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:58.618Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:58.646Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:58.677 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f1d2f437-7791-7335-dfcb-47b48ea86815 Address:127.0.0.1:29727}]" 29:58.678 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29727 [Follower]" leader= 29:58.678 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f1d2f437-7791-7335-dfcb-47b48ea86815.dc1 127.0.0.1 29:58.678 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f1d2f437-7791-7335-dfcb-47b48ea86815 127.0.0.1 2021-10-05T16:29:58.679Z [INFO] agent.router: Initializing LAN area manager 29:58.679 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29722 network=udp 29:58.679 [INFO] TestAgent.server: Adding LAN server: server="Node-f1d2f437-7791-7335-dfcb-47b48ea86815 (Addr: tcp/127.0.0.1:29727) (DC: dc1)" 29:58.679 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29722 network=tcp 29:58.679 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f1d2f437-7791-7335-dfcb-47b48ea86815.dc1 area=wan 29:58.680 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29723 network=tcp 29:58.680 [INFO] TestAgent: started state syncer 29:58.680 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29728 network=tcp 29:58.720 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:58.720 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29727 [Candidate]" term=2 29:58.735 [DEBUG] TestAgent.server.raft: votes: needed=1 29:58.735 [DEBUG] TestAgent.server.raft: vote granted: from=f1d2f437-7791-7335-dfcb-47b48ea86815 term=2 tally=1 29:58.735 [INFO] TestAgent.server.raft: election won: tally=1 29:58.735 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29727 [Leader]" 29:58.735 [INFO] TestAgent.server: cluster leadership acquired 29:58.736 [INFO] TestAgent.server: New leader elected: payload=Node-f1d2f437-7791-7335-dfcb-47b48ea86815 29:58.741 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29727 29:58.761 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:58.790 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:58.790 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:58.790 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:58.790 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:58.790 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:58.790 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f1d2f437-7791-7335-dfcb-47b48ea86815 29:58.790 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f1d2f437-7791-7335-dfcb-47b48ea86815 29:58.804 [INFO] TestAgent.server: federation state anti-entropy synced 29:58.980 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:58.992 [INFO] TestAgent: Synced node info 29:59.040 [INFO] TestAgent: Requesting shutdown 29:59.040 [INFO] TestAgent.server: shutting down server 29:59.040 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:59.040 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:59.040 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:59.040 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:59.040 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:59.040 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:59.040 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:59.041 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:59.041 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:59.041 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:59.056 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:59.064Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:59.064Z [INFO] agent.router.manager: shutting down 29:59.064 [INFO] TestAgent: consul server down 29:59.064 [INFO] TestAgent: shutdown complete 29:59.064 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29722 network=tcp 29:59.064 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29722 network=udp 29:59.064 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29723 network=tcp 29:59.568 [INFO] TestAgent: Waiting for endpoints to shut down 29:59.568 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_UnmanagedConnectProxyInvalid (0.00s) --- PASS: TestAgent_RegisterService_UnmanagedConnectProxyInvalid/service_manager (0.98s) --- PASS: TestAgent_RegisterService_UnmanagedConnectProxyInvalid/normal (1.01s) === RUN TestAgent_RegisterService_ConnectNative === RUN TestAgent_RegisterService_ConnectNative/normal === PAUSE TestAgent_RegisterService_ConnectNative/normal === RUN TestAgent_RegisterService_ConnectNative/service_manager === PAUSE TestAgent_RegisterService_ConnectNative/service_manager === CONT TestAgent_RegisterService_ConnectNative/normal === CONT TestAgent_RegisterService_ConnectNative/service_manager 2021-10-05T16:29:59.598Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:59.632Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:59.719 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:539c0931-b977-6fa9-6a6c-fd3242b1fd0d Address:127.0.0.1:29741}]" 29:59.720 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-539c0931-b977-6fa9-6a6c-fd3242b1fd0d.dc1 127.0.0.1 29:59.720 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29741 [Follower]" leader= 29:59.721 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-539c0931-b977-6fa9-6a6c-fd3242b1fd0d 127.0.0.1 2021-10-05T16:29:59.721Z [INFO] agent.router: Initializing LAN area manager 29:59.721 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29736 network=udp 29:59.721 [INFO] TestAgent.server: Adding LAN server: server="Node-539c0931-b977-6fa9-6a6c-fd3242b1fd0d (Addr: tcp/127.0.0.1:29741) (DC: dc1)" 29:59.722 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-539c0931-b977-6fa9-6a6c-fd3242b1fd0d.dc1 area=wan 29:59.722 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29736 network=tcp 29:59.723 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29737 network=tcp 29:59.723 [INFO] TestAgent: started state syncer 29:59.723 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29742 network=tcp 29:59.789 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:59.789 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29741 [Candidate]" term=2 29:59.812 [DEBUG] TestAgent.server.raft: votes: needed=1 29:59.812 [DEBUG] TestAgent.server.raft: vote granted: from=539c0931-b977-6fa9-6a6c-fd3242b1fd0d term=2 tally=1 29:59.812 [INFO] TestAgent.server.raft: election won: tally=1 29:59.812 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29741 [Leader]" 29:59.815 [INFO] TestAgent.server: cluster leadership acquired 29:59.816 [INFO] TestAgent.server: New leader elected: payload=Node-539c0931-b977-6fa9-6a6c-fd3242b1fd0d 29:59.819 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29741 29:59.858 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:59.892 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:59.892 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:59.892 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:59.892 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:59.892 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:59.892 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-539c0931-b977-6fa9-6a6c-fd3242b1fd0d 29:59.892 [INFO] TestAgent.server: member joined, marking health alive: member=Node-539c0931-b977-6fa9-6a6c-fd3242b1fd0d 29:59.912 [INFO] TestAgent.server: federation state anti-entropy synced 29:59.968 [INFO] TestAgent: Synced node info 29:59.980 [INFO] TestAgent: Synced service: service=web 29:59.980 [DEBUG] TestAgent: Check in sync: check=service:web 29:59.980 [INFO] TestAgent: Requesting shutdown 29:59.980 [INFO] TestAgent.server: shutting down server 29:59.980 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:59.980 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:59.980 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:59.980 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:59.980 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:59.980 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:59.980 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:59.981 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:59.981 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:59.981 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:59.981 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:59.991 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:59.991Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:59.991Z [INFO] agent.router.manager: shutting down 29:59.991 [INFO] TestAgent: consul server down 29:59.991 [INFO] TestAgent: shutdown complete 29:59.991 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29736 network=tcp 29:59.991 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29736 network=udp 29:59.992 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29737 network=tcp 30:00.492 [INFO] TestAgent: Waiting for endpoints to shut down 30:00.492 [INFO] TestAgent: Endpoints down 2021-10-05T16:29:59.606Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:59.661Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:59.691 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d27524a1-0e5c-32e9-09b4-4c5a7ab6b726 Address:127.0.0.1:29734}]" 29:59.691 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d27524a1-0e5c-32e9-09b4-4c5a7ab6b726.dc1 127.0.0.1 29:59.692 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29734 [Follower]" leader= 29:59.692 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d27524a1-0e5c-32e9-09b4-4c5a7ab6b726 127.0.0.1 2021-10-05T16:29:59.692Z [INFO] agent.router: Initializing LAN area manager 29:59.692 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29729 network=udp 29:59.692 [INFO] TestAgent.server: Adding LAN server: server="Node-d27524a1-0e5c-32e9-09b4-4c5a7ab6b726 (Addr: tcp/127.0.0.1:29734) (DC: dc1)" 29:59.692 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d27524a1-0e5c-32e9-09b4-4c5a7ab6b726.dc1 area=wan 29:59.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29729 network=tcp 29:59.693 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29730 network=tcp 29:59.693 [INFO] TestAgent: started state syncer 29:59.693 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29735 network=tcp 29:59.733 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:59.734 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29734 [Candidate]" term=2 29:59.744 [DEBUG] TestAgent.server.raft: votes: needed=1 29:59.744 [DEBUG] TestAgent.server.raft: vote granted: from=d27524a1-0e5c-32e9-09b4-4c5a7ab6b726 term=2 tally=1 29:59.744 [INFO] TestAgent.server.raft: election won: tally=1 29:59.744 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29734 [Leader]" 29:59.744 [INFO] TestAgent.server: cluster leadership acquired 29:59.744 [INFO] TestAgent.server: New leader elected: payload=Node-d27524a1-0e5c-32e9-09b4-4c5a7ab6b726 29:59.751 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29734 29:59.816 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:59.885 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:59.885 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:59.885 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:59.885 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:59.885 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:59.885 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d27524a1-0e5c-32e9-09b4-4c5a7ab6b726 29:59.885 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d27524a1-0e5c-32e9-09b4-4c5a7ab6b726 29:59.911 [INFO] TestAgent.server: federation state anti-entropy synced 30:00.092 [INFO] TestAgent: Synced node info 30:00.105 [INFO] TestAgent: Synced service: service=web 30:00.105 [DEBUG] TestAgent: Check in sync: check=service:web 30:00.105 [INFO] TestAgent: Requesting shutdown 30:00.105 [INFO] TestAgent.server: shutting down server 30:00.105 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:00.105 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:00.105 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:00.105 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:00.106 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:00.106 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:00.106 [DEBUG] TestAgent: Node info in sync 30:00.106 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:00.106 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:00.106 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:00.106 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:00.106 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:00.116 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 30:00.116 [INFO] TestAgent: Synced service: service=web 30:00.116 [DEBUG] TestAgent: Check in sync: check=service:web 30:00.116 [DEBUG] TestAgent: Node info in sync 30:00.116 [DEBUG] TestAgent: Service in sync: service=web 30:00.116 [DEBUG] TestAgent: Check in sync: check=service:web 2021-10-05T16:30:00.116Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:00.117Z [INFO] agent.router.manager: shutting down 30:00.117 [INFO] TestAgent: consul server down 30:00.117 [INFO] TestAgent: shutdown complete 30:00.117 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29729 network=tcp 30:00.117 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29729 network=udp 30:00.117 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29730 network=tcp 30:00.620 [INFO] TestAgent: Waiting for endpoints to shut down 30:00.620 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_ConnectNative (0.00s) --- PASS: TestAgent_RegisterService_ConnectNative/service_manager (0.92s) --- PASS: TestAgent_RegisterService_ConnectNative/normal (1.05s) === RUN TestAgent_RegisterService_ScriptCheck_ExecDisable === RUN TestAgent_RegisterService_ScriptCheck_ExecDisable/normal === PAUSE TestAgent_RegisterService_ScriptCheck_ExecDisable/normal === RUN TestAgent_RegisterService_ScriptCheck_ExecDisable/service_manager === PAUSE TestAgent_RegisterService_ScriptCheck_ExecDisable/service_manager === CONT TestAgent_RegisterService_ScriptCheck_ExecDisable/normal === CONT TestAgent_RegisterService_ScriptCheck_ExecDisable/service_manager 2021-10-05T16:30:00.669Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:00.688Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:00.862 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:df053f7a-6ee2-1613-3960-8b755ee6cab3 Address:127.0.0.1:29748}]" 30:00.863 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-df053f7a-6ee2-1613-3960-8b755ee6cab3.dc1 127.0.0.1 30:00.863 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-df053f7a-6ee2-1613-3960-8b755ee6cab3 127.0.0.1 2021-10-05T16:30:00.863Z [INFO] agent.router: Initializing LAN area manager 30:00.864 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29748 [Follower]" leader= 30:00.864 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29743 network=udp 30:00.864 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-df053f7a-6ee2-1613-3960-8b755ee6cab3.dc1 area=wan 30:00.864 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29743 network=tcp 30:00.864 [INFO] TestAgent.server: Adding LAN server: server="Node-df053f7a-6ee2-1613-3960-8b755ee6cab3 (Addr: tcp/127.0.0.1:29748) (DC: dc1)" 30:00.864 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29744 network=tcp 30:00.865 [INFO] TestAgent: started state syncer 30:00.865 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29749 network=tcp 30:00.911 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:00.912 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29748 [Candidate]" term=2 30:00.923 [DEBUG] TestAgent.server.raft: votes: needed=1 30:00.923 [DEBUG] TestAgent.server.raft: vote granted: from=df053f7a-6ee2-1613-3960-8b755ee6cab3 term=2 tally=1 30:00.923 [INFO] TestAgent.server.raft: election won: tally=1 30:00.923 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29748 [Leader]" 30:00.924 [INFO] TestAgent.server: cluster leadership acquired 30:00.924 [INFO] TestAgent.server: New leader elected: payload=Node-df053f7a-6ee2-1613-3960-8b755ee6cab3 30:00.931 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29748 30:00.969 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:01.028 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:01.028 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:01.028 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:01.028 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:01.028 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:01.028 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-df053f7a-6ee2-1613-3960-8b755ee6cab3 30:01.028 [INFO] TestAgent.server: member joined, marking health alive: member=Node-df053f7a-6ee2-1613-3960-8b755ee6cab3 30:01.041 [INFO] TestAgent: Requesting shutdown 30:01.042 [INFO] TestAgent.server: shutting down server 30:01.042 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:01.042 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:01.042 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:01.042 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:01.042 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:01.044 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:01.044 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:01.044 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:01.044 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:01.052 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:01.064Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:01.064Z [INFO] agent.router.manager: shutting down 30:01.066 [INFO] TestAgent: consul server down 30:01.066 [INFO] TestAgent: shutdown complete 30:01.066 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29743 network=tcp 30:01.066 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29743 network=udp 30:01.066 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29744 network=tcp 30:01.066 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 30:01.066 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:01.568 [INFO] TestAgent: Waiting for endpoints to shut down 30:01.568 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:00.654Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:00.688Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:00.874 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ea66d9c7-adc7-4cd3-50fd-6754560867df Address:127.0.0.1:29755}]" 30:00.874 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29755 [Follower]" leader= 30:00.874 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ea66d9c7-adc7-4cd3-50fd-6754560867df.dc1 127.0.0.1 30:00.875 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ea66d9c7-adc7-4cd3-50fd-6754560867df 127.0.0.1 2021-10-05T16:30:00.875Z [INFO] agent.router: Initializing LAN area manager 30:00.875 [INFO] TestAgent.server: Adding LAN server: server="Node-ea66d9c7-adc7-4cd3-50fd-6754560867df (Addr: tcp/127.0.0.1:29755) (DC: dc1)" 30:00.875 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ea66d9c7-adc7-4cd3-50fd-6754560867df.dc1 area=wan 30:00.875 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29750 network=udp 30:00.875 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29750 network=tcp 30:00.876 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29751 network=tcp 30:00.876 [INFO] TestAgent: started state syncer 30:00.876 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29756 network=tcp 30:00.927 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:00.927 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29755 [Candidate]" term=2 30:00.957 [DEBUG] TestAgent.server.raft: votes: needed=1 30:00.957 [DEBUG] TestAgent.server.raft: vote granted: from=ea66d9c7-adc7-4cd3-50fd-6754560867df term=2 tally=1 30:00.957 [INFO] TestAgent.server.raft: election won: tally=1 30:00.957 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29755 [Leader]" 30:00.957 [INFO] TestAgent.server: cluster leadership acquired 30:00.958 [INFO] TestAgent.server: New leader elected: payload=Node-ea66d9c7-adc7-4cd3-50fd-6754560867df 30:00.968 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29755 30:01.004 [INFO] TestAgent: Synced node info 30:01.004 [DEBUG] TestAgent: Node info in sync 30:01.033 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:01.081 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:01.081 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:01.081 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:01.082 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:01.082 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:01.082 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ea66d9c7-adc7-4cd3-50fd-6754560867df 30:01.082 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ea66d9c7-adc7-4cd3-50fd-6754560867df 30:01.113 [INFO] TestAgent.server: federation state anti-entropy synced 30:01.226 [INFO] TestAgent: Requesting shutdown 30:01.226 [INFO] TestAgent.server: shutting down server 30:01.226 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:01.226 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:01.226 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:01.226 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:01.226 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:01.226 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:01.226 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:01.226 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:01.226 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:01.226 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:01.232 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:01.240Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:01.241Z [INFO] agent.router.manager: shutting down 30:01.241 [INFO] TestAgent: consul server down 30:01.241 [INFO] TestAgent: shutdown complete 30:01.241 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29750 network=tcp 30:01.241 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29750 network=udp 30:01.241 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29751 network=tcp 30:01.744 [INFO] TestAgent: Waiting for endpoints to shut down 30:01.744 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_ScriptCheck_ExecDisable (0.00s) --- PASS: TestAgent_RegisterService_ScriptCheck_ExecDisable/normal (0.95s) --- PASS: TestAgent_RegisterService_ScriptCheck_ExecDisable/service_manager (1.12s) === RUN TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable === RUN TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/normal === PAUSE TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/normal === RUN TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/service_manager === PAUSE TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/service_manager === CONT TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/normal === CONT TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/service_manager 2021-10-05T16:30:01.798Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:01.828Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:01.964 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:881be60b-bbd1-9574-0b0f-76579932e100 Address:127.0.0.1:29762}]" 30:01.964 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-881be60b-bbd1-9574-0b0f-76579932e100.dc1 127.0.0.1 30:01.965 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-881be60b-bbd1-9574-0b0f-76579932e100 127.0.0.1 2021-10-05T16:30:01.965Z [INFO] agent.router: Initializing LAN area manager 30:01.965 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29757 network=udp 30:01.965 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29762 [Follower]" leader= 30:01.965 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-881be60b-bbd1-9574-0b0f-76579932e100.dc1 area=wan 30:01.966 [INFO] TestAgent.server: Adding LAN server: server="Node-881be60b-bbd1-9574-0b0f-76579932e100 (Addr: tcp/127.0.0.1:29762) (DC: dc1)" 30:01.966 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29757 network=tcp 30:01.966 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29758 network=tcp 30:01.966 [INFO] TestAgent: started state syncer 30:01.966 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29763 network=tcp 30:02.008 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:02.008 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29762 [Candidate]" term=2 30:02.056 [DEBUG] TestAgent.server.raft: votes: needed=1 30:02.056 [DEBUG] TestAgent.server.raft: vote granted: from=881be60b-bbd1-9574-0b0f-76579932e100 term=2 tally=1 30:02.056 [INFO] TestAgent.server.raft: election won: tally=1 30:02.056 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29762 [Leader]" 30:02.057 [INFO] TestAgent.server: cluster leadership acquired 30:02.057 [INFO] TestAgent.server: New leader elected: payload=Node-881be60b-bbd1-9574-0b0f-76579932e100 30:02.088 [INFO] TestAgent: Synced node info 30:02.088 [DEBUG] TestAgent: Node info in sync 30:02.088 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29762 30:02.127 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:02.152 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:02.152 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:02.152 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:02.152 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:02.152 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:02.152 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-881be60b-bbd1-9574-0b0f-76579932e100 30:02.152 [INFO] TestAgent.server: member joined, marking health alive: member=Node-881be60b-bbd1-9574-0b0f-76579932e100 30:02.184 [INFO] TestAgent.server: federation state anti-entropy synced 30:02.188 [INFO] TestAgent: Requesting shutdown 30:02.188 [INFO] TestAgent.server: shutting down server 30:02.188 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:02.188 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:02.188 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:02.188 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:02.188 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:02.188 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:02.188 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:02.188 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:02.188 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:02.188 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:02.200 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:02.212Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:02.212Z [INFO] agent.router.manager: shutting down 30:02.212 [INFO] TestAgent: consul server down 30:02.212 [INFO] TestAgent: shutdown complete 30:02.212 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29757 network=tcp 30:02.212 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29757 network=udp 30:02.212 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29758 network=tcp 30:02.713 [INFO] TestAgent: Waiting for endpoints to shut down 30:02.713 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:01.813Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:01.853Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:02.008 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:15595ea9-62a8-234a-5122-d37887dd3903 Address:127.0.0.1:29769}]" 30:02.009 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-15595ea9-62a8-234a-5122-d37887dd3903.dc1 127.0.0.1 30:02.009 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-15595ea9-62a8-234a-5122-d37887dd3903 127.0.0.1 2021-10-05T16:30:02.009Z [INFO] agent.router: Initializing LAN area manager 30:02.010 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29764 network=udp 30:02.010 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29769 [Follower]" leader= 30:02.010 [INFO] TestAgent.server: Adding LAN server: server="Node-15595ea9-62a8-234a-5122-d37887dd3903 (Addr: tcp/127.0.0.1:29769) (DC: dc1)" 30:02.010 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-15595ea9-62a8-234a-5122-d37887dd3903.dc1 area=wan 30:02.010 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29764 network=tcp 30:02.011 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29765 network=tcp 30:02.011 [INFO] TestAgent: started state syncer 30:02.011 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29770 network=tcp 30:02.076 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:02.076 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29769 [Candidate]" term=2 30:02.132 [DEBUG] TestAgent.server.raft: votes: needed=1 30:02.132 [DEBUG] TestAgent.server.raft: vote granted: from=15595ea9-62a8-234a-5122-d37887dd3903 term=2 tally=1 30:02.132 [INFO] TestAgent.server.raft: election won: tally=1 30:02.132 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29769 [Leader]" 30:02.132 [INFO] TestAgent.server: cluster leadership acquired 30:02.132 [INFO] TestAgent.server: New leader elected: payload=Node-15595ea9-62a8-234a-5122-d37887dd3903 30:02.164 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29769 30:02.210 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:02.255 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:02.255 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:02.255 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:02.255 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:02.255 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:02.255 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-15595ea9-62a8-234a-5122-d37887dd3903 30:02.255 [INFO] TestAgent.server: member joined, marking health alive: member=Node-15595ea9-62a8-234a-5122-d37887dd3903 30:02.287 [INFO] TestAgent.server: federation state anti-entropy synced 30:02.408 [INFO] TestAgent: Requesting shutdown 30:02.408 [INFO] TestAgent.server: shutting down server 30:02.408 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:02.408 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:02.408 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:02.408 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:02.408 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:02.408 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:02.409 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:02.409 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:02.409 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:02.409 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:02.409 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:02.424 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 30:02.424 [INFO] TestAgent: Synced node info 2021-10-05T16:30:02.440Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:02.440Z [INFO] agent.router.manager: shutting down 30:02.444 [INFO] TestAgent: consul server down 30:02.444 [INFO] TestAgent: shutdown complete 30:02.444 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29764 network=tcp 30:02.444 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29764 network=udp 30:02.444 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29765 network=tcp 30:02.444 [WARN] TestAgent: Deregistering service failed.: service=test error="leadership lost while committing log" 30:02.444 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="leadership lost while committing log" 30:02.948 [INFO] TestAgent: Waiting for endpoints to shut down 30:02.948 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable (0.00s) --- PASS: TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/normal (0.97s) --- PASS: TestAgent_RegisterService_ScriptCheck_ExecRemoteDisable/service_manager (1.20s) === RUN TestAgent_DeregisterService === PAUSE TestAgent_DeregisterService === RUN TestAgent_DeregisterService_ACLDeny === PAUSE TestAgent_DeregisterService_ACLDeny === RUN TestAgent_ServiceMaintenance_BadRequest === PAUSE TestAgent_ServiceMaintenance_BadRequest === RUN TestAgent_ServiceMaintenance_Enable === PAUSE TestAgent_ServiceMaintenance_Enable === RUN TestAgent_ServiceMaintenance_Disable === PAUSE TestAgent_ServiceMaintenance_Disable === RUN TestAgent_ServiceMaintenance_ACLDeny === PAUSE TestAgent_ServiceMaintenance_ACLDeny === RUN TestAgent_NodeMaintenance_BadRequest === PAUSE TestAgent_NodeMaintenance_BadRequest === RUN TestAgent_NodeMaintenance_Enable === PAUSE TestAgent_NodeMaintenance_Enable === RUN TestAgent_NodeMaintenance_Disable === PAUSE TestAgent_NodeMaintenance_Disable === RUN TestAgent_NodeMaintenance_ACLDeny === PAUSE TestAgent_NodeMaintenance_ACLDeny === RUN TestAgent_RegisterCheck_Service === PAUSE TestAgent_RegisterCheck_Service === RUN TestAgent_Monitor === PAUSE TestAgent_Monitor === RUN TestAgent_Monitor_ACLDeny === PAUSE TestAgent_Monitor_ACLDeny === RUN TestAgent_TokenTriggersFullSync === PAUSE TestAgent_TokenTriggersFullSync === RUN TestAgent_Token === PAUSE TestAgent_Token === RUN TestAgentConnectCARoots_empty === PAUSE TestAgentConnectCARoots_empty === RUN TestAgentConnectCARoots_list === PAUSE TestAgentConnectCARoots_list === RUN TestAgentConnectCALeafCert_aclDefaultDeny === PAUSE TestAgentConnectCALeafCert_aclDefaultDeny === RUN TestAgentConnectCALeafCert_aclServiceWrite === PAUSE TestAgentConnectCALeafCert_aclServiceWrite === RUN TestAgentConnectCALeafCert_aclServiceReadDeny === PAUSE TestAgentConnectCALeafCert_aclServiceReadDeny === RUN TestAgentConnectCALeafCert_good agent_endpoint_test.go:5187: DM-skipped --- SKIP: TestAgentConnectCALeafCert_good (0.00s) === RUN TestAgentConnectCALeafCert_goodNotLocal agent_endpoint_test.go:5283: DM-skipped --- SKIP: TestAgentConnectCALeafCert_goodNotLocal (0.00s) === RUN TestAgentConnectCALeafCert_secondaryDC_good === PAUSE TestAgentConnectCALeafCert_secondaryDC_good === RUN TestAgentConnectAuthorize_badBody === PAUSE TestAgentConnectAuthorize_badBody === RUN TestAgentConnectAuthorize_noTarget === PAUSE TestAgentConnectAuthorize_noTarget === RUN TestAgentConnectAuthorize_idInvalidFormat === PAUSE TestAgentConnectAuthorize_idInvalidFormat === RUN TestAgentConnectAuthorize_idNotService === PAUSE TestAgentConnectAuthorize_idNotService === RUN TestAgentConnectAuthorize_allow === PAUSE TestAgentConnectAuthorize_allow === RUN TestAgentConnectAuthorize_deny === PAUSE TestAgentConnectAuthorize_deny === RUN TestAgentConnectAuthorize_allowTrustDomain === PAUSE TestAgentConnectAuthorize_allowTrustDomain === RUN TestAgentConnectAuthorize_denyWildcard === PAUSE TestAgentConnectAuthorize_denyWildcard === RUN TestAgentConnectAuthorize_serviceWrite === PAUSE TestAgentConnectAuthorize_serviceWrite === RUN TestAgentConnectAuthorize_defaultDeny === PAUSE TestAgentConnectAuthorize_defaultDeny === RUN TestAgentConnectAuthorize_defaultAllow === PAUSE TestAgentConnectAuthorize_defaultAllow === RUN TestAgent_Host === PAUSE TestAgent_Host === RUN TestAgent_HostBadACL === PAUSE TestAgent_HostBadACL === RUN TestAgent_Services_ExposeConfig === PAUSE TestAgent_Services_ExposeConfig === RUN TestAgent_MultiStartStop === RUN TestAgent_MultiStartStop/#00 === PAUSE TestAgent_MultiStartStop/#00 === RUN TestAgent_MultiStartStop/#01 === PAUSE TestAgent_MultiStartStop/#01 === RUN TestAgent_MultiStartStop/#02 === PAUSE TestAgent_MultiStartStop/#02 === RUN TestAgent_MultiStartStop/#03 === PAUSE TestAgent_MultiStartStop/#03 === RUN TestAgent_MultiStartStop/#04 === PAUSE TestAgent_MultiStartStop/#04 === RUN TestAgent_MultiStartStop/#05 === PAUSE TestAgent_MultiStartStop/#05 === RUN TestAgent_MultiStartStop/#06 === PAUSE TestAgent_MultiStartStop/#06 === RUN TestAgent_MultiStartStop/#07 === PAUSE TestAgent_MultiStartStop/#07 === RUN TestAgent_MultiStartStop/#08 === PAUSE TestAgent_MultiStartStop/#08 === RUN TestAgent_MultiStartStop/#09 === PAUSE TestAgent_MultiStartStop/#09 === CONT TestAgent_MultiStartStop/#00 === CONT TestAgent_MultiStartStop/#05 === CONT TestAgent_MultiStartStop/#08 === CONT TestAgent_MultiStartStop/#04 === CONT TestAgent_MultiStartStop/#09 === CONT TestAgent_MultiStartStop/#02 === CONT TestAgent_MultiStartStop/#07 === CONT TestAgent_MultiStartStop/#03 === CONT TestAgent_MultiStartStop/#06 === CONT TestAgent_MultiStartStop/#01 2021-10-05T16:30:02.969Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.051Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.212 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b47677f6-7e09-cb98-97b6-9301a9291eec Address:127.0.0.1:29783}]" 30:03.212 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29783 [Follower]" leader= 30:03.215 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b47677f6-7e09-cb98-97b6-9301a9291eec.dc1 127.0.0.1 30:03.228 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b47677f6-7e09-cb98-97b6-9301a9291eec 127.0.0.1 2021-10-05T16:30:03.228Z [INFO] agent.router: Initializing LAN area manager 30:03.229 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29778 network=udp 30:03.229 [INFO] TestAgent.server: Adding LAN server: server="Node-b47677f6-7e09-cb98-97b6-9301a9291eec (Addr: tcp/127.0.0.1:29783) (DC: dc1)" 30:03.229 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b47677f6-7e09-cb98-97b6-9301a9291eec.dc1 area=wan 30:03.229 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29778 network=tcp 30:03.230 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29779 network=tcp 30:03.230 [INFO] TestAgent: started state syncer 30:03.230 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29784 network=tcp 30:03.264 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.264 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29783 [Candidate]" term=2 30:03.312 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.312 [DEBUG] TestAgent.server.raft: vote granted: from=b47677f6-7e09-cb98-97b6-9301a9291eec term=2 tally=1 30:03.312 [INFO] TestAgent.server.raft: election won: tally=1 30:03.312 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29783 [Leader]" 30:03.312 [INFO] TestAgent.server: cluster leadership acquired 30:03.312 [INFO] TestAgent.server: New leader elected: payload=Node-b47677f6-7e09-cb98-97b6-9301a9291eec 30:03.344 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29783 30:03.400 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.465 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.465 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.465 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.465 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.465 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.465 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b47677f6-7e09-cb98-97b6-9301a9291eec 30:03.465 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b47677f6-7e09-cb98-97b6-9301a9291eec 30:03.500 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.596 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:03.612 [INFO] TestAgent: Synced node info 30:03.696 [INFO] TestAgent: Requesting shutdown 30:03.696 [INFO] TestAgent.server: shutting down server 30:03.696 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.696 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.696 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.696 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.696 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.696 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.696 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.696 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.696 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.696 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.704 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.712Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.712Z [INFO] agent.router.manager: shutting down 30:03.712 [INFO] TestAgent: consul server down 30:03.712 [INFO] TestAgent: shutdown complete 30:03.712 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29778 network=tcp 30:03.712 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29778 network=udp 30:03.712 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29779 network=tcp 30:04.216 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.216 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.145Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.197Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.301 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:eed3757a-feed-911f-5d0c-dacefe0c2e3b Address:127.0.0.1:29790}]" 30:03.301 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-eed3757a-feed-911f-5d0c-dacefe0c2e3b.dc1 127.0.0.1 30:03.302 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-eed3757a-feed-911f-5d0c-dacefe0c2e3b 127.0.0.1 2021-10-05T16:30:03.302Z [INFO] agent.router: Initializing LAN area manager 30:03.302 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29785 network=udp 30:03.302 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29790 [Follower]" leader= 30:03.302 [INFO] TestAgent.server: Adding LAN server: server="Node-eed3757a-feed-911f-5d0c-dacefe0c2e3b (Addr: tcp/127.0.0.1:29790) (DC: dc1)" 30:03.302 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-eed3757a-feed-911f-5d0c-dacefe0c2e3b.dc1 area=wan 30:03.303 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29785 network=tcp 30:03.303 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29786 network=tcp 30:03.303 [INFO] TestAgent: started state syncer 30:03.303 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29791 network=tcp 30:03.348 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.348 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29790 [Candidate]" term=2 30:03.372 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.372 [DEBUG] TestAgent.server.raft: vote granted: from=eed3757a-feed-911f-5d0c-dacefe0c2e3b term=2 tally=1 30:03.372 [INFO] TestAgent.server.raft: election won: tally=1 30:03.372 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29790 [Leader]" 30:03.374 [INFO] TestAgent.server: cluster leadership acquired 30:03.374 [INFO] TestAgent.server: New leader elected: payload=Node-eed3757a-feed-911f-5d0c-dacefe0c2e3b 30:03.392 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29790 30:03.426 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.477 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.477 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.477 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.477 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.477 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.477 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-eed3757a-feed-911f-5d0c-dacefe0c2e3b 30:03.477 [INFO] TestAgent.server: member joined, marking health alive: member=Node-eed3757a-feed-911f-5d0c-dacefe0c2e3b 30:03.529 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.692 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:03.702 [INFO] TestAgent: Synced node info 30:03.702 [DEBUG] TestAgent: Node info in sync 30:03.712 [INFO] TestAgent: Requesting shutdown 30:03.712 [INFO] TestAgent.server: shutting down server 30:03.712 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.712 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.712 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.712 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.712 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.712 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.712 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.712 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.712 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.712 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.716 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.720Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.720Z [INFO] agent.router.manager: shutting down 30:03.720 [INFO] TestAgent: consul server down 30:03.720 [INFO] TestAgent: shutdown complete 30:03.720 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29785 network=tcp 30:03.720 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29785 network=udp 30:03.720 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29786 network=tcp 30:04.221 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.221 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.056Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.074Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.167 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cc714bbc-01ff-c537-8ac4-5c14f0f5c461 Address:127.0.0.1:29839}]" 30:03.168 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cc714bbc-01ff-c537-8ac4-5c14f0f5c461.dc1 127.0.0.1 30:03.169 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cc714bbc-01ff-c537-8ac4-5c14f0f5c461 127.0.0.1 2021-10-05T16:30:03.169Z [INFO] agent.router: Initializing LAN area manager 30:03.169 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29834 network=udp 30:03.169 [INFO] TestAgent.server: Adding LAN server: server="Node-cc714bbc-01ff-c537-8ac4-5c14f0f5c461 (Addr: tcp/127.0.0.1:29839) (DC: dc1)" 30:03.170 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cc714bbc-01ff-c537-8ac4-5c14f0f5c461.dc1 area=wan 30:03.170 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29834 network=tcp 30:03.188 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29839 [Follower]" leader= 30:03.209 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29835 network=tcp 30:03.209 [INFO] TestAgent: started state syncer 30:03.230 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29840 network=tcp 30:03.232 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.232 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29839 [Candidate]" term=2 30:03.274 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.274 [DEBUG] TestAgent.server.raft: vote granted: from=cc714bbc-01ff-c537-8ac4-5c14f0f5c461 term=2 tally=1 30:03.274 [INFO] TestAgent.server.raft: election won: tally=1 30:03.274 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29839 [Leader]" 30:03.275 [INFO] TestAgent.server: cluster leadership acquired 30:03.275 [INFO] TestAgent.server: New leader elected: payload=Node-cc714bbc-01ff-c537-8ac4-5c14f0f5c461 30:03.296 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29839 30:03.364 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.425 [INFO] TestAgent: Synced node info 30:03.425 [DEBUG] TestAgent: Node info in sync 30:03.443 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.443 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.443 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.443 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.443 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.443 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cc714bbc-01ff-c537-8ac4-5c14f0f5c461 30:03.443 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cc714bbc-01ff-c537-8ac4-5c14f0f5c461 30:03.480 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.762 [INFO] TestAgent: Requesting shutdown 30:03.762 [INFO] TestAgent.server: shutting down server 30:03.762 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.762 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.762 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.762 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.762 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.762 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.762 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.762 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.762 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.762 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.775 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.779Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.779Z [INFO] agent.router.manager: shutting down 30:03.779 [INFO] TestAgent: consul server down 30:03.779 [INFO] TestAgent: shutdown complete 30:03.779 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29834 network=tcp 30:03.779 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29834 network=udp 30:03.779 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29835 network=tcp 30:04.280 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.280 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.148Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.170Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.272 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b0adad1d-1c81-1c16-e05e-700f062843fc Address:127.0.0.1:29825}]" 30:03.272 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b0adad1d-1c81-1c16-e05e-700f062843fc.dc1 127.0.0.1 30:03.273 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b0adad1d-1c81-1c16-e05e-700f062843fc 127.0.0.1 2021-10-05T16:30:03.273Z [INFO] agent.router: Initializing LAN area manager 30:03.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29820 network=udp 30:03.273 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29825 [Follower]" leader= 30:03.274 [INFO] TestAgent.server: Adding LAN server: server="Node-b0adad1d-1c81-1c16-e05e-700f062843fc (Addr: tcp/127.0.0.1:29825) (DC: dc1)" 30:03.274 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b0adad1d-1c81-1c16-e05e-700f062843fc.dc1 area=wan 30:03.274 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29820 network=tcp 30:03.274 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29821 network=tcp 30:03.274 [INFO] TestAgent: started state syncer 30:03.274 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29826 network=tcp 30:03.318 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.318 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29825 [Candidate]" term=2 30:03.338 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.338 [DEBUG] TestAgent.server.raft: vote granted: from=b0adad1d-1c81-1c16-e05e-700f062843fc term=2 tally=1 30:03.338 [INFO] TestAgent.server.raft: election won: tally=1 30:03.338 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29825 [Leader]" 30:03.338 [INFO] TestAgent.server: cluster leadership acquired 30:03.338 [INFO] TestAgent.server: New leader elected: payload=Node-b0adad1d-1c81-1c16-e05e-700f062843fc 30:03.354 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29825 30:03.411 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.500 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.500 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.500 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.500 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.500 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.500 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b0adad1d-1c81-1c16-e05e-700f062843fc 30:03.500 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b0adad1d-1c81-1c16-e05e-700f062843fc 30:03.538 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.580 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:03.596 [INFO] TestAgent: Synced node info 30:03.791 [INFO] TestAgent: Requesting shutdown 30:03.791 [INFO] TestAgent.server: shutting down server 30:03.791 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.791 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.791 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.791 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.791 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.791 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.791 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.791 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.791 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.791 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.800 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.808Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.808Z [INFO] agent.router.manager: shutting down 30:03.808 [INFO] TestAgent: consul server down 30:03.808 [INFO] TestAgent: shutdown complete 30:03.808 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29820 network=tcp 30:03.808 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29820 network=udp 30:03.808 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29821 network=tcp 30:04.310 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.310 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.082Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.155Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.254 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:03f2970e-fcee-57e7-2478-4918d5373d68 Address:127.0.0.1:29818}]" 30:03.255 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-03f2970e-fcee-57e7-2478-4918d5373d68.dc1 127.0.0.1 30:03.255 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-03f2970e-fcee-57e7-2478-4918d5373d68 127.0.0.1 2021-10-05T16:30:03.255Z [INFO] agent.router: Initializing LAN area manager 30:03.255 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29813 network=udp 30:03.255 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29818 [Follower]" leader= 30:03.256 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-03f2970e-fcee-57e7-2478-4918d5373d68.dc1 area=wan 30:03.256 [INFO] TestAgent.server: Adding LAN server: server="Node-03f2970e-fcee-57e7-2478-4918d5373d68 (Addr: tcp/127.0.0.1:29818) (DC: dc1)" 30:03.256 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29813 network=tcp 30:03.257 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29814 network=tcp 30:03.257 [INFO] TestAgent: started state syncer 30:03.257 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29819 network=tcp 30:03.304 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.304 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29818 [Candidate]" term=2 30:03.328 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.328 [DEBUG] TestAgent.server.raft: vote granted: from=03f2970e-fcee-57e7-2478-4918d5373d68 term=2 tally=1 30:03.328 [INFO] TestAgent.server.raft: election won: tally=1 30:03.328 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29818 [Leader]" 30:03.329 [INFO] TestAgent.server: cluster leadership acquired 30:03.329 [INFO] TestAgent.server: New leader elected: payload=Node-03f2970e-fcee-57e7-2478-4918d5373d68 30:03.341 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29818 30:03.412 [INFO] TestAgent: Synced node info 30:03.412 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.472 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.472 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.472 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.472 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.472 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.472 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-03f2970e-fcee-57e7-2478-4918d5373d68 30:03.472 [INFO] TestAgent.server: member joined, marking health alive: member=Node-03f2970e-fcee-57e7-2478-4918d5373d68 30:03.528 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.832 [INFO] TestAgent: Requesting shutdown 30:03.832 [INFO] TestAgent.server: shutting down server 30:03.832 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.832 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.832 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.832 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.832 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.832 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.832 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.832 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.833 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.833 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.840 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.852Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.852Z [INFO] agent.router.manager: shutting down 30:03.852 [INFO] TestAgent: consul server down 30:03.852 [INFO] TestAgent: shutdown complete 30:03.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29813 network=tcp 30:03.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29813 network=udp 30:03.852 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29814 network=tcp 30:04.352 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.352 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.145Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.168Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.248 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:45e97d39-30cd-bfc3-081f-dba73536d7c8 Address:127.0.0.1:29832}]" 30:03.248 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29832 [Follower]" leader= 30:03.249 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-45e97d39-30cd-bfc3-081f-dba73536d7c8.dc1 127.0.0.1 30:03.249 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-45e97d39-30cd-bfc3-081f-dba73536d7c8 127.0.0.1 2021-10-05T16:30:03.249Z [INFO] agent.router: Initializing LAN area manager 30:03.249 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29827 network=udp 30:03.250 [INFO] TestAgent.server: Adding LAN server: server="Node-45e97d39-30cd-bfc3-081f-dba73536d7c8 (Addr: tcp/127.0.0.1:29832) (DC: dc1)" 30:03.250 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-45e97d39-30cd-bfc3-081f-dba73536d7c8.dc1 area=wan 30:03.250 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29827 network=tcp 30:03.251 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29828 network=tcp 30:03.251 [INFO] TestAgent: started state syncer 30:03.251 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29833 network=tcp 30:03.308 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.308 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29832 [Candidate]" term=2 30:03.352 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.352 [DEBUG] TestAgent.server.raft: vote granted: from=45e97d39-30cd-bfc3-081f-dba73536d7c8 term=2 tally=1 30:03.352 [INFO] TestAgent.server.raft: election won: tally=1 30:03.352 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29832 [Leader]" 30:03.353 [INFO] TestAgent.server: cluster leadership acquired 30:03.353 [INFO] TestAgent.server: New leader elected: payload=Node-45e97d39-30cd-bfc3-081f-dba73536d7c8 30:03.374 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29832 30:03.396 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.483 [INFO] TestAgent: Synced node info 30:03.483 [DEBUG] TestAgent: Node info in sync 30:03.500 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.500 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.500 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.500 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.500 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.500 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-45e97d39-30cd-bfc3-081f-dba73536d7c8 30:03.500 [INFO] TestAgent.server: member joined, marking health alive: member=Node-45e97d39-30cd-bfc3-081f-dba73536d7c8 30:03.512 [DEBUG] TestAgent: Node info in sync 30:03.541 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.864 [INFO] TestAgent: Requesting shutdown 30:03.864 [INFO] TestAgent.server: shutting down server 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.864 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.864 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.864 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.864 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.864 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.864 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.872 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.880Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.880Z [INFO] agent.router.manager: shutting down 30:03.880 [INFO] TestAgent: consul server down 30:03.880 [INFO] TestAgent: shutdown complete 30:03.880 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29827 network=tcp 30:03.880 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29827 network=udp 30:03.880 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29828 network=tcp 30:04.384 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.384 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.141Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.214Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.296 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:38e9aab9-5496-78ed-e685-cd8fefd761ca Address:127.0.0.1:29797}]" 30:03.296 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29797 [Follower]" leader= 30:03.297 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-38e9aab9-5496-78ed-e685-cd8fefd761ca.dc1 127.0.0.1 30:03.297 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-38e9aab9-5496-78ed-e685-cd8fefd761ca 127.0.0.1 2021-10-05T16:30:03.297Z [INFO] agent.router: Initializing LAN area manager 30:03.297 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29792 network=udp 30:03.298 [INFO] TestAgent.server: Adding LAN server: server="Node-38e9aab9-5496-78ed-e685-cd8fefd761ca (Addr: tcp/127.0.0.1:29797) (DC: dc1)" 30:03.298 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-38e9aab9-5496-78ed-e685-cd8fefd761ca.dc1 area=wan 30:03.298 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29792 network=tcp 30:03.298 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29793 network=tcp 30:03.298 [INFO] TestAgent: started state syncer 30:03.299 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29798 network=tcp 30:03.340 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.340 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29797 [Candidate]" term=2 30:03.387 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.387 [DEBUG] TestAgent.server.raft: vote granted: from=38e9aab9-5496-78ed-e685-cd8fefd761ca term=2 tally=1 30:03.387 [INFO] TestAgent.server.raft: election won: tally=1 30:03.387 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29797 [Leader]" 30:03.387 [INFO] TestAgent.server: cluster leadership acquired 30:03.387 [INFO] TestAgent.server: New leader elected: payload=Node-38e9aab9-5496-78ed-e685-cd8fefd761ca 30:03.428 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29797 30:03.488 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.556 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.556 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.556 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.556 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.556 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.557 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-38e9aab9-5496-78ed-e685-cd8fefd761ca 30:03.557 [INFO] TestAgent.server: member joined, marking health alive: member=Node-38e9aab9-5496-78ed-e685-cd8fefd761ca 30:03.592 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.784 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:03.787 [INFO] TestAgent: Synced node info 30:03.864 [INFO] TestAgent: Requesting shutdown 30:03.864 [INFO] TestAgent.server: shutting down server 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.864 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.864 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.868 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.868 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.868 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.868 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.868 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.876 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.899Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.899Z [INFO] agent.router.manager: shutting down 30:03.899 [INFO] TestAgent: consul server down 30:03.899 [INFO] TestAgent: shutdown complete 30:03.899 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29792 network=tcp 30:03.899 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29792 network=udp 30:03.899 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29793 network=tcp 30:04.400 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.400 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.078Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.164Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.264 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0ee2ea2a-311f-f6df-de78-3b97d7785821 Address:127.0.0.1:29804}]" 30:03.264 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29804 [Follower]" leader= 30:03.265 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0ee2ea2a-311f-f6df-de78-3b97d7785821.dc1 127.0.0.1 30:03.266 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0ee2ea2a-311f-f6df-de78-3b97d7785821 127.0.0.1 2021-10-05T16:30:03.266Z [INFO] agent.router: Initializing LAN area manager 30:03.266 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29799 network=udp 30:03.266 [INFO] TestAgent.server: Adding LAN server: server="Node-0ee2ea2a-311f-f6df-de78-3b97d7785821 (Addr: tcp/127.0.0.1:29804) (DC: dc1)" 30:03.266 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0ee2ea2a-311f-f6df-de78-3b97d7785821.dc1 area=wan 30:03.266 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29799 network=tcp 30:03.267 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29800 network=tcp 30:03.267 [INFO] TestAgent: started state syncer 30:03.267 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29805 network=tcp 30:03.308 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.308 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29804 [Candidate]" term=2 30:03.329 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.329 [DEBUG] TestAgent.server.raft: vote granted: from=0ee2ea2a-311f-f6df-de78-3b97d7785821 term=2 tally=1 30:03.329 [INFO] TestAgent.server.raft: election won: tally=1 30:03.329 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29804 [Leader]" 30:03.330 [INFO] TestAgent.server: cluster leadership acquired 30:03.330 [INFO] TestAgent.server: New leader elected: payload=Node-0ee2ea2a-311f-f6df-de78-3b97d7785821 30:03.343 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29804 30:03.413 [INFO] TestAgent: Synced node info 30:03.413 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.469 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.469 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.469 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.469 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.469 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.469 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0ee2ea2a-311f-f6df-de78-3b97d7785821 30:03.469 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0ee2ea2a-311f-f6df-de78-3b97d7785821 30:03.512 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.872 [INFO] TestAgent: Requesting shutdown 30:03.872 [INFO] TestAgent.server: shutting down server 30:03.872 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.872 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.872 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.872 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.872 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.872 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.872 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.872 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.872 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.872 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.895 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.900Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.900Z [INFO] agent.router.manager: shutting down 30:03.900 [INFO] TestAgent: consul server down 30:03.900 [INFO] TestAgent: shutdown complete 30:03.900 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29799 network=tcp 30:03.900 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29799 network=udp 30:03.900 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29800 network=tcp 30:04.400 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.400 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:03.064Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.138Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.250 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e47c2655-2941-db84-0831-b82085c7bd94 Address:127.0.0.1:29811}]" 30:03.251 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29811 [Follower]" leader= 30:03.252 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e47c2655-2941-db84-0831-b82085c7bd94.dc1 127.0.0.1 30:03.257 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e47c2655-2941-db84-0831-b82085c7bd94 127.0.0.1 2021-10-05T16:30:03.257Z [INFO] agent.router: Initializing LAN area manager 30:03.258 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29806 network=udp 30:03.258 [INFO] TestAgent.server: Adding LAN server: server="Node-e47c2655-2941-db84-0831-b82085c7bd94 (Addr: tcp/127.0.0.1:29811) (DC: dc1)" 30:03.258 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e47c2655-2941-db84-0831-b82085c7bd94.dc1 area=wan 30:03.258 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29806 network=tcp 30:03.259 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29807 network=tcp 30:03.259 [INFO] TestAgent: started state syncer 30:03.259 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29812 network=tcp 30:03.292 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.292 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29811 [Candidate]" term=2 30:03.324 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.324 [DEBUG] TestAgent.server.raft: vote granted: from=e47c2655-2941-db84-0831-b82085c7bd94 term=2 tally=1 30:03.324 [INFO] TestAgent.server.raft: election won: tally=1 30:03.324 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29811 [Leader]" 30:03.328 [INFO] TestAgent.server: cluster leadership acquired 30:03.328 [INFO] TestAgent.server: New leader elected: payload=Node-e47c2655-2941-db84-0831-b82085c7bd94 30:03.352 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29811 30:03.384 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.403 [INFO] TestAgent: Synced node info 30:03.403 [DEBUG] TestAgent: Node info in sync 30:03.444 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.444 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.444 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.444 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.444 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.444 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e47c2655-2941-db84-0831-b82085c7bd94 30:03.444 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e47c2655-2941-db84-0831-b82085c7bd94 30:03.489 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.912 [INFO] TestAgent: Requesting shutdown 30:03.912 [INFO] TestAgent.server: shutting down server 30:03.912 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.912 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.912 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.912 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.912 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.912 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.912 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.912 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.912 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.912 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.920 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.932Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.932Z [INFO] agent.router.manager: shutting down 30:03.932 [INFO] TestAgent: consul server down 30:03.932 [INFO] TestAgent: shutdown complete 30:03.932 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29806 network=tcp 30:03.932 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29806 network=udp 30:03.932 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29807 network=tcp 30:04.436 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.436 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:02.976Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:03.169Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:03.276 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1039ab93-652f-40db-0e8a-e787eae530ab Address:127.0.0.1:29776}]" 30:03.276 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1039ab93-652f-40db-0e8a-e787eae530ab.dc1 127.0.0.1 30:03.277 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1039ab93-652f-40db-0e8a-e787eae530ab 127.0.0.1 2021-10-05T16:30:03.277Z [INFO] agent.router: Initializing LAN area manager 30:03.277 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29771 network=udp 30:03.277 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29776 [Follower]" leader= 30:03.278 [INFO] TestAgent.server: Adding LAN server: server="Node-1039ab93-652f-40db-0e8a-e787eae530ab (Addr: tcp/127.0.0.1:29776) (DC: dc1)" 30:03.278 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1039ab93-652f-40db-0e8a-e787eae530ab.dc1 area=wan 30:03.278 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29771 network=tcp 30:03.278 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29772 network=tcp 30:03.278 [INFO] TestAgent: started state syncer 30:03.278 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29777 network=tcp 30:03.328 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:03.328 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29776 [Candidate]" term=2 30:03.380 [DEBUG] TestAgent.server.raft: votes: needed=1 30:03.380 [DEBUG] TestAgent.server.raft: vote granted: from=1039ab93-652f-40db-0e8a-e787eae530ab term=2 tally=1 30:03.380 [INFO] TestAgent.server.raft: election won: tally=1 30:03.380 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29776 [Leader]" 30:03.380 [INFO] TestAgent.server: cluster leadership acquired 30:03.380 [INFO] TestAgent.server: New leader elected: payload=Node-1039ab93-652f-40db-0e8a-e787eae530ab 30:03.412 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29776 30:03.492 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:03.556 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.556 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.556 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.556 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.556 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.556 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1039ab93-652f-40db-0e8a-e787eae530ab 30:03.556 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1039ab93-652f-40db-0e8a-e787eae530ab 30:03.600 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.696 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:03.716 [INFO] TestAgent: Synced node info 30:03.948 [INFO] TestAgent: Requesting shutdown 30:03.948 [INFO] TestAgent.server: shutting down server 30:03.948 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.948 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.948 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.948 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.948 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.948 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.948 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.948 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.948 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.948 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.956 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.960Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.960Z [INFO] agent.router.manager: shutting down 30:03.960 [INFO] TestAgent: consul server down 30:03.960 [INFO] TestAgent: shutdown complete 30:03.960 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29771 network=tcp 30:03.960 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29771 network=udp 30:03.960 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29772 network=tcp 30:04.464 [INFO] TestAgent: Waiting for endpoints to shut down 30:04.464 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_MultiStartStop (0.00s) --- PASS: TestAgent_MultiStartStop/#05 (1.26s) --- PASS: TestAgent_MultiStartStop/#08 (1.27s) --- PASS: TestAgent_MultiStartStop/#03 (1.31s) --- PASS: TestAgent_MultiStartStop/#01 (1.34s) --- PASS: TestAgent_MultiStartStop/#07 (1.39s) --- PASS: TestAgent_MultiStartStop/#06 (1.42s) --- PASS: TestAgent_MultiStartStop/#04 (1.44s) --- PASS: TestAgent_MultiStartStop/#09 (1.44s) --- PASS: TestAgent_MultiStartStop/#02 (1.47s) --- PASS: TestAgent_MultiStartStop/#00 (1.51s) === RUN TestAgent_ConnectClusterIDConfig === RUN TestAgent_ConnectClusterIDConfig/default_TestAgent_has_fixed_cluster_id 2021-10-05T16:30:04.495Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:04.529Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:04.604 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cb16300c-178b-7f74-c4f4-5c261a6c800d Address:127.0.0.1:29846}]" 30:04.605 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cb16300c-178b-7f74-c4f4-5c261a6c800d.dc1 127.0.0.1 30:04.605 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cb16300c-178b-7f74-c4f4-5c261a6c800d 127.0.0.1 2021-10-05T16:30:04.605Z [INFO] agent.router: Initializing LAN area manager 30:04.605 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29841 network=udp 30:04.605 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29846 [Follower]" leader= 30:04.606 [INFO] TestAgent.server: Adding LAN server: server="Node-cb16300c-178b-7f74-c4f4-5c261a6c800d (Addr: tcp/127.0.0.1:29846) (DC: dc1)" 30:04.606 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cb16300c-178b-7f74-c4f4-5c261a6c800d.dc1 area=wan 30:04.606 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29841 network=tcp 30:04.606 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29842 network=tcp 30:04.606 [INFO] TestAgent: started state syncer 30:04.606 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29847 network=tcp 30:04.664 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:04.664 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29846 [Candidate]" term=2 30:04.701 [DEBUG] TestAgent.server.raft: votes: needed=1 30:04.701 [DEBUG] TestAgent.server.raft: vote granted: from=cb16300c-178b-7f74-c4f4-5c261a6c800d term=2 tally=1 30:04.701 [INFO] TestAgent.server.raft: election won: tally=1 30:04.701 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29846 [Leader]" 30:04.702 [INFO] TestAgent.server: cluster leadership acquired 30:04.702 [INFO] TestAgent.server: New leader elected: payload=Node-cb16300c-178b-7f74-c4f4-5c261a6c800d 30:04.707 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29846 30:04.720 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:04.793 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:04.793 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:04.793 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:04.793 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:04.793 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:04.793 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cb16300c-178b-7f74-c4f4-5c261a6c800d 30:04.793 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cb16300c-178b-7f74-c4f4-5c261a6c800d 30:04.822 [INFO] TestAgent.server: federation state anti-entropy synced 30:04.964 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:04.980 [INFO] TestAgent: Synced node info 30:04.980 [DEBUG] TestAgent: Node info in sync 30:05.084 [INFO] TestAgent: Requesting shutdown 30:05.084 [INFO] TestAgent.server: shutting down server 30:05.084 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:05.084 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:05.084 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:05.084 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:05.084 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:05.084 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:05.084 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:05.084 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:05.084 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:05.084 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:05.092 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:05.100Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:05.100Z [INFO] agent.router.manager: shutting down 30:05.100 [INFO] TestAgent: consul server down 30:05.100 [INFO] TestAgent: shutdown complete 30:05.100 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29841 network=tcp 30:05.100 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29841 network=udp 30:05.100 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29842 network=tcp 30:05.604 [INFO] TestAgent: Waiting for endpoints to shut down 30:05.604 [INFO] TestAgent: Endpoints down === RUN TestAgent_ConnectClusterIDConfig/no_cluster_ID_specified_sets_to_test_ID 2021-10-05T16:30:05.641Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:05.663Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:05.736 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d043d636-0301-cecf-3807-2e67a201f21c Address:127.0.0.1:29853}]" 30:05.737 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d043d636-0301-cecf-3807-2e67a201f21c.dc1 127.0.0.1 30:05.737 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d043d636-0301-cecf-3807-2e67a201f21c 127.0.0.1 2021-10-05T16:30:05.737Z [INFO] agent.router: Initializing LAN area manager 30:05.737 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29848 network=udp 30:05.737 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29853 [Follower]" leader= 30:05.738 [INFO] TestAgent.server: Adding LAN server: server="Node-d043d636-0301-cecf-3807-2e67a201f21c (Addr: tcp/127.0.0.1:29853) (DC: dc1)" 30:05.738 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d043d636-0301-cecf-3807-2e67a201f21c.dc1 area=wan 30:05.738 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29848 network=tcp 30:05.738 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29849 network=tcp 30:05.738 [INFO] TestAgent: started state syncer 30:05.739 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29854 network=tcp 30:05.788 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:05.788 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29853 [Candidate]" term=2 30:05.836 [DEBUG] TestAgent.server.raft: votes: needed=1 30:05.836 [DEBUG] TestAgent.server.raft: vote granted: from=d043d636-0301-cecf-3807-2e67a201f21c term=2 tally=1 30:05.836 [INFO] TestAgent.server.raft: election won: tally=1 30:05.836 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29853 [Leader]" 30:05.840 [INFO] TestAgent.server: cluster leadership acquired 30:05.840 [INFO] TestAgent.server: New leader elected: payload=Node-d043d636-0301-cecf-3807-2e67a201f21c 30:05.868 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29853 30:05.928 [INFO] TestAgent: Requesting shutdown 30:05.928 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:05.928 [INFO] TestAgent.server: shutting down server 30:05.928 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:05.928 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:05.940 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:05.948Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:05.948Z [INFO] agent.router.manager: shutting down 30:05.956 [INFO] TestAgent: consul server down 30:05.956 [INFO] TestAgent: shutdown complete 30:05.956 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29848 network=tcp 30:05.956 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29848 network=udp 30:05.956 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29849 network=tcp 30:05.956 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 30:05.956 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 30:06.459 [INFO] TestAgent: Waiting for endpoints to shut down 30:06.459 [INFO] TestAgent: Endpoints down === RUN TestAgent_ConnectClusterIDConfig/non-UUID_cluster_id_is_fatal 2021-10-05T16:30:06.487Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:06.521Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:06.521 [INFO] TestAgent: Requesting shutdown 30:06.521 [INFO] TestAgent: shutdown complete --- PASS: TestAgent_ConnectClusterIDConfig (2.06s) --- PASS: TestAgent_ConnectClusterIDConfig/default_TestAgent_has_fixed_cluster_id (1.14s) --- PASS: TestAgent_ConnectClusterIDConfig/no_cluster_ID_specified_sets_to_test_ID (0.86s) --- PASS: TestAgent_ConnectClusterIDConfig/non-UUID_cluster_id_is_fatal (0.06s) === RUN TestAgent_StartStop === PAUSE TestAgent_StartStop === RUN TestAgent_RPCPing === PAUSE TestAgent_RPCPing === RUN TestAgent_TokenStore === PAUSE TestAgent_TokenStore === RUN TestAgent_ReconnectConfigSettings === PAUSE TestAgent_ReconnectConfigSettings === RUN TestAgent_ReconnectConfigWanDisabled === PAUSE TestAgent_ReconnectConfigWanDisabled === RUN TestAgent_AddService === RUN TestAgent_AddService/normal === PAUSE TestAgent_AddService/normal === RUN TestAgent_AddService/service_manager === PAUSE TestAgent_AddService/service_manager === CONT TestAgent_AddService/normal === CONT TestAgent_AddService/service_manager === RUN TestAgent_AddService/service_manager/one_check === RUN TestAgent_AddService/service_manager/one_check/svcid1 === RUN TestAgent_AddService/service_manager/one_check/check1 === RUN TestAgent_AddService/service_manager/one_check/check1_ttl === RUN TestAgent_AddService/service_manager/multiple_checks === RUN TestAgent_AddService/service_manager/multiple_checks/svcid2 === RUN TestAgent_AddService/service_manager/multiple_checks/service:svcid2:4 === RUN TestAgent_AddService/service_manager/multiple_checks/check1 === RUN TestAgent_AddService/service_manager/multiple_checks/check-noname === RUN TestAgent_AddService/service_manager/multiple_checks/service:svcid2:3 === RUN TestAgent_AddService/service_manager/multiple_checks/check1_ttl === RUN TestAgent_AddService/service_manager/multiple_checks/check-noname_ttl === RUN TestAgent_AddService/service_manager/multiple_checks/service:svcid2:3_ttl === RUN TestAgent_AddService/service_manager/multiple_checks/service:svcid2:4_ttl === RUN TestAgent_AddService/normal/one_check === RUN TestAgent_AddService/normal/one_check/svcid1 === RUN TestAgent_AddService/normal/one_check/check1 === RUN TestAgent_AddService/normal/one_check/check1_ttl === RUN TestAgent_AddService/normal/multiple_checks === RUN TestAgent_AddService/normal/multiple_checks/svcid2 === RUN TestAgent_AddService/normal/multiple_checks/check1 === RUN TestAgent_AddService/normal/multiple_checks/check-noname === RUN TestAgent_AddService/normal/multiple_checks/service:svcid2:3 === RUN TestAgent_AddService/normal/multiple_checks/service:svcid2:4 === RUN TestAgent_AddService/normal/multiple_checks/service:svcid2:3_ttl === RUN TestAgent_AddService/normal/multiple_checks/service:svcid2:4_ttl === RUN TestAgent_AddService/normal/multiple_checks/check1_ttl === RUN TestAgent_AddService/normal/multiple_checks/check-noname_ttl 2021-10-05T16:30:06.552Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:06.581Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:06.692 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7029a7d0-54f5-ae23-6eb2-984d90679eaa Address:127.0.0.1:29874}]" 30:06.693 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:06.693 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:06.693Z [INFO] agent.router: Initializing LAN area manager 30:06.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29869 network=udp 30:06.693 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29874 [Follower]" leader= 30:06.694 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29874) (DC: dc1)" 30:06.694 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:06.694 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29869 network=tcp 30:06.694 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29870 network=tcp 30:06.694 [INFO] TestAgent: started state syncer 30:06.695 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29875 network=tcp 30:06.760 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:06.760 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29874 [Candidate]" term=2 30:06.812 [DEBUG] TestAgent.server.raft: votes: needed=1 30:06.812 [DEBUG] TestAgent.server.raft: vote granted: from=7029a7d0-54f5-ae23-6eb2-984d90679eaa term=2 tally=1 30:06.812 [INFO] TestAgent.server.raft: election won: tally=1 30:06.812 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29874 [Leader]" 30:06.816 [INFO] TestAgent.server: cluster leadership acquired 30:06.816 [INFO] TestAgent.server: New leader elected: payload=node1 30:06.829 [INFO] TestAgent: Requesting shutdown 30:06.829 [INFO] TestAgent.server: shutting down server 30:06.829 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:06.829 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:06.842 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29874 30:06.844 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:06.852Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:06.852Z [INFO] agent.router.manager: shutting down 30:06.860 [ERROR] TestAgent.server.autopilot: failed to initialize config: error="leadership lost while committing log" 30:06.860 [INFO] TestAgent: consul server down 30:06.860 [ERROR] TestAgent.server: failed to establish leadership: error="raft is already shutdown" 30:06.860 [INFO] TestAgent: shutdown complete 30:06.860 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29869 network=tcp 30:06.860 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29869 network=udp 30:06.860 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29870 network=tcp 30:07.360 [INFO] TestAgent: Waiting for endpoints to shut down 30:07.360 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:06.580Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:06.619Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:06.716 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:abb7e9e0-5fd7-88c1-61c4-c03bb7db4978 Address:127.0.0.1:29867}]" 30:06.717 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:06.717 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:06.717Z [INFO] agent.router: Initializing LAN area manager 30:06.717 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29862 network=udp 30:06.718 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29867 [Follower]" leader= 30:06.718 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29867) (DC: dc1)" 30:06.718 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:06.718 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29862 network=tcp 30:06.719 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29863 network=tcp 30:06.719 [INFO] TestAgent: started state syncer 30:06.719 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29868 network=tcp 30:06.788 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:06.788 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29867 [Candidate]" term=2 30:06.838 [DEBUG] TestAgent.server.raft: votes: needed=1 30:06.838 [DEBUG] TestAgent.server.raft: vote granted: from=abb7e9e0-5fd7-88c1-61c4-c03bb7db4978 term=2 tally=1 30:06.838 [INFO] TestAgent.server.raft: election won: tally=1 30:06.838 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29867 [Leader]" 30:06.838 [INFO] TestAgent.server: cluster leadership acquired 30:06.839 [INFO] TestAgent.server: New leader elected: payload=node1 30:06.864 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29867 30:06.883 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:06.944 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:06.944 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:06.944 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:06.944 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:06.944 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:06.944 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:06.944 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:06.980 [INFO] TestAgent.server: federation state anti-entropy synced 30:06.997 [INFO] TestAgent: Requesting shutdown 30:06.997 [INFO] TestAgent.server: shutting down server 30:06.997 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:06.997 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:06.997 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:06.997 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:06.997 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:06.997 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:06.997 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:06.997 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:06.997 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:06.997 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:06.997 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:07.012 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:07.020Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:07.020Z [INFO] agent.router.manager: shutting down 30:07.020 [INFO] TestAgent: consul server down 30:07.020 [INFO] TestAgent: shutdown complete 30:07.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29862 network=tcp 30:07.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29862 network=udp 30:07.020 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29863 network=tcp 30:07.524 [INFO] TestAgent: Waiting for endpoints to shut down 30:07.524 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddService (0.00s) --- PASS: TestAgent_AddService/service_manager (0.84s) --- PASS: TestAgent_AddService/service_manager/one_check (0.00s) --- PASS: TestAgent_AddService/service_manager/one_check/svcid1 (0.00s) --- PASS: TestAgent_AddService/service_manager/one_check/check1 (0.00s) --- PASS: TestAgent_AddService/service_manager/one_check/check1_ttl (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/svcid2 (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/service:svcid2:4 (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/check1 (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/check-noname (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/service:svcid2:3 (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/check1_ttl (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/check-noname_ttl (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/service:svcid2:3_ttl (0.00s) --- PASS: TestAgent_AddService/service_manager/multiple_checks/service:svcid2:4_ttl (0.00s) --- PASS: TestAgent_AddService/normal (1.00s) --- PASS: TestAgent_AddService/normal/one_check (0.00s) --- PASS: TestAgent_AddService/normal/one_check/svcid1 (0.00s) --- PASS: TestAgent_AddService/normal/one_check/check1 (0.00s) --- PASS: TestAgent_AddService/normal/one_check/check1_ttl (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/svcid2 (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/check1 (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/check-noname (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/service:svcid2:3 (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/service:svcid2:4 (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/service:svcid2:3_ttl (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/service:svcid2:4_ttl (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/check1_ttl (0.00s) --- PASS: TestAgent_AddService/normal/multiple_checks/check-noname_ttl (0.00s) === RUN TestAgent_AddServices_AliasUpdateCheckNotReverted === RUN TestAgent_AddServices_AliasUpdateCheckNotReverted/normal === PAUSE TestAgent_AddServices_AliasUpdateCheckNotReverted/normal === RUN TestAgent_AddServices_AliasUpdateCheckNotReverted/service_manager === PAUSE TestAgent_AddServices_AliasUpdateCheckNotReverted/service_manager === CONT TestAgent_AddServices_AliasUpdateCheckNotReverted/normal === CONT TestAgent_AddServices_AliasUpdateCheckNotReverted/service_manager 2021-10-05T16:30:07.552Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:07.583Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:07.621 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:248a36a3-447e-2aa6-42f7-d99cd0dcbcca Address:127.0.0.1:29888}]" 30:07.622 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:07.622 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:07.623Z [INFO] agent.router: Initializing LAN area manager 30:07.623 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29883 network=udp 30:07.623 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29888 [Follower]" leader= 30:07.623 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29888) (DC: dc1)" 30:07.623 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:07.623 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29883 network=tcp 30:07.624 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29884 network=tcp 30:07.624 [INFO] TestAgent: started state syncer 30:07.624 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29889 network=tcp 30:07.683 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:07.683 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29888 [Candidate]" term=2 30:07.720 [DEBUG] TestAgent.server.raft: votes: needed=1 30:07.720 [DEBUG] TestAgent.server.raft: vote granted: from=248a36a3-447e-2aa6-42f7-d99cd0dcbcca term=2 tally=1 30:07.720 [INFO] TestAgent.server.raft: election won: tally=1 30:07.720 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29888 [Leader]" 30:07.720 [INFO] TestAgent.server: cluster leadership acquired 30:07.720 [INFO] TestAgent.server: New leader elected: payload=node1 30:07.756 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29888 30:07.788 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:07.820 [INFO] TestAgent: Synced node info 30:07.820 [DEBUG] TestAgent: Node info in sync 30:07.876 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:07.876 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:07.876 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:07.876 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:07.876 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:07.876 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:07.876 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:07.908 [INFO] TestAgent.server: federation state anti-entropy synced 30:07.964 [INFO] TestAgent: Requesting shutdown 30:07.964 [INFO] TestAgent.server: shutting down server 30:07.964 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:07.964 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:07.964 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:07.964 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:07.964 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:07.964 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:07.964 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:07.964 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:07.964 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:07.964 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:07.973 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:07.975Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:07.975Z [INFO] agent.router.manager: shutting down 30:07.975 [INFO] TestAgent: consul server down 30:07.975 [INFO] TestAgent: shutdown complete 30:07.975 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29883 network=tcp 30:07.975 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29883 network=udp 30:07.975 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29884 network=tcp 30:08.476 [INFO] TestAgent: Waiting for endpoints to shut down 30:08.476 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:07.567Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:07.602Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:07.685 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3974ee9d-320d-b64e-2027-cdfc880b633a Address:127.0.0.1:29881}]" 30:07.686 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:07.686 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:07.686Z [INFO] agent.router: Initializing LAN area manager 30:07.687 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29876 network=udp 30:07.687 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29881 [Follower]" leader= 30:07.687 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29881) (DC: dc1)" 30:07.687 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:07.687 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29876 network=tcp 30:07.688 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29877 network=tcp 30:07.688 [INFO] TestAgent: started state syncer 30:07.688 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29882 network=tcp 30:07.756 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:07.756 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29881 [Candidate]" term=2 30:07.779 [DEBUG] TestAgent.server.raft: votes: needed=1 30:07.779 [DEBUG] TestAgent.server.raft: vote granted: from=3974ee9d-320d-b64e-2027-cdfc880b633a term=2 tally=1 30:07.779 [INFO] TestAgent.server.raft: election won: tally=1 30:07.779 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29881 [Leader]" 30:07.780 [INFO] TestAgent.server: cluster leadership acquired 30:07.780 [INFO] TestAgent.server: New leader elected: payload=node1 30:07.820 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29881 30:07.872 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:07.920 [INFO] TestAgent: Synced node info 30:07.935 [DEBUG] TestAgent: Node info in sync 30:07.935 [DEBUG] TestAgent: Node info in sync 30:07.937 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:07.937 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:07.937 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:07.937 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:07.937 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:07.937 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:07.937 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:07.970 [INFO] TestAgent.server: federation state anti-entropy synced 30:07.999 [DEBUG] TestAgent: Node info in sync 30:08.007 [INFO] TestAgent: Synced service: service=fake 30:08.017 [INFO] TestAgent: Synced service: service=web-1 30:08.036 [INFO] TestAgent: Synced service: service=web-3 30:08.060 [INFO] TestAgent: Synced service: service=web-4 30:08.076 [INFO] TestAgent: Synced service: service=web-5 30:08.096 [INFO] TestAgent: Synced service: service=web-2 30:08.112 [INFO] TestAgent: Synced service: service=web-6 30:08.124 [INFO] TestAgent: Synced service: service=web-7 30:08.140 [INFO] TestAgent: Synced service: service=web-8 30:08.152 [INFO] TestAgent: Synced service: service=web-9 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-1 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-4 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-5 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-7 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-8 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-9 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-2 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-3 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-6 30:08.152 [DEBUG] TestAgent: Node info in sync 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-3 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-4 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-5 30:08.152 [DEBUG] TestAgent: Service in sync: service=fake 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-1 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-7 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-8 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-9 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-2 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-6 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-2 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-3 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-6 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-8 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-9 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-1 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-4 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-5 30:08.152 [DEBUG] TestAgent: Check in sync: check=service:web-7 30:08.152 [DEBUG] TestAgent: Node info in sync 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-8 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-9 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-2 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-6 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-7 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-4 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-5 30:08.152 [DEBUG] TestAgent: Service in sync: service=fake 30:08.152 [DEBUG] TestAgent: Service in sync: service=web-1 30:08.153 [DEBUG] TestAgent: Service in sync: service=web-3 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-2 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-3 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-6 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-1 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-4 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-5 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-7 30:08.153 [DEBUG] TestAgent: Check in sync: check=service:web-8 30:08.168 [INFO] TestAgent: Synced check: check=service:web-9 30:08.168 [DEBUG] TestAgent: Node info in sync 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-1 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-3 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-4 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-5 30:08.168 [DEBUG] TestAgent: Service in sync: service=fake 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-6 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-7 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-8 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-9 30:08.168 [DEBUG] TestAgent: Service in sync: service=web-2 30:08.168 [DEBUG] TestAgent: Check in sync: check=service:web-9 30:08.168 [DEBUG] TestAgent: Check in sync: check=service:web-1 30:08.168 [DEBUG] TestAgent: Check in sync: check=service:web-4 30:08.168 [DEBUG] TestAgent: Check in sync: check=service:web-5 30:08.168 [DEBUG] TestAgent: Check in sync: check=service:web-7 30:08.181 [INFO] TestAgent: Synced check: check=service:web-8 30:08.181 [DEBUG] TestAgent: Check in sync: check=service:web-2 30:08.181 [DEBUG] TestAgent: Check in sync: check=service:web-3 30:08.181 [DEBUG] TestAgent: Check in sync: check=service:web-6 30:08.181 [DEBUG] TestAgent: Node info in sync 30:08.181 [DEBUG] TestAgent: Service in sync: service=fake 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-1 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-3 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-4 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-5 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-2 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-6 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-7 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-8 30:08.181 [DEBUG] TestAgent: Service in sync: service=web-9 30:08.181 [DEBUG] TestAgent: Check in sync: check=service:web-6 30:08.181 [DEBUG] TestAgent: Check in sync: check=service:web-2 30:08.184 [INFO] TestAgent: Synced check: check=service:web-3 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-5 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-7 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-8 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-9 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-1 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-4 30:08.184 [DEBUG] TestAgent: Node info in sync 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-2 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-6 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-7 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-8 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-9 30:08.184 [DEBUG] TestAgent: Service in sync: service=fake 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-1 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-3 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-4 30:08.184 [DEBUG] TestAgent: Service in sync: service=web-5 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-2 30:08.184 [DEBUG] TestAgent: Check in sync: check=service:web-3 30:08.190 [INFO] TestAgent: Synced check: check=service:web-6 30:08.190 [DEBUG] TestAgent: Check in sync: check=service:web-8 30:08.190 [DEBUG] TestAgent: Check in sync: check=service:web-9 30:08.190 [DEBUG] TestAgent: Check in sync: check=service:web-1 30:08.190 [DEBUG] TestAgent: Check in sync: check=service:web-4 30:08.190 [DEBUG] TestAgent: Check in sync: check=service:web-5 30:08.190 [DEBUG] TestAgent: Check in sync: check=service:web-7 30:08.190 [DEBUG] TestAgent: Node info in sync 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-2 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-6 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-7 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-8 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-9 30:08.190 [DEBUG] TestAgent: Service in sync: service=fake 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-1 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-3 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-4 30:08.190 [DEBUG] TestAgent: Service in sync: service=web-5 30:08.193 [INFO] TestAgent: Synced check: check=service:web-2 30:08.193 [DEBUG] TestAgent: Check in sync: check=service:web-3 30:08.193 [DEBUG] TestAgent: Check in sync: check=service:web-6 30:08.193 [DEBUG] TestAgent: Check in sync: check=service:web-9 30:08.212 [INFO] TestAgent: Synced check: check=service:web-1 30:08.222 [INFO] TestAgent: Synced check: check=service:web-4 30:08.244 [INFO] TestAgent: Synced check: check=service:web-5 30:08.248 [INFO] TestAgent: Synced check: check=service:web-7 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-8 30:08.248 [INFO] TestAgent: Requesting shutdown 30:08.248 [DEBUG] TestAgent: Node info in sync 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-4 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-5 30:08.248 [DEBUG] TestAgent: Service in sync: service=fake 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-1 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-3 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-8 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-9 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-2 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-6 30:08.248 [DEBUG] TestAgent: Service in sync: service=web-7 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-2 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-3 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-6 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-1 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-4 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-5 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-7 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-8 30:08.248 [DEBUG] TestAgent: Check in sync: check=service:web-9 30:08.248 [INFO] TestAgent.server: shutting down server 30:08.248 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:08.248 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:08.248 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:08.248 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:08.248 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:08.248 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:08.248 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:08.248 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:08.248 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:08.248 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:08.252 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:08.253Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:08.253Z [INFO] agent.router.manager: shutting down 30:08.253 [INFO] TestAgent: consul server down 30:08.253 [INFO] TestAgent: shutdown complete 30:08.253 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29876 network=tcp 30:08.253 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29876 network=udp 30:08.253 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29877 network=tcp 30:08.756 [INFO] TestAgent: Waiting for endpoints to shut down 30:08.756 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddServices_AliasUpdateCheckNotReverted (0.00s) --- PASS: TestAgent_AddServices_AliasUpdateCheckNotReverted/service_manager (0.95s) --- PASS: TestAgent_AddServices_AliasUpdateCheckNotReverted/normal (1.23s) === RUN TestAgent_CheckAliasRPC [DEBUG] Service Removed {serviceAlias-1074727158 {}} , err:= [DEBUG] Service Removed {serviceAlias-876082266 {}} , err:= [DEBUG] Service Removed {serviceAlias-1023457197 {}} , err:= [DEBUG] Service Removed {serviceAlias-1216434316 {}} , err:= [DEBUG] STARTING shutdown for TestAgent_CheckAliasRPC 2021-10-05 16:30:09.879966966 +0000 UTC m=+35.970061939 [DEBUG] DONE shutdown for TestAgent_CheckAliasRPC 2021-10-05 16:30:09.880021158 +0000 UTC m=+35.970116147 2021-10-05T16:30:08.778Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:08.816Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:08.857 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e6174c5d-cc28-2e2a-b094-8e232feffd50 Address:127.0.0.1:29895}]" 30:08.857 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:08.858 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:08.858Z [INFO] agent.router: Initializing LAN area manager 30:08.858 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29890 network=udp 30:08.858 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29895 [Follower]" leader= 30:08.859 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29895) (DC: dc1)" 30:08.859 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:08.859 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29890 network=tcp 30:08.860 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29891 network=tcp 30:08.860 [INFO] TestAgent: started state syncer 30:08.860 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29896 network=tcp 30:08.916 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:08.916 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29895 [Candidate]" term=2 30:08.964 [DEBUG] TestAgent.server.raft: votes: needed=1 30:08.964 [DEBUG] TestAgent.server.raft: vote granted: from=e6174c5d-cc28-2e2a-b094-8e232feffd50 term=2 tally=1 30:08.964 [INFO] TestAgent.server.raft: election won: tally=1 30:08.964 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29895 [Leader]" 30:08.964 [INFO] TestAgent.server: cluster leadership acquired 30:08.964 [INFO] TestAgent.server: New leader elected: payload=node1 30:08.996 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29895 30:09.052 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:09.116 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:09.116 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:09.116 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:09.116 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:09.116 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:09.116 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:09.116 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:09.144 [INFO] TestAgent.server: federation state anti-entropy synced 30:09.176 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:09.192 [INFO] TestAgent: Synced node info 30:09.192 [DEBUG] TestAgent: Node info in sync 30:09.752 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:09.752 [DEBUG] TestAgent: Node info in sync 30:09.768 [INFO] TestAgent: Synced service: service=svcid1 30:09.768 [DEBUG] TestAgent: Node info in sync 30:09.768 [DEBUG] TestAgent: Service in sync: service=svcid1 30:09.776 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.776467678 +0000 UTC m=+35.866563199" 30:09.776 [DEBUG] TestAgent: Node info in sync 30:09.796 [INFO] TestAgent: Synced service: service=serviceAlias-1074727158 30:09.816 [INFO] TestAgent: Synced service: service=serviceAlias-876082266 30:09.825 [INFO] TestAgent: Synced service: service=serviceAlias-1023457197 30:09.833 [INFO] TestAgent: Synced service: service=serviceAlias-1216434316 30:09.852 [INFO] TestAgent: Synced service: service=svcid1 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-1074727158 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-876082266 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-1023457197 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-1216434316 30:09.852 [DEBUG] TestAgent: Node info in sync 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-1074727158 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-876082266 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-1023457197 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-1216434316 30:09.852 [DEBUG] TestAgent: Service in sync: service=svcid1 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-1074727158 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-876082266 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-1023457197 30:09.852 [DEBUG] TestAgent: Check in sync: check=check-1216434316 30:09.852 [DEBUG] TestAgent: Node info in sync 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-1216434316 30:09.852 [DEBUG] TestAgent: Service in sync: service=svcid1 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-1074727158 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-876082266 30:09.852 [DEBUG] TestAgent: Service in sync: service=serviceAlias-1023457197 30:09.879 [INFO] TestAgent: Synced check: check=check-1023457197 30:09.879 [DEBUG] TestAgent: Check in sync: check=check-1216434316 30:09.879 [DEBUG] TestAgent: Check in sync: check=check-1074727158 30:09.879 [DEBUG] TestAgent: Check in sync: check=check-876082266 30:09.879 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.87838237 +0000 UTC m=+35.968477353" 30:09.879 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.879540462 +0000 UTC m=+35.969635409" 30:09.879 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.8796756 +0000 UTC m=+35.969770519" 30:09.879 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.87977563 +0000 UTC m=+35.969870550" 30:09.879 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.879852832 +0000 UTC m=+35.969947785" 30:09.879 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.879931383 +0000 UTC m=+35.970026339" 30:09.880 [DEBUG] TestAgent: Service tag will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: tag="tag-2021-10-05 16:30:09.879988381 +0000 UTC m=+35.970083364" --- PASS: TestAgent_CheckAliasRPC (1.12s) === RUN TestAgent_AddServiceNoExec === RUN TestAgent_AddServiceNoExec/normal === PAUSE TestAgent_AddServiceNoExec/normal === RUN TestAgent_AddServiceNoExec/service_manager === PAUSE TestAgent_AddServiceNoExec/service_manager === CONT TestAgent_AddServiceNoExec/normal === CONT TestAgent_AddServiceNoExec/service_manager [WARN] freeport: 6 out of 7 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:09.908Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:09.923Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:09.990 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:324e9673-9f68-4ae6-9334-6c8d8e624a40 Address:127.0.0.1:29909}]" 30:09.991 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:09.991 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29909 [Follower]" leader= 30:09.992 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:09.992Z [INFO] agent.router: Initializing LAN area manager 30:09.992 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29904 network=udp 30:09.992 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29909) (DC: dc1)" 30:09.992 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:09.992 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29904 network=tcp 30:09.993 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29905 network=tcp 30:09.993 [INFO] TestAgent: started state syncer 30:09.993 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29910 network=tcp 30:10.056 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.056 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29909 [Candidate]" term=2 30:10.090 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.090 [DEBUG] TestAgent.server.raft: vote granted: from=324e9673-9f68-4ae6-9334-6c8d8e624a40 term=2 tally=1 30:10.090 [INFO] TestAgent.server.raft: election won: tally=1 30:10.090 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29909 [Leader]" 30:10.090 [INFO] TestAgent.server: cluster leadership acquired 30:10.090 [INFO] TestAgent.server: New leader elected: payload=node1 30:10.120 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29909 30:10.192 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.264 [INFO] TestAgent: Synced node info 30:10.283 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.283 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.283 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.283 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.283 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.283 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:10.283 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:10.302 [INFO] TestAgent.server: federation state anti-entropy synced 30:10.314 [INFO] TestAgent: Requesting shutdown 30:10.314 [INFO] TestAgent.server: shutting down server 30:10.314 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:10.314 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:10.314 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:10.314 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:10.314 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:10.314 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:10.314 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:10.314 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:10.314 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:10.314 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:10.337 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:10.339Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:10.339Z [INFO] agent.router.manager: shutting down 30:10.339 [INFO] TestAgent: consul server down 30:10.339 [INFO] TestAgent: shutdown complete 30:10.339 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29904 network=tcp 30:10.339 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29904 network=udp 30:10.339 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29905 network=tcp 30:10.840 [INFO] TestAgent: Waiting for endpoints to shut down 30:10.840 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:09.904Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:09.926Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:10.004 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ef2a0237-634b-d652-c984-a27822cc80a1 Address:127.0.0.1:29902}]" 30:10.005 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:10.005 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:10.005Z [INFO] agent.router: Initializing LAN area manager 30:10.005 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29902 [Follower]" leader= 30:10.006 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29902) (DC: dc1)" 30:10.006 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29897 network=udp 30:10.006 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:10.006 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29897 network=tcp 30:10.006 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29898 network=tcp 30:10.007 [INFO] TestAgent: started state syncer 30:10.007 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29903 network=tcp 30:10.057 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.057 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29902 [Candidate]" term=2 30:10.077 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.077 [DEBUG] TestAgent.server.raft: vote granted: from=ef2a0237-634b-d652-c984-a27822cc80a1 term=2 tally=1 30:10.077 [INFO] TestAgent.server.raft: election won: tally=1 30:10.077 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29902 [Leader]" 30:10.078 [INFO] TestAgent.server: cluster leadership acquired 30:10.078 [INFO] TestAgent.server: New leader elected: payload=node1 30:10.083 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29902 30:10.155 [INFO] TestAgent: Synced node info 30:10.155 [DEBUG] TestAgent: Node info in sync 30:10.155 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.249 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.249 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.249 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.249 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.249 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.249 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:10.249 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:10.287 [INFO] TestAgent.server: federation state anti-entropy synced 30:10.421 [INFO] TestAgent: Requesting shutdown 30:10.421 [INFO] TestAgent.server: shutting down server 30:10.421 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:10.421 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:10.421 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:10.421 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:10.421 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:10.422 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:10.422 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:10.422 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:10.422 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:10.422 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:10.433 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:10.434Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:10.434Z [INFO] agent.router.manager: shutting down 30:10.434 [INFO] TestAgent: consul server down 30:10.434 [INFO] TestAgent: shutdown complete 30:10.434 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29897 network=tcp 30:10.434 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29897 network=udp 30:10.434 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29898 network=tcp 30:10.935 [INFO] TestAgent: Waiting for endpoints to shut down 30:10.935 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddServiceNoExec (0.00s) --- PASS: TestAgent_AddServiceNoExec/service_manager (0.96s) --- PASS: TestAgent_AddServiceNoExec/normal (1.06s) === RUN TestAgent_AddServiceNoRemoteExec === RUN TestAgent_AddServiceNoRemoteExec/normal === PAUSE TestAgent_AddServiceNoRemoteExec/normal === RUN TestAgent_AddServiceNoRemoteExec/service_manager === PAUSE TestAgent_AddServiceNoRemoteExec/service_manager === CONT TestAgent_AddServiceNoRemoteExec/normal === CONT TestAgent_AddServiceNoRemoteExec/service_manager [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:11.024Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:11.064Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:11.138 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c199d582-3ead-5635-294d-6a02e78f26b5 Address:127.0.0.1:29916}]" 30:11.138 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:11.139 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:11.139Z [INFO] agent.router: Initializing LAN area manager 30:11.139 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29911 network=udp 30:11.139 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29916 [Follower]" leader= 30:11.140 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29916) (DC: dc1)" 30:11.140 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:11.140 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29911 network=tcp 30:11.141 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29912 network=tcp 30:11.141 [INFO] TestAgent: started state syncer 30:11.141 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29917 network=tcp 30:11.204 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:11.204 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29916 [Candidate]" term=2 30:11.235 [DEBUG] TestAgent.server.raft: votes: needed=1 30:11.235 [DEBUG] TestAgent.server.raft: vote granted: from=c199d582-3ead-5635-294d-6a02e78f26b5 term=2 tally=1 30:11.235 [INFO] TestAgent.server.raft: election won: tally=1 30:11.235 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29916 [Leader]" 30:11.235 [INFO] TestAgent.server: cluster leadership acquired 30:11.235 [INFO] TestAgent.server: New leader elected: payload=node1 30:11.252 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29916 30:11.280 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:11.325 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:11.325 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:11.325 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:11.325 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:11.325 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:11.326 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:11.326 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:11.348 [INFO] TestAgent.server: federation state anti-entropy synced 30:11.364 [INFO] TestAgent: Requesting shutdown 30:11.364 [INFO] TestAgent.server: shutting down server 30:11.364 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:11.364 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:11.364 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:11.364 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:11.364 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:11.364 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:11.364 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:11.364 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:11.364 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:11.364 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:11.364 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:11.376 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:11.380Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:11.380Z [INFO] agent.router.manager: shutting down 30:11.380 [INFO] TestAgent: consul server down 30:11.380 [INFO] TestAgent: shutdown complete 30:11.380 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29911 network=tcp 30:11.380 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29911 network=udp 30:11.380 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29912 network=tcp 30:11.880 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.880 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:10.995Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:11.029Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:11.086 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bebfe1c6-b14c-3eb9-ae3d-f77ad8880164 Address:127.0.0.1:29923}]" 30:11.086 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29923 [Follower]" leader= 30:11.088 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:11.089 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:11.089Z [INFO] agent.router: Initializing LAN area manager 30:11.089 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29923) (DC: dc1)" 30:11.089 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:11.090 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29918 network=tcp 30:11.090 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29918 network=udp 30:11.091 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29919 network=tcp 30:11.091 [INFO] TestAgent: started state syncer 30:11.091 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29924 network=tcp 30:11.156 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:11.156 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29923 [Candidate]" term=2 30:11.204 [DEBUG] TestAgent.server.raft: votes: needed=1 30:11.204 [DEBUG] TestAgent.server.raft: vote granted: from=bebfe1c6-b14c-3eb9-ae3d-f77ad8880164 term=2 tally=1 30:11.204 [INFO] TestAgent.server.raft: election won: tally=1 30:11.204 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29923 [Leader]" 30:11.205 [INFO] TestAgent.server: cluster leadership acquired 30:11.205 [INFO] TestAgent.server: New leader elected: payload=node1 30:11.231 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29923 30:11.260 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:11.330 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:11.330 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:11.330 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:11.330 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:11.330 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:11.330 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:11.330 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:11.330 [INFO] TestAgent: Synced node info 30:11.330 [DEBUG] TestAgent: Node info in sync 30:11.356 [INFO] TestAgent: Requesting shutdown 30:11.356 [INFO] TestAgent.server: shutting down server 30:11.356 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:11.356 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:11.356 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:11.356 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:11.356 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:11.356 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:11.356 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:11.356 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:11.364 [INFO] TestAgent.server: federation state anti-entropy synced 30:11.364 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:11.384 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:11.392Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:11.392Z [INFO] agent.router.manager: shutting down 30:11.393 [INFO] TestAgent: consul server down 30:11.393 [INFO] TestAgent: shutdown complete 30:11.393 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29918 network=tcp 30:11.393 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29918 network=udp 30:11.393 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29919 network=tcp 30:11.896 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.896 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddServiceNoRemoteExec (0.00s) --- PASS: TestAgent_AddServiceNoRemoteExec/normal (0.94s) --- PASS: TestAgent_AddServiceNoRemoteExec/service_manager (0.95s) === RUN TestCacheRateLimit agent_test.go:749: DM-skipped --- SKIP: TestCacheRateLimit (0.00s) === RUN TestAddServiceIPv4TaggedDefault [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:11.925Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:11.955Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:12.048 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5b8e794a-d36f-9e9e-a9a1-a425fc78281d Address:127.0.0.1:29930}]" 30:12.048 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29930 [Follower]" leader= 30:12.049 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5b8e794a-d36f-9e9e-a9a1-a425fc78281d.dc1 127.0.0.1 30:12.049 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5b8e794a-d36f-9e9e-a9a1-a425fc78281d 127.0.0.1 2021-10-05T16:30:12.049Z [INFO] agent.router: Initializing LAN area manager 30:12.049 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29925 network=udp 30:12.050 [INFO] TestAgent.server: Adding LAN server: server="Node-5b8e794a-d36f-9e9e-a9a1-a425fc78281d (Addr: tcp/127.0.0.1:29930) (DC: dc1)" 30:12.050 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5b8e794a-d36f-9e9e-a9a1-a425fc78281d.dc1 area=wan 30:12.050 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29925 network=tcp 30:12.050 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29926 network=tcp 30:12.050 [INFO] TestAgent: started state syncer 30:12.050 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29931 network=tcp 30:12.090 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:12.090 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29930 [Candidate]" term=2 30:12.129 [DEBUG] TestAgent.server.raft: votes: needed=1 30:12.129 [DEBUG] TestAgent.server.raft: vote granted: from=5b8e794a-d36f-9e9e-a9a1-a425fc78281d term=2 tally=1 30:12.129 [INFO] TestAgent.server.raft: election won: tally=1 30:12.129 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29930 [Leader]" 30:12.129 [INFO] TestAgent.server: cluster leadership acquired 30:12.129 [INFO] TestAgent.server: New leader elected: payload=Node-5b8e794a-d36f-9e9e-a9a1-a425fc78281d 30:12.136 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29930 30:12.164 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:12.192 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:12.192 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:12.192 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:12.192 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:12.192 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:12.192 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5b8e794a-d36f-9e9e-a9a1-a425fc78281d 30:12.192 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5b8e794a-d36f-9e9e-a9a1-a425fc78281d 30:12.213 [INFO] TestAgent.server: federation state anti-entropy synced 30:12.232 [WARN] TestAgent: Service name will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: service=my_service 30:12.232 [INFO] TestAgent: Requesting shutdown 30:12.232 [INFO] TestAgent.server: shutting down server 30:12.232 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:12.232 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:12.232 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:12.232 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:12.232 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:12.232 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:12.232 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:12.232 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:12.232 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:12.232 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:12.232 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:12.237 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:12.243Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:12.243Z [INFO] agent.router.manager: shutting down 30:12.243 [INFO] TestAgent: consul server down 30:12.243 [INFO] TestAgent: shutdown complete 30:12.243 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29925 network=tcp 30:12.243 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29925 network=udp 30:12.243 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29926 network=tcp 30:12.744 [INFO] TestAgent: Waiting for endpoints to shut down 30:12.744 [INFO] TestAgent: Endpoints down --- PASS: TestAddServiceIPv4TaggedDefault (0.85s) === RUN TestAddServiceIPv6TaggedDefault [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:12.771Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:12.822Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:12.908 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0 Address:127.0.0.1:29937}]" 30:12.909 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0.dc1 127.0.0.1 30:12.909 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0 127.0.0.1 2021-10-05T16:30:12.909Z [INFO] agent.router: Initializing LAN area manager 30:12.909 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29932 network=udp 30:12.909 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29937 [Follower]" leader= 30:12.910 [INFO] TestAgent.server: Adding LAN server: server="Node-c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0 (Addr: tcp/127.0.0.1:29937) (DC: dc1)" 30:12.910 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0.dc1 area=wan 30:12.910 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29932 network=tcp 30:12.911 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29933 network=tcp 30:12.911 [INFO] TestAgent: started state syncer 30:12.911 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29938 network=tcp 30:12.948 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:12.948 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29937 [Candidate]" term=2 30:12.996 [DEBUG] TestAgent.server.raft: votes: needed=1 30:12.996 [DEBUG] TestAgent.server.raft: vote granted: from=c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0 term=2 tally=1 30:12.996 [INFO] TestAgent.server.raft: election won: tally=1 30:12.996 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29937 [Leader]" 30:12.996 [INFO] TestAgent.server: cluster leadership acquired 30:12.996 [INFO] TestAgent.server: New leader elected: payload=Node-c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0 30:13.016 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29937 30:13.040 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:13.067 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:13.067 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:13.067 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:13.067 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:13.067 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:13.067 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0 30:13.067 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c7e7e7e0-92a9-52d5-a5ce-a1d5368755a0 30:13.098 [INFO] TestAgent.server: federation state anti-entropy synced 30:13.192 [WARN] TestAgent: Service name will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: service=my_service 30:13.192 [INFO] TestAgent: Requesting shutdown 30:13.192 [INFO] TestAgent.server: shutting down server 30:13.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:13.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:13.192 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:13.192 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:13.192 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:13.192 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:13.192 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:13.192 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:13.192 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:13.192 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:13.192 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:13.205 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:13.224Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:13.224Z [INFO] agent.router.manager: shutting down 30:13.224 [INFO] TestAgent: consul server down 30:13.224 [INFO] TestAgent: shutdown complete 30:13.224 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29932 network=tcp 30:13.224 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29932 network=udp 30:13.224 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29933 network=tcp 30:13.724 [INFO] TestAgent: Waiting for endpoints to shut down 30:13.724 [INFO] TestAgent: Endpoints down --- PASS: TestAddServiceIPv6TaggedDefault (0.98s) === RUN TestAddServiceIPv4TaggedSet [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:13.737Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:13.748Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:13.796 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4d2d7251-5b2f-46f7-1d35-67ab7e46ada8 Address:127.0.0.1:29944}]" 30:13.797 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4d2d7251-5b2f-46f7-1d35-67ab7e46ada8.dc1 127.0.0.1 30:13.797 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4d2d7251-5b2f-46f7-1d35-67ab7e46ada8 127.0.0.1 2021-10-05T16:30:13.797Z [INFO] agent.router: Initializing LAN area manager 30:13.798 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29939 network=udp 30:13.798 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29944 [Follower]" leader= 30:13.798 [INFO] TestAgent.server: Adding LAN server: server="Node-4d2d7251-5b2f-46f7-1d35-67ab7e46ada8 (Addr: tcp/127.0.0.1:29944) (DC: dc1)" 30:13.798 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4d2d7251-5b2f-46f7-1d35-67ab7e46ada8.dc1 area=wan 30:13.798 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29939 network=tcp 30:13.799 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29940 network=tcp 30:13.799 [INFO] TestAgent: started state syncer 30:13.799 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29945 network=tcp 30:13.857 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:13.857 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29944 [Candidate]" term=2 30:13.868 [DEBUG] TestAgent.server.raft: votes: needed=1 30:13.868 [DEBUG] TestAgent.server.raft: vote granted: from=4d2d7251-5b2f-46f7-1d35-67ab7e46ada8 term=2 tally=1 30:13.868 [INFO] TestAgent.server.raft: election won: tally=1 30:13.868 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29944 [Leader]" 30:13.872 [INFO] TestAgent.server: cluster leadership acquired 30:13.872 [INFO] TestAgent.server: New leader elected: payload=Node-4d2d7251-5b2f-46f7-1d35-67ab7e46ada8 30:13.876 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29944 30:13.908 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:13.961 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:13.962 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:13.962 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:13.962 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:13.962 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:13.962 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4d2d7251-5b2f-46f7-1d35-67ab7e46ada8 30:13.962 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4d2d7251-5b2f-46f7-1d35-67ab7e46ada8 30:13.984 [INFO] TestAgent.server: federation state anti-entropy synced 30:13.988 [WARN] TestAgent: Service name will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: service=my_service 30:13.988 [INFO] TestAgent: Requesting shutdown 30:13.988 [INFO] TestAgent.server: shutting down server 30:13.988 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:13.988 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:13.988 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:13.988 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:13.988 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:13.988 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:13.988 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:13.988 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:13.988 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:13.988 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:13.988 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:13.995 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:14.002Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:14.002Z [INFO] agent.router.manager: shutting down 30:14.002 [INFO] TestAgent: consul server down 30:14.002 [INFO] TestAgent: shutdown complete 30:14.002 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29939 network=tcp 30:14.002 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29939 network=udp 30:14.002 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29940 network=tcp 30:14.502 [INFO] TestAgent: Waiting for endpoints to shut down 30:14.502 [INFO] TestAgent: Endpoints down --- PASS: TestAddServiceIPv4TaggedSet (0.78s) === RUN TestAddServiceIPv6TaggedSet [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:14.528Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:14.565Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:14.600 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2fe7f7bf-5557-49be-ea1f-f899620817a7 Address:127.0.0.1:29951}]" 30:14.601 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2fe7f7bf-5557-49be-ea1f-f899620817a7.dc1 127.0.0.1 30:14.602 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2fe7f7bf-5557-49be-ea1f-f899620817a7 127.0.0.1 2021-10-05T16:30:14.602Z [INFO] agent.router: Initializing LAN area manager 30:14.602 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29946 network=udp 30:14.602 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29951 [Follower]" leader= 30:14.602 [INFO] TestAgent.server: Adding LAN server: server="Node-2fe7f7bf-5557-49be-ea1f-f899620817a7 (Addr: tcp/127.0.0.1:29951) (DC: dc1)" 30:14.602 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2fe7f7bf-5557-49be-ea1f-f899620817a7.dc1 area=wan 30:14.603 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29946 network=tcp 30:14.603 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29947 network=tcp 30:14.603 [INFO] TestAgent: started state syncer 30:14.603 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29952 network=tcp 30:14.660 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:14.660 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29951 [Candidate]" term=2 30:14.677 [DEBUG] TestAgent.server.raft: votes: needed=1 30:14.677 [DEBUG] TestAgent.server.raft: vote granted: from=2fe7f7bf-5557-49be-ea1f-f899620817a7 term=2 tally=1 30:14.677 [INFO] TestAgent.server.raft: election won: tally=1 30:14.677 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29951 [Leader]" 30:14.677 [INFO] TestAgent.server: cluster leadership acquired 30:14.677 [INFO] TestAgent.server: New leader elected: payload=Node-2fe7f7bf-5557-49be-ea1f-f899620817a7 30:14.700 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29951 30:14.748 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:14.806 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:14.806 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:14.806 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:14.806 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:14.806 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:14.806 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2fe7f7bf-5557-49be-ea1f-f899620817a7 30:14.806 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2fe7f7bf-5557-49be-ea1f-f899620817a7 30:14.823 [INFO] TestAgent.server: federation state anti-entropy synced 30:14.844 [WARN] TestAgent: Service name will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.: service=my_service 30:14.844 [INFO] TestAgent: Requesting shutdown 30:14.844 [INFO] TestAgent.server: shutting down server 30:14.844 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:14.844 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:14.844 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:14.844 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:14.844 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:14.844 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:14.844 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:14.844 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:14.844 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:14.844 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:14.844 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:14.856 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:14.859Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:14.859Z [INFO] agent.router.manager: shutting down 30:14.859 [INFO] TestAgent: consul server down 30:14.859 [INFO] TestAgent: shutdown complete 30:14.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29946 network=tcp 30:14.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29946 network=udp 30:14.860 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29947 network=tcp 30:15.360 [INFO] TestAgent: Waiting for endpoints to shut down 30:15.360 [INFO] TestAgent: Endpoints down --- PASS: TestAddServiceIPv6TaggedSet (0.86s) === RUN TestAgent_RemoveService === RUN TestAgent_RemoveService/normal === PAUSE TestAgent_RemoveService/normal === RUN TestAgent_RemoveService/service_manager === PAUSE TestAgent_RemoveService/service_manager === CONT TestAgent_RemoveService/normal === CONT TestAgent_RemoveService/service_manager [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:15.405Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:15.447Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:15.497 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:462625e0-a520-f2cc-79bc-ead1bee61e07 Address:127.0.0.1:29965}]" 30:15.498 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-462625e0-a520-f2cc-79bc-ead1bee61e07.dc1 127.0.0.1 30:15.498 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-462625e0-a520-f2cc-79bc-ead1bee61e07 127.0.0.1 2021-10-05T16:30:15.498Z [INFO] agent.router: Initializing LAN area manager 30:15.499 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29960 network=udp 30:15.499 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29965 [Follower]" leader= 30:15.499 [INFO] TestAgent.server: Adding LAN server: server="Node-462625e0-a520-f2cc-79bc-ead1bee61e07 (Addr: tcp/127.0.0.1:29965) (DC: dc1)" 30:15.499 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-462625e0-a520-f2cc-79bc-ead1bee61e07.dc1 area=wan 30:15.499 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29960 network=tcp 30:15.500 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29961 network=tcp 30:15.500 [INFO] TestAgent: started state syncer 30:15.500 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29966 network=tcp 30:15.562 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:15.562 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29965 [Candidate]" term=2 30:15.574 [DEBUG] TestAgent.server.raft: votes: needed=1 30:15.574 [DEBUG] TestAgent.server.raft: vote granted: from=462625e0-a520-f2cc-79bc-ead1bee61e07 term=2 tally=1 30:15.574 [INFO] TestAgent.server.raft: election won: tally=1 30:15.574 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29965 [Leader]" 30:15.574 [INFO] TestAgent.server: cluster leadership acquired 30:15.574 [INFO] TestAgent.server: New leader elected: payload=Node-462625e0-a520-f2cc-79bc-ead1bee61e07 30:15.582 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29965 30:15.600 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:15.635 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:15.635 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:15.635 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:15.635 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:15.635 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:15.635 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-462625e0-a520-f2cc-79bc-ead1bee61e07 30:15.635 [INFO] TestAgent.server: member joined, marking health alive: member=Node-462625e0-a520-f2cc-79bc-ead1bee61e07 30:15.660 [INFO] TestAgent.server: federation state anti-entropy synced 30:15.863 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:15.868 [INFO] TestAgent: Synced node info 30:15.868 [DEBUG] TestAgent: Node info in sync 30:15.871 [WARN] TestAgent: Failed to deregister service: service=redis error="Service {"redis" {}} does not exist" 30:15.872 [DEBUG] TestAgent: removed check: check=service:memcache 30:15.872 [DEBUG] TestAgent: removed check: check=check2 30:15.872 [DEBUG] TestAgent: removed service: service=memcache 30:15.872 [DEBUG] TestAgent: removed check: check=service:redis:1 30:15.872 [DEBUG] TestAgent: removed check: check=service:redis:2 30:15.872 [DEBUG] TestAgent: removed service: service=redis 30:15.872 [INFO] TestAgent: Requesting shutdown 30:15.872 [INFO] TestAgent.server: shutting down server 30:15.872 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:15.872 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:15.872 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:15.872 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:15.872 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:15.872 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:15.872 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:15.872 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:15.872 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:15.872 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:15.878 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:15.883Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:15.883Z [INFO] agent.router.manager: shutting down 30:15.883 [INFO] TestAgent: consul server down 30:15.883 [INFO] TestAgent: shutdown complete 30:15.883 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29960 network=tcp 30:15.883 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29960 network=udp 30:15.883 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29961 network=tcp 30:16.384 [INFO] TestAgent: Waiting for endpoints to shut down 30:16.384 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:15.373Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:15.416Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:15.481 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b1d61526-2e55-a394-6052-352da60921ec Address:127.0.0.1:29958}]" 30:15.482 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b1d61526-2e55-a394-6052-352da60921ec.dc1 127.0.0.1 30:15.482 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b1d61526-2e55-a394-6052-352da60921ec 127.0.0.1 2021-10-05T16:30:15.482Z [INFO] agent.router: Initializing LAN area manager 30:15.483 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29953 network=udp 30:15.483 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29958 [Follower]" leader= 30:15.483 [INFO] TestAgent.server: Adding LAN server: server="Node-b1d61526-2e55-a394-6052-352da60921ec (Addr: tcp/127.0.0.1:29958) (DC: dc1)" 30:15.483 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b1d61526-2e55-a394-6052-352da60921ec.dc1 area=wan 30:15.483 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29953 network=tcp 30:15.484 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29954 network=tcp 30:15.484 [INFO] TestAgent: started state syncer 30:15.484 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29959 network=tcp 30:15.552 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:15.552 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29958 [Candidate]" term=2 30:15.575 [DEBUG] TestAgent.server.raft: votes: needed=1 30:15.575 [DEBUG] TestAgent.server.raft: vote granted: from=b1d61526-2e55-a394-6052-352da60921ec term=2 tally=1 30:15.575 [INFO] TestAgent.server.raft: election won: tally=1 30:15.575 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29958 [Leader]" 30:15.575 [INFO] TestAgent.server: cluster leadership acquired 30:15.575 [INFO] TestAgent.server: New leader elected: payload=Node-b1d61526-2e55-a394-6052-352da60921ec 30:15.583 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29958 30:15.612 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:15.638 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:15.638 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:15.638 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:15.638 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:15.638 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:15.638 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b1d61526-2e55-a394-6052-352da60921ec 30:15.638 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b1d61526-2e55-a394-6052-352da60921ec 30:15.676 [INFO] TestAgent.server: federation state anti-entropy synced 30:15.860 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:15.865 [INFO] TestAgent: Synced node info 30:15.907 [WARN] TestAgent: Failed to deregister service: service=redis error="Service {"redis" {}} does not exist" 30:15.908 [DEBUG] TestAgent: removed check: check=check2 30:15.908 [DEBUG] TestAgent: removed check: check=service:memcache 30:15.908 [DEBUG] TestAgent: removed service: service=memcache 30:15.908 [DEBUG] TestAgent: removed check: check=service:redis:1 30:15.908 [DEBUG] TestAgent: removed check: check=service:redis:2 30:15.908 [DEBUG] TestAgent: removed service: service=redis 30:15.908 [INFO] TestAgent: Requesting shutdown 30:15.908 [INFO] TestAgent.server: shutting down server 30:15.908 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:15.908 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:15.908 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:15.908 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:15.908 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:15.908 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:15.908 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:15.908 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:15.908 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:15.908 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:15.915 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:15.920Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:15.920Z [INFO] agent.router.manager: shutting down 30:15.920 [INFO] TestAgent: consul server down 30:15.920 [INFO] TestAgent: shutdown complete 30:15.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29953 network=tcp 30:15.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29953 network=udp 30:15.920 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29954 network=tcp 30:16.424 [INFO] TestAgent: Waiting for endpoints to shut down 30:16.424 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RemoveService (0.00s) --- PASS: TestAgent_RemoveService/service_manager (1.02s) --- PASS: TestAgent_RemoveService/normal (1.06s) === RUN TestAgent_RemoveServiceRemovesAllChecks === RUN TestAgent_RemoveServiceRemovesAllChecks/normal === PAUSE TestAgent_RemoveServiceRemovesAllChecks/normal === RUN TestAgent_RemoveServiceRemovesAllChecks/service_manager === PAUSE TestAgent_RemoveServiceRemovesAllChecks/service_manager === CONT TestAgent_RemoveServiceRemovesAllChecks/normal === CONT TestAgent_RemoveServiceRemovesAllChecks/service_manager [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:16.458Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:16.472Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:16.518 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:baff1461-a458-f6f4-025e-02293d017b05 Address:127.0.0.1:29972}]" 30:16.519 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:16.519 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29972 [Follower]" leader= 30:16.519 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:16.519Z [INFO] agent.router: Initializing LAN area manager 30:16.520 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29967 network=udp 30:16.520 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29972) (DC: dc1)" 30:16.520 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:16.520 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29967 network=tcp 30:16.520 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29968 network=tcp 30:16.521 [INFO] TestAgent: started state syncer 30:16.521 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29973 network=tcp 30:16.570 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:16.570 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29972 [Candidate]" term=2 30:16.616 [DEBUG] TestAgent.server.raft: votes: needed=1 30:16.616 [DEBUG] TestAgent.server.raft: vote granted: from=baff1461-a458-f6f4-025e-02293d017b05 term=2 tally=1 30:16.616 [INFO] TestAgent.server.raft: election won: tally=1 30:16.616 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29972 [Leader]" 30:16.616 [INFO] TestAgent.server: cluster leadership acquired 30:16.616 [INFO] TestAgent.server: New leader elected: payload=node1 30:16.638 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29972 30:16.674 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:16.684 [DEBUG] TestAgent: removed check: check=chk1 30:16.684 [DEBUG] TestAgent: removed check: check=chk2 30:16.684 [DEBUG] TestAgent: removed service: service=redis 30:16.684 [INFO] TestAgent: Requesting shutdown 30:16.684 [INFO] TestAgent.server: shutting down server 30:16.684 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:16.684 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:16.692 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:16.700Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:16.700Z [INFO] agent.router.manager: shutting down 30:16.704 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 30:16.704 [INFO] TestAgent: consul server down 30:16.704 [INFO] TestAgent: shutdown complete 30:16.704 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29967 network=tcp 30:16.704 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29967 network=udp 30:16.704 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29968 network=tcp 30:17.208 [INFO] TestAgent: Waiting for endpoints to shut down 30:17.208 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:16.454Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:16.487Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:16.576 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:aba7d5e0-b2f7-01a7-d002-a2272faf2735 Address:127.0.0.1:29979}]" 30:16.576 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29979 [Follower]" leader= 30:16.577 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: node1.dc1 127.0.0.1 30:16.577 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: node1 127.0.0.1 2021-10-05T16:30:16.577Z [INFO] agent.router: Initializing LAN area manager 30:16.577 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29974 network=udp 30:16.577 [INFO] TestAgent.server: Adding LAN server: server="node1 (Addr: tcp/127.0.0.1:29979) (DC: dc1)" 30:16.577 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29974 network=tcp 30:16.578 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=node1.dc1 area=wan 30:16.578 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29975 network=tcp 30:16.578 [INFO] TestAgent: started state syncer 30:16.578 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29980 network=tcp 30:16.626 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:16.626 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29979 [Candidate]" term=2 30:16.637 [DEBUG] TestAgent.server.raft: votes: needed=1 30:16.637 [DEBUG] TestAgent.server.raft: vote granted: from=aba7d5e0-b2f7-01a7-d002-a2272faf2735 term=2 tally=1 30:16.637 [INFO] TestAgent.server.raft: election won: tally=1 30:16.637 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29979 [Leader]" 30:16.638 [INFO] TestAgent.server: cluster leadership acquired 30:16.638 [INFO] TestAgent.server: New leader elected: payload=node1 30:16.664 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29979 30:16.709 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:16.776 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:16.776 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:16.776 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:16.776 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:16.776 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:16.776 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=node1 30:16.776 [INFO] TestAgent.server: member joined, marking health alive: member=node1 30:16.790 [INFO] TestAgent.server: federation state anti-entropy synced 30:16.834 [DEBUG] TestAgent: removed check: check=chk2 30:16.834 [DEBUG] TestAgent: removed check: check=chk1 30:16.836 [DEBUG] TestAgent: removed service: service=redis 30:16.836 [INFO] TestAgent: Requesting shutdown 30:16.848 [INFO] TestAgent.server: shutting down server 30:16.848 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:16.848 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:16.848 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:16.848 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:16.848 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:16.848 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:16.848 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:16.848 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:16.848 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:16.848 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:16.848 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:16.864 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:16.871Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:16.871Z [INFO] agent.router.manager: shutting down 30:16.871 [INFO] TestAgent: consul server down 30:16.871 [INFO] TestAgent: shutdown complete 30:16.871 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29974 network=tcp 30:16.871 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29974 network=udp 30:16.872 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29975 network=tcp 30:17.372 [INFO] TestAgent: Waiting for endpoints to shut down 30:17.372 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RemoveServiceRemovesAllChecks (0.00s) --- PASS: TestAgent_RemoveServiceRemovesAllChecks/normal (0.78s) --- PASS: TestAgent_RemoveServiceRemovesAllChecks/service_manager (0.94s) === RUN TestAgent_IndexChurn === PAUSE TestAgent_IndexChurn === RUN TestAgent_AddCheck === PAUSE TestAgent_AddCheck === RUN TestAgent_AddCheck_StartPassing === PAUSE TestAgent_AddCheck_StartPassing === RUN TestAgent_AddCheck_MinInterval === PAUSE TestAgent_AddCheck_MinInterval === RUN TestAgent_AddCheck_MissingService === PAUSE TestAgent_AddCheck_MissingService === RUN TestAgent_AddCheck_RestoreState === PAUSE TestAgent_AddCheck_RestoreState === RUN TestAgent_AddCheck_ExecDisable === PAUSE TestAgent_AddCheck_ExecDisable === RUN TestAgent_AddCheck_ExecRemoteDisable === PAUSE TestAgent_AddCheck_ExecRemoteDisable === RUN TestAgent_AddCheck_GRPC === PAUSE TestAgent_AddCheck_GRPC === RUN TestAgent_RestoreServiceWithAliasCheck agent_test.go:1540: skipping slow test; set SLOWTEST=1 to run --- SKIP: TestAgent_RestoreServiceWithAliasCheck (0.00s) === RUN TestAgent_AddCheck_Alias === PAUSE TestAgent_AddCheck_Alias === RUN TestAgent_AddCheck_Alias_setToken === PAUSE TestAgent_AddCheck_Alias_setToken === RUN TestAgent_AddCheck_Alias_userToken === PAUSE TestAgent_AddCheck_Alias_userToken === RUN TestAgent_AddCheck_Alias_userAndSetToken === PAUSE TestAgent_AddCheck_Alias_userAndSetToken === RUN TestAgent_RemoveCheck === PAUSE TestAgent_RemoveCheck === RUN TestAgent_HTTPCheck_TLSSkipVerify === PAUSE TestAgent_HTTPCheck_TLSSkipVerify === RUN TestAgent_HTTPCheck_EnableAgentTLSForChecks agent_test.go:1899: DM-skipped --- SKIP: TestAgent_HTTPCheck_EnableAgentTLSForChecks (0.00s) === RUN TestAgent_updateTTLCheck === PAUSE TestAgent_updateTTLCheck === RUN TestAgent_PersistService === RUN TestAgent_PersistService/normal === PAUSE TestAgent_PersistService/normal === RUN TestAgent_PersistService/service_manager === PAUSE TestAgent_PersistService/service_manager === CONT TestAgent_PersistService/normal === CONT TestAgent_PersistService/service_manager [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 30:18.002 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-b6846e22-868e-cc82-3128-88fda72ac395 127.0.0.1 2021-10-05T16:30:18.002Z [INFO] agent.router: Initializing LAN area manager 30:18.003 [DEBUG] TestAgent: restored service definition from file: service=redis file=/tmp/consul-test/TestAgent_PersistService_service_manager-TestAgent-agent201364860/services/86a1b907d54bf7010394bf316e183e67 30:18.003 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29995 network=udp 30:18.003 [INFO] TestAgent.client.serf.lan: serf: Attempting re-join to previously known node: Node-e87d8e9b-2610-66b6-5ea1-410343a6be4f: 127.0.0.1:29991 30:18.003 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29995 network=tcp 30:18.004 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Failed to join 127.0.0.1: dial tcp 127.0.0.1:29991: connect: connection refused 30:18.004 [WARN] TestAgent.client.serf.lan: serf: Failed to re-join any previously known node 30:18.012 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29996 network=tcp 30:18.012 [INFO] TestAgent: started state syncer 30:18.012 [INFO] TestAgent: Requesting shutdown 30:18.012 [INFO] TestAgent.client: shutting down client 30:18.012 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 30:18.012 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30001 network=tcp 30:18.012 [ERROR] TestAgent: gRPC server failed: error="grpc: the server has been stopped" 2021-10-05T16:30:18.012Z [WARN] agent.router.manager: No servers available 30:18.012 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 30:18.020 [INFO] TestAgent: consul client down 30:18.020 [INFO] TestAgent: shutdown complete 30:18.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29995 network=tcp 30:18.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29995 network=udp 30:18.020 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29996 network=tcp 30:18.520 [INFO] TestAgent: Waiting for endpoints to shut down 30:18.520 [INFO] TestAgent: Endpoints down 30:17.413 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-e87d8e9b-2610-66b6-5ea1-410343a6be4f 127.0.0.1 2021-10-05T16:30:17.413Z [INFO] agent.router: Initializing LAN area manager 30:17.413 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29988 network=udp 30:17.413 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29988 network=tcp 30:17.414 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29989 network=tcp 30:17.414 [INFO] TestAgent: started state syncer 30:17.416 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29994 network=tcp 30:17.432 [INFO] TestAgent: Requesting shutdown 30:17.432 [INFO] TestAgent.client: shutting down client 30:17.432 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 30:17.441 [INFO] TestAgent: consul client down 30:17.441 [INFO] TestAgent: shutdown complete 30:17.441 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29988 network=tcp 30:17.441 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29988 network=udp 30:17.441 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29989 network=tcp 30:17.944 [INFO] TestAgent: Waiting for endpoints to shut down 30:17.944 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! 30:18.078 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-e8140227-0a8b-ea0c-c0a6-c608b4465a58 127.0.0.1 2021-10-05T16:30:18.078Z [INFO] agent.router: Initializing LAN area manager 30:18.079 [DEBUG] TestAgent: restored service definition from file: service=redis file=/tmp/consul-test/TestAgent_PersistService_normal-TestAgent-agent093397585/services/86a1b907d54bf7010394bf316e183e67 30:18.079 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30002 network=udp 30:18.079 [INFO] TestAgent.client.serf.lan: serf: Attempting re-join to previously known node: Node-b952d61f-8f07-a94d-017d-adc4acc42a6a: 127.0.0.1:29984 30:18.079 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Failed to join 127.0.0.1: dial tcp 127.0.0.1:29984: connect: connection refused 30:18.079 [WARN] TestAgent.client.serf.lan: serf: Failed to re-join any previously known node 30:18.081 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30002 network=tcp 30:18.082 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30003 network=tcp 30:18.082 [INFO] TestAgent: started state syncer 30:18.086 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30008 network=tcp 2021-10-05T16:30:18.088Z [WARN] agent.router.manager: No servers available 30:18.088 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 30:18.088 [INFO] TestAgent: Requesting shutdown 30:18.088 [INFO] TestAgent.client: shutting down client 30:18.088 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 30:18.100 [INFO] TestAgent: consul client down 30:18.100 [INFO] TestAgent: shutdown complete 30:18.100 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30002 network=tcp 30:18.100 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30002 network=udp 30:18.100 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30003 network=tcp 30:18.601 [INFO] TestAgent: Waiting for endpoints to shut down 30:18.601 [INFO] TestAgent: Endpoints down 30:17.419 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-b952d61f-8f07-a94d-017d-adc4acc42a6a 127.0.0.1 2021-10-05T16:30:17.419Z [INFO] agent.router: Initializing LAN area manager 30:17.419 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29981 network=udp 30:17.420 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29981 network=tcp 30:17.420 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29982 network=tcp 30:17.420 [INFO] TestAgent: started state syncer 30:17.428 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29987 network=tcp 30:17.457 [INFO] TestAgent: Requesting shutdown 30:17.457 [INFO] TestAgent.client: shutting down client 30:17.457 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 30:17.495 [INFO] TestAgent: consul client down 30:17.495 [INFO] TestAgent: shutdown complete 30:17.495 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29981 network=tcp 30:17.495 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29981 network=udp 30:17.495 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29982 network=tcp 30:17.996 [INFO] TestAgent: Waiting for endpoints to shut down 30:17.996 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PersistService (0.00s) --- PASS: TestAgent_PersistService/service_manager (1.15s) --- PASS: TestAgent_PersistService/normal (1.23s) === RUN TestAgent_persistedService_compat === RUN TestAgent_persistedService_compat/normal === PAUSE TestAgent_persistedService_compat/normal === RUN TestAgent_persistedService_compat/service_manager === PAUSE TestAgent_persistedService_compat/service_manager === CONT TestAgent_persistedService_compat/normal === CONT TestAgent_persistedService_compat/service_manager [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:18.623Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:18.650Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:18.710 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:322488e7-31fc-a45d-c9ed-3857fc8cad6c Address:127.0.0.1:30021}]" 30:18.711 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-322488e7-31fc-a45d-c9ed-3857fc8cad6c.dc1 127.0.0.1 30:18.712 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-322488e7-31fc-a45d-c9ed-3857fc8cad6c 127.0.0.1 2021-10-05T16:30:18.712Z [INFO] agent.router: Initializing LAN area manager 30:18.712 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30021 [Follower]" leader= 30:18.712 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30016 network=udp 30:18.712 [INFO] TestAgent.server: Adding LAN server: server="Node-322488e7-31fc-a45d-c9ed-3857fc8cad6c (Addr: tcp/127.0.0.1:30021) (DC: dc1)" 30:18.712 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30016 network=tcp 30:18.712 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-322488e7-31fc-a45d-c9ed-3857fc8cad6c.dc1 area=wan 30:18.713 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30017 network=tcp 30:18.713 [INFO] TestAgent: started state syncer 30:18.713 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30022 network=tcp 30:18.760 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:18.760 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30021 [Candidate]" term=2 30:18.799 [DEBUG] TestAgent.server.raft: votes: needed=1 30:18.799 [DEBUG] TestAgent.server.raft: vote granted: from=322488e7-31fc-a45d-c9ed-3857fc8cad6c term=2 tally=1 30:18.799 [INFO] TestAgent.server.raft: election won: tally=1 30:18.799 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30021 [Leader]" 30:18.800 [INFO] TestAgent.server: cluster leadership acquired 30:18.800 [INFO] TestAgent.server: New leader elected: payload=Node-322488e7-31fc-a45d-c9ed-3857fc8cad6c 30:18.807 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30021 30:18.824 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:18.880 [INFO] TestAgent: Synced node info 30:18.880 [DEBUG] TestAgent: Node info in sync 30:18.880 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:18.880 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:18.880 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:18.880 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:18.880 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:18.880 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-322488e7-31fc-a45d-c9ed-3857fc8cad6c 30:18.880 [INFO] TestAgent.server: member joined, marking health alive: member=Node-322488e7-31fc-a45d-c9ed-3857fc8cad6c 30:18.896 [INFO] TestAgent.server: federation state anti-entropy synced 30:18.949 [DEBUG] TestAgent: restored service definition from file: service=redis file=/tmp/consul-test/TestAgent_persistedService_compat_service_manager-TestAgent-agent886600206/services/86a1b907d54bf7010394bf316e183e67 30:18.949 [INFO] TestAgent: Requesting shutdown 30:18.949 [INFO] TestAgent.server: shutting down server 30:18.949 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:18.949 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:18.949 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:18.949 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:18.949 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:18.949 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:18.949 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:18.950 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:18.950 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:18.950 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:18.956 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:18.969Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:18.969Z [INFO] agent.router.manager: shutting down 30:18.969 [INFO] TestAgent: consul server down 30:18.969 [INFO] TestAgent: shutdown complete 30:18.969 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30016 network=tcp 30:18.969 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30016 network=udp 30:18.969 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30017 network=tcp 30:19.472 [INFO] TestAgent: Waiting for endpoints to shut down 30:19.472 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:18.619Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:18.638Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:18.740 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b4c3f842-136a-8b47-3420-2c15da29e582 Address:127.0.0.1:30014}]" 30:18.741 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b4c3f842-136a-8b47-3420-2c15da29e582.dc1 127.0.0.1 30:18.741 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30014 [Follower]" leader= 30:18.741 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b4c3f842-136a-8b47-3420-2c15da29e582 127.0.0.1 2021-10-05T16:30:18.741Z [INFO] agent.router: Initializing LAN area manager 30:18.742 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30009 network=udp 30:18.742 [INFO] TestAgent.server: Adding LAN server: server="Node-b4c3f842-136a-8b47-3420-2c15da29e582 (Addr: tcp/127.0.0.1:30014) (DC: dc1)" 30:18.742 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b4c3f842-136a-8b47-3420-2c15da29e582.dc1 area=wan 30:18.742 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30009 network=tcp 30:18.742 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30010 network=tcp 30:18.742 [INFO] TestAgent: started state syncer 30:18.742 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30015 network=tcp 30:18.800 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:18.800 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30014 [Candidate]" term=2 30:18.813 [DEBUG] TestAgent.server.raft: votes: needed=1 30:18.813 [DEBUG] TestAgent.server.raft: vote granted: from=b4c3f842-136a-8b47-3420-2c15da29e582 term=2 tally=1 30:18.813 [INFO] TestAgent.server.raft: election won: tally=1 30:18.813 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30014 [Leader]" 30:18.813 [INFO] TestAgent.server: cluster leadership acquired 30:18.814 [INFO] TestAgent.server: New leader elected: payload=Node-b4c3f842-136a-8b47-3420-2c15da29e582 30:18.827 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30014 30:18.868 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:18.902 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:18.902 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:18.902 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:18.902 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:18.902 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:18.902 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b4c3f842-136a-8b47-3420-2c15da29e582 30:18.902 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b4c3f842-136a-8b47-3420-2c15da29e582 30:18.916 [INFO] TestAgent.server: federation state anti-entropy synced 30:19.132 [DEBUG] TestAgent: restored service definition from file: service=redis file=/tmp/consul-test/TestAgent_persistedService_compat_normal-TestAgent-agent652751019/services/86a1b907d54bf7010394bf316e183e67 30:19.132 [INFO] TestAgent: Requesting shutdown 30:19.132 [INFO] TestAgent.server: shutting down server 30:19.132 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:19.132 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:19.132 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:19.132 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:19.132 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:19.132 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:19.132 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:19.132 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:19.133 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:19.133 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:19.133 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:19.143 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:19.152Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:19.152Z [INFO] agent.router.manager: shutting down 30:19.152 [INFO] TestAgent: consul server down 30:19.152 [INFO] TestAgent: shutdown complete 30:19.152 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30009 network=tcp 30:19.152 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30009 network=udp 30:19.152 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30010 network=tcp 30:19.656 [INFO] TestAgent: Waiting for endpoints to shut down 30:19.656 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_persistedService_compat (0.00s) --- PASS: TestAgent_persistedService_compat/service_manager (0.87s) --- PASS: TestAgent_persistedService_compat/normal (1.05s) === RUN TestAgent_PurgeService === RUN TestAgent_PurgeService/normal === PAUSE TestAgent_PurgeService/normal === RUN TestAgent_PurgeService/service_manager === PAUSE TestAgent_PurgeService/service_manager === CONT TestAgent_PurgeService/normal === CONT TestAgent_PurgeService/service_manager [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:19.694Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:19.754Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:19.822 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3fa0b64d-8c51-0581-cc73-4becb1ab45e1 Address:127.0.0.1:30035}]" 30:19.822 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3fa0b64d-8c51-0581-cc73-4becb1ab45e1.dc1 127.0.0.1 30:19.823 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3fa0b64d-8c51-0581-cc73-4becb1ab45e1 127.0.0.1 2021-10-05T16:30:19.823Z [INFO] agent.router: Initializing LAN area manager 30:19.823 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30030 network=udp 30:19.823 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30035 [Follower]" leader= 30:19.824 [INFO] TestAgent.server: Adding LAN server: server="Node-3fa0b64d-8c51-0581-cc73-4becb1ab45e1 (Addr: tcp/127.0.0.1:30035) (DC: dc1)" 30:19.824 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3fa0b64d-8c51-0581-cc73-4becb1ab45e1.dc1 area=wan 30:19.824 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30030 network=tcp 30:19.824 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30031 network=tcp 30:19.824 [INFO] TestAgent: started state syncer 30:19.825 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30036 network=tcp 30:19.872 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:19.872 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30035 [Candidate]" term=2 30:19.916 [DEBUG] TestAgent.server.raft: votes: needed=1 30:19.916 [DEBUG] TestAgent.server.raft: vote granted: from=3fa0b64d-8c51-0581-cc73-4becb1ab45e1 term=2 tally=1 30:19.916 [INFO] TestAgent.server.raft: election won: tally=1 30:19.916 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30035 [Leader]" 30:19.920 [INFO] TestAgent.server: cluster leadership acquired 30:19.920 [INFO] TestAgent.server: New leader elected: payload=Node-3fa0b64d-8c51-0581-cc73-4becb1ab45e1 30:19.935 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30035 30:19.954 [DEBUG] TestAgent: removed service: service=redis 30:19.968 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:19.988 [INFO] TestAgent: Synced node info 30:19.996 [INFO] TestAgent: Synced service: service=redis 30:19.996 [DEBUG] TestAgent: removed service: service=redis 30:19.996 [INFO] TestAgent: Requesting shutdown 30:19.996 [INFO] TestAgent.server: shutting down server 30:19.996 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:20.008 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:20.013Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:20.013Z [INFO] agent.router.manager: shutting down 30:20.028 [INFO] TestAgent: consul server down 30:20.028 [INFO] TestAgent: shutdown complete 30:20.028 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30030 network=tcp 30:20.028 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30030 network=udp 30:20.028 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30031 network=tcp 30:20.028 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 30:20.028 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 30:20.532 [INFO] TestAgent: Waiting for endpoints to shut down 30:20.532 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:19.679Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:19.746Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:19.836 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:07937cc2-3e9c-93cd-53f8-45e564977e26 Address:127.0.0.1:30028}]" 30:19.836 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30028 [Follower]" leader= 30:19.837 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-07937cc2-3e9c-93cd-53f8-45e564977e26.dc1 127.0.0.1 30:19.837 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-07937cc2-3e9c-93cd-53f8-45e564977e26 127.0.0.1 2021-10-05T16:30:19.837Z [INFO] agent.router: Initializing LAN area manager 30:19.837 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30023 network=udp 30:19.837 [INFO] TestAgent.server: Adding LAN server: server="Node-07937cc2-3e9c-93cd-53f8-45e564977e26 (Addr: tcp/127.0.0.1:30028) (DC: dc1)" 30:19.837 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-07937cc2-3e9c-93cd-53f8-45e564977e26.dc1 area=wan 30:19.837 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30023 network=tcp 30:19.838 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30024 network=tcp 30:19.838 [INFO] TestAgent: started state syncer 30:19.838 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30029 network=tcp 30:19.888 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:19.888 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30028 [Candidate]" term=2 30:19.900 [DEBUG] TestAgent.server.raft: votes: needed=1 30:19.900 [DEBUG] TestAgent.server.raft: vote granted: from=07937cc2-3e9c-93cd-53f8-45e564977e26 term=2 tally=1 30:19.900 [INFO] TestAgent.server.raft: election won: tally=1 30:19.900 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30028 [Leader]" 30:19.904 [INFO] TestAgent.server: cluster leadership acquired 30:19.904 [INFO] TestAgent.server: New leader elected: payload=Node-07937cc2-3e9c-93cd-53f8-45e564977e26 30:19.909 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30028 30:19.931 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:19.976 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:19.976 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:19.976 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:19.976 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:19.976 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:19.976 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-07937cc2-3e9c-93cd-53f8-45e564977e26 30:19.976 [INFO] TestAgent.server: member joined, marking health alive: member=Node-07937cc2-3e9c-93cd-53f8-45e564977e26 30:19.991 [INFO] TestAgent.server: federation state anti-entropy synced 30:20.116 [DEBUG] TestAgent: removed service: service=redis 30:20.128 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:20.136 [INFO] TestAgent: Synced node info 30:20.140 [INFO] TestAgent: Synced service: service=redis 30:20.140 [DEBUG] TestAgent: Node info in sync 30:20.140 [DEBUG] TestAgent: Service in sync: service=redis 30:20.140 [DEBUG] TestAgent: removed service: service=redis 30:20.140 [INFO] TestAgent: Requesting shutdown 30:20.140 [INFO] TestAgent.server: shutting down server 30:20.140 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:20.140 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:20.140 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:20.140 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:20.140 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:20.140 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:20.140 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:20.140 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:20.140 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:20.140 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:20.144 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:20.150Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:20.150Z [INFO] agent.router.manager: shutting down 30:20.150 [INFO] TestAgent: consul server down 30:20.150 [INFO] TestAgent: shutdown complete 30:20.150 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30023 network=tcp 30:20.150 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30023 network=udp 30:20.150 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30024 network=tcp 30:20.652 [INFO] TestAgent: Waiting for endpoints to shut down 30:20.652 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PurgeService (0.00s) --- PASS: TestAgent_PurgeService/service_manager (0.87s) --- PASS: TestAgent_PurgeService/normal (1.00s) === RUN TestAgent_PurgeServiceOnDuplicate === RUN TestAgent_PurgeServiceOnDuplicate/normal === PAUSE TestAgent_PurgeServiceOnDuplicate/normal === RUN TestAgent_PurgeServiceOnDuplicate/service_manager === PAUSE TestAgent_PurgeServiceOnDuplicate/service_manager === CONT TestAgent_PurgeServiceOnDuplicate/normal === CONT TestAgent_PurgeServiceOnDuplicate/service_manager [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 30:21.385 [INFO] Agent2.client.serf.lan: serf: EventMemberJoin: Node-bc762d9b-860b-c259-611d-02ee7997c3c5 127.0.0.1 2021-10-05T16:30:21.385Z [INFO] agent.router: Initializing LAN area manager 30:21.386 [DEBUG] Agent2: service exists, not restoring from file: service=redis file=/tmp/consul-test/TestAgent_PurgeServiceOnDuplicate_normal-TestAgent-agent623680271/services/86a1b907d54bf7010394bf316e183e67 30:21.386 [INFO] Agent2.client.serf.lan: serf: Attempting re-join to previously known node: Node-5936bff4-3e13-6388-1b64-f62992401d95: 127.0.0.1:30040 30:21.386 [INFO] Agent2: Started DNS server: address=127.0.0.1:30051 network=udp 30:21.386 [INFO] Agent2: Started DNS server: address=127.0.0.1:30051 network=tcp 30:21.386 [DEBUG] Agent2.client.memberlist.lan: memberlist: Failed to join 127.0.0.1: dial tcp 127.0.0.1:30040: connect: connection refused 30:21.386 [WARN] Agent2.client.serf.lan: serf: Failed to re-join any previously known node 30:21.387 [INFO] Agent2: Started HTTP server: address=127.0.0.1:30052 network=tcp 30:21.387 [INFO] Agent2: started state syncer 30:21.387 [INFO] Agent2: Started gRPC server: address=127.0.0.1:30057 network=tcp 2021-10-05T16:30:21.387Z [WARN] agent.router.manager: No servers available 30:21.387 [ERROR] Agent2.anti_entropy: failed to sync remote state: error="No known Consul servers" 30:21.387 [INFO] Agent2: Requesting shutdown 30:21.387 [INFO] Agent2.client: shutting down client 30:21.387 [WARN] Agent2.client.serf.lan: serf: Shutdown without a Leave 30:21.412 [INFO] Agent2: consul client down 30:21.412 [INFO] Agent2: shutdown complete 30:21.412 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30051 network=tcp 30:21.412 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30051 network=udp 30:21.412 [INFO] Agent2: Stopping server: protocol=HTTP address=127.0.0.1:30052 network=tcp 30:21.912 [INFO] Agent2: Waiting for endpoints to shut down 30:21.912 [INFO] Agent2: Endpoints down 30:20.721 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-5936bff4-3e13-6388-1b64-f62992401d95 127.0.0.1 2021-10-05T16:30:20.721Z [INFO] agent.router: Initializing LAN area manager 30:20.721 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30037 network=udp 30:20.721 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30037 network=tcp 30:20.722 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30038 network=tcp 30:20.722 [INFO] TestAgent: started state syncer 30:20.723 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30043 network=tcp 30:20.732 [INFO] TestAgent: Requesting shutdown 30:20.732 [INFO] TestAgent.client: shutting down client 30:20.732 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 30:20.752 [INFO] TestAgent: consul client down 30:20.752 [INFO] TestAgent: shutdown complete 30:20.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30037 network=tcp 30:20.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30037 network=udp 30:20.752 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30038 network=tcp 30:21.253 [INFO] TestAgent: Waiting for endpoints to shut down 30:21.253 [INFO] TestAgent: Endpoints down 30:21.401 [INFO] Agent2.client.serf.lan: serf: EventMemberJoin: Node-79153125-292a-de71-f7e6-ff416d63fbb3 127.0.0.1 2021-10-05T16:30:21.401Z [INFO] agent.router: Initializing LAN area manager 30:21.401 [DEBUG] Agent2: service exists, not restoring from file: service=redis file=/tmp/consul-test/TestAgent_PurgeServiceOnDuplicate_service_manager-TestAgent-agent166841634/services/86a1b907d54bf7010394bf316e183e67 30:21.401 [INFO] Agent2: Started DNS server: address=127.0.0.1:30058 network=udp 30:21.401 [INFO] Agent2.client.serf.lan: serf: Attempting re-join to previously known node: Node-0fd4b3dd-600a-d839-b08b-c91d4a8f86d3: 127.0.0.1:30047 30:21.401 [INFO] Agent2: Started DNS server: address=127.0.0.1:30058 network=tcp 30:21.402 [INFO] Agent2: Started HTTP server: address=127.0.0.1:30059 network=tcp 30:21.402 [INFO] Agent2: started state syncer 30:21.402 [INFO] Agent2: Requesting shutdown 30:21.402 [INFO] Agent2.client: shutting down client 30:21.402 [WARN] Agent2.client.serf.lan: serf: Shutdown without a Leave 30:21.402 [INFO] Agent2: Started gRPC server: address=127.0.0.1:30064 network=tcp 30:21.402 [ERROR] Agent2: gRPC server failed: error="grpc: the server has been stopped" 2021-10-05T16:30:21.402Z [WARN] agent.router.manager: No servers available 30:21.402 [ERROR] Agent2.anti_entropy: failed to sync remote state: error="No known Consul servers" 30:21.404 [DEBUG] Agent2.client.memberlist.lan: memberlist: Failed to join 127.0.0.1: dial tcp 127.0.0.1:30047: connect: connection refused 30:21.404 [WARN] Agent2.client.serf.lan: serf: Failed to re-join any previously known node 30:21.412 [INFO] Agent2: consul client down 30:21.412 [INFO] Agent2: shutdown complete 30:21.412 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30058 network=tcp 30:21.412 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30058 network=udp 30:21.412 [INFO] Agent2: Stopping server: protocol=HTTP address=127.0.0.1:30059 network=tcp 30:21.913 [INFO] Agent2: Waiting for endpoints to shut down 30:21.913 [INFO] Agent2: Endpoints down 30:20.727 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-0fd4b3dd-600a-d839-b08b-c91d4a8f86d3 127.0.0.1 2021-10-05T16:30:20.727Z [INFO] agent.router: Initializing LAN area manager 30:20.727 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30044 network=udp 30:20.727 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30044 network=tcp 30:20.728 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30045 network=tcp 30:20.728 [INFO] TestAgent: started state syncer 30:20.728 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30050 network=tcp 30:20.752 [INFO] TestAgent: Requesting shutdown 30:20.752 [INFO] TestAgent.client: shutting down client 30:20.752 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 30:20.776 [INFO] TestAgent: consul client down 30:20.776 [INFO] TestAgent: shutdown complete 30:20.776 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30044 network=tcp 30:20.776 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30044 network=udp 30:20.776 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30045 network=tcp 30:21.277 [INFO] TestAgent: Waiting for endpoints to shut down 30:21.277 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PurgeServiceOnDuplicate (0.00s) --- PASS: TestAgent_PurgeServiceOnDuplicate/normal (1.26s) --- PASS: TestAgent_PurgeServiceOnDuplicate/service_manager (1.26s) === RUN TestAgent_PersistCheck === PAUSE TestAgent_PersistCheck === RUN TestAgent_PurgeCheck === PAUSE TestAgent_PurgeCheck === RUN TestAgent_PurgeCheckOnDuplicate === PAUSE TestAgent_PurgeCheckOnDuplicate === RUN TestAgent_DeregisterPersistedSidecarAfterRestart === PAUSE TestAgent_DeregisterPersistedSidecarAfterRestart === RUN TestAgent_loadChecks_token === PAUSE TestAgent_loadChecks_token === RUN TestAgent_unloadChecks === PAUSE TestAgent_unloadChecks === RUN TestAgent_loadServices_token === RUN TestAgent_loadServices_token/normal === PAUSE TestAgent_loadServices_token/normal === RUN TestAgent_loadServices_token/service_manager === PAUSE TestAgent_loadServices_token/service_manager === CONT TestAgent_loadServices_token/normal === CONT TestAgent_loadServices_token/service_manager [WARN] freeport: 6 out of 34 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:21.928Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:21.944Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:21.978 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c9a04998-4f64-658b-5610-4f3db79bb0ce Address:127.0.0.1:30070}]" 30:21.979 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c9a04998-4f64-658b-5610-4f3db79bb0ce.dc1 127.0.0.1 30:21.980 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c9a04998-4f64-658b-5610-4f3db79bb0ce 127.0.0.1 2021-10-05T16:30:21.980Z [INFO] agent.router: Initializing LAN area manager 30:21.980 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30070 [Follower]" leader= 30:21.980 [INFO] TestAgent.server: Adding LAN server: server="Node-c9a04998-4f64-658b-5610-4f3db79bb0ce (Addr: tcp/127.0.0.1:30070) (DC: dc1)" 30:21.980 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c9a04998-4f64-658b-5610-4f3db79bb0ce.dc1 area=wan 30:21.980 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30065 network=udp 30:21.980 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30065 network=tcp 30:21.981 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30066 network=tcp 30:21.981 [INFO] TestAgent: started state syncer 30:21.981 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30071 network=tcp 30:22.045 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:22.045 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30070 [Candidate]" term=2 30:22.057 [DEBUG] TestAgent.server.raft: votes: needed=1 30:22.057 [DEBUG] TestAgent.server.raft: vote granted: from=c9a04998-4f64-658b-5610-4f3db79bb0ce term=2 tally=1 30:22.057 [INFO] TestAgent.server.raft: election won: tally=1 30:22.057 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30070 [Leader]" 30:22.058 [INFO] TestAgent.server: cluster leadership acquired 30:22.058 [INFO] TestAgent.server: New leader elected: payload=Node-c9a04998-4f64-658b-5610-4f3db79bb0ce 30:22.064 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30070 30:22.096 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:22.146 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:22.146 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:22.146 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:22.146 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:22.146 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:22.146 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c9a04998-4f64-658b-5610-4f3db79bb0ce 30:22.146 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c9a04998-4f64-658b-5610-4f3db79bb0ce 30:22.163 [INFO] TestAgent.server: federation state anti-entropy synced 30:22.244 [INFO] TestAgent: Requesting shutdown 30:22.244 [INFO] TestAgent.server: shutting down server 30:22.244 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:22.244 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:22.244 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:22.244 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:22.244 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:22.244 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:22.244 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:22.244 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:22.244 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:22.244 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:22.244 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:22.252 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:22.256Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:22.256Z [INFO] agent.router.manager: shutting down 30:22.256 [INFO] TestAgent: consul server down 30:22.256 [INFO] TestAgent: shutdown complete 30:22.256 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30065 network=tcp 30:22.256 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30065 network=udp 30:22.256 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30066 network=tcp 30:22.760 [INFO] TestAgent: Waiting for endpoints to shut down 30:22.760 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:21.952Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:21.990Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:22.024 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e4faf7ce-2ac1-f9f4-1798-b488234d9abd Address:127.0.0.1:30077}]" 30:22.024 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e4faf7ce-2ac1-f9f4-1798-b488234d9abd.dc1 127.0.0.1 30:22.025 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e4faf7ce-2ac1-f9f4-1798-b488234d9abd 127.0.0.1 2021-10-05T16:30:22.025Z [INFO] agent.router: Initializing LAN area manager 30:22.025 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30072 network=udp 30:22.025 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30077 [Follower]" leader= 30:22.026 [INFO] TestAgent.server: Adding LAN server: server="Node-e4faf7ce-2ac1-f9f4-1798-b488234d9abd (Addr: tcp/127.0.0.1:30077) (DC: dc1)" 30:22.026 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e4faf7ce-2ac1-f9f4-1798-b488234d9abd.dc1 area=wan 30:22.026 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30072 network=tcp 30:22.026 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30073 network=tcp 30:22.026 [INFO] TestAgent: started state syncer 30:22.026 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30078 network=tcp 30:22.092 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:22.092 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30077 [Candidate]" term=2 30:22.137 [DEBUG] TestAgent.server.raft: votes: needed=1 30:22.137 [DEBUG] TestAgent.server.raft: vote granted: from=e4faf7ce-2ac1-f9f4-1798-b488234d9abd term=2 tally=1 30:22.137 [INFO] TestAgent.server.raft: election won: tally=1 30:22.137 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30077 [Leader]" 30:22.140 [INFO] TestAgent.server: cluster leadership acquired 30:22.140 [INFO] TestAgent.server: New leader elected: payload=Node-e4faf7ce-2ac1-f9f4-1798-b488234d9abd 30:22.147 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30077 30:22.166 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:22.208 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:22.208 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:22.208 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:22.208 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:22.208 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:22.208 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e4faf7ce-2ac1-f9f4-1798-b488234d9abd 30:22.208 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e4faf7ce-2ac1-f9f4-1798-b488234d9abd 30:22.209 [INFO] TestAgent: Synced node info 30:22.256 [INFO] TestAgent: Synced service: service=rabbitmq 30:22.265 [INFO] TestAgent.server: federation state anti-entropy synced 30:22.374 [INFO] TestAgent: Requesting shutdown 30:22.374 [INFO] TestAgent.server: shutting down server 30:22.374 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:22.374 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:22.374 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:22.374 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:22.374 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:22.374 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:22.374 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:22.374 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:22.375 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:22.375 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:22.388 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:22.389Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:22.389Z [INFO] agent.router.manager: shutting down 30:22.389 [INFO] TestAgent: consul server down 30:22.389 [INFO] TestAgent: shutdown complete 30:22.389 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30072 network=tcp 30:22.389 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30072 network=udp 30:22.389 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30073 network=tcp 30:22.892 [INFO] TestAgent: Waiting for endpoints to shut down 30:22.892 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadServices_token (0.00s) --- PASS: TestAgent_loadServices_token/normal (0.85s) --- PASS: TestAgent_loadServices_token/service_manager (0.98s) === RUN TestAgent_loadServices_sidecar === RUN TestAgent_loadServices_sidecar/normal === PAUSE TestAgent_loadServices_sidecar/normal === RUN TestAgent_loadServices_sidecar/service_manager === PAUSE TestAgent_loadServices_sidecar/service_manager === CONT TestAgent_loadServices_sidecar/normal === CONT TestAgent_loadServices_sidecar/service_manager [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:22.931Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:22.989Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:23.056 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ce5d9289-0d1c-1043-e643-ddd06ed6d7ab Address:127.0.0.1:30091}]" 30:23.057 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ce5d9289-0d1c-1043-e643-ddd06ed6d7ab.dc1 127.0.0.1 30:23.057 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30091 [Follower]" leader= 30:23.057 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ce5d9289-0d1c-1043-e643-ddd06ed6d7ab 127.0.0.1 2021-10-05T16:30:23.058Z [INFO] agent.router: Initializing LAN area manager 30:23.058 [DEBUG] TestAgent: added local registration for service: service=rabbitmq-sidecar-proxy 30:23.058 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30086 network=udp 30:23.058 [INFO] TestAgent.server: Adding LAN server: server="Node-ce5d9289-0d1c-1043-e643-ddd06ed6d7ab (Addr: tcp/127.0.0.1:30091) (DC: dc1)" 30:23.058 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ce5d9289-0d1c-1043-e643-ddd06ed6d7ab.dc1 area=wan 30:23.059 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30086 network=tcp 30:23.061 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30087 network=tcp 30:23.061 [INFO] TestAgent: started state syncer 30:23.061 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30092 network=tcp 30:23.095 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:23.095 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30091 [Candidate]" term=2 30:23.105 [DEBUG] TestAgent.server.raft: votes: needed=1 30:23.105 [DEBUG] TestAgent.server.raft: vote granted: from=ce5d9289-0d1c-1043-e643-ddd06ed6d7ab term=2 tally=1 30:23.105 [INFO] TestAgent.server.raft: election won: tally=1 30:23.105 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30091 [Leader]" 30:23.108 [INFO] TestAgent.server: cluster leadership acquired 30:23.108 [INFO] TestAgent.server: New leader elected: payload=Node-ce5d9289-0d1c-1043-e643-ddd06ed6d7ab 30:23.128 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30091 30:23.172 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:23.244 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:23.244 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:23.244 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:23.244 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:23.244 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:23.244 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ce5d9289-0d1c-1043-e643-ddd06ed6d7ab 30:23.244 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ce5d9289-0d1c-1043-e643-ddd06ed6d7ab 30:23.280 [INFO] TestAgent.server: federation state anti-entropy synced 30:23.340 [INFO] TestAgent: Requesting shutdown 30:23.340 [INFO] TestAgent.server: shutting down server 30:23.340 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:23.340 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:23.340 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:23.340 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:23.340 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:23.340 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:23.340 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:23.340 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:23.340 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:23.340 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:23.340 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:23.356 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:23.368Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:23.368Z [INFO] agent.router.manager: shutting down 30:23.368 [INFO] TestAgent: consul server down 30:23.368 [INFO] TestAgent: shutdown complete 30:23.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30086 network=tcp 30:23.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30086 network=udp 30:23.368 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30087 network=tcp 30:23.868 [INFO] TestAgent: Waiting for endpoints to shut down 30:23.868 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:22.931Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:22.971Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:23.064 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f37af6b4-461a-4474-d637-acec1b2c8c75 Address:127.0.0.1:30084}]" 30:23.064 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f37af6b4-461a-4474-d637-acec1b2c8c75.dc1 127.0.0.1 30:23.065 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f37af6b4-461a-4474-d637-acec1b2c8c75 127.0.0.1 2021-10-05T16:30:23.065Z [INFO] agent.router: Initializing LAN area manager 30:23.065 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30079 network=udp 30:23.065 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30084 [Follower]" leader= 30:23.066 [INFO] TestAgent.server: Adding LAN server: server="Node-f37af6b4-461a-4474-d637-acec1b2c8c75 (Addr: tcp/127.0.0.1:30084) (DC: dc1)" 30:23.066 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f37af6b4-461a-4474-d637-acec1b2c8c75.dc1 area=wan 30:23.066 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30079 network=tcp 30:23.066 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30080 network=tcp 30:23.066 [INFO] TestAgent: started state syncer 30:23.067 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30085 network=tcp 30:23.128 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:23.128 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30084 [Candidate]" term=2 30:23.174 [DEBUG] TestAgent.server.raft: votes: needed=1 30:23.174 [DEBUG] TestAgent.server.raft: vote granted: from=f37af6b4-461a-4474-d637-acec1b2c8c75 term=2 tally=1 30:23.174 [INFO] TestAgent.server.raft: election won: tally=1 30:23.174 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30084 [Leader]" 30:23.174 [INFO] TestAgent.server: cluster leadership acquired 30:23.175 [INFO] TestAgent.server: New leader elected: payload=Node-f37af6b4-461a-4474-d637-acec1b2c8c75 30:23.204 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30084 30:23.249 [INFO] TestAgent: Synced node info 30:23.263 [INFO] TestAgent: Synced service: service=rabbitmq 30:23.275 [INFO] TestAgent: Synced service: service=rabbitmq-sidecar-proxy 30:23.275 [DEBUG] TestAgent: Check in sync: check=service:rabbitmq-sidecar-proxy:1 30:23.275 [DEBUG] TestAgent: Check in sync: check=service:rabbitmq-sidecar-proxy:2 30:23.275 [DEBUG] TestAgent: Node info in sync 30:23.275 [DEBUG] TestAgent: Service in sync: service=rabbitmq 30:23.275 [DEBUG] TestAgent: Service in sync: service=rabbitmq-sidecar-proxy 30:23.275 [DEBUG] TestAgent: Check in sync: check=service:rabbitmq-sidecar-proxy:1 30:23.275 [DEBUG] TestAgent: Check in sync: check=service:rabbitmq-sidecar-proxy:2 30:23.275 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:23.300 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:23.300 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:23.301 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:23.301 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:23.301 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:23.301 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f37af6b4-461a-4474-d637-acec1b2c8c75 30:23.301 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f37af6b4-461a-4474-d637-acec1b2c8c75 30:23.312 [INFO] TestAgent.server: federation state anti-entropy synced 30:23.412 [INFO] TestAgent: Requesting shutdown 30:23.412 [INFO] TestAgent.server: shutting down server 30:23.412 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:23.412 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:23.412 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:23.412 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:23.412 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:23.412 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:23.412 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:23.412 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:23.412 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:23.412 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:23.424 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:23.432Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:23.432Z [INFO] agent.router.manager: shutting down 30:23.440 [INFO] TestAgent: consul server down 30:23.440 [INFO] TestAgent: shutdown complete 30:23.440 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30079 network=tcp 30:23.440 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30079 network=udp 30:23.440 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30080 network=tcp 30:23.942 [INFO] TestAgent: Waiting for endpoints to shut down 30:23.942 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadServices_sidecar (0.00s) --- PASS: TestAgent_loadServices_sidecar/service_manager (0.97s) --- PASS: TestAgent_loadServices_sidecar/normal (1.05s) === RUN TestAgent_loadServices_sidecarSeparateToken === RUN TestAgent_loadServices_sidecarSeparateToken/normal === PAUSE TestAgent_loadServices_sidecarSeparateToken/normal === RUN TestAgent_loadServices_sidecarSeparateToken/service_manager === PAUSE TestAgent_loadServices_sidecarSeparateToken/service_manager === CONT TestAgent_loadServices_sidecarSeparateToken/normal === CONT TestAgent_loadServices_sidecarSeparateToken/service_manager [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:23.976Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:24.002Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:24.045 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b4f437b2-d485-22bd-8c18-e5fac9457334 Address:127.0.0.1:30105}]" 30:24.046 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b4f437b2-d485-22bd-8c18-e5fac9457334.dc1 127.0.0.1 30:24.047 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b4f437b2-d485-22bd-8c18-e5fac9457334 127.0.0.1 2021-10-05T16:30:24.047Z [INFO] agent.router: Initializing LAN area manager 30:24.047 [DEBUG] TestAgent: added local registration for service: service=rabbitmq-sidecar-proxy 30:24.047 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30100 network=udp 30:24.047 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30105 [Follower]" leader= 30:24.048 [INFO] TestAgent.server: Adding LAN server: server="Node-b4f437b2-d485-22bd-8c18-e5fac9457334 (Addr: tcp/127.0.0.1:30105) (DC: dc1)" 30:24.048 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b4f437b2-d485-22bd-8c18-e5fac9457334.dc1 area=wan 30:24.048 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30100 network=tcp 30:24.051 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30101 network=tcp 30:24.051 [INFO] TestAgent: started state syncer 30:24.052 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30106 network=tcp 30:24.113 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:24.113 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30105 [Candidate]" term=2 30:24.133 [DEBUG] TestAgent.server.raft: votes: needed=1 30:24.133 [DEBUG] TestAgent.server.raft: vote granted: from=b4f437b2-d485-22bd-8c18-e5fac9457334 term=2 tally=1 30:24.133 [INFO] TestAgent.server.raft: election won: tally=1 30:24.133 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30105 [Leader]" 30:24.133 [INFO] TestAgent.server: cluster leadership acquired 30:24.133 [INFO] TestAgent.server: New leader elected: payload=Node-b4f437b2-d485-22bd-8c18-e5fac9457334 30:24.149 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30105 30:24.169 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:24.216 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:24.216 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:24.216 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:24.216 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:24.216 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:24.217 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b4f437b2-d485-22bd-8c18-e5fac9457334 30:24.217 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b4f437b2-d485-22bd-8c18-e5fac9457334 30:24.236 [INFO] TestAgent.server: federation state anti-entropy synced 30:24.348 [INFO] TestAgent: Requesting shutdown 30:24.348 [INFO] TestAgent.server: shutting down server 30:24.348 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:24.348 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:24.348 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:24.348 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:24.348 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:24.348 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:24.348 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:24.348 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:24.348 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:24.348 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:24.348 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:24.356 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:24.368Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:24.368Z [INFO] agent.router.manager: shutting down 30:24.368 [INFO] TestAgent: consul server down 30:24.368 [INFO] TestAgent: shutdown complete 30:24.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30100 network=tcp 30:24.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30100 network=udp 30:24.368 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30101 network=tcp 30:24.872 [INFO] TestAgent: Waiting for endpoints to shut down 30:24.872 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:23.964Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:23.980Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:24.011 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c71e0cc4-de57-0867-f07c-87659a8b38c0 Address:127.0.0.1:30098}]" 30:24.012 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30098 [Follower]" leader= 30:24.012 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c71e0cc4-de57-0867-f07c-87659a8b38c0.dc1 127.0.0.1 30:24.013 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c71e0cc4-de57-0867-f07c-87659a8b38c0 127.0.0.1 2021-10-05T16:30:24.013Z [INFO] agent.router: Initializing LAN area manager 30:24.013 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30093 network=udp 30:24.014 [INFO] TestAgent.server: Adding LAN server: server="Node-c71e0cc4-de57-0867-f07c-87659a8b38c0 (Addr: tcp/127.0.0.1:30098) (DC: dc1)" 30:24.014 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c71e0cc4-de57-0867-f07c-87659a8b38c0.dc1 area=wan 30:24.014 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30093 network=tcp 30:24.015 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30094 network=tcp 30:24.015 [INFO] TestAgent: started state syncer 30:24.015 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30099 network=tcp 30:24.061 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:24.062 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30098 [Candidate]" term=2 30:24.073 [DEBUG] TestAgent.server.raft: votes: needed=1 30:24.073 [DEBUG] TestAgent.server.raft: vote granted: from=c71e0cc4-de57-0867-f07c-87659a8b38c0 term=2 tally=1 30:24.073 [INFO] TestAgent.server.raft: election won: tally=1 30:24.073 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30098 [Leader]" 30:24.076 [INFO] TestAgent.server: cluster leadership acquired 30:24.076 [INFO] TestAgent.server: New leader elected: payload=Node-c71e0cc4-de57-0867-f07c-87659a8b38c0 30:24.090 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30098 30:24.107 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:24.156 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:24.156 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:24.156 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:24.156 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:24.156 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:24.156 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c71e0cc4-de57-0867-f07c-87659a8b38c0 30:24.156 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c71e0cc4-de57-0867-f07c-87659a8b38c0 30:24.200 [INFO] TestAgent.server: federation state anti-entropy synced 30:24.360 [INFO] TestAgent: Requesting shutdown 30:24.360 [INFO] TestAgent.server: shutting down server 30:24.360 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:24.360 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:24.360 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:24.360 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:24.360 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:24.360 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:24.360 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:24.360 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:24.360 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:24.360 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:24.360 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:24.376 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:24.388Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:24.388Z [INFO] agent.router.manager: shutting down 30:24.388 [INFO] TestAgent: consul server down 30:24.388 [INFO] TestAgent: shutdown complete 30:24.388 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30093 network=tcp 30:24.388 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30093 network=udp 30:24.388 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30094 network=tcp 30:24.892 [INFO] TestAgent: Waiting for endpoints to shut down 30:24.892 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadServices_sidecarSeparateToken (0.00s) --- PASS: TestAgent_loadServices_sidecarSeparateToken/service_manager (0.93s) --- PASS: TestAgent_loadServices_sidecarSeparateToken/normal (0.95s) === RUN TestAgent_loadServices_sidecarInheritMeta === RUN TestAgent_loadServices_sidecarInheritMeta/normal === PAUSE TestAgent_loadServices_sidecarInheritMeta/normal === RUN TestAgent_loadServices_sidecarInheritMeta/service_manager === PAUSE TestAgent_loadServices_sidecarInheritMeta/service_manager === CONT TestAgent_loadServices_sidecarInheritMeta/normal === CONT TestAgent_loadServices_sidecarInheritMeta/service_manager [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:24.918Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:24.946Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:24.986 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a5768502-4cb0-264c-3a10-80e5557be89a Address:127.0.0.1:30112}]" 30:24.986 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a5768502-4cb0-264c-3a10-80e5557be89a.dc1 127.0.0.1 30:24.987 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a5768502-4cb0-264c-3a10-80e5557be89a 127.0.0.1 2021-10-05T16:30:24.987Z [INFO] agent.router: Initializing LAN area manager 30:24.987 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30107 network=udp 30:24.987 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30112 [Follower]" leader= 30:24.988 [INFO] TestAgent.server: Adding LAN server: server="Node-a5768502-4cb0-264c-3a10-80e5557be89a (Addr: tcp/127.0.0.1:30112) (DC: dc1)" 30:24.988 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a5768502-4cb0-264c-3a10-80e5557be89a.dc1 area=wan 30:24.988 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30107 network=tcp 30:24.988 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30108 network=tcp 30:24.988 [INFO] TestAgent: started state syncer 30:24.989 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30113 network=tcp 30:25.059 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:25.059 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30112 [Candidate]" term=2 30:25.076 [DEBUG] TestAgent.server.raft: votes: needed=1 30:25.076 [DEBUG] TestAgent.server.raft: vote granted: from=a5768502-4cb0-264c-3a10-80e5557be89a term=2 tally=1 30:25.076 [INFO] TestAgent.server.raft: election won: tally=1 30:25.076 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30112 [Leader]" 30:25.076 [INFO] TestAgent.server: cluster leadership acquired 30:25.076 [INFO] TestAgent.server: New leader elected: payload=Node-a5768502-4cb0-264c-3a10-80e5557be89a 30:25.086 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30112 30:25.105 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:25.114 [INFO] TestAgent: Requesting shutdown 30:25.114 [INFO] TestAgent.server: shutting down server 30:25.114 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:25.114 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:25.128 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:25.136Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:25.136Z [INFO] agent.router.manager: shutting down 30:25.150 [INFO] TestAgent: consul server down 30:25.150 [INFO] TestAgent: shutdown complete 30:25.150 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30107 network=tcp 30:25.150 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30107 network=udp 30:25.150 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30108 network=tcp 30:25.151 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 30:25.151 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 30:25.151 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 30:25.651 [INFO] TestAgent: Waiting for endpoints to shut down 30:25.652 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:24.920Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:24.937Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:24.978 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e Address:127.0.0.1:30119}]" 30:24.979 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e.dc1 127.0.0.1 30:24.980 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30119 [Follower]" leader= 30:24.980 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e 127.0.0.1 2021-10-05T16:30:24.980Z [INFO] agent.router: Initializing LAN area manager 30:24.980 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e.dc1 area=wan 30:24.980 [INFO] TestAgent.server: Adding LAN server: server="Node-a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e (Addr: tcp/127.0.0.1:30119) (DC: dc1)" 30:24.980 [DEBUG] TestAgent: added local registration for service: service=rabbitmq-sidecar-proxy 30:24.981 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30114 network=udp 30:24.981 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30114 network=tcp 30:24.981 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30115 network=tcp 30:24.981 [INFO] TestAgent: started state syncer 30:24.981 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30120 network=tcp 30:25.018 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:25.018 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30119 [Candidate]" term=2 30:25.028 [DEBUG] TestAgent.server.raft: votes: needed=1 30:25.028 [DEBUG] TestAgent.server.raft: vote granted: from=a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e term=2 tally=1 30:25.028 [INFO] TestAgent.server.raft: election won: tally=1 30:25.028 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30119 [Leader]" 30:25.028 [INFO] TestAgent.server: cluster leadership acquired 30:25.028 [INFO] TestAgent.server: New leader elected: payload=Node-a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e 30:25.036 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30119 30:25.066 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:25.094 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:25.101 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:25.103 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:25.108 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:25.129 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:25.129 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:25.129 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:25.129 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:25.129 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:25.129 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e 30:25.129 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a0b7a037-3d3d-e558-52d9-b3c0f5a0cf7e 30:25.153 [INFO] TestAgent.server: federation state anti-entropy synced 30:25.243 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:25.249 [INFO] TestAgent: Synced node info 30:25.255 [INFO] TestAgent: Synced service: service=rabbitmq 30:25.272 [INFO] TestAgent: Synced service: service=rabbitmq-sidecar-proxy 30:25.272 [DEBUG] TestAgent: Check in sync: check=service:rabbitmq-sidecar-proxy:1 30:25.272 [DEBUG] TestAgent: Check in sync: check=service:rabbitmq-sidecar-proxy:2 30:25.272 [INFO] TestAgent: Requesting shutdown 30:25.272 [INFO] TestAgent.server: shutting down server 30:25.272 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:25.272 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:25.272 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:25.272 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:25.272 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:25.272 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:25.272 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:25.272 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:25.272 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:25.272 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:25.281 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:25.290Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:25.290Z [INFO] agent.router.manager: shutting down 30:25.290 [INFO] TestAgent: consul server down 30:25.290 [INFO] TestAgent: shutdown complete 30:25.290 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30114 network=tcp 30:25.290 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30114 network=udp 30:25.290 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30115 network=tcp 30:25.790 [INFO] TestAgent: Waiting for endpoints to shut down 30:25.790 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadServices_sidecarInheritMeta (0.00s) --- PASS: TestAgent_loadServices_sidecarInheritMeta/normal (0.76s) --- PASS: TestAgent_loadServices_sidecarInheritMeta/service_manager (0.90s) === RUN TestAgent_loadServices_sidecarOverrideMeta === RUN TestAgent_loadServices_sidecarOverrideMeta/normal === PAUSE TestAgent_loadServices_sidecarOverrideMeta/normal === RUN TestAgent_loadServices_sidecarOverrideMeta/service_manager === PAUSE TestAgent_loadServices_sidecarOverrideMeta/service_manager === CONT TestAgent_loadServices_sidecarOverrideMeta/normal === CONT TestAgent_loadServices_sidecarOverrideMeta/service_manager [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:25.841Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:25.903Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:26.000 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8a1334de-57a1-5d08-84bf-d69fbfc34429 Address:127.0.0.1:30126}]" 30:26.000 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30126 [Follower]" leader= 30:26.001 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8a1334de-57a1-5d08-84bf-d69fbfc34429.dc1 127.0.0.1 30:26.001 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8a1334de-57a1-5d08-84bf-d69fbfc34429 127.0.0.1 2021-10-05T16:30:26.001Z [INFO] agent.router: Initializing LAN area manager 30:26.002 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30121 network=udp 30:26.002 [INFO] TestAgent.server: Adding LAN server: server="Node-8a1334de-57a1-5d08-84bf-d69fbfc34429 (Addr: tcp/127.0.0.1:30126) (DC: dc1)" 30:26.002 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8a1334de-57a1-5d08-84bf-d69fbfc34429.dc1 area=wan 30:26.002 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30121 network=tcp 30:26.003 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30122 network=tcp 30:26.003 [INFO] TestAgent: started state syncer 30:26.003 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30127 network=tcp 30:26.052 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:26.052 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30126 [Candidate]" term=2 30:26.104 [DEBUG] TestAgent.server.raft: votes: needed=1 30:26.104 [DEBUG] TestAgent.server.raft: vote granted: from=8a1334de-57a1-5d08-84bf-d69fbfc34429 term=2 tally=1 30:26.104 [INFO] TestAgent.server.raft: election won: tally=1 30:26.104 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30126 [Leader]" 30:26.107 [INFO] TestAgent.server: cluster leadership acquired 30:26.107 [INFO] TestAgent.server: New leader elected: payload=Node-8a1334de-57a1-5d08-84bf-d69fbfc34429 30:26.123 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30126 30:26.164 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:26.172 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:26.172 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:26.175 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:26.175 [ERROR] TestAgent.proxycfg: watch error: service_id=rabbitmq-sidecar-proxy id=leaf error="error filling agent cache: internal error: CA root is nil" 30:26.188 [INFO] TestAgent: Requesting shutdown 30:26.188 [INFO] TestAgent.server: shutting down server 30:26.188 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:26.188 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:26.196 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:26.203Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:26.203Z [INFO] agent.router.manager: shutting down 30:26.206 [INFO] TestAgent: consul server down 30:26.206 [INFO] TestAgent: shutdown complete 30:26.206 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30121 network=tcp 30:26.206 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30121 network=udp 30:26.206 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30122 network=tcp 30:26.206 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 30:26.712 [INFO] TestAgent: Waiting for endpoints to shut down 30:26.712 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:25.843Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:25.923Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:26.003 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:71a79908-f0f1-31ca-3875-1aa3bd67aa28 Address:127.0.0.1:30133}]" 30:26.004 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30133 [Follower]" leader= 30:26.004 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28.dc1 127.0.0.1 30:26.005 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28 127.0.0.1 2021-10-05T16:30:26.005Z [INFO] agent.router: Initializing LAN area manager 30:26.005 [DEBUG] TestAgent: added local registration for service: service=rabbitmq-sidecar-proxy 30:26.005 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30128 network=udp 30:26.005 [INFO] TestAgent.server: Adding LAN server: server="Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28 (Addr: tcp/127.0.0.1:30133) (DC: dc1)" 30:26.005 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28.dc1 area=wan 30:26.006 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30128 network=tcp 30:26.006 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30129 network=tcp 30:26.006 [INFO] TestAgent: started state syncer 30:26.007 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30134 network=tcp 30:26.052 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:26.052 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30133 [Candidate]" term=2 30:26.096 [DEBUG] TestAgent.server.raft: votes: needed=1 30:26.096 [DEBUG] TestAgent.server.raft: vote granted: from=71a79908-f0f1-31ca-3875-1aa3bd67aa28 term=2 tally=1 30:26.096 [INFO] TestAgent.server.raft: election won: tally=1 30:26.096 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30133 [Leader]" 30:26.100 [INFO] TestAgent.server: cluster leadership acquired 30:26.100 [INFO] TestAgent.server: New leader elected: payload=Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28 30:26.117 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30133 30:26.164 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:26.216 [INFO] TestAgent: Requesting shutdown 30:26.216 [INFO] TestAgent.server: shutting down server 30:26.216 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:26.216 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:26.228 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 30:26.232 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:26.232 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:26.232 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:26.232 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:26.232 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:26.232 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28 30:26.232 [INFO] TestAgent.server: member joined, marking health alive: member=Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28 2021-10-05T16:30:26.236Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:26.236Z [INFO] agent.router.manager: shutting down 30:26.252 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-71a79908-f0f1-31ca-3875-1aa3bd67aa28 127.0.0.1 30131 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:71a79908-f0f1-31ca-3875-1aa3bd67aa28 port:30133 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:30132] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 30:26.252 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:26.252 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:26.252 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:26.252 [INFO] TestAgent: consul server down 30:26.252 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:26.252 [INFO] TestAgent: shutdown complete 30:26.252 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:26.252 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30128 network=tcp 30:26.252 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30128 network=udp 30:26.252 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:26.252 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:26.252 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30129 network=tcp 30:26.752 [INFO] TestAgent: Waiting for endpoints to shut down 30:26.752 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! --- PASS: TestAgent_loadServices_sidecarOverrideMeta (0.00s) --- PASS: TestAgent_loadServices_sidecarOverrideMeta/normal (1.04s) --- PASS: TestAgent_loadServices_sidecarOverrideMeta/service_manager (1.04s) === RUN TestAgent_unloadServices === RUN TestAgent_unloadServices/normal === PAUSE TestAgent_unloadServices/normal === RUN TestAgent_unloadServices/service_manager === PAUSE TestAgent_unloadServices/service_manager === CONT TestAgent_unloadServices/normal === CONT TestAgent_unloadServices/service_manager [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:26.863Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:26.910Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:26.996 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9ea4d602-ed2c-92f2-8c1b-cd6adb6ff29d Address:127.0.0.1:30147}]" 30:26.997 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9ea4d602-ed2c-92f2-8c1b-cd6adb6ff29d.dc1 127.0.0.1 30:26.998 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9ea4d602-ed2c-92f2-8c1b-cd6adb6ff29d 127.0.0.1 2021-10-05T16:30:26.998Z [INFO] agent.router: Initializing LAN area manager 30:26.998 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30142 network=udp 30:26.998 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30147 [Follower]" leader= 30:26.998 [INFO] TestAgent.server: Adding LAN server: server="Node-9ea4d602-ed2c-92f2-8c1b-cd6adb6ff29d (Addr: tcp/127.0.0.1:30147) (DC: dc1)" 30:26.998 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9ea4d602-ed2c-92f2-8c1b-cd6adb6ff29d.dc1 area=wan 30:26.998 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30142 network=tcp 30:26.999 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30143 network=tcp 30:26.999 [INFO] TestAgent: started state syncer 30:26.999 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30148 network=tcp 30:27.040 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:27.040 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30147 [Candidate]" term=2 30:27.095 [DEBUG] TestAgent.server.raft: votes: needed=1 30:27.095 [DEBUG] TestAgent.server.raft: vote granted: from=9ea4d602-ed2c-92f2-8c1b-cd6adb6ff29d term=2 tally=1 30:27.095 [INFO] TestAgent.server.raft: election won: tally=1 30:27.095 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30147 [Leader]" 30:27.096 [INFO] TestAgent.server: cluster leadership acquired 30:27.096 [INFO] TestAgent.server: New leader elected: payload=Node-9ea4d602-ed2c-92f2-8c1b-cd6adb6ff29d 30:27.125 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30147 30:27.176 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:27.188 [DEBUG] TestAgent: removed service: service=redis 30:27.188 [INFO] TestAgent: Requesting shutdown 30:27.188 [INFO] TestAgent.server: shutting down server 30:27.188 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:27.188 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:27.204 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:27.216Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:27.216Z [INFO] agent.router.manager: shutting down 30:27.220 [INFO] TestAgent: consul server down 30:27.220 [INFO] TestAgent: shutdown complete 30:27.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30142 network=tcp 30:27.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30142 network=udp 30:27.220 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30143 network=tcp 30:27.220 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 30:27.220 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 30:27.724 [INFO] TestAgent: Waiting for endpoints to shut down 30:27.724 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:26.885Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:26.921Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:27.000 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:864458e4-6e50-275c-6ae0-49c599edcebb Address:127.0.0.1:30140}]" 30:27.001 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-864458e4-6e50-275c-6ae0-49c599edcebb.dc1 127.0.0.1 30:27.001 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-864458e4-6e50-275c-6ae0-49c599edcebb 127.0.0.1 2021-10-05T16:30:27.001Z [INFO] agent.router: Initializing LAN area manager 30:27.002 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30135 network=udp 30:27.002 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30140 [Follower]" leader= 30:27.002 [INFO] TestAgent.server: Adding LAN server: server="Node-864458e4-6e50-275c-6ae0-49c599edcebb (Addr: tcp/127.0.0.1:30140) (DC: dc1)" 30:27.002 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-864458e4-6e50-275c-6ae0-49c599edcebb.dc1 area=wan 30:27.002 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30135 network=tcp 30:27.003 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30136 network=tcp 30:27.003 [INFO] TestAgent: started state syncer 30:27.003 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30141 network=tcp 30:27.040 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:27.040 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30140 [Candidate]" term=2 30:27.096 [DEBUG] TestAgent.server.raft: votes: needed=1 30:27.096 [DEBUG] TestAgent.server.raft: vote granted: from=864458e4-6e50-275c-6ae0-49c599edcebb term=2 tally=1 30:27.096 [INFO] TestAgent.server.raft: election won: tally=1 30:27.096 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30140 [Leader]" 30:27.096 [INFO] TestAgent.server: cluster leadership acquired 30:27.096 [INFO] TestAgent.server: New leader elected: payload=Node-864458e4-6e50-275c-6ae0-49c599edcebb 30:27.124 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30140 30:27.180 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:27.248 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:27.248 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:27.248 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:27.248 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:27.248 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:27.248 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-864458e4-6e50-275c-6ae0-49c599edcebb 30:27.248 [INFO] TestAgent.server: member joined, marking health alive: member=Node-864458e4-6e50-275c-6ae0-49c599edcebb 30:27.280 [INFO] TestAgent.server: federation state anti-entropy synced 30:27.324 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:27.340 [INFO] TestAgent: Synced node info 30:27.405 [DEBUG] TestAgent: removed service: service=redis 30:27.405 [INFO] TestAgent: Requesting shutdown 30:27.405 [INFO] TestAgent.server: shutting down server 30:27.405 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:27.405 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:27.405 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:27.405 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:27.405 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:27.405 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:27.405 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:27.405 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:27.405 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:27.405 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:27.412 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:27.419Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:27.419Z [INFO] agent.router.manager: shutting down 30:27.419 [INFO] TestAgent: consul server down 30:27.419 [INFO] TestAgent: shutdown complete 30:27.419 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30135 network=tcp 30:27.419 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30135 network=udp 30:27.419 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30136 network=tcp 30:27.920 [INFO] TestAgent: Waiting for endpoints to shut down 30:27.920 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_unloadServices (0.00s) --- PASS: TestAgent_unloadServices/service_manager (0.88s) --- PASS: TestAgent_unloadServices/normal (1.08s) === RUN TestAgent_Service_MaintenanceMode === PAUSE TestAgent_Service_MaintenanceMode === RUN TestAgent_Service_Reap [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:27.965Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:28.000Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:28.088 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b9f847f0-7c29-ec0c-8294-009e40e2794f Address:127.0.0.1:30154}]" 30:28.089 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b9f847f0-7c29-ec0c-8294-009e40e2794f.dc1 127.0.0.1 30:28.089 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b9f847f0-7c29-ec0c-8294-009e40e2794f 127.0.0.1 2021-10-05T16:30:28.089Z [INFO] agent.router: Initializing LAN area manager 30:28.089 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30149 network=udp 30:28.089 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30154 [Follower]" leader= 30:28.090 [INFO] TestAgent.server: Adding LAN server: server="Node-b9f847f0-7c29-ec0c-8294-009e40e2794f (Addr: tcp/127.0.0.1:30154) (DC: dc1)" 30:28.090 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b9f847f0-7c29-ec0c-8294-009e40e2794f.dc1 area=wan 30:28.090 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30149 network=tcp 30:28.090 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30150 network=tcp 30:28.090 [INFO] TestAgent: started state syncer 30:28.090 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30155 network=tcp 30:28.132 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:28.132 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30154 [Candidate]" term=2 30:28.172 [DEBUG] TestAgent.server.raft: votes: needed=1 30:28.172 [DEBUG] TestAgent.server.raft: vote granted: from=b9f847f0-7c29-ec0c-8294-009e40e2794f term=2 tally=1 30:28.172 [INFO] TestAgent.server.raft: election won: tally=1 30:28.172 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30154 [Leader]" 30:28.176 [INFO] TestAgent.server: cluster leadership acquired 30:28.176 [INFO] TestAgent.server: New leader elected: payload=Node-b9f847f0-7c29-ec0c-8294-009e40e2794f 30:28.211 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30154 30:28.229 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:28.291 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:28.291 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:28.291 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:28.291 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:28.291 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:28.291 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b9f847f0-7c29-ec0c-8294-009e40e2794f 30:28.291 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b9f847f0-7c29-ec0c-8294-009e40e2794f 30:28.304 [INFO] TestAgent.server: federation state anti-entropy synced 30:28.340 [WARN] TestAgent: Check missed TTL, is now critical: check=service:redis 30:28.397 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:28.419 [INFO] TestAgent: Synced node info 30:28.428 [INFO] TestAgent: Synced service: service=redis 30:28.428 [DEBUG] TestAgent: Check in sync: check=service:redis 30:28.428 [DEBUG] TestAgent: Check status updated: check=service:redis status=passing 30:28.428 [DEBUG] TestAgent: Node info in sync 30:28.428 [DEBUG] TestAgent: Service in sync: service=redis 30:28.428 [DEBUG] TestAgent: Check in sync: check=service:redis 30:28.456 [WARN] TestAgent: Check missed TTL, is now critical: check=service:redis 30:28.684 [DEBUG] TestAgent: removed check: check=service:redis 30:28.684 [DEBUG] TestAgent: removed service: service=redis 30:28.684 [INFO] TestAgent: Check for service has been critical for too long; deregistered service: service=redis check=service:redis 30:28.929 [INFO] TestAgent: Requesting shutdown 30:28.929 [INFO] TestAgent.server: shutting down server 30:28.929 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:28.929 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:28.929 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:28.929 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:28.929 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:28.930 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:28.930 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:28.930 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:28.930 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:28.930 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:28.940 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:28.948Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:28.948Z [INFO] agent.router.manager: shutting down 30:28.948 [INFO] TestAgent: consul server down 30:28.948 [INFO] TestAgent: shutdown complete 30:28.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30149 network=tcp 30:28.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30149 network=udp 30:28.948 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30150 network=tcp 30:29.449 [INFO] TestAgent: Waiting for endpoints to shut down 30:29.449 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Service_Reap (1.53s) === RUN TestAgent_Service_NoReap [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:29.536Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:29.571Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:29.610 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1cc7a8bf-80b9-766f-d94f-0e7723573599 Address:127.0.0.1:30161}]" 30:29.611 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1cc7a8bf-80b9-766f-d94f-0e7723573599.dc1 127.0.0.1 30:29.611 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1cc7a8bf-80b9-766f-d94f-0e7723573599 127.0.0.1 2021-10-05T16:30:29.611Z [INFO] agent.router: Initializing LAN area manager 30:29.611 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30156 network=udp 30:29.611 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30161 [Follower]" leader= 30:29.612 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1cc7a8bf-80b9-766f-d94f-0e7723573599.dc1 area=wan 30:29.612 [INFO] TestAgent.server: Adding LAN server: server="Node-1cc7a8bf-80b9-766f-d94f-0e7723573599 (Addr: tcp/127.0.0.1:30161) (DC: dc1)" 30:29.612 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30156 network=tcp 30:29.612 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30157 network=tcp 30:29.613 [INFO] TestAgent: started state syncer 30:29.613 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30162 network=tcp 30:29.659 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:29.659 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30161 [Candidate]" term=2 30:29.668 [DEBUG] TestAgent.server.raft: votes: needed=1 30:29.668 [DEBUG] TestAgent.server.raft: vote granted: from=1cc7a8bf-80b9-766f-d94f-0e7723573599 term=2 tally=1 30:29.668 [INFO] TestAgent.server.raft: election won: tally=1 30:29.668 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30161 [Leader]" 30:29.668 [INFO] TestAgent.server: cluster leadership acquired 30:29.668 [INFO] TestAgent.server: New leader elected: payload=Node-1cc7a8bf-80b9-766f-d94f-0e7723573599 30:29.674 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30161 30:29.687 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:29.720 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:29.720 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:29.720 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:29.720 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:29.720 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:29.720 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1cc7a8bf-80b9-766f-d94f-0e7723573599 30:29.720 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1cc7a8bf-80b9-766f-d94f-0e7723573599 30:29.733 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:29.751 [INFO] TestAgent: Synced node info 30:29.751 [DEBUG] TestAgent: Node info in sync 30:29.751 [INFO] TestAgent.server: federation state anti-entropy synced 30:30.039 [WARN] TestAgent: Check missed TTL, is now critical: check=service:redis 30:30.106 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:30.106 [DEBUG] TestAgent: Node info in sync 30:30.115 [INFO] TestAgent: Synced service: service=redis 30:30.115 [DEBUG] TestAgent: Check in sync: check=service:redis 30:30.115 [DEBUG] TestAgent: Node info in sync 30:30.115 [DEBUG] TestAgent: Service in sync: service=redis 30:30.115 [DEBUG] TestAgent: Check in sync: check=service:redis 30:30.415 [INFO] TestAgent: Requesting shutdown 30:30.415 [INFO] TestAgent.server: shutting down server 30:30.415 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:30.416 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:30.416 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:30.416 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:30.416 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:30.416 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:30.416 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:30.416 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:30.416 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:30.416 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:30.420 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:30.421Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:30.421Z [INFO] agent.router.manager: shutting down 30:30.421 [INFO] TestAgent: consul server down 30:30.421 [INFO] TestAgent: shutdown complete 30:30.421 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30156 network=tcp 30:30.421 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30156 network=udp 30:30.421 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30157 network=tcp 30:30.924 [INFO] TestAgent: Waiting for endpoints to shut down 30:30.924 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Service_NoReap (1.47s) === RUN TestAgent_AddService_restoresSnapshot === RUN TestAgent_AddService_restoresSnapshot/normal === PAUSE TestAgent_AddService_restoresSnapshot/normal === RUN TestAgent_AddService_restoresSnapshot/service_manager === PAUSE TestAgent_AddService_restoresSnapshot/service_manager === CONT TestAgent_AddService_restoresSnapshot/normal === CONT TestAgent_AddService_restoresSnapshot/service_manager [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:30.979Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:31.017Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:31.094 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:22ffac0f-7e13-a75f-7ea7-8267a4d0f313 Address:127.0.0.1:30168}]" 30:31.094 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-22ffac0f-7e13-a75f-7ea7-8267a4d0f313.dc1 127.0.0.1 30:31.095 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-22ffac0f-7e13-a75f-7ea7-8267a4d0f313 127.0.0.1 2021-10-05T16:30:31.095Z [INFO] agent.router: Initializing LAN area manager 30:31.095 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30163 network=udp 30:31.095 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30168 [Follower]" leader= 30:31.095 [INFO] TestAgent.server: Adding LAN server: server="Node-22ffac0f-7e13-a75f-7ea7-8267a4d0f313 (Addr: tcp/127.0.0.1:30168) (DC: dc1)" 30:31.096 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-22ffac0f-7e13-a75f-7ea7-8267a4d0f313.dc1 area=wan 30:31.096 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30163 network=tcp 30:31.096 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30164 network=tcp 30:31.096 [INFO] TestAgent: started state syncer 30:31.096 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30169 network=tcp 30:31.158 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:31.158 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30168 [Candidate]" term=2 30:31.167 [DEBUG] TestAgent.server.raft: votes: needed=1 30:31.167 [DEBUG] TestAgent.server.raft: vote granted: from=22ffac0f-7e13-a75f-7ea7-8267a4d0f313 term=2 tally=1 30:31.167 [INFO] TestAgent.server.raft: election won: tally=1 30:31.167 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30168 [Leader]" 30:31.168 [INFO] TestAgent.server: cluster leadership acquired 30:31.168 [INFO] TestAgent.server: New leader elected: payload=Node-22ffac0f-7e13-a75f-7ea7-8267a4d0f313 30:31.172 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30168 30:31.185 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:31.207 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:31.207 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:31.207 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:31.207 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:31.207 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:31.207 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-22ffac0f-7e13-a75f-7ea7-8267a4d0f313 30:31.208 [INFO] TestAgent.server: member joined, marking health alive: member=Node-22ffac0f-7e13-a75f-7ea7-8267a4d0f313 30:31.208 [INFO] TestAgent: Requesting shutdown 30:31.208 [INFO] TestAgent.server: shutting down server 30:31.208 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:31.208 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:31.208 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:31.208 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:31.208 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:31.208 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:31.208 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:31.208 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:31.208 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:31.215 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 30:31.218 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:31.218 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:30:31.221Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:31.221Z [INFO] agent.router.manager: shutting down 30:31.221 [INFO] TestAgent: consul server down 30:31.221 [INFO] TestAgent: shutdown complete 30:31.221 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30163 network=tcp 30:31.221 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30163 network=udp 30:31.221 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30164 network=tcp 30:31.724 [INFO] TestAgent: Waiting for endpoints to shut down 30:31.724 [INFO] TestAgent: Endpoints down [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:30.975Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:31.017Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:31.080 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0e6f2b0e-be92-f432-ee1c-bc6793e4d240 Address:127.0.0.1:30175}]" 30:31.080 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30175 [Follower]" leader= 30:31.082 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0e6f2b0e-be92-f432-ee1c-bc6793e4d240.dc1 127.0.0.1 30:31.083 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0e6f2b0e-be92-f432-ee1c-bc6793e4d240 127.0.0.1 2021-10-05T16:30:31.083Z [INFO] agent.router: Initializing LAN area manager 30:31.083 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30170 network=udp 30:31.083 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0e6f2b0e-be92-f432-ee1c-bc6793e4d240.dc1 area=wan 30:31.083 [INFO] TestAgent.server: Adding LAN server: server="Node-0e6f2b0e-be92-f432-ee1c-bc6793e4d240 (Addr: tcp/127.0.0.1:30175) (DC: dc1)" 30:31.083 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30170 network=tcp 30:31.084 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30171 network=tcp 30:31.084 [INFO] TestAgent: started state syncer 30:31.084 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30176 network=tcp 30:31.140 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:31.140 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30175 [Candidate]" term=2 30:31.184 [DEBUG] TestAgent.server.raft: votes: needed=1 30:31.184 [DEBUG] TestAgent.server.raft: vote granted: from=0e6f2b0e-be92-f432-ee1c-bc6793e4d240 term=2 tally=1 30:31.184 [INFO] TestAgent.server.raft: election won: tally=1 30:31.184 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30175 [Leader]" 30:31.188 [INFO] TestAgent.server: cluster leadership acquired 30:31.188 [INFO] TestAgent.server: New leader elected: payload=Node-0e6f2b0e-be92-f432-ee1c-bc6793e4d240 30:31.207 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30175 30:31.222 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:31.247 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:31.247 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:31.247 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:31.247 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:31.247 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:31.247 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0e6f2b0e-be92-f432-ee1c-bc6793e4d240 30:31.247 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0e6f2b0e-be92-f432-ee1c-bc6793e4d240 30:31.268 [INFO] TestAgent.server: federation state anti-entropy synced 30:31.352 [INFO] TestAgent: Requesting shutdown 30:31.352 [INFO] TestAgent.server: shutting down server 30:31.352 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:31.352 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:31.352 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:31.352 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:31.352 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:31.352 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:31.352 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:31.352 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:31.352 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:31.352 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:31.352 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:31.360 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:31.368Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:31.368Z [INFO] agent.router.manager: shutting down 30:31.368 [INFO] TestAgent: consul server down 30:31.368 [INFO] TestAgent: shutdown complete 30:31.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30170 network=tcp 30:31.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30170 network=udp 30:31.368 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30171 network=tcp 30:31.872 [INFO] TestAgent: Waiting for endpoints to shut down 30:31.872 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddService_restoresSnapshot (0.00s) --- PASS: TestAgent_AddService_restoresSnapshot/normal (0.80s) --- PASS: TestAgent_AddService_restoresSnapshot/service_manager (0.94s) === RUN TestAgent_AddCheck_restoresSnapshot === PAUSE TestAgent_AddCheck_restoresSnapshot === RUN TestAgent_NodeMaintenanceMode === PAUSE TestAgent_NodeMaintenanceMode === RUN TestAgent_checkStateSnapshot === PAUSE TestAgent_checkStateSnapshot === RUN TestAgent_loadChecks_checkFails === PAUSE TestAgent_loadChecks_checkFails === RUN TestAgent_persistCheckState === PAUSE TestAgent_persistCheckState === RUN TestAgent_loadCheckState === PAUSE TestAgent_loadCheckState === RUN TestAgent_purgeCheckState === PAUSE TestAgent_purgeCheckState === RUN TestAgent_GetCoordinate === PAUSE TestAgent_GetCoordinate === RUN TestAgent_reloadWatches === PAUSE TestAgent_reloadWatches === RUN TestAgent_reloadWatchesHTTPS === PAUSE TestAgent_reloadWatchesHTTPS === RUN TestAgent_loadTokens === PAUSE TestAgent_loadTokens === RUN TestAgent_SecurityChecks === PAUSE TestAgent_SecurityChecks === RUN TestAgent_ReloadConfigOutgoingRPCConfig === PAUSE TestAgent_ReloadConfigOutgoingRPCConfig === RUN TestAgent_ReloadConfigAndKeepChecksStatus === RUN TestAgent_ReloadConfigAndKeepChecksStatus/normal === PAUSE TestAgent_ReloadConfigAndKeepChecksStatus/normal === RUN TestAgent_ReloadConfigAndKeepChecksStatus/service_manager === PAUSE TestAgent_ReloadConfigAndKeepChecksStatus/service_manager === CONT TestAgent_ReloadConfigAndKeepChecksStatus/normal agent_test.go:3644: DM-skipped === CONT TestAgent_ReloadConfigAndKeepChecksStatus/service_manager agent_test.go:3644: DM-skipped --- PASS: TestAgent_ReloadConfigAndKeepChecksStatus (0.00s) --- SKIP: TestAgent_ReloadConfigAndKeepChecksStatus/normal (0.00s) --- SKIP: TestAgent_ReloadConfigAndKeepChecksStatus/service_manager (0.00s) === RUN TestAgent_ReloadConfigIncomingRPCConfig === PAUSE TestAgent_ReloadConfigIncomingRPCConfig === RUN TestAgent_ReloadConfigTLSConfigFailure === PAUSE TestAgent_ReloadConfigTLSConfigFailure === RUN TestAgent_consulConfig_AutoEncryptAllowTLS === PAUSE TestAgent_consulConfig_AutoEncryptAllowTLS === RUN TestAgent_consulConfig_RaftTrailingLogs === PAUSE TestAgent_consulConfig_RaftTrailingLogs === RUN TestAgent_grpcInjectAddr === RUN TestAgent_grpcInjectAddr/localhost_web_svc === RUN TestAgent_grpcInjectAddr/localhost_no_svc === RUN TestAgent_grpcInjectAddr/ipv4_web_svc === RUN TestAgent_grpcInjectAddr/ipv4_no_svc === RUN TestAgent_grpcInjectAddr/ipv6_no_svc === RUN TestAgent_grpcInjectAddr/ipv6_web_svc === RUN TestAgent_grpcInjectAddr/zone_ipv6_web_svc === RUN TestAgent_grpcInjectAddr/ipv6_literal_web_svc === RUN TestAgent_grpcInjectAddr/ipv6_injected_into_ipv6_url === RUN TestAgent_grpcInjectAddr/ipv6_injected_into_ipv6_url_with_svc === RUN TestAgent_grpcInjectAddr/ipv6_injected_into_ipv6_url_with_special --- PASS: TestAgent_grpcInjectAddr (0.00s) --- PASS: TestAgent_grpcInjectAddr/localhost_web_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/localhost_no_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv4_web_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv4_no_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv6_no_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv6_web_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/zone_ipv6_web_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv6_literal_web_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv6_injected_into_ipv6_url (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv6_injected_into_ipv6_url_with_svc (0.00s) --- PASS: TestAgent_grpcInjectAddr/ipv6_injected_into_ipv6_url_with_special (0.00s) === RUN TestAgent_httpInjectAddr === RUN TestAgent_httpInjectAddr/localhost_health === RUN TestAgent_httpInjectAddr/https_localhost_health === RUN TestAgent_httpInjectAddr/https_ipv4_health === RUN TestAgent_httpInjectAddr/https_ipv4_without_path === RUN TestAgent_httpInjectAddr/https_ipv6_health === RUN TestAgent_httpInjectAddr/https_ipv6_with_zone === RUN TestAgent_httpInjectAddr/https_ipv6_literal === RUN TestAgent_httpInjectAddr/https_ipv6_without_path === RUN TestAgent_httpInjectAddr/ipv6_injected_into_ipv6_url === RUN TestAgent_httpInjectAddr/ipv6_with_brackets_injected_into_ipv6_url === RUN TestAgent_httpInjectAddr/short_domain_health === RUN TestAgent_httpInjectAddr/nested_url_in_query --- PASS: TestAgent_httpInjectAddr (0.00s) --- PASS: TestAgent_httpInjectAddr/localhost_health (0.00s) --- PASS: TestAgent_httpInjectAddr/https_localhost_health (0.00s) --- PASS: TestAgent_httpInjectAddr/https_ipv4_health (0.00s) --- PASS: TestAgent_httpInjectAddr/https_ipv4_without_path (0.00s) --- PASS: TestAgent_httpInjectAddr/https_ipv6_health (0.00s) --- PASS: TestAgent_httpInjectAddr/https_ipv6_with_zone (0.00s) --- PASS: TestAgent_httpInjectAddr/https_ipv6_literal (0.00s) --- PASS: TestAgent_httpInjectAddr/https_ipv6_without_path (0.00s) --- PASS: TestAgent_httpInjectAddr/ipv6_injected_into_ipv6_url (0.00s) --- PASS: TestAgent_httpInjectAddr/ipv6_with_brackets_injected_into_ipv6_url (0.00s) --- PASS: TestAgent_httpInjectAddr/short_domain_health (0.00s) --- PASS: TestAgent_httpInjectAddr/nested_url_in_query (0.00s) === RUN TestDefaultIfEmpty --- PASS: TestDefaultIfEmpty (0.00s) === RUN TestConfigSourceFromName === RUN TestConfigSourceFromName/local === RUN TestConfigSourceFromName/remote === RUN TestConfigSourceFromName/#00 === RUN TestConfigSourceFromName/LOCAL === RUN TestConfigSourceFromName/REMOTE === RUN TestConfigSourceFromName/garbage === RUN TestConfigSourceFromName/_ --- PASS: TestConfigSourceFromName (0.00s) --- PASS: TestConfigSourceFromName/local (0.00s) --- PASS: TestConfigSourceFromName/remote (0.00s) --- PASS: TestConfigSourceFromName/#00 (0.00s) --- PASS: TestConfigSourceFromName/LOCAL (0.00s) --- PASS: TestConfigSourceFromName/REMOTE (0.00s) --- PASS: TestConfigSourceFromName/garbage (0.00s) --- PASS: TestConfigSourceFromName/_ (0.00s) === RUN TestAgent_RerouteExistingHTTPChecks === PAUSE TestAgent_RerouteExistingHTTPChecks === RUN TestAgent_RerouteNewHTTPChecks === PAUSE TestAgent_RerouteNewHTTPChecks === RUN TestAgentCache_serviceInConfigFile_initialFetchErrors_Issue6521 agent_test.go:4245: DM-skipped --- SKIP: TestAgentCache_serviceInConfigFile_initialFetchErrors_Issue6521 (0.00s) === RUN TestAgent_JoinWAN_viaMeshGateway === PAUSE TestAgent_JoinWAN_viaMeshGateway === RUN TestAutoConfig_Integration [WARN] freeport: 6 out of 13 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! agent_test.go:4731: Forcing roots rotation on the server [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:32.474Z [INFO] agent.auto_config: retrieving initial agent auto configuration remotely 30:32.648 [INFO] test-client.client.serf.lan: serf: EventMemberJoin: test-client 127.0.0.1 2021-10-05T16:30:32.648Z [INFO] agent.router: Initializing LAN area manager 2021-10-05T16:30:32.648Z [INFO] agent.auto_config: auto-config started 30:32.649 [INFO] test-client: Started DNS server: address=127.0.0.1:30184 network=udp 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.649Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.650Z [WARN] agent.router.manager: No servers available 30:32.650 [INFO] test-client: Started DNS server: address=127.0.0.1:30184 network=tcp 30:32.651 [INFO] test-client: Started HTTP server: address=127.0.0.1:30185 network=tcp 30:32.651 [INFO] test-client: started state syncer 2021-10-05T16:30:32.651Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:32.651Z [WARN] agent.router.manager: No servers available 30:32.651 [INFO] test-client: Started gRPC server: address=127.0.0.1:30190 network=tcp 30:32.651 [INFO] test-client: Retry join is supported for the following discovery methods: cluster=LAN discovery_methods="aliyun aws gce mdns os packet" 30:32.651 [INFO] test-client: Joining cluster...: cluster=LAN 30:32.651 [INFO] test-client: (LAN) joining: lan_addresses=[127.0.0.1:30180] 2021-10-05T16:30:32.651Z [WARN] agent.router.manager: No servers available 30:32.651 [ERROR] test-client.anti_entropy: failed to sync remote state: error="No known Consul servers" 30:32.652 [DEBUG] test-client.client.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:30180 30:32.656 [INFO] test-client.client.serf.lan: serf: EventMemberJoin: Node-41aa8851-0d80-6bc4-6a22-a462368701d3 127.0.0.1 30:32.656 [INFO] test-client: (LAN) joined: number_of_nodes=1 30:32.656 [DEBUG] test-client: systemd notify failed: error="No socket" 30:32.656 [INFO] test-client: Join cluster completed. Synced with initial agents: cluster=LAN num_agents=1 30:32.656 [INFO] test-client.client: adding server: server="Node-41aa8851-0d80-6bc4-6a22-a462368701d3 (Addr: tcp/127.0.0.1:30182) (DC: dc1)" 30:32.700 [DEBUG] test-client.client: transitioned out of legacy ACL mode 30:32.700 [INFO] test-client.client.serf.lan: serf: EventMemberUpdate: test-client 30:32.828 [DEBUG] test-client.client.serf.lan: serf: messageUserEventType: consul:new-leader 30:33.025 [DEBUG] test-client.client.serf.lan: serf: messageUserEventType: consul:new-leader 30:33.025 [DEBUG] test-client.client.serf.lan: serf: messageJoinType: test-client 30:33.025 [DEBUG] test-client.client.serf.lan: serf: messageUserEventType: consul:new-leader 30:33.025 [DEBUG] test-client.client.serf.lan: serf: messageJoinType: test-client 30:33.225 [DEBUG] test-client.client.serf.lan: serf: messageUserEventType: consul:new-leader 30:33.225 [DEBUG] test-client.client.serf.lan: serf: messageJoinType: test-client 30:33.428 [DEBUG] test-client.client.serf.lan: serf: messageJoinType: test-client 30:34.739 [DEBUG] test-client: Skipping remote check since it is managed automatically: check=serfHealth 30:34.744 [INFO] test-client: Synced node info 30:34.744 [DEBUG] test-client: Node info in sync 30:34.925 [INFO] test-client: Requesting shutdown 30:34.925 [INFO] test-client.client: shutting down client 30:34.925 [WARN] test-client.client.serf.lan: serf: Shutdown without a Leave 30:34.929 [INFO] test-client: consul client down 30:34.929 [INFO] test-client: shutdown complete 30:34.929 [INFO] test-client: Stopping server: protocol=DNS address=127.0.0.1:30184 network=tcp 30:34.929 [INFO] test-client: Stopping server: protocol=DNS address=127.0.0.1:30184 network=udp 30:34.929 [INFO] test-client: Stopping server: protocol=HTTP address=127.0.0.1:30185 network=tcp 30:34.929 [ERROR] test-client.client: RPC failed to server: method=ConnectCA.Roots server=127.0.0.1:30182 error="rpc error making call: EOF" 30:35.436 [INFO] test-client: Waiting for endpoints to shut down 30:35.436 [INFO] test-client: Endpoints down 2021-10-05T16:30:31.907Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:31.939Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:32.020 [INFO] TestAgent-Server.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:41aa8851-0d80-6bc4-6a22-a462368701d3 Address:127.0.0.1:30182}]" 30:32.021 [INFO] TestAgent-Server.server.serf.wan: serf: EventMemberJoin: Node-41aa8851-0d80-6bc4-6a22-a462368701d3.dc1 127.0.0.1 30:32.022 [INFO] TestAgent-Server.server.serf.lan: serf: EventMemberJoin: Node-41aa8851-0d80-6bc4-6a22-a462368701d3 127.0.0.1 2021-10-05T16:30:32.022Z [INFO] agent.router: Initializing LAN area manager 30:32.022 [INFO] TestAgent-Server: Started DNS server: address=127.0.0.1:30177 network=udp 30:32.022 [INFO] TestAgent-Server.server.raft: entering follower state: follower="Node at 127.0.0.1:30182 [Follower]" leader= 30:32.023 [INFO] TestAgent-Server.server: Adding LAN server: server="Node-41aa8851-0d80-6bc4-6a22-a462368701d3 (Addr: tcp/127.0.0.1:30182) (DC: dc1)" 30:32.023 [INFO] TestAgent-Server.server: Handled event for server in area: event=member-join server=Node-41aa8851-0d80-6bc4-6a22-a462368701d3.dc1 area=wan 30:32.023 [INFO] TestAgent-Server: Started DNS server: address=127.0.0.1:30177 network=tcp 30:32.023 [INFO] TestAgent-Server: Started HTTP server: address=127.0.0.1:30178 network=tcp 30:32.023 [INFO] TestAgent-Server: started state syncer 30:32.023 [INFO] TestAgent-Server: Started gRPC server: address=127.0.0.1:30183 network=tcp 30:32.060 [WARN] TestAgent-Server.server.raft: heartbeat timeout reached, starting election: last-leader= 30:32.060 [INFO] TestAgent-Server.server.raft: entering candidate state: node="Node at 127.0.0.1:30182 [Candidate]" term=2 30:32.076 [DEBUG] TestAgent-Server.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:32.108 [DEBUG] TestAgent-Server.server.raft: votes: needed=1 30:32.108 [DEBUG] TestAgent-Server.server.raft: vote granted: from=41aa8851-0d80-6bc4-6a22-a462368701d3 term=2 tally=1 30:32.108 [INFO] TestAgent-Server.server.raft: election won: tally=1 30:32.108 [INFO] TestAgent-Server.server.raft: entering leader state: leader="Node at 127.0.0.1:30182 [Leader]" 30:32.112 [INFO] TestAgent-Server.server: cluster leadership acquired 30:32.112 [INFO] TestAgent-Server.server: New leader elected: payload=Node-41aa8851-0d80-6bc4-6a22-a462368701d3 30:32.140 [INFO] TestAgent-Server.server: initializing acls 30:32.156 [INFO] TestAgent-Server.server: Created ACL 'global-management' policy 30:32.172 [ERROR] TestAgent-Server.anti_entropy: failed to sync remote state: error="ACL not found" 30:32.172 [INFO] TestAgent-Server.server: Bootstrapped ACL master token from configuration 30:32.176 [INFO] TestAgent-Server.server: initializing acls 30:32.220 [INFO] TestAgent-Server.server: Created ACL anonymous token from configuration 30:32.220 [INFO] TestAgent-Server.leader: started routine: routine="legacy ACL token upgrade" 30:32.220 [INFO] TestAgent-Server.leader: started routine: routine="acl token reaping" 30:32.220 [DEBUG] TestAgent-Server.server: transitioning out of legacy ACL mode 30:32.220 [INFO] TestAgent-Server.server.serf.lan: serf: EventMemberUpdate: Node-41aa8851-0d80-6bc4-6a22-a462368701d3 30:32.220 [INFO] TestAgent-Server.server.serf.wan: serf: EventMemberUpdate: Node-41aa8851-0d80-6bc4-6a22-a462368701d3.dc1 30:32.220 [INFO] TestAgent-Server.server: Handled event for server in area: event=member-update server=Node-41aa8851-0d80-6bc4-6a22-a462368701d3.dc1 area=wan 30:32.220 [INFO] TestAgent-Server.server: Created ACL anonymous token from configuration 30:32.220 [INFO] TestAgent-Server.server.serf.lan: serf: EventMemberUpdate: Node-41aa8851-0d80-6bc4-6a22-a462368701d3 30:32.220 [INFO] TestAgent-Server.server.serf.wan: serf: EventMemberUpdate: Node-41aa8851-0d80-6bc4-6a22-a462368701d3.dc1 30:32.224 [INFO] TestAgent-Server.server: Updating LAN server: server="Node-41aa8851-0d80-6bc4-6a22-a462368701d3 (Addr: tcp/127.0.0.1:30182) (DC: dc1)" 30:32.224 [INFO] TestAgent-Server.server: Updating LAN server: server="Node-41aa8851-0d80-6bc4-6a22-a462368701d3 (Addr: tcp/127.0.0.1:30182) (DC: dc1)" 30:32.224 [INFO] TestAgent-Server.server: Handled event for server in area: event=member-update server=Node-41aa8851-0d80-6bc4-6a22-a462368701d3.dc1 area=wan 30:32.272 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:32.336 [INFO] TestAgent-Server.server.connect: initialized primary datacenter CA with provider: provider=consul 30:32.336 [INFO] TestAgent-Server.leader: started routine: routine="federation state anti-entropy" 30:32.336 [INFO] TestAgent-Server.leader: started routine: routine="federation state pruning" 30:32.336 [INFO] TestAgent-Server.leader: started routine: routine="intermediate cert renew watch" 30:32.336 [INFO] TestAgent-Server.leader: started routine: routine="CA root pruning" 30:32.336 [DEBUG] TestAgent-Server.server: Skipping self join check for node since the cluster is too small: node=Node-41aa8851-0d80-6bc4-6a22-a462368701d3 30:32.336 [INFO] TestAgent-Server.server: member joined, marking health alive: member=Node-41aa8851-0d80-6bc4-6a22-a462368701d3 30:32.352 [DEBUG] TestAgent-Server.server: Skipping self join check for node since the cluster is too small: node=Node-41aa8851-0d80-6bc4-6a22-a462368701d3 30:32.352 [DEBUG] TestAgent-Server.server: Skipping self join check for node since the cluster is too small: node=Node-41aa8851-0d80-6bc4-6a22-a462368701d3 30:32.368 [INFO] TestAgent-Server.server: federation state anti-entropy synced 30:32.652 [DEBUG] TestAgent-Server.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:36408 30:32.653 [INFO] TestAgent-Server.server.serf.lan: serf: EventMemberJoin: test-client 127.0.0.1 30:32.653 [INFO] TestAgent-Server.server: member joined, marking health alive: member=test-client 30:32.752 [DEBUG] connect.ca.consul: consul CA provider configured: id=39:3b:97:f2:f0:0a:8b:98:a0:55:68:1e:c4:04:9b:8d:92:e5:1d:b5:67:e9:0f:f3:ea:4e:7e:93:e0:31:6e:98 is_primary=true 30:32.850 [INFO] TestAgent-Server.server.serf.lan: serf: EventMemberUpdate: test-client 30:32.850 [DEBUG] TestAgent-Server.server.serf.lan: serf: messageJoinType: test-client 30:32.858 [INFO] TestAgent-Server.server.connect: CA rotated to new root under provider: provider=consul 30:33.025 [DEBUG] TestAgent-Server.server.serf.lan: serf: messageJoinType: test-client 30:33.056 [DEBUG] TestAgent-Server.server.serf.lan: serf: messageJoinType: test-client 30:33.253 [DEBUG] TestAgent-Server.server.serf.lan: serf: messageJoinType: test-client 30:34.604 [DEBUG] TestAgent-Server: Skipping remote check since it is managed automatically: check=serfHealth 30:34.624 [INFO] TestAgent-Server: Synced node info 30:34.624 [DEBUG] TestAgent-Server: Node info in sync 30:35.436 [INFO] TestAgent-Server: Requesting shutdown 30:35.436 [INFO] TestAgent-Server.server: shutting down server 30:35.436 [DEBUG] TestAgent-Server.leader: stopping routine: routine="federation state anti-entropy" 30:35.436 [DEBUG] TestAgent-Server.leader: stopping routine: routine="federation state pruning" 30:35.436 [DEBUG] TestAgent-Server.leader: stopping routine: routine="intermediate cert renew watch" 30:35.436 [DEBUG] TestAgent-Server.leader: stopping routine: routine="CA root pruning" 30:35.436 [DEBUG] TestAgent-Server.leader: stopping routine: routine="legacy ACL token upgrade" 30:35.436 [DEBUG] TestAgent-Server.leader: stopping routine: routine="acl token reaping" 30:35.436 [WARN] TestAgent-Server.server.serf.lan: serf: Shutdown without a Leave 30:35.436 [DEBUG] TestAgent-Server.leader: stopped routine: routine="intermediate cert renew watch" 30:35.436 [DEBUG] TestAgent-Server.leader: stopped routine: routine="legacy ACL token upgrade" 30:35.436 [DEBUG] TestAgent-Server.leader: stopped routine: routine="CA root pruning" 30:35.436 [DEBUG] TestAgent-Server.leader: stopped routine: routine="acl token reaping" 30:35.436 [INFO] TestAgent-Server.server: shutting down Connect CA roots monitor 30:35.436 [ERROR] TestAgent-Server.server: error performing anti-entropy sync of federation state: error="context canceled" 30:35.436 [DEBUG] TestAgent-Server.leader: stopped routine: routine="federation state anti-entropy" 30:35.436 [DEBUG] TestAgent-Server.leader: stopped routine: routine="federation state pruning" 30:35.446 [WARN] TestAgent-Server.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:35.448Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:35.448Z [INFO] agent.router.manager: shutting down 30:35.449 [INFO] TestAgent-Server: consul server down 30:35.449 [INFO] TestAgent-Server: shutdown complete 30:35.449 [INFO] TestAgent-Server: Stopping server: protocol=DNS address=127.0.0.1:30177 network=tcp 30:35.449 [INFO] TestAgent-Server: Stopping server: protocol=DNS address=127.0.0.1:30177 network=udp 30:35.449 [INFO] TestAgent-Server: Stopping server: protocol=HTTP address=127.0.0.1:30178 network=tcp 30:35.524 [DEBUG] TestAgent-Server.server.memberlist.lan: memberlist: Failed ping: test-client (timeout reached) 30:35.949 [INFO] TestAgent-Server: Waiting for endpoints to shut down 30:35.949 [INFO] TestAgent-Server: Endpoints down --- PASS: TestAutoConfig_Integration (4.08s) === RUN TestAgent_AutoEncrypt [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:36.335Z [INFO] agent.auto_config: automatically upgraded to TLS 30:36.336 [INFO] test-client.client.serf.lan: serf: EventMemberJoin: test-client 127.0.0.1 2021-10-05T16:30:36.336Z [INFO] agent.router: Initializing LAN area manager 2021-10-05T16:30:36.336Z [INFO] agent.auto_config: auto-config started 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.337Z [WARN] agent.router.manager: No servers available 30:36.339 [INFO] test-client: Started DNS server: address=127.0.0.1:30198 network=tcp 30:36.339 [INFO] test-client: Started DNS server: address=127.0.0.1:30198 network=udp 30:36.340 [INFO] test-client: Started HTTPS server: address=127.0.0.1:30200 network=tcp 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 30:36.340 [INFO] test-client: started state syncer 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 30:36.340 [INFO] test-client: Started gRPC server: address=127.0.0.1:30204 network=tcp 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 30:36.340 [INFO] test-client: Retry join is supported for the following discovery methods: cluster=LAN discovery_methods="aliyun aws gce mdns os packet" 30:36.340 [INFO] test-client: Joining cluster...: cluster=LAN 30:36.340 [INFO] test-client: (LAN) joining: lan_addresses=[127.0.0.1:30194] 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 30:36.340 [ERROR] test-client.anti_entropy: failed to sync remote state: error="No known Consul servers" 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 2021-10-05T16:30:36.340Z [WARN] agent.router.manager: No servers available 30:36.344 [DEBUG] test-client.client.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:30194 30:36.348 [INFO] test-client.client.serf.lan: serf: EventMemberJoin: Node-bb656f69-3920-42d3-23b9-f7547cb38d08 127.0.0.1 30:36.348 [INFO] test-client: (LAN) joined: number_of_nodes=1 30:36.348 [DEBUG] test-client: systemd notify failed: error="No socket" 30:36.348 [INFO] test-client: Join cluster completed. Synced with initial agents: cluster=LAN num_agents=1 30:36.348 [INFO] test-client.client: adding server: server="Node-bb656f69-3920-42d3-23b9-f7547cb38d08 (Addr: tcp/127.0.0.1:30196) (DC: dc1)" 30:36.387 [DEBUG] test-client.client: transitioned out of legacy ACL mode 30:36.387 [INFO] test-client.client.serf.lan: serf: EventMemberUpdate: test-client 30:36.397 [INFO] test-client: Requesting shutdown 30:36.398 [INFO] test-client.client: shutting down client 30:36.398 [WARN] test-client.client.serf.lan: serf: Shutdown without a Leave 30:36.407 [INFO] test-client: consul client down 30:36.407 [INFO] test-client: shutdown complete 30:36.407 [INFO] test-client: Stopping server: protocol=DNS address=127.0.0.1:30198 network=tcp 30:36.407 [INFO] test-client: Stopping server: protocol=DNS address=127.0.0.1:30198 network=udp 30:36.407 [INFO] test-client: Stopping server: protocol=HTTPS address=127.0.0.1:30200 network=tcp 30:36.907 [INFO] test-client: Waiting for endpoints to shut down 30:36.907 [INFO] test-client: Endpoints down 2021-10-05T16:30:35.987Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:36.031Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:36.055 [INFO] test-server.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bb656f69-3920-42d3-23b9-f7547cb38d08 Address:127.0.0.1:30196}]" 30:36.056 [INFO] test-server.server.raft: entering follower state: follower="Node at 127.0.0.1:30196 [Follower]" leader= 30:36.056 [INFO] test-server.server.serf.wan: serf: EventMemberJoin: Node-bb656f69-3920-42d3-23b9-f7547cb38d08.dc1 127.0.0.1 30:36.057 [INFO] test-server.server.serf.lan: serf: EventMemberJoin: Node-bb656f69-3920-42d3-23b9-f7547cb38d08 127.0.0.1 2021-10-05T16:30:36.057Z [INFO] agent.router: Initializing LAN area manager 30:36.057 [INFO] test-server: Started DNS server: address=127.0.0.1:30191 network=udp 30:36.057 [INFO] test-server.server: Adding LAN server: server="Node-bb656f69-3920-42d3-23b9-f7547cb38d08 (Addr: tcp/127.0.0.1:30196) (DC: dc1)" 30:36.057 [INFO] test-server.server: Handled event for server in area: event=member-join server=Node-bb656f69-3920-42d3-23b9-f7547cb38d08.dc1 area=wan 30:36.057 [INFO] test-server: Started DNS server: address=127.0.0.1:30191 network=tcp 30:36.058 [INFO] test-server: Started HTTP server: address=127.0.0.1:30192 network=tcp 30:36.058 [INFO] test-server: started state syncer 30:36.058 [INFO] test-server: Started gRPC server: address=127.0.0.1:30197 network=tcp 30:36.104 [WARN] test-server.server.raft: heartbeat timeout reached, starting election: last-leader= 30:36.104 [INFO] test-server.server.raft: entering candidate state: node="Node at 127.0.0.1:30196 [Candidate]" term=2 30:36.108 [DEBUG] test-server.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:36.113 [DEBUG] test-server.server.raft: votes: needed=1 30:36.113 [DEBUG] test-server.server.raft: vote granted: from=bb656f69-3920-42d3-23b9-f7547cb38d08 term=2 tally=1 30:36.113 [INFO] test-server.server.raft: election won: tally=1 30:36.113 [INFO] test-server.server.raft: entering leader state: leader="Node at 127.0.0.1:30196 [Leader]" 30:36.114 [INFO] test-server.server: cluster leadership acquired 30:36.114 [INFO] test-server.server: New leader elected: payload=Node-bb656f69-3920-42d3-23b9-f7547cb38d08 30:36.120 [INFO] test-server.server: initializing acls 30:36.123 [INFO] test-server.server: Created ACL 'global-management' policy 30:36.130 [INFO] test-server.server: Bootstrapped ACL master token from configuration 30:36.145 [INFO] test-server.server: Created ACL anonymous token from configuration 30:36.145 [INFO] test-server.leader: started routine: routine="legacy ACL token upgrade" 30:36.145 [INFO] test-server.leader: started routine: routine="acl token reaping" 30:36.145 [INFO] test-server.server.serf.lan: serf: EventMemberUpdate: Node-bb656f69-3920-42d3-23b9-f7547cb38d08 30:36.145 [INFO] test-server.server.serf.wan: serf: EventMemberUpdate: Node-bb656f69-3920-42d3-23b9-f7547cb38d08.dc1 30:36.148 [INFO] test-server.server: Updating LAN server: server="Node-bb656f69-3920-42d3-23b9-f7547cb38d08 (Addr: tcp/127.0.0.1:30196) (DC: dc1)" 30:36.148 [INFO] test-server.server: Handled event for server in area: event=member-update server=Node-bb656f69-3920-42d3-23b9-f7547cb38d08.dc1 area=wan 30:36.166 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:36.184 [INFO] test-server.server.connect: initialized primary datacenter CA with provider: provider=consul 30:36.184 [INFO] test-server.leader: started routine: routine="federation state anti-entropy" 30:36.184 [INFO] test-server.leader: started routine: routine="federation state pruning" 30:36.184 [INFO] test-server.leader: started routine: routine="intermediate cert renew watch" 30:36.184 [INFO] test-server.leader: started routine: routine="CA root pruning" 30:36.184 [DEBUG] test-server.server: Skipping self join check for node since the cluster is too small: node=Node-bb656f69-3920-42d3-23b9-f7547cb38d08 30:36.184 [INFO] test-server.server: member joined, marking health alive: member=Node-bb656f69-3920-42d3-23b9-f7547cb38d08 30:36.192 [DEBUG] test-server.server: Skipping self join check for node since the cluster is too small: node=Node-bb656f69-3920-42d3-23b9-f7547cb38d08 30:36.207 [INFO] test-server.server: federation state anti-entropy synced 30:36.241 [DEBUG] test-server.acl: dropping node from result due to ACLs: node=Node-bb656f69-3920-42d3-23b9-f7547cb38d08 30:36.292 [DEBUG] test-server: Skipping remote check since it is managed automatically: check=serfHealth 30:36.304 [INFO] test-server: Synced node info 30:36.344 [DEBUG] test-server.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:51560 30:36.345 [INFO] test-server.server.serf.lan: serf: EventMemberJoin: test-client 127.0.0.1 30:36.345 [INFO] test-server.server: member joined, marking health alive: member=test-client 30:36.798 [DEBUG] test-server: Skipping remote check since it is managed automatically: check=serfHealth 30:36.798 [DEBUG] test-server: Node info in sync 30:36.798 [DEBUG] test-server: Node info in sync 30:36.907 [INFO] test-server: Requesting shutdown 30:36.907 [INFO] test-server.server: shutting down server 30:36.907 [DEBUG] test-server.leader: stopping routine: routine="legacy ACL token upgrade" 30:36.907 [DEBUG] test-server.leader: stopping routine: routine="acl token reaping" 30:36.907 [DEBUG] test-server.leader: stopping routine: routine="federation state anti-entropy" 30:36.907 [DEBUG] test-server.leader: stopping routine: routine="federation state pruning" 30:36.907 [DEBUG] test-server.leader: stopping routine: routine="intermediate cert renew watch" 30:36.907 [DEBUG] test-server.leader: stopping routine: routine="CA root pruning" 30:36.907 [WARN] test-server.server.serf.lan: serf: Shutdown without a Leave 30:36.907 [ERROR] test-server.server: error performing anti-entropy sync of federation state: error="context canceled" 30:36.907 [DEBUG] test-server.leader: stopped routine: routine="federation state anti-entropy" 30:36.907 [INFO] test-server.server: shutting down Connect CA roots monitor 30:36.907 [DEBUG] test-server.leader: stopped routine: routine="legacy ACL token upgrade" 30:36.907 [DEBUG] test-server.leader: stopped routine: routine="acl token reaping" 30:36.907 [DEBUG] test-server.leader: stopped routine: routine="federation state pruning" 30:36.907 [DEBUG] test-server.leader: stopped routine: routine="intermediate cert renew watch" 30:36.907 [DEBUG] test-server.leader: stopped routine: routine="CA root pruning" 30:36.913 [WARN] test-server.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:36.920Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:36.920Z [INFO] agent.router.manager: shutting down 30:36.920 [INFO] test-server: consul server down 30:36.920 [INFO] test-server: shutdown complete 30:36.920 [INFO] test-server: Stopping server: protocol=DNS address=127.0.0.1:30191 network=tcp 30:36.920 [INFO] test-server: Stopping server: protocol=DNS address=127.0.0.1:30191 network=udp 30:36.920 [INFO] test-server: Stopping server: protocol=HTTP address=127.0.0.1:30192 network=tcp 30:37.421 [INFO] test-server: Waiting for endpoints to shut down 30:37.421 [INFO] test-server: Endpoints down --- PASS: TestAgent_AutoEncrypt (1.47s) === RUN TestSharedRPCRouter [WARN] freeport: 6 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 6 out of 6 pending ports are still in use; something probably didn't wait around for the port to be closed! 30:37.994 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-0ecfc6be-3c01-5a5d-bb8c-d364a8738a86 127.0.0.1 2021-10-05T16:30:37.994Z [INFO] agent.router: Initializing LAN area manager 30:37.995 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30212 network=udp 30:37.995 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30212 network=tcp 30:37.995 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30213 network=tcp 30:37.995 [INFO] TestAgent: started state syncer 2021-10-05T16:30:37.996Z [WARN] agent.router.manager: No servers available 30:37.999 [INFO] TestAgent: Retry join is supported for the following discovery methods: cluster=LAN discovery_methods="aliyun aws gce mdns os packet" 30:37.999 [INFO] TestAgent: Joining cluster...: cluster=LAN 30:37.999 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:30208] 30:37.999 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30218 network=tcp 30:37.999 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:30208 2021-10-05T16:30:38.000Z [WARN] agent.router.manager: No servers available 30:38.000 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 30:38.000 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d 127.0.0.1 30:38.000 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 30:38.000 [DEBUG] TestAgent: systemd notify failed: error="No socket" 30:38.000 [INFO] TestAgent: Join cluster completed. Synced with initial agents: cluster=LAN num_agents=1 30:38.001 [INFO] TestAgent.client: adding server: server="Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d (Addr: tcp/127.0.0.1:30210) (DC: dc1)" 2021-10-05T16:30:37.470Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:37.494Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:37.549 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7a667c84-c254-4acc-1ffe-9ac7136dbc6d Address:127.0.0.1:30210}]" 30:37.550 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d.dc1 127.0.0.1 30:37.550 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d 127.0.0.1 2021-10-05T16:30:37.550Z [INFO] agent.router: Initializing LAN area manager 30:37.551 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30205 network=udp 30:37.551 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30210 [Follower]" leader= 30:37.551 [INFO] TestAgent.server: Adding LAN server: server="Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d (Addr: tcp/127.0.0.1:30210) (DC: dc1)" 30:37.551 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d.dc1 area=wan 30:37.551 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30205 network=tcp 30:37.552 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30206 network=tcp 30:37.552 [INFO] TestAgent: started state syncer 30:37.552 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30211 network=tcp 30:37.604 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:37.604 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30210 [Candidate]" term=2 30:37.640 [DEBUG] TestAgent.server.raft: votes: needed=1 30:37.640 [DEBUG] TestAgent.server.raft: vote granted: from=7a667c84-c254-4acc-1ffe-9ac7136dbc6d term=2 tally=1 30:37.640 [INFO] TestAgent.server.raft: election won: tally=1 30:37.640 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30210 [Leader]" 30:37.643 [INFO] TestAgent.server: cluster leadership acquired 30:37.644 [INFO] TestAgent.server: New leader elected: payload=Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d 30:37.647 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30210 30:37.676 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:37.728 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:37.728 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:37.728 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:37.728 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:37.728 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:37.728 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d 30:37.728 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7a667c84-c254-4acc-1ffe-9ac7136dbc6d 30:37.772 [INFO] TestAgent.server: federation state anti-entropy synced 30:37.860 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:37.876 [INFO] TestAgent: Synced node info 30:37.876 [DEBUG] TestAgent: Node info in sync 30:37.999 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:46168 30:38.000 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0ecfc6be-3c01-5a5d-bb8c-d364a8738a86 127.0.0.1 30:38.000 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0ecfc6be-3c01-5a5d-bb8c-d364a8738a86 30:38.032 [INFO] TestAgent: Requesting shutdown 30:38.033 [INFO] TestAgent.server: shutting down server 30:38.033 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:38.033 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:38.033 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:38.033 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:38.033 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:38.033 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:38.033 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:38.033 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:38.033 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:38.033 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:38.044 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:38.052Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:38.052Z [INFO] agent.router.manager: shutting down 30:38.052 [INFO] TestAgent: consul server down 30:38.052 [INFO] TestAgent: shutdown complete 30:38.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30205 network=tcp 30:38.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30205 network=udp 30:38.052 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30206 network=tcp 30:38.556 [INFO] TestAgent: Waiting for endpoints to shut down 30:38.556 [INFO] TestAgent: Endpoints down --- PASS: TestSharedRPCRouter (1.13s) === RUN TestCatalogRegister_Service_InvalidAddress === PAUSE TestCatalogRegister_Service_InvalidAddress === RUN TestCatalogDeregister === PAUSE TestCatalogDeregister === RUN TestCatalogDatacenters === PAUSE TestCatalogDatacenters === RUN TestCatalogNodes === PAUSE TestCatalogNodes === RUN TestCatalogNodes_MetaFilter === PAUSE TestCatalogNodes_MetaFilter === RUN TestCatalogNodes_Filter === PAUSE TestCatalogNodes_Filter === RUN TestCatalogNodes_WanTranslation === PAUSE TestCatalogNodes_WanTranslation === RUN TestCatalogNodes_Blocking === PAUSE TestCatalogNodes_Blocking === RUN TestCatalogNodes_DistanceSort === PAUSE TestCatalogNodes_DistanceSort === RUN TestCatalogServices === PAUSE TestCatalogServices === RUN TestCatalogServices_NodeMetaFilter === PAUSE TestCatalogServices_NodeMetaFilter === RUN TestCatalogRegister_checkRegistration === PAUSE TestCatalogRegister_checkRegistration === RUN TestCatalogServiceNodes === PAUSE TestCatalogServiceNodes === RUN TestCatalogServiceNodes_NodeMetaFilter === PAUSE TestCatalogServiceNodes_NodeMetaFilter === RUN TestCatalogServiceNodes_Filter === PAUSE TestCatalogServiceNodes_Filter === RUN TestCatalogServiceNodes_WanTranslation === PAUSE TestCatalogServiceNodes_WanTranslation === RUN TestCatalogServiceNodes_DistanceSort === PAUSE TestCatalogServiceNodes_DistanceSort === RUN TestCatalogServiceNodes_ConnectProxy === PAUSE TestCatalogServiceNodes_ConnectProxy === RUN TestCatalogConnectServiceNodes_good === PAUSE TestCatalogConnectServiceNodes_good === RUN TestCatalogConnectServiceNodes_Filter catalog_endpoint_test.go:1042: DM-skipped --- SKIP: TestCatalogConnectServiceNodes_Filter (0.00s) === RUN TestCatalogNodeServices === PAUSE TestCatalogNodeServices === RUN TestCatalogNodeServiceList === PAUSE TestCatalogNodeServiceList === RUN TestCatalogNodeServices_Filter === PAUSE TestCatalogNodeServices_Filter === RUN TestCatalogNodeServices_ConnectProxy === PAUSE TestCatalogNodeServices_ConnectProxy === RUN TestCatalogNodeServices_WanTranslation === PAUSE TestCatalogNodeServices_WanTranslation === RUN TestCatalog_GatewayServices_Terminating === PAUSE TestCatalog_GatewayServices_Terminating === RUN TestCatalog_GatewayServices_Ingress === PAUSE TestCatalog_GatewayServices_Ingress === RUN TestConfig_Get === PAUSE TestConfig_Get === RUN TestConfig_Delete === PAUSE TestConfig_Delete === RUN TestConfig_Apply === PAUSE TestConfig_Apply === RUN TestConfig_Apply_TerminatingGateway === PAUSE TestConfig_Apply_TerminatingGateway === RUN TestConfig_Apply_IngressGateway === PAUSE TestConfig_Apply_IngressGateway === RUN TestConfig_Apply_ProxyDefaultsMeshGateway === PAUSE TestConfig_Apply_ProxyDefaultsMeshGateway === RUN TestConfig_Apply_CAS === PAUSE TestConfig_Apply_CAS === RUN TestConfig_Apply_Decoding === PAUSE TestConfig_Apply_Decoding === RUN TestConfig_Apply_ProxyDefaultsExpose === PAUSE TestConfig_Apply_ProxyDefaultsExpose === RUN TestConnectCARoots_empty === PAUSE TestConnectCARoots_empty === RUN TestConnectCARoots_list === PAUSE TestConnectCARoots_list === RUN TestConnectCAConfig === PAUSE TestConnectCAConfig === RUN TestConnectCARoots_PEMEncoding [WARN] freeport: 10 out of 20 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:38.985Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:39.007Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:39.092 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dd2a89ae-a009-0d2e-14d8-d914febc36d0 Address:127.0.0.1:30231}]" 30:39.093 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0.dc2 127.0.0.1 30:39.093 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0 127.0.0.1 2021-10-05T16:30:39.093Z [INFO] agent.router: Initializing LAN area manager 30:39.093 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30226 network=udp 30:39.093 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30231 [Follower]" leader= 30:39.094 [INFO] TestAgent.server: Adding LAN server: server="Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0 (Addr: tcp/127.0.0.1:30231) (DC: dc2)" 30:39.094 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0.dc2 area=wan 30:39.094 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30226 network=tcp 30:39.094 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30227 network=tcp 30:39.095 [INFO] TestAgent: started state syncer 30:39.095 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30232 network=tcp 30:39.095 [INFO] TestAgent: Retry join is supported for the following discovery methods: cluster=WAN discovery_methods="aliyun aws gce mdns os packet" 30:39.095 [INFO] TestAgent: Joining cluster...: cluster=WAN 30:39.095 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:30223] 30:39.096 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:30223 30:39.100 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf.dc1 127.0.0.1 30:39.100 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 30:39.100 [INFO] TestAgent: Join cluster completed. Synced with initial agents: cluster=WAN num_agents=1 30:39.100 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf.dc1 area=wan 30:39.140 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:39.140 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30231 [Candidate]" term=2 30:39.188 [DEBUG] TestAgent.server.raft: votes: needed=1 30:39.188 [DEBUG] TestAgent.server.raft: vote granted: from=dd2a89ae-a009-0d2e-14d8-d914febc36d0 term=2 tally=1 30:39.188 [INFO] TestAgent.server.raft: election won: tally=1 30:39.188 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30231 [Leader]" 30:39.192 [INFO] TestAgent.server: cluster leadership acquired 30:39.192 [INFO] TestAgent.server: New leader elected: payload=Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0 30:39.220 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs, servers in acl datacenter are not yet upgraded: ACLDatacenter=dc1 mode=0 found=true 30:39.279 [DEBUG] connect.ca.consul: consul CA provider configured: id=ad:4a:c6:ab:ef:63:c9:60:1a:51:7f:19:62:e3:e9:d9:0e:76:55:10:6e:74:24:69:28:a1:6c:b8:b9:8f:fd:89 is_primary=false 30:39.352 [INFO] TestAgent.server.connect: received new intermediate certificate from primary datacenter 30:39.392 [INFO] TestAgent: Synced node info 30:39.392 [DEBUG] TestAgent: Node info in sync 30:39.392 [INFO] TestAgent.server.connect: updated root certificates from primary datacenter 30:39.392 [INFO] TestAgent.server.connect: initialized secondary datacenter CA with provider: provider=consul 30:39.392 [INFO] TestAgent.leader: started routine: routine="config entry replication" 30:39.392 [INFO] TestAgent.leader: started routine: routine="federation state replication" 30:39.392 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:39.392 [INFO] TestAgent.leader: started routine: routine="secondary CA roots watch" 30:39.392 [INFO] TestAgent.leader: started routine: routine="intention replication" 30:39.392 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:39.392 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:39.392 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0 30:39.392 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0 30:39.393 [DEBUG] TestAgent.server.connect: starting Connect intention replication from primary datacenter: primary=dc1 30:39.393 [DEBUG] TestAgent.server.connect: starting Connect CA root replication from primary datacenter: primary=dc1 30:39.400 [INFO] TestAgent: Requesting shutdown 30:39.400 [INFO] TestAgent.server: shutting down server 30:39.400 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:39.401 [DEBUG] TestAgent.leader: stopping routine: routine="secondary CA roots watch" 30:39.401 [DEBUG] TestAgent.leader: stopping routine: routine="intention replication" 30:39.401 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:39.401 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:39.401 [DEBUG] TestAgent.leader: stopping routine: routine="config entry replication" 30:39.401 [DEBUG] TestAgent.leader: stopping routine: routine="federation state replication" 30:39.401 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:39.401 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:39.401 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:39.401 [DEBUG] TestAgent.server: finished fetching remote objects: amount=1 30:39.401 [DEBUG] TestAgent.server.replication.config_entry: finished fetching config entries: amount=0 30:39.401 [INFO] TestAgent.replication.federation_state: stopped replication 30:39.401 [INFO] TestAgent.server.replication.config_entry: stopped replication 30:39.401 [DEBUG] TestAgent.leader: stopped routine: routine="federation state replication" 30:39.401 [DEBUG] TestAgent.leader: stopped routine: routine="config entry replication" 30:39.401 [DEBUG] TestAgent.leader: stopped routine: routine="intention replication" 30:39.408 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 30:39.416 [INFO] TestAgent.server: federation state anti-entropy synced 30:39.416 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:30:39.416Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:39.416Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:39.416Z [INFO] agent.router.manager: shutting down 30:39.418 [INFO] TestAgent: consul server down 30:39.418 [INFO] TestAgent: shutdown complete 30:39.418 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30226 network=tcp 30:39.418 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30226 network=udp 30:39.418 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30227 network=tcp 30:39.419 [ERROR] TestAgent.server.connect: CA root replication failed, will retry: routine="secondary CA roots watch" error="Failed to initialize the secondary CA: leadership lost while committing log" 30:39.419 [DEBUG] TestAgent.leader: stopped routine: routine="secondary CA roots watch" 30:39.919 [INFO] TestAgent: Waiting for endpoints to shut down 30:39.919 [INFO] TestAgent: Endpoints down 2021-10-05T16:30:38.621Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:38.633Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:38.656 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7c71bbe2-7b4f-3fd4-2caf-364669be07bf Address:127.0.0.1:30224}]" 30:38.657 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf.dc1 127.0.0.1 30:38.657 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf 127.0.0.1 2021-10-05T16:30:38.657Z [INFO] agent.router: Initializing LAN area manager 30:38.658 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30219 network=udp 30:38.658 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30224 [Follower]" leader= 30:38.658 [INFO] TestAgent.server: Adding LAN server: server="Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf (Addr: tcp/127.0.0.1:30224) (DC: dc1)" 30:38.658 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf.dc1 area=wan 30:38.658 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30219 network=tcp 30:38.659 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30220 network=tcp 30:38.659 [INFO] TestAgent: started state syncer 30:38.659 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30225 network=tcp 30:38.715 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:38.715 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30224 [Candidate]" term=2 30:38.723 [DEBUG] TestAgent.server.raft: votes: needed=1 30:38.723 [DEBUG] TestAgent.server.raft: vote granted: from=7c71bbe2-7b4f-3fd4-2caf-364669be07bf term=2 tally=1 30:38.723 [INFO] TestAgent.server.raft: election won: tally=1 30:38.723 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30224 [Leader]" 30:38.724 [INFO] TestAgent.server: cluster leadership acquired 30:38.724 [INFO] TestAgent.server: New leader elected: payload=Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf 30:38.728 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30224 30:38.743 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:38.789 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:38.789 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:38.789 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:38.789 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:38.789 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:38.789 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf 30:38.789 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7c71bbe2-7b4f-3fd4-2caf-364669be07bf 30:38.801 [INFO] TestAgent.server: federation state anti-entropy synced 30:38.928 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:38.948 [INFO] TestAgent: Synced node info 30:39.096 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:38266 30:39.097 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0.dc2 127.0.0.1 30:39.097 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dd2a89ae-a009-0d2e-14d8-d914febc36d0.dc2 area=wan 30:39.919 [INFO] TestAgent: Requesting shutdown 30:39.919 [INFO] TestAgent.server: shutting down server 30:39.919 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:39.919 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:39.919 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:39.919 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:39.919 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:39.919 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:39.919 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:39.919 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:39.919 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:39.919 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:39.937 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:39.963Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:39.963Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:39.963Z [INFO] agent.router.manager: shutting down 30:39.963 [INFO] TestAgent: consul server down 30:39.963 [INFO] TestAgent: shutdown complete 30:39.963 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30219 network=tcp 30:39.963 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30219 network=udp 30:39.963 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30220 network=tcp 30:40.464 [INFO] TestAgent: Waiting for endpoints to shut down 30:40.464 [INFO] TestAgent: Endpoints down --- PASS: TestConnectCARoots_PEMEncoding (1.91s) === RUN TestCoordinate_Disabled_Response === PAUSE TestCoordinate_Disabled_Response === RUN TestCoordinate_Datacenters === PAUSE TestCoordinate_Datacenters === RUN TestCoordinate_Nodes === PAUSE TestCoordinate_Nodes === RUN TestCoordinate_Node === PAUSE TestCoordinate_Node === RUN TestCoordinate_Update === PAUSE TestCoordinate_Update === RUN TestCoordinate_Update_ACLDeny === PAUSE TestCoordinate_Update_ACLDeny === RUN TestDenylist === PAUSE TestDenylist === RUN TestDiscoveryChainRead === PAUSE TestDiscoveryChainRead === RUN TestRecursorAddr === PAUSE TestRecursorAddr === RUN TestEncodeKVasRFC1464 --- PASS: TestEncodeKVasRFC1464 (0.00s) === RUN TestDNS_Over_TCP === PAUSE TestDNS_Over_TCP === RUN TestDNS_EmptyAltDomain === PAUSE TestDNS_EmptyAltDomain === RUN TestDNS_NodeLookup === PAUSE TestDNS_NodeLookup === RUN TestDNS_CaseInsensitiveNodeLookup === PAUSE TestDNS_CaseInsensitiveNodeLookup === RUN TestDNS_NodeLookup_PeriodName === PAUSE TestDNS_NodeLookup_PeriodName === RUN TestDNS_NodeLookup_AAAA === PAUSE TestDNS_NodeLookup_AAAA === RUN TestDNSCycleRecursorCheck === PAUSE TestDNSCycleRecursorCheck === RUN TestDNSCycleRecursorCheckAllFail dns_test.go:452: DM-skipped --- SKIP: TestDNSCycleRecursorCheckAllFail (0.00s) === RUN TestDNS_NodeLookup_CNAME === PAUSE TestDNS_NodeLookup_CNAME === RUN TestDNS_NodeLookup_TXT [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:40.495Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:40.518Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:40.606 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5decdacf-196e-bd69-f214-f5cbd35b2579 Address:127.0.0.1:30238}]" 30:40.606 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30238 [Follower]" leader= 30:40.606 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5decdacf-196e-bd69-f214-f5cbd35b2579.dc1 127.0.0.1 30:40.607 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5decdacf-196e-bd69-f214-f5cbd35b2579 127.0.0.1 2021-10-05T16:30:40.607Z [INFO] agent.router: Initializing LAN area manager 30:40.607 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30233 network=udp 30:40.607 [INFO] TestAgent.server: Adding LAN server: server="Node-5decdacf-196e-bd69-f214-f5cbd35b2579 (Addr: tcp/127.0.0.1:30238) (DC: dc1)" 30:40.607 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5decdacf-196e-bd69-f214-f5cbd35b2579.dc1 area=wan 30:40.607 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30233 network=tcp 30:40.608 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30234 network=tcp 30:40.608 [INFO] TestAgent: started state syncer 30:40.608 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30239 network=tcp 30:40.671 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:40.671 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30238 [Candidate]" term=2 30:40.714 [DEBUG] TestAgent.server.raft: votes: needed=1 30:40.714 [DEBUG] TestAgent.server.raft: vote granted: from=5decdacf-196e-bd69-f214-f5cbd35b2579 term=2 tally=1 30:40.714 [INFO] TestAgent.server.raft: election won: tally=1 30:40.714 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30238 [Leader]" 30:40.714 [INFO] TestAgent.server: cluster leadership acquired 30:40.714 [INFO] TestAgent.server: New leader elected: payload=Node-5decdacf-196e-bd69-f214-f5cbd35b2579 30:40.732 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30238 30:40.784 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:40.856 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:40.856 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:40.856 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:40.856 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:40.856 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:40.856 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5decdacf-196e-bd69-f214-f5cbd35b2579 30:40.856 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5decdacf-196e-bd69-f214-f5cbd35b2579 30:40.879 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:40.896 [INFO] TestAgent.server: federation state anti-entropy synced 30:40.909 [INFO] TestAgent: Synced node info 30:40.909 [DEBUG] TestAgent: Node info in sync 30:40.910 [DEBUG] TestAgent.dns: request served from client: name=google.node.consul. type=TXT class=IN latency=201.361µs client=127.0.0.1:49665 client_network=udp 30:40.910 [INFO] TestAgent: Requesting shutdown 30:40.910 [INFO] TestAgent.server: shutting down server 30:40.910 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:40.910 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:40.910 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:40.910 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:40.910 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:40.910 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:40.910 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:40.910 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:40.910 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:40.910 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:40.914 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:40.928Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:40.928Z [INFO] agent.router.manager: shutting down 30:40.928 [INFO] TestAgent: consul server down 30:40.928 [INFO] TestAgent: shutdown complete 30:40.928 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30233 network=tcp 30:40.929 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30233 network=udp 30:40.929 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30234 network=tcp 30:41.430 [INFO] TestAgent: Waiting for endpoints to shut down 30:41.430 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_TXT (0.96s) === RUN TestDNS_NodeLookup_TXT_DontSuppress [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:41.447Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:41.485Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:41.524 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:533a2013-424d-132c-c95b-2b39e47ffe7a Address:127.0.0.1:30245}]" 30:41.525 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30245 [Follower]" leader= 30:41.525 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-533a2013-424d-132c-c95b-2b39e47ffe7a.dc1 127.0.0.1 30:41.526 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-533a2013-424d-132c-c95b-2b39e47ffe7a 127.0.0.1 2021-10-05T16:30:41.526Z [INFO] agent.router: Initializing LAN area manager 30:41.526 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30240 network=udp 30:41.526 [INFO] TestAgent.server: Adding LAN server: server="Node-533a2013-424d-132c-c95b-2b39e47ffe7a (Addr: tcp/127.0.0.1:30245) (DC: dc1)" 30:41.526 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-533a2013-424d-132c-c95b-2b39e47ffe7a.dc1 area=wan 30:41.526 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30240 network=tcp 30:41.527 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30241 network=tcp 30:41.527 [INFO] TestAgent: started state syncer 30:41.527 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30246 network=tcp 30:41.568 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:41.568 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30245 [Candidate]" term=2 30:41.603 [DEBUG] TestAgent.server.raft: votes: needed=1 30:41.603 [DEBUG] TestAgent.server.raft: vote granted: from=533a2013-424d-132c-c95b-2b39e47ffe7a term=2 tally=1 30:41.603 [INFO] TestAgent.server.raft: election won: tally=1 30:41.603 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30245 [Leader]" 30:41.604 [INFO] TestAgent.server: cluster leadership acquired 30:41.604 [INFO] TestAgent.server: New leader elected: payload=Node-533a2013-424d-132c-c95b-2b39e47ffe7a 30:41.613 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30245 30:41.638 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:41.676 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:41.676 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:41.676 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:41.676 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:41.676 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:41.676 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-533a2013-424d-132c-c95b-2b39e47ffe7a 30:41.676 [INFO] TestAgent.server: member joined, marking health alive: member=Node-533a2013-424d-132c-c95b-2b39e47ffe7a 30:41.718 [INFO] TestAgent.server: federation state anti-entropy synced 30:41.727 [DEBUG] TestAgent.dns: request served from client: name=google.node.consul. type=TXT class=IN latency=125.083µs client=127.0.0.1:56963 client_network=udp 30:41.727 [INFO] TestAgent: Requesting shutdown 30:41.727 [INFO] TestAgent.server: shutting down server 30:41.727 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:41.727 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:41.727 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:41.727 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:41.727 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:41.727 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:41.727 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:41.727 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:41.727 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:41.727 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:41.727 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:41.744 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:41.752Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:41.752Z [INFO] agent.router.manager: shutting down 30:41.752 [INFO] TestAgent: consul server down 30:41.752 [INFO] TestAgent: shutdown complete 30:41.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30240 network=tcp 30:41.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30240 network=udp 30:41.752 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30241 network=tcp 30:42.256 [INFO] TestAgent: Waiting for endpoints to shut down 30:42.256 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_TXT_DontSuppress (0.83s) === RUN TestDNS_NodeLookup_ANY [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:42.284Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:42.303Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:42.396 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1268e432-dd95-c84c-c528-1d29bc8bdd06 Address:127.0.0.1:30252}]" 30:42.396 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30252 [Follower]" leader= 30:42.397 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1268e432-dd95-c84c-c528-1d29bc8bdd06.dc1 127.0.0.1 30:42.397 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1268e432-dd95-c84c-c528-1d29bc8bdd06 127.0.0.1 2021-10-05T16:30:42.397Z [INFO] agent.router: Initializing LAN area manager 30:42.397 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30247 network=udp 30:42.398 [INFO] TestAgent.server: Adding LAN server: server="Node-1268e432-dd95-c84c-c528-1d29bc8bdd06 (Addr: tcp/127.0.0.1:30252) (DC: dc1)" 30:42.398 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1268e432-dd95-c84c-c528-1d29bc8bdd06.dc1 area=wan 30:42.398 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30247 network=tcp 30:42.398 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30248 network=tcp 30:42.398 [INFO] TestAgent: started state syncer 30:42.398 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30253 network=tcp 30:42.468 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:42.468 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30252 [Candidate]" term=2 30:42.511 [DEBUG] TestAgent.server.raft: votes: needed=1 30:42.511 [DEBUG] TestAgent.server.raft: vote granted: from=1268e432-dd95-c84c-c528-1d29bc8bdd06 term=2 tally=1 30:42.511 [INFO] TestAgent.server.raft: election won: tally=1 30:42.512 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30252 [Leader]" 30:42.512 [INFO] TestAgent.server: cluster leadership acquired 30:42.512 [INFO] TestAgent.server: New leader elected: payload=Node-1268e432-dd95-c84c-c528-1d29bc8bdd06 30:42.518 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30252 30:42.540 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:42.588 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:42.588 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:42.588 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:42.588 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:42.588 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:42.588 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1268e432-dd95-c84c-c528-1d29bc8bdd06 30:42.588 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1268e432-dd95-c84c-c528-1d29bc8bdd06 30:42.628 [INFO] TestAgent.server: federation state anti-entropy synced 30:42.726 [DEBUG] TestAgent.dns: request served from client: name=bar.node.consul. type=ANY class=IN latency=105.271µs client=127.0.0.1:45701 client_network=udp 30:42.726 [INFO] TestAgent: Requesting shutdown 30:42.726 [INFO] TestAgent.server: shutting down server 30:42.726 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:42.726 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:42.726 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:42.726 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:42.726 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:42.726 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:42.726 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:42.726 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:42.726 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:42.726 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:42.726 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:42.734 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:42.744Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:42.744Z [INFO] agent.router.manager: shutting down 30:42.744 [INFO] TestAgent: consul server down 30:42.744 [INFO] TestAgent: shutdown complete 30:42.744 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30247 network=tcp 30:42.744 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30247 network=udp 30:42.744 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30248 network=tcp 30:43.248 [INFO] TestAgent: Waiting for endpoints to shut down 30:43.248 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_ANY (0.99s) === RUN TestDNS_NodeLookup_ANY_DontSuppressTXT [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:43.287Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:43.364Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:43.460 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bc22ac75-543b-24c9-3631-2e53fb9eca61 Address:127.0.0.1:30259}]" 30:43.460 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30259 [Follower]" leader= 30:43.460 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bc22ac75-543b-24c9-3631-2e53fb9eca61.dc1 127.0.0.1 30:43.461 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bc22ac75-543b-24c9-3631-2e53fb9eca61 127.0.0.1 2021-10-05T16:30:43.461Z [INFO] agent.router: Initializing LAN area manager 30:43.461 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30254 network=udp 30:43.461 [INFO] TestAgent.server: Adding LAN server: server="Node-bc22ac75-543b-24c9-3631-2e53fb9eca61 (Addr: tcp/127.0.0.1:30259) (DC: dc1)" 30:43.461 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bc22ac75-543b-24c9-3631-2e53fb9eca61.dc1 area=wan 30:43.461 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30254 network=tcp 30:43.462 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30255 network=tcp 30:43.462 [INFO] TestAgent: started state syncer 30:43.462 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30260 network=tcp 30:43.519 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:43.519 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30259 [Candidate]" term=2 30:43.544 [DEBUG] TestAgent.server.raft: votes: needed=1 30:43.544 [DEBUG] TestAgent.server.raft: vote granted: from=bc22ac75-543b-24c9-3631-2e53fb9eca61 term=2 tally=1 30:43.544 [INFO] TestAgent.server.raft: election won: tally=1 30:43.544 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30259 [Leader]" 30:43.548 [INFO] TestAgent.server: cluster leadership acquired 30:43.548 [INFO] TestAgent.server: New leader elected: payload=Node-bc22ac75-543b-24c9-3631-2e53fb9eca61 30:43.573 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30259 30:43.616 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:43.659 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:43.659 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:43.659 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:43.659 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:43.659 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:43.659 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bc22ac75-543b-24c9-3631-2e53fb9eca61 30:43.659 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bc22ac75-543b-24c9-3631-2e53fb9eca61 30:43.684 [INFO] TestAgent.server: federation state anti-entropy synced 30:43.856 [DEBUG] TestAgent.dns: request served from client: name=bar.node.consul. type=ANY class=IN latency=171.016µs client=127.0.0.1:44725 client_network=udp 30:43.857 [INFO] TestAgent: Requesting shutdown 30:43.857 [INFO] TestAgent.server: shutting down server 30:43.857 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:43.857 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:43.857 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:43.857 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:43.857 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:43.857 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:43.857 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:43.857 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:43.857 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:43.857 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:43.857 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:43.872 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:43.872Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:43.872Z [INFO] agent.router.manager: shutting down 30:43.872 [INFO] TestAgent: consul server down 30:43.872 [INFO] TestAgent: shutdown complete 30:43.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30254 network=tcp 30:43.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30254 network=udp 30:43.872 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30255 network=tcp 30:44.377 [INFO] TestAgent: Waiting for endpoints to shut down 30:44.377 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_ANY_DontSuppressTXT (1.13s) === RUN TestDNS_NodeLookup_A_SuppressTXT [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:44.412Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:44.434Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:44.528 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f6119892-7e09-93f0-b0ce-201dbaa751ff Address:127.0.0.1:30266}]" 30:44.529 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f6119892-7e09-93f0-b0ce-201dbaa751ff.dc1 127.0.0.1 30:44.529 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f6119892-7e09-93f0-b0ce-201dbaa751ff 127.0.0.1 2021-10-05T16:30:44.529Z [INFO] agent.router: Initializing LAN area manager 30:44.529 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30261 network=udp 30:44.530 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30266 [Follower]" leader= 30:44.530 [INFO] TestAgent.server: Adding LAN server: server="Node-f6119892-7e09-93f0-b0ce-201dbaa751ff (Addr: tcp/127.0.0.1:30266) (DC: dc1)" 30:44.530 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f6119892-7e09-93f0-b0ce-201dbaa751ff.dc1 area=wan 30:44.530 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30261 network=tcp 30:44.531 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30262 network=tcp 30:44.531 [INFO] TestAgent: started state syncer 30:44.531 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30267 network=tcp 30:44.590 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:44.590 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30266 [Candidate]" term=2 30:44.600 [DEBUG] TestAgent.server.raft: votes: needed=1 30:44.600 [DEBUG] TestAgent.server.raft: vote granted: from=f6119892-7e09-93f0-b0ce-201dbaa751ff term=2 tally=1 30:44.600 [INFO] TestAgent.server.raft: election won: tally=1 30:44.600 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30266 [Leader]" 30:44.600 [INFO] TestAgent.server: cluster leadership acquired 30:44.600 [INFO] TestAgent.server: New leader elected: payload=Node-f6119892-7e09-93f0-b0ce-201dbaa751ff 30:44.608 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30266 30:44.626 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:44.704 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:44.704 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:44.704 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:44.704 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:44.704 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:44.704 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f6119892-7e09-93f0-b0ce-201dbaa751ff 30:44.704 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f6119892-7e09-93f0-b0ce-201dbaa751ff 30:44.708 [INFO] TestAgent: Synced node info 30:44.708 [DEBUG] TestAgent: Node info in sync 30:44.736 [INFO] TestAgent.server: federation state anti-entropy synced 30:44.808 [DEBUG] TestAgent.dns: request served from client: name=bar.node.consul. type=A class=IN latency=137.388µs client=127.0.0.1:46242 client_network=udp 30:44.808 [INFO] TestAgent: Requesting shutdown 30:44.808 [INFO] TestAgent.server: shutting down server 30:44.808 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:44.808 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:44.808 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:44.808 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:44.808 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:44.808 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:44.808 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:44.808 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:44.808 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:44.808 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:44.816 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:44.820Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:44.820Z [INFO] agent.router.manager: shutting down 30:44.820 [INFO] TestAgent: consul server down 30:44.820 [INFO] TestAgent: shutdown complete 30:44.820 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30261 network=tcp 30:44.820 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30261 network=udp 30:44.820 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30262 network=tcp 30:45.320 [INFO] TestAgent: Waiting for endpoints to shut down 30:45.320 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_A_SuppressTXT (0.94s) === RUN TestDNS_EDNS0 === PAUSE TestDNS_EDNS0 === RUN TestDNS_EDNS0_ECS === PAUSE TestDNS_EDNS0_ECS === RUN TestDNS_ReverseLookup === PAUSE TestDNS_ReverseLookup === RUN TestDNS_ReverseLookup_CustomDomain === PAUSE TestDNS_ReverseLookup_CustomDomain === RUN TestDNS_ReverseLookup_IPV6 === PAUSE TestDNS_ReverseLookup_IPV6 === RUN TestDNS_ServiceReverseLookup === PAUSE TestDNS_ServiceReverseLookup === RUN TestDNS_ServiceReverseLookup_IPV6 === PAUSE TestDNS_ServiceReverseLookup_IPV6 === RUN TestDNS_ServiceReverseLookup_CustomDomain === PAUSE TestDNS_ServiceReverseLookup_CustomDomain === RUN TestDNS_SOA_Settings === PAUSE TestDNS_SOA_Settings === RUN TestDNS_ServiceReverseLookupNodeAddress === PAUSE TestDNS_ServiceReverseLookupNodeAddress === RUN TestDNS_ServiceLookupNoMultiCNAME === PAUSE TestDNS_ServiceLookupNoMultiCNAME === RUN TestDNS_ServiceLookupPreferNoCNAME === PAUSE TestDNS_ServiceLookupPreferNoCNAME === RUN TestDNS_ServiceLookupMultiAddrNoCNAME === PAUSE TestDNS_ServiceLookupMultiAddrNoCNAME === RUN TestDNS_ServiceLookup === PAUSE TestDNS_ServiceLookup === RUN TestDNS_ServiceLookupWithInternalServiceAddress === PAUSE TestDNS_ServiceLookupWithInternalServiceAddress === RUN TestDNS_ConnectServiceLookup === PAUSE TestDNS_ConnectServiceLookup === RUN TestDNS_IngressServiceLookup === PAUSE TestDNS_IngressServiceLookup === RUN TestDNS_ExternalServiceLookup === PAUSE TestDNS_ExternalServiceLookup === RUN TestDNS_InifiniteRecursion === PAUSE TestDNS_InifiniteRecursion === RUN TestDNS_ExternalServiceToConsulCNAMELookup === PAUSE TestDNS_ExternalServiceToConsulCNAMELookup === RUN TestDNS_NSRecords === PAUSE TestDNS_NSRecords === RUN TestDNS_NSRecords_IPV6 === PAUSE TestDNS_NSRecords_IPV6 === RUN TestDNS_ExternalServiceToConsulCNAMENestedLookup === PAUSE TestDNS_ExternalServiceToConsulCNAMENestedLookup === RUN TestDNS_ServiceLookup_ServiceAddress_A === PAUSE TestDNS_ServiceLookup_ServiceAddress_A === RUN TestDNS_ServiceLookup_ServiceAddress_SRV === PAUSE TestDNS_ServiceLookup_ServiceAddress_SRV === RUN TestDNS_ServiceLookup_ServiceAddressIPV6 === PAUSE TestDNS_ServiceLookup_ServiceAddressIPV6 === RUN TestDNS_ServiceLookup_WanTranslation === PAUSE TestDNS_ServiceLookup_WanTranslation === RUN TestDNS_Lookup_TaggedIPAddresses === PAUSE TestDNS_Lookup_TaggedIPAddresses === RUN TestDNS_CaseInsensitiveServiceLookup === PAUSE TestDNS_CaseInsensitiveServiceLookup === RUN TestDNS_ServiceLookup_TagPeriod === PAUSE TestDNS_ServiceLookup_TagPeriod === RUN TestDNS_PreparedQueryNearIPEDNS === PAUSE TestDNS_PreparedQueryNearIPEDNS === RUN TestDNS_PreparedQueryNearIP === PAUSE TestDNS_PreparedQueryNearIP === RUN TestDNS_ServiceLookup_PreparedQueryNamePeriod === PAUSE TestDNS_ServiceLookup_PreparedQueryNamePeriod === RUN TestDNS_ServiceLookup_Dedup === PAUSE TestDNS_ServiceLookup_Dedup === RUN TestDNS_ServiceLookup_Dedup_SRV === PAUSE TestDNS_ServiceLookup_Dedup_SRV === RUN TestDNS_Recurse === PAUSE TestDNS_Recurse === RUN TestDNS_Recurse_Truncation === PAUSE TestDNS_Recurse_Truncation === RUN TestDNS_RecursorTimeout === PAUSE TestDNS_RecursorTimeout === RUN TestDNS_ServiceLookup_FilterCritical === PAUSE TestDNS_ServiceLookup_FilterCritical === RUN TestDNS_ServiceLookup_OnlyFailing === PAUSE TestDNS_ServiceLookup_OnlyFailing === RUN TestDNS_ServiceLookup_OnlyPassing === PAUSE TestDNS_ServiceLookup_OnlyPassing === RUN TestDNS_ServiceLookup_Randomize === PAUSE TestDNS_ServiceLookup_Randomize === RUN TestBinarySearch === PAUSE TestBinarySearch === RUN TestDNS_TCP_and_UDP_Truncate === PAUSE TestDNS_TCP_and_UDP_Truncate === RUN TestDNS_ServiceLookup_Truncate === PAUSE TestDNS_ServiceLookup_Truncate === RUN TestDNS_ServiceLookup_LargeResponses === PAUSE TestDNS_ServiceLookup_LargeResponses === RUN TestDNS_ServiceLookup_ARecordLimits dns_test.go:4656: DM-skipped --- SKIP: TestDNS_ServiceLookup_ARecordLimits (0.00s) === RUN TestDNS_ServiceLookup_AnswerLimits === PAUSE TestDNS_ServiceLookup_AnswerLimits === RUN TestDNS_ServiceLookup_CNAME dns_test.go:4801: DM-skipped --- SKIP: TestDNS_ServiceLookup_CNAME (0.00s) === RUN TestDNS_ServiceLookup_ServiceAddress_CNAME === PAUSE TestDNS_ServiceLookup_ServiceAddress_CNAME === RUN TestDNS_NodeLookup_TTL === PAUSE TestDNS_NodeLookup_TTL === RUN TestDNS_ServiceLookup_TTL === PAUSE TestDNS_ServiceLookup_TTL === RUN TestDNS_PreparedQuery_TTL === PAUSE TestDNS_PreparedQuery_TTL === RUN TestDNS_PreparedQuery_Failover === PAUSE TestDNS_PreparedQuery_Failover === RUN TestDNS_ServiceLookup_SRV_RFC === PAUSE TestDNS_ServiceLookup_SRV_RFC === RUN TestDNS_ServiceLookup_SRV_RFC_TCP_Default === PAUSE TestDNS_ServiceLookup_SRV_RFC_TCP_Default === RUN TestDNS_ServiceLookup_FilterACL === PAUSE TestDNS_ServiceLookup_FilterACL === RUN TestDNS_ServiceLookup_MetaTXT [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:45.343Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:45.370Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:45.460 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:86a57538-e360-1dc7-5859-39201a841974 Address:127.0.0.1:30273}]" 30:45.460 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30273 [Follower]" leader= 30:45.461 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-86a57538-e360-1dc7-5859-39201a841974.dc1 127.0.0.1 30:45.461 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-86a57538-e360-1dc7-5859-39201a841974 127.0.0.1 2021-10-05T16:30:45.461Z [INFO] agent.router: Initializing LAN area manager 30:45.462 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30268 network=udp 30:45.462 [INFO] TestAgent.server: Adding LAN server: server="Node-86a57538-e360-1dc7-5859-39201a841974 (Addr: tcp/127.0.0.1:30273) (DC: dc1)" 30:45.462 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-86a57538-e360-1dc7-5859-39201a841974.dc1 area=wan 30:45.462 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30268 network=tcp 30:45.462 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30269 network=tcp 30:45.463 [INFO] TestAgent: started state syncer 30:45.463 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30274 network=tcp 30:45.506 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:45.506 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30273 [Candidate]" term=2 30:45.532 [DEBUG] TestAgent.server.raft: votes: needed=1 30:45.532 [DEBUG] TestAgent.server.raft: vote granted: from=86a57538-e360-1dc7-5859-39201a841974 term=2 tally=1 30:45.532 [INFO] TestAgent.server.raft: election won: tally=1 30:45.532 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30273 [Leader]" 30:45.536 [INFO] TestAgent.server: cluster leadership acquired 30:45.536 [INFO] TestAgent.server: New leader elected: payload=Node-86a57538-e360-1dc7-5859-39201a841974 30:45.561 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30273 30:45.604 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:45.616 [INFO] TestAgent: Synced node info 30:45.634 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=304.744µs client=127.0.0.1:58754 client_network=udp 30:45.634 [INFO] TestAgent: Requesting shutdown 30:45.634 [INFO] TestAgent.server: shutting down server 30:45.634 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:45.645 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:45.660Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:45.660Z [INFO] agent.router.manager: shutting down 30:45.660 [INFO] TestAgent: consul server down 30:45.660 [INFO] TestAgent: shutdown complete 30:45.660 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30268 network=tcp 30:45.660 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30268 network=udp 30:45.660 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30269 network=tcp 30:45.660 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:45.660 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:45.660 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:45.660 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:45.660 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:45.660 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-86a57538-e360-1dc7-5859-39201a841974 30:45.660 [INFO] TestAgent.server: member joined, marking health alive: member=Node-86a57538-e360-1dc7-5859-39201a841974 30:45.661 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 30:45.661 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 30:45.661 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 30:45.661 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 30:45.661 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 30:45.661 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-86a57538-e360-1dc7-5859-39201a841974 127.0.0.1 30271 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:86a57538-e360-1dc7-5859-39201a841974 port:30273 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:30272] alive 1 5 2 2 5 4}" error="raft is already shutdown" 30:45.661 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:45.661 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:45.661 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:45.661 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:45.661 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:45.661 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:45.661 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:45.661 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:46.162 [INFO] TestAgent: Waiting for endpoints to shut down 30:46.162 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_MetaTXT (0.84s) === RUN TestDNS_ServiceLookup_SuppressTXT [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:46.177Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:46.202Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:46.232 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4 Address:127.0.0.1:30280}]" 30:46.233 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4.dc1 127.0.0.1 30:46.233 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4 127.0.0.1 2021-10-05T16:30:46.233Z [INFO] agent.router: Initializing LAN area manager 30:46.233 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30275 network=udp 30:46.233 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30280 [Follower]" leader= 30:46.234 [INFO] TestAgent.server: Adding LAN server: server="Node-3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4 (Addr: tcp/127.0.0.1:30280) (DC: dc1)" 30:46.234 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4.dc1 area=wan 30:46.234 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30275 network=tcp 30:46.234 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30276 network=tcp 30:46.234 [INFO] TestAgent: started state syncer 30:46.235 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30281 network=tcp 30:46.277 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:46.277 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30280 [Candidate]" term=2 30:46.287 [DEBUG] TestAgent.server.raft: votes: needed=1 30:46.287 [DEBUG] TestAgent.server.raft: vote granted: from=3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4 term=2 tally=1 30:46.287 [INFO] TestAgent.server.raft: election won: tally=1 30:46.287 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30280 [Leader]" 30:46.287 [INFO] TestAgent.server: cluster leadership acquired 30:46.287 [INFO] TestAgent.server: New leader elected: payload=Node-3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4 30:46.304 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30280 30:46.332 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:46.389 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:46.389 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:46.389 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:46.389 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:46.389 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:46.389 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4 30:46.389 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3ad32ff5-c1cc-6b87-dba2-47246a0e9fb4 30:46.448 [INFO] TestAgent.server: federation state anti-entropy synced 30:46.449 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=183.997µs client=127.0.0.1:58268 client_network=udp 30:46.449 [INFO] TestAgent: Requesting shutdown 30:46.449 [INFO] TestAgent.server: shutting down server 30:46.449 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:46.449 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:46.449 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:46.449 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:46.449 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:46.449 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:46.449 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:46.449 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:46.449 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:46.449 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:46.449 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:46.453 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:46.457Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:46.457Z [INFO] agent.router.manager: shutting down 30:46.457 [INFO] TestAgent: consul server down 30:46.457 [INFO] TestAgent: shutdown complete 30:46.457 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30275 network=tcp 30:46.457 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30275 network=udp 30:46.457 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30276 network=tcp 30:46.958 [INFO] TestAgent: Waiting for endpoints to shut down 30:46.958 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_SuppressTXT (0.80s) === RUN TestDNS_AddressLookup === PAUSE TestDNS_AddressLookup === RUN TestDNS_AddressLookupIPV6 === PAUSE TestDNS_AddressLookupIPV6 === RUN TestDNS_NonExistentDC_Server === PAUSE TestDNS_NonExistentDC_Server === RUN TestDNS_NonExistentDC_RPC === PAUSE TestDNS_NonExistentDC_RPC === RUN TestDNS_NonExistingLookup === PAUSE TestDNS_NonExistingLookup === RUN TestDNS_NonExistingLookupEmptyAorAAAA === PAUSE TestDNS_NonExistingLookupEmptyAorAAAA === RUN TestDNS_AltDomains_Service === PAUSE TestDNS_AltDomains_Service === RUN TestDNS_AltDomains_SOA === PAUSE TestDNS_AltDomains_SOA === RUN TestDNS_AltDomains_Overlap === PAUSE TestDNS_AltDomains_Overlap === RUN TestDNS_PreparedQuery_AllowStale === PAUSE TestDNS_PreparedQuery_AllowStale === RUN TestDNS_InvalidQueries === PAUSE TestDNS_InvalidQueries === RUN TestDNS_PreparedQuery_AgentSource === PAUSE TestDNS_PreparedQuery_AgentSource === RUN TestDNS_trimUDPResponse_NoTrim === PAUSE TestDNS_trimUDPResponse_NoTrim === RUN TestDNS_trimUDPResponse_TrimLimit === PAUSE TestDNS_trimUDPResponse_TrimLimit === RUN TestDNS_trimUDPResponse_TrimSize === PAUSE TestDNS_trimUDPResponse_TrimSize === RUN TestDNS_trimUDPResponse_TrimSizeEDNS === PAUSE TestDNS_trimUDPResponse_TrimSizeEDNS === RUN TestDNS_syncExtra === PAUSE TestDNS_syncExtra === RUN TestDNS_Compression_trimUDPResponse === PAUSE TestDNS_Compression_trimUDPResponse === RUN TestDNS_Compression_Query === PAUSE TestDNS_Compression_Query === RUN TestDNS_Compression_ReverseLookup === PAUSE TestDNS_Compression_ReverseLookup === RUN TestDNS_Compression_Recurse === PAUSE TestDNS_Compression_Recurse === RUN TestDNSInvalidRegex === RUN TestDNSInvalidRegex/Valid_Hostname === RUN TestDNSInvalidRegex/Valid_Hostname#01 === RUN TestDNSInvalidRegex/Invalid_Hostname_with_special_chars === RUN TestDNSInvalidRegex/Invalid_Hostname_with_special_chars_in_the_end === RUN TestDNSInvalidRegex/Whitespace === RUN TestDNSInvalidRegex/Only_special_chars --- PASS: TestDNSInvalidRegex (0.00s) --- PASS: TestDNSInvalidRegex/Valid_Hostname (0.00s) --- PASS: TestDNSInvalidRegex/Valid_Hostname#01 (0.00s) --- PASS: TestDNSInvalidRegex/Invalid_Hostname_with_special_chars (0.00s) --- PASS: TestDNSInvalidRegex/Invalid_Hostname_with_special_chars_in_the_end (0.00s) --- PASS: TestDNSInvalidRegex/Whitespace (0.00s) --- PASS: TestDNSInvalidRegex/Only_special_chars (0.00s) === RUN TestDNS_ConfigReload === PAUSE TestDNS_ConfigReload === RUN TestDNS_ReloadConfig_DuringQuery === PAUSE TestDNS_ReloadConfig_DuringQuery === RUN TestEventFire === PAUSE TestEventFire === RUN TestEventFire_token === PAUSE TestEventFire_token === RUN TestEventList === PAUSE TestEventList === RUN TestEventList_Filter === PAUSE TestEventList_Filter === RUN TestEventList_ACLFilter === PAUSE TestEventList_ACLFilter === RUN TestEventList_Blocking === PAUSE TestEventList_Blocking === RUN TestEventList_EventBufOrder === PAUSE TestEventList_EventBufOrder === RUN TestUUIDToUint64 === PAUSE TestUUIDToUint64 === RUN TestHealthChecksInState health_endpoint_test.go:23: DM-skipped --- SKIP: TestHealthChecksInState (0.00s) === RUN TestHealthChecksInState_NodeMetaFilter === PAUSE TestHealthChecksInState_NodeMetaFilter === RUN TestHealthChecksInState_Filter === PAUSE TestHealthChecksInState_Filter === RUN TestHealthChecksInState_DistanceSort === PAUSE TestHealthChecksInState_DistanceSort === RUN TestHealthNodeChecks === PAUSE TestHealthNodeChecks === RUN TestHealthNodeChecks_Filtering === PAUSE TestHealthNodeChecks_Filtering === RUN TestHealthServiceChecks === PAUSE TestHealthServiceChecks === RUN TestHealthServiceChecks_NodeMetaFilter === PAUSE TestHealthServiceChecks_NodeMetaFilter === RUN TestHealthServiceChecks_Filtering === PAUSE TestHealthServiceChecks_Filtering === RUN TestHealthServiceChecks_DistanceSort === PAUSE TestHealthServiceChecks_DistanceSort === RUN TestHealthServiceNodes === PAUSE TestHealthServiceNodes === RUN TestHealthServiceNodes_NodeMetaFilter === PAUSE TestHealthServiceNodes_NodeMetaFilter === RUN TestHealthServiceNodes_Filter === PAUSE TestHealthServiceNodes_Filter === RUN TestHealthServiceNodes_DistanceSort === PAUSE TestHealthServiceNodes_DistanceSort === RUN TestHealthServiceNodes_PassingFilter === PAUSE TestHealthServiceNodes_PassingFilter === RUN TestHealthServiceNodes_CheckType === PAUSE TestHealthServiceNodes_CheckType === RUN TestHealthServiceNodes_WanTranslation === PAUSE TestHealthServiceNodes_WanTranslation === RUN TestHealthConnectServiceNodes === PAUSE TestHealthConnectServiceNodes === RUN TestHealthIngressServiceNodes === PAUSE TestHealthIngressServiceNodes === RUN TestHealthConnectServiceNodes_Filter === PAUSE TestHealthConnectServiceNodes_Filter === RUN TestHealthConnectServiceNodes_PassingFilter === PAUSE TestHealthConnectServiceNodes_PassingFilter === RUN TestFilterNonPassing === PAUSE TestFilterNonPassing === RUN TestDecodeACLPolicyWrite === RUN TestDecodeACLPolicyWrite/hashes_base64_encoded === RUN TestDecodeACLPolicyWrite/hashes_not-base64_encoded === RUN TestDecodeACLPolicyWrite/hashes_empty_string === RUN TestDecodeACLPolicyWrite/hashes_null === RUN TestDecodeACLPolicyWrite/hashes_numeric_value --- PASS: TestDecodeACLPolicyWrite (0.00s) --- PASS: TestDecodeACLPolicyWrite/hashes_base64_encoded (0.00s) --- PASS: TestDecodeACLPolicyWrite/hashes_not-base64_encoded (0.00s) --- PASS: TestDecodeACLPolicyWrite/hashes_empty_string (0.00s) --- PASS: TestDecodeACLPolicyWrite/hashes_null (0.00s) --- PASS: TestDecodeACLPolicyWrite/hashes_numeric_value (0.00s) === RUN TestDecodeACLToken === RUN TestDecodeACLToken/timestamps_correctly_RFC3339_formatted === RUN TestDecodeACLToken/timestamps_incorrectly_formatted_(RFC822) === RUN TestDecodeACLToken/timestamps_incorrectly_formatted_(RFC850) === RUN TestDecodeACLToken/timestamps_empty_string === RUN TestDecodeACLToken/timestamps_null === RUN TestDecodeACLToken/durations_correctly_formatted === RUN TestDecodeACLToken/durations_small,_correctly_formatted === RUN TestDecodeACLToken/durations_incorrectly_formatted === RUN TestDecodeACLToken/durations_empty_string === RUN TestDecodeACLToken/durations_string_without_quotes === RUN TestDecodeACLToken/durations_numeric === RUN TestDecodeACLToken/durations_negative === RUN TestDecodeACLToken/durations_numeric_and_negative === RUN TestDecodeACLToken/hashes_base64_encoded === RUN TestDecodeACLToken/hashes_not-base64_encoded === RUN TestDecodeACLToken/hashes_empty_string === RUN TestDecodeACLToken/hashes_null === RUN TestDecodeACLToken/hashes_numeric_value --- PASS: TestDecodeACLToken (0.00s) --- PASS: TestDecodeACLToken/timestamps_correctly_RFC3339_formatted (0.00s) --- PASS: TestDecodeACLToken/timestamps_incorrectly_formatted_(RFC822) (0.00s) --- PASS: TestDecodeACLToken/timestamps_incorrectly_formatted_(RFC850) (0.00s) --- PASS: TestDecodeACLToken/timestamps_empty_string (0.00s) --- PASS: TestDecodeACLToken/timestamps_null (0.00s) --- PASS: TestDecodeACLToken/durations_correctly_formatted (0.00s) --- PASS: TestDecodeACLToken/durations_small,_correctly_formatted (0.00s) --- PASS: TestDecodeACLToken/durations_incorrectly_formatted (0.00s) --- PASS: TestDecodeACLToken/durations_empty_string (0.00s) --- PASS: TestDecodeACLToken/durations_string_without_quotes (0.00s) --- PASS: TestDecodeACLToken/durations_numeric (0.00s) --- PASS: TestDecodeACLToken/durations_negative (0.00s) --- PASS: TestDecodeACLToken/durations_numeric_and_negative (0.00s) --- PASS: TestDecodeACLToken/hashes_base64_encoded (0.00s) --- PASS: TestDecodeACLToken/hashes_not-base64_encoded (0.00s) --- PASS: TestDecodeACLToken/hashes_empty_string (0.00s) --- PASS: TestDecodeACLToken/hashes_null (0.00s) --- PASS: TestDecodeACLToken/hashes_numeric_value (0.00s) === RUN TestDecodeACLRoleWrite === RUN TestDecodeACLRoleWrite/hashes_base64_encoded === RUN TestDecodeACLRoleWrite/hashes_not-base64_encoded === RUN TestDecodeACLRoleWrite/hashes_empty_string === RUN TestDecodeACLRoleWrite/hashes_null === RUN TestDecodeACLRoleWrite/hashes_numeric_value --- PASS: TestDecodeACLRoleWrite (0.00s) --- PASS: TestDecodeACLRoleWrite/hashes_base64_encoded (0.00s) --- PASS: TestDecodeACLRoleWrite/hashes_not-base64_encoded (0.00s) --- PASS: TestDecodeACLRoleWrite/hashes_empty_string (0.00s) --- PASS: TestDecodeACLRoleWrite/hashes_null (0.00s) --- PASS: TestDecodeACLRoleWrite/hashes_numeric_value (0.00s) === RUN TestDecodeAgentRegisterCheck === RUN TestDecodeAgentRegisterCheck/durations_correctly_formatted === RUN TestDecodeAgentRegisterCheck/durations_small,_correctly_formatted === RUN TestDecodeAgentRegisterCheck/durations_incorrectly_formatted === RUN TestDecodeAgentRegisterCheck/durations_empty_string === RUN TestDecodeAgentRegisterCheck/durations_string_without_quotes === RUN TestDecodeAgentRegisterCheck/durations_numeric === RUN TestDecodeAgentRegisterCheck/durations_negative === RUN TestDecodeAgentRegisterCheck/durations_numeric_and_negative === RUN TestDecodeAgentRegisterCheck/filled_in_map === RUN TestDecodeAgentRegisterCheck/empty_map === RUN TestDecodeAgentRegisterCheck/empty_map#01 === RUN TestDecodeAgentRegisterCheck/malformatted_map === RUN TestDecodeAgentRegisterCheck/not_a_map_(slice) === RUN TestDecodeAgentRegisterCheck/not_a_map_(int) === RUN TestDecodeAgentRegisterCheck/scriptArgs:_all_set === RUN TestDecodeAgentRegisterCheck/scriptArgs:_first_and_second_set === RUN TestDecodeAgentRegisterCheck/scriptArgs:_first_and_third_set === RUN TestDecodeAgentRegisterCheck/scriptArgs:_second_and_third_set === RUN TestDecodeAgentRegisterCheck/scriptArgs:_first_set === RUN TestDecodeAgentRegisterCheck/scriptArgs:_second_set === RUN TestDecodeAgentRegisterCheck/scriptArgs:_third_set === RUN TestDecodeAgentRegisterCheck/scriptArgs:_none_set === RUN TestDecodeAgentRegisterCheck/deregister:_both_set === RUN TestDecodeAgentRegisterCheck/deregister:_first_set === RUN TestDecodeAgentRegisterCheck/deregister:_second_set === RUN TestDecodeAgentRegisterCheck/deregister:_neither_set === RUN TestDecodeAgentRegisterCheck/dockerContainerID:_both_set === RUN TestDecodeAgentRegisterCheck/dockerContainerID:_first_set === RUN TestDecodeAgentRegisterCheck/dockerContainerID:_second_set === RUN TestDecodeAgentRegisterCheck/dockerContainerID:_neither_set === RUN TestDecodeAgentRegisterCheck/tlsSkipVerify:_both_set === RUN TestDecodeAgentRegisterCheck/tlsSkipVerify:_first_set === RUN TestDecodeAgentRegisterCheck/tlsSkipVerify:_second_set === RUN TestDecodeAgentRegisterCheck/tlsSkipVerify:_neither_set === RUN TestDecodeAgentRegisterCheck/serviceID:_both_set === RUN TestDecodeAgentRegisterCheck/serviceID:_first_set === RUN TestDecodeAgentRegisterCheck/serviceID:_second_set === RUN TestDecodeAgentRegisterCheck/serviceID:_neither_set --- PASS: TestDecodeAgentRegisterCheck (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_correctly_formatted (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_small,_correctly_formatted (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_incorrectly_formatted (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_empty_string (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_string_without_quotes (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_numeric (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_negative (0.00s) --- PASS: TestDecodeAgentRegisterCheck/durations_numeric_and_negative (0.00s) --- PASS: TestDecodeAgentRegisterCheck/filled_in_map (0.00s) --- PASS: TestDecodeAgentRegisterCheck/empty_map (0.00s) --- PASS: TestDecodeAgentRegisterCheck/empty_map#01 (0.00s) --- PASS: TestDecodeAgentRegisterCheck/malformatted_map (0.00s) --- PASS: TestDecodeAgentRegisterCheck/not_a_map_(slice) (0.00s) --- PASS: TestDecodeAgentRegisterCheck/not_a_map_(int) (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_all_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_first_and_second_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_first_and_third_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_second_and_third_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_third_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/scriptArgs:_none_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/deregister:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/deregister:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/deregister:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/deregister:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/dockerContainerID:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/dockerContainerID:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/dockerContainerID:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/dockerContainerID:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/tlsSkipVerify:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/tlsSkipVerify:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/tlsSkipVerify:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/tlsSkipVerify:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/serviceID:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/serviceID:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/serviceID:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterCheck/serviceID:_neither_set (0.00s) === RUN TestDecodeAgentRegisterService === RUN TestDecodeAgentRegisterService/translateEnableTagTCs:_both_set === RUN TestDecodeAgentRegisterService/translateEnableTagTCs:_first_set === RUN TestDecodeAgentRegisterService/translateEnableTagTCs:_second_set === RUN TestDecodeAgentRegisterService/translateEnableTagTCs:_neither_set === RUN TestDecodeAgentRegisterService/DestinationName:_both_set === RUN TestDecodeAgentRegisterService/DestinationName:_first_set === RUN TestDecodeAgentRegisterService/DestinationName:_second_set === RUN TestDecodeAgentRegisterService/DestinationName:_neither_set === RUN TestDecodeAgentRegisterService/DestinationType:_both_set === RUN TestDecodeAgentRegisterService/DestinationType:_first_set === RUN TestDecodeAgentRegisterService/DestinationType:_second_set === RUN TestDecodeAgentRegisterService/DestinationType:_neither_set === RUN TestDecodeAgentRegisterService/DestinationNamespace:_both_set === RUN TestDecodeAgentRegisterService/DestinationNamespace:_first_set === RUN TestDecodeAgentRegisterService/DestinationNamespace:_second_set === RUN TestDecodeAgentRegisterService/DestinationNamespace:_neither_set === RUN TestDecodeAgentRegisterService/LocalBindPort:_both_set === RUN TestDecodeAgentRegisterService/LocalBindPort:_first_set === RUN TestDecodeAgentRegisterService/LocalBindPort:_second_set === RUN TestDecodeAgentRegisterService/LocalBindPort:_neither_set === RUN TestDecodeAgentRegisterService/LocalBindAddress:_both_set === RUN TestDecodeAgentRegisterService/LocalBindAddress:_first_set === RUN TestDecodeAgentRegisterService/LocalBindAddress:_second_set === RUN TestDecodeAgentRegisterService/LocalBindAddress:_neither_set === RUN TestDecodeAgentRegisterService/DestinationServiceName:_both_set === RUN TestDecodeAgentRegisterService/DestinationServiceName:_first_set === RUN TestDecodeAgentRegisterService/DestinationServiceName:_second_set === RUN TestDecodeAgentRegisterService/DestinationServiceName:_neither_set === RUN TestDecodeAgentRegisterService/DestinationServiceID:_both_set === RUN TestDecodeAgentRegisterService/DestinationServiceID:_first_set === RUN TestDecodeAgentRegisterService/DestinationServiceID:_second_set === RUN TestDecodeAgentRegisterService/DestinationServiceID:_neither_set === RUN TestDecodeAgentRegisterService/LocalServicePort:_both_set === RUN TestDecodeAgentRegisterService/LocalServicePort:_first_set === RUN TestDecodeAgentRegisterService/LocalServicePort:_second_set === RUN TestDecodeAgentRegisterService/LocalServicePort:_neither_set === RUN TestDecodeAgentRegisterService/LocalServiceAddress:_both_set === RUN TestDecodeAgentRegisterService/LocalServiceAddress:_first_set === RUN TestDecodeAgentRegisterService/LocalServiceAddress:_second_set === RUN TestDecodeAgentRegisterService/LocalServiceAddress:_neither_set === RUN TestDecodeAgentRegisterService/SidecarService:_both_set === RUN TestDecodeAgentRegisterService/SidecarService:_first_set === RUN TestDecodeAgentRegisterService/SidecarService:_second_set === RUN TestDecodeAgentRegisterService/SidecarService:_neither_set === RUN TestDecodeAgentRegisterService/LocalPathPort:_both_set === RUN TestDecodeAgentRegisterService/LocalPathPort:_first_set === RUN TestDecodeAgentRegisterService/LocalPathPort:_second_set === RUN TestDecodeAgentRegisterService/LocalPathPort:_neither_set === RUN TestDecodeAgentRegisterService/ListenerPort:_both_set === RUN TestDecodeAgentRegisterService/ListenerPort:_first_set === RUN TestDecodeAgentRegisterService/ListenerPort:_second_set === RUN TestDecodeAgentRegisterService/ListenerPort:_neither_set === RUN TestDecodeAgentRegisterService/TaggedAddresses:_both_set === RUN TestDecodeAgentRegisterService/TaggedAddresses:_first_set === RUN TestDecodeAgentRegisterService/TaggedAddresses:_second_set === RUN TestDecodeAgentRegisterService/TaggedAddresses:_neither_set === RUN TestDecodeAgentRegisterService/durations_correctly_formatted === RUN TestDecodeAgentRegisterService/durations_small,_correctly_formatted === RUN TestDecodeAgentRegisterService/durations_incorrectly_formatted === RUN TestDecodeAgentRegisterService/durations_empty_string === RUN TestDecodeAgentRegisterService/durations_string_without_quotes === RUN TestDecodeAgentRegisterService/durations_numeric === RUN TestDecodeAgentRegisterService/durations_negative === RUN TestDecodeAgentRegisterService/durations_numeric_and_negative === RUN TestDecodeAgentRegisterService/filled_in_map === RUN TestDecodeAgentRegisterService/empty_map === RUN TestDecodeAgentRegisterService/empty_map#01 === RUN TestDecodeAgentRegisterService/malformatted_map === RUN TestDecodeAgentRegisterService/not_a_map_(slice) === RUN TestDecodeAgentRegisterService/not_a_map_(int) === RUN TestDecodeAgentRegisterService/scriptArgs:_all_set === RUN TestDecodeAgentRegisterService/scriptArgs:_first_and_second_set === RUN TestDecodeAgentRegisterService/scriptArgs:_first_and_third_set === RUN TestDecodeAgentRegisterService/scriptArgs:_second_and_third_set === RUN TestDecodeAgentRegisterService/scriptArgs:_first_set === RUN TestDecodeAgentRegisterService/scriptArgs:_second_set === RUN TestDecodeAgentRegisterService/scriptArgs:_third_set === RUN TestDecodeAgentRegisterService/scriptArgs:_none_set === RUN TestDecodeAgentRegisterService/deregister:_both_set === RUN TestDecodeAgentRegisterService/deregister:_first_set === RUN TestDecodeAgentRegisterService/deregister:_second_set === RUN TestDecodeAgentRegisterService/deregister:_neither_set === RUN TestDecodeAgentRegisterService/dockerContainerID:_both_set === RUN TestDecodeAgentRegisterService/dockerContainerID:_first_set === RUN TestDecodeAgentRegisterService/dockerContainerID:_second_set === RUN TestDecodeAgentRegisterService/dockerContainerID:_neither_set === RUN TestDecodeAgentRegisterService/tlsSkipVerify:_both_set === RUN TestDecodeAgentRegisterService/tlsSkipVerify:_first_set === RUN TestDecodeAgentRegisterService/tlsSkipVerify:_second_set === RUN TestDecodeAgentRegisterService/tlsSkipVerify:_neither_set === RUN TestDecodeAgentRegisterService/serviceID:_both_set === RUN TestDecodeAgentRegisterService/serviceID:_first_set === RUN TestDecodeAgentRegisterService/serviceID:_second_set === RUN TestDecodeAgentRegisterService/serviceID:_neither_set --- PASS: TestDecodeAgentRegisterService (0.02s) --- PASS: TestDecodeAgentRegisterService/translateEnableTagTCs:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/translateEnableTagTCs:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/translateEnableTagTCs:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/translateEnableTagTCs:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationName:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationName:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationName:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationName:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationType:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationType:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationType:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationType:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationNamespace:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationNamespace:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationNamespace:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationNamespace:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindPort:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindPort:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindPort:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindPort:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindAddress:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindAddress:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindAddress:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalBindAddress:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceName:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceName:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceName:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceName:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceID:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceID:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceID:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/DestinationServiceID:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServicePort:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServicePort:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServicePort:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServicePort:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServiceAddress:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServiceAddress:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServiceAddress:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalServiceAddress:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/SidecarService:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/SidecarService:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/SidecarService:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/SidecarService:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalPathPort:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalPathPort:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalPathPort:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/LocalPathPort:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/ListenerPort:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/ListenerPort:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/ListenerPort:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/ListenerPort:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/TaggedAddresses:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/TaggedAddresses:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/TaggedAddresses:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/TaggedAddresses:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_correctly_formatted (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_small,_correctly_formatted (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_incorrectly_formatted (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_empty_string (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_string_without_quotes (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_numeric (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_negative (0.00s) --- PASS: TestDecodeAgentRegisterService/durations_numeric_and_negative (0.00s) --- PASS: TestDecodeAgentRegisterService/filled_in_map (0.00s) --- PASS: TestDecodeAgentRegisterService/empty_map (0.00s) --- PASS: TestDecodeAgentRegisterService/empty_map#01 (0.00s) --- PASS: TestDecodeAgentRegisterService/malformatted_map (0.00s) --- PASS: TestDecodeAgentRegisterService/not_a_map_(slice) (0.00s) --- PASS: TestDecodeAgentRegisterService/not_a_map_(int) (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_all_set (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_first_and_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_first_and_third_set (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_second_and_third_set (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_third_set (0.00s) --- PASS: TestDecodeAgentRegisterService/scriptArgs:_none_set (0.00s) --- PASS: TestDecodeAgentRegisterService/deregister:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/deregister:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/deregister:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/deregister:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/dockerContainerID:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/dockerContainerID:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/dockerContainerID:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/dockerContainerID:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/tlsSkipVerify:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/tlsSkipVerify:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/tlsSkipVerify:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/tlsSkipVerify:_neither_set (0.00s) --- PASS: TestDecodeAgentRegisterService/serviceID:_both_set (0.00s) --- PASS: TestDecodeAgentRegisterService/serviceID:_first_set (0.00s) --- PASS: TestDecodeAgentRegisterService/serviceID:_second_set (0.00s) --- PASS: TestDecodeAgentRegisterService/serviceID:_neither_set (0.00s) === RUN TestDecodeCatalogRegister === RUN TestDecodeCatalogRegister/durations_correctly_formatted === RUN TestDecodeCatalogRegister/durations_small,_correctly_formatted === RUN TestDecodeCatalogRegister/durations_incorrectly_formatted === RUN TestDecodeCatalogRegister/durations_empty_string === RUN TestDecodeCatalogRegister/durations_string_without_quotes === RUN TestDecodeCatalogRegister/durations_numeric === RUN TestDecodeCatalogRegister/durations_negative === RUN TestDecodeCatalogRegister/durations_numeric_and_negative --- PASS: TestDecodeCatalogRegister (0.00s) --- PASS: TestDecodeCatalogRegister/durations_correctly_formatted (0.00s) --- PASS: TestDecodeCatalogRegister/durations_small,_correctly_formatted (0.00s) --- PASS: TestDecodeCatalogRegister/durations_incorrectly_formatted (0.00s) --- PASS: TestDecodeCatalogRegister/durations_empty_string (0.00s) --- PASS: TestDecodeCatalogRegister/durations_string_without_quotes (0.00s) --- PASS: TestDecodeCatalogRegister/durations_numeric (0.00s) --- PASS: TestDecodeCatalogRegister/durations_negative (0.00s) --- PASS: TestDecodeCatalogRegister/durations_numeric_and_negative (0.00s) === RUN TestDecodeIntentionCreate === RUN TestDecodeIntentionCreate/hashes_base64_encoded === RUN TestDecodeIntentionCreate/hashes_not-base64_encoded === RUN TestDecodeIntentionCreate/hashes_empty_string === RUN TestDecodeIntentionCreate/hashes_null === RUN TestDecodeIntentionCreate/hashes_numeric_value === RUN TestDecodeIntentionCreate/timestamps_correctly_RFC3339_formatted === RUN TestDecodeIntentionCreate/timestamps_incorrectly_formatted_(RFC822) === RUN TestDecodeIntentionCreate/timestamps_incorrectly_formatted_(RFC850) === RUN TestDecodeIntentionCreate/timestamps_empty_string === RUN TestDecodeIntentionCreate/timestamps_null --- PASS: TestDecodeIntentionCreate (0.00s) --- PASS: TestDecodeIntentionCreate/hashes_base64_encoded (0.00s) --- PASS: TestDecodeIntentionCreate/hashes_not-base64_encoded (0.00s) --- PASS: TestDecodeIntentionCreate/hashes_empty_string (0.00s) --- PASS: TestDecodeIntentionCreate/hashes_null (0.00s) --- PASS: TestDecodeIntentionCreate/hashes_numeric_value (0.00s) --- PASS: TestDecodeIntentionCreate/timestamps_correctly_RFC3339_formatted (0.00s) --- PASS: TestDecodeIntentionCreate/timestamps_incorrectly_formatted_(RFC822) (0.00s) --- PASS: TestDecodeIntentionCreate/timestamps_incorrectly_formatted_(RFC850) (0.00s) --- PASS: TestDecodeIntentionCreate/timestamps_empty_string (0.00s) --- PASS: TestDecodeIntentionCreate/timestamps_null (0.00s) === RUN TestDecodeOperatorAutopilotConfiguration === RUN TestDecodeOperatorAutopilotConfiguration/durations_correctly_formatted === RUN TestDecodeOperatorAutopilotConfiguration/durations_small,_correctly_formatted === RUN TestDecodeOperatorAutopilotConfiguration/durations_incorrectly_formatted === RUN TestDecodeOperatorAutopilotConfiguration/durations_empty_string === RUN TestDecodeOperatorAutopilotConfiguration/durations_string_without_quotes === RUN TestDecodeOperatorAutopilotConfiguration/durations_numeric === RUN TestDecodeOperatorAutopilotConfiguration/durations_negative === RUN TestDecodeOperatorAutopilotConfiguration/durations_numeric_and_negative --- PASS: TestDecodeOperatorAutopilotConfiguration (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_correctly_formatted (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_small,_correctly_formatted (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_incorrectly_formatted (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_empty_string (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_string_without_quotes (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_numeric (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_negative (0.00s) --- PASS: TestDecodeOperatorAutopilotConfiguration/durations_numeric_and_negative (0.00s) === RUN TestDecodeSessionCreate === RUN TestDecodeSessionCreate/durations_correctly_formatted === RUN TestDecodeSessionCreate/durations_small,_correctly_formatted === RUN TestDecodeSessionCreate/durations_incorrectly_formatted === RUN TestDecodeSessionCreate/durations_empty_string === RUN TestDecodeSessionCreate/durations_string_without_quotes === RUN TestDecodeSessionCreate/durations_numeric === RUN TestDecodeSessionCreate/duration_small,_numeric_(<_lockDelayMinThreshold) === RUN TestDecodeSessionCreate/duration_string,_no_unit === RUN TestDecodeSessionCreate/duration_small,_string,_already_duration === RUN TestDecodeSessionCreate/duration_small,_numeric,_negative === RUN TestDecodeSessionCreate/many_check_ids === RUN TestDecodeSessionCreate/one_check_ids === RUN TestDecodeSessionCreate/empty_check_id_slice === RUN TestDecodeSessionCreate/null_check_ids === RUN TestDecodeSessionCreate/empty_value_check_ids === RUN TestDecodeSessionCreate/malformatted_check_ids_(string) --- PASS: TestDecodeSessionCreate (0.00s) --- PASS: TestDecodeSessionCreate/durations_correctly_formatted (0.00s) --- PASS: TestDecodeSessionCreate/durations_small,_correctly_formatted (0.00s) --- PASS: TestDecodeSessionCreate/durations_incorrectly_formatted (0.00s) --- PASS: TestDecodeSessionCreate/durations_empty_string (0.00s) --- PASS: TestDecodeSessionCreate/durations_string_without_quotes (0.00s) --- PASS: TestDecodeSessionCreate/durations_numeric (0.00s) --- PASS: TestDecodeSessionCreate/duration_small,_numeric_(<_lockDelayMinThreshold) (0.00s) --- PASS: TestDecodeSessionCreate/duration_string,_no_unit (0.00s) --- PASS: TestDecodeSessionCreate/duration_small,_string,_already_duration (0.00s) --- PASS: TestDecodeSessionCreate/duration_small,_numeric,_negative (0.00s) --- PASS: TestDecodeSessionCreate/many_check_ids (0.00s) --- PASS: TestDecodeSessionCreate/one_check_ids (0.00s) --- PASS: TestDecodeSessionCreate/empty_check_id_slice (0.00s) --- PASS: TestDecodeSessionCreate/null_check_ids (0.00s) --- PASS: TestDecodeSessionCreate/empty_value_check_ids (0.00s) --- PASS: TestDecodeSessionCreate/malformatted_check_ids_(string) (0.00s) === RUN TestDecodeTxnConvertOps === RUN TestDecodeTxnConvertOps/durations_correctly_formatted === RUN TestDecodeTxnConvertOps/durations_small,_correctly_formatted === RUN TestDecodeTxnConvertOps/durations_incorrectly_formatted === RUN TestDecodeTxnConvertOps/durations_empty_string === RUN TestDecodeTxnConvertOps/durations_string_without_quotes === RUN TestDecodeTxnConvertOps/durations_numeric === RUN TestDecodeTxnConvertOps/durations_negative === RUN TestDecodeTxnConvertOps/durations_numeric_and_negative --- PASS: TestDecodeTxnConvertOps (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_correctly_formatted (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_small,_correctly_formatted (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_incorrectly_formatted (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_empty_string (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_string_without_quotes (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_numeric (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_negative (0.00s) --- PASS: TestDecodeTxnConvertOps/durations_numeric_and_negative (0.00s) === RUN TestHTTPAPI_MethodNotAllowed_OSS [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query/xxx/execute === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query/xxx/execute === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query/xxx/execute === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query/xxx/execute === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query/xxx/execute === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query/xxx/execute === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query/xxx/explain === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query/xxx/explain === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query/xxx/explain === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query/xxx/explain === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query/xxx/explain === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query/xxx/explain === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/node-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/node-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/node-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/node-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/node-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/node-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/leave === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/leave === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/leave === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/leave [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/leave === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/leave === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/warn/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/warn/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/warn/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/warn/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/warn/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/warn/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/rules/translate === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/rules/translate === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/rules/translate === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/rules/translate === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/rules/translate === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/rules/translate === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/role === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/role === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/role === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/role === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/role === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/role === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/tokens === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/tokens === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/tokens === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/tokens === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/tokens === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/tokens === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/checks === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/checks === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/checks === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/checks === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/checks === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/checks === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/federation-state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/federation-state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/federation-state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/federation-state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/federation-state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/federation-state/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/federation-states/mesh-gateways === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/federation-states/mesh-gateways === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/federation-states/mesh-gateways === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/federation-states/mesh-gateways === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/federation-states/mesh-gateways === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/federation-states/mesh-gateways === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/role/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/role/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/role/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/role/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/role/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/role/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/health/service/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/health/service/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/health/service/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/health/service/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/health/service/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/health/service/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/update/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/update/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/update/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/update/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/update/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/update/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/config === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/config === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/config === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/config === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/config === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/config === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/health/service/id/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/health/service/id/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/health/service/id/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/health/service/id/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/health/service/id/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/health/service/id/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/datacenters === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/info/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/auth-methods === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/auth-methods === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/auth-methods === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/auth-methods === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/auth-methods === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/auth-methods === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/deregister/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/roles === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/roles === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/roles === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/roles === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/roles === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/roles === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/join/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/join/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/join/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/join/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/join/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/join/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/fail/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/fail/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/fail/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/fail/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/fail/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/fail/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/gateway-services-nodes/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/gateway-services-nodes/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/gateway-services-nodes/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/gateway-services-nodes/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/gateway-services-nodes/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/gateway-services-nodes/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/connect/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/connect/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/connect/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/connect/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/connect/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/connect/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/event/fire/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/event/fire/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/event/fire/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/event/fire/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/event/fire/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/event/fire/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/checks/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/checks/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/checks/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/checks/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/checks/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/checks/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/host === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/host === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/host === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/host === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/host === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/host === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/binding-rule/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/binding-rule/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/binding-rule/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/binding-rule/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/binding-rule/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/binding-rule/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/node/ [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/auth-method === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/auth-method === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/auth-method === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/auth-method === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/auth-method === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/auth-method === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/connect/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/kv/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/kv/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/kv/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/kv/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/kv/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/kv/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/logout === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/logout === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/logout === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/logout === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/logout === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/logout === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policies === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policies === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policies === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policies === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policies === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policies === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policy === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policy === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policy === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policy === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policy === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policy === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/ingress/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/ingress/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/ingress/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/ingress/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/ingress/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/ingress/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/raft/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/raft/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/raft/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/raft/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/raft/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/raft/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/role/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/role/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/role/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/role/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/role/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/role/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/binding-rules === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/binding-rules === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/binding-rules === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/binding-rules === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/binding-rules === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/binding-rules === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/acl/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/acl/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/acl/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/acl/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/acl/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/acl/authorize === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/config/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/config/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/config/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/config/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/config/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/config/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/event/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/event/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/event/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/event/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/event/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/event/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/snapshot === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/snapshot === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/snapshot === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/snapshot === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/snapshot === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/snapshot === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/metrics === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/metrics === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/metrics === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/metrics === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/metrics === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/metrics === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/services === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/keyring === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/keyring === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/keyring === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/keyring === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/keyring === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/keyring === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/clone/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/clone/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/clone/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/clone/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/clone/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/clone/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/token/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/update === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/federation-states === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/federation-states === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/federation-states === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/federation-states === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/federation-states === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/federation-states === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/rules/translate/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/rules/translate/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/rules/translate/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/rules/translate/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/rules/translate/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/rules/translate/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/connect/ca/roots === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/binding-rule === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/binding-rule === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/binding-rule === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/binding-rule === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/binding-rule === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/binding-rule === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/token === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/token === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/token === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/token === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/token === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/token === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/gateway-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/gateway-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/gateway-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/gateway-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/gateway-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/gateway-services/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/ca/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/ca/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/ca/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/ca/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/ca/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/ca/configuration === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/connect/ca/leaf/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/connect/ca/leaf/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/connect/ca/leaf/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/connect/ca/leaf/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/connect/ca/leaf/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/connect/ca/leaf/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/service/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/destroy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/renew/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/renew/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/renew/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/renew/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/renew/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/renew/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/bootstrap === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/bootstrap === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/bootstrap === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/bootstrap === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/bootstrap === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/bootstrap === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/pass/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/pass/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/pass/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/pass/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/pass/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/pass/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/node/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/status/leader === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/status/leader === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/status/leader === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/status/leader === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/status/leader === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/status/leader === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/members === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/members === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/members === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/members === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/members === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/members === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/list === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/login === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/login === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/login === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/login === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/login === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/login === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/nodes === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/replication === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/replication === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/replication === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/replication === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/replication === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/replication === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policy/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policy/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policy/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policy/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policy/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policy/name/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policy/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/force-leave/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/force-leave/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/force-leave/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/force-leave/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/force-leave/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/force-leave/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/deregister === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/deregister === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/deregister === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/deregister === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/deregister === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/deregister === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/auth-method/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/auth-method/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/auth-method/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/auth-method/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/auth-method/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/auth-method/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/token/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/token/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/token/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/token/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/token/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/token/self === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/create === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions/check === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions/check === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions/check === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions/check === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions/check === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions/check === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/discovery-chain/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/discovery-chain/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/discovery-chain/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/discovery-chain/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/discovery-chain/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/discovery-chain/ === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/raft/peer === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/raft/peer === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/raft/peer === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/raft/peer === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/raft/peer === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/raft/peer === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/autopilot/health === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/autopilot/health === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/autopilot/health === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/autopilot/health === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/autopilot/health === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/autopilot/health === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/txn === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/txn === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/txn [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/txn === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/txn === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/txn === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/maintenance === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/maintenance === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/maintenance === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/maintenance === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/maintenance === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/maintenance === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/register === RUN TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions/match === RUN TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions/match === RUN TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions/match === RUN TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions/match === RUN TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions/match === RUN TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions/match [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:47.009Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:47.022Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:47.066 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d Address:127.0.0.1:30287}]" 30:47.066 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30287 [Follower]" leader= 30:47.067 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d.dc1 127.0.0.1 30:47.067 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 127.0.0.1 2021-10-05T16:30:47.067Z [INFO] agent.router: Initializing LAN area manager 30:47.068 [INFO] TestAgent.server: Adding LAN server: server="Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d (Addr: tcp/127.0.0.1:30287) (DC: dc1)" 30:47.068 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d.dc1 area=wan 30:47.068 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30282 network=udp 30:47.068 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30282 network=tcp 30:47.068 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30283 network=tcp 30:47.068 [INFO] TestAgent: started state syncer 30:47.068 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30288 network=tcp 30:47.110 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:47.110 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30287 [Candidate]" term=2 30:47.119 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:47.137 [DEBUG] TestAgent.server.raft: votes: needed=1 30:47.137 [DEBUG] TestAgent.server.raft: vote granted: from=8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d term=2 tally=1 30:47.137 [INFO] TestAgent.server.raft: election won: tally=1 30:47.137 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30287 [Leader]" 30:47.140 [INFO] TestAgent.server: cluster leadership acquired 30:47.140 [INFO] TestAgent.server: New leader elected: payload=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.147 [INFO] TestAgent.server: initializing acls 30:47.161 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:47.161 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.170 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 30:47.175 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:47.185 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:47.185 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:47.185 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:47.185 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.185 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d.dc1 30:47.187 [INFO] TestAgent.server: Updating LAN server: server="Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d (Addr: tcp/127.0.0.1:30287) (DC: dc1)" 30:47.188 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d.dc1 area=wan 30:47.197 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:47.223 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:47.223 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:47.223 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:47.223 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:47.223 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:47.223 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.224 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.235 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.238 [ERROR] TestAgent.http: Request error: method=GET url=/v1/query/ from=127.0.0.1:36400 error="failed prepared query lookup: index error: UUID must be 36 characters" 30:47.238 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/query/ from=127.0.0.1:36400 latency=697.296µs 30:47.239 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/query/ from=127.0.0.1:36402 error="Prepared Query lookup failed: failed prepared query lookup: index error: UUID must be 36 characters" 30:47.239 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/query/ from=127.0.0.1:36402 latency=249.086µs 30:47.240 [ERROR] TestAgent.http: Request error: method=POST url=/v1/query/ from=127.0.0.1:36404 error="method POST not allowed" 30:47.240 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/query/ from=127.0.0.1:36404 latency=289.706µs 30:47.246 [INFO] TestAgent.server: federation state anti-entropy synced 30:47.248 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/query/ from=127.0.0.1:36406 error="Prepared Query lookup failed: failed prepared query lookup: index error: UUID must be 36 characters" 30:47.248 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/query/ from=127.0.0.1:36406 latency=390.671µs 30:47.249 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/query/ from=127.0.0.1:36408 error="method HEAD not allowed" 30:47.249 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/query/ from=127.0.0.1:36408 latency=35.619µs 30:47.251 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/query/ from=127.0.0.1:36408 latency=1.247759ms 30:47.252 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/query/xxx/execute from=127.0.0.1:36410 latency=334.195µs 30:47.257 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/query/xxx/execute from=127.0.0.1:36412 error="method PUT not allowed" 30:47.257 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/query/xxx/execute from=127.0.0.1:36412 latency=164.041µs 30:47.257 [ERROR] TestAgent.http: Request error: method=POST url=/v1/query/xxx/execute from=127.0.0.1:36414 error="method POST not allowed" 30:47.257 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/query/xxx/execute from=127.0.0.1:36414 latency=107.653µs 30:47.258 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/query/xxx/execute from=127.0.0.1:36416 error="method DELETE not allowed" 30:47.258 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/query/xxx/execute from=127.0.0.1:36416 latency=108.033µs 30:47.259 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/query/xxx/execute from=127.0.0.1:36418 error="method HEAD not allowed" 30:47.259 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/query/xxx/execute from=127.0.0.1:36418 latency=21.297µs 30:47.259 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/query/xxx/execute from=127.0.0.1:36418 latency=90.595µs 30:47.263 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/query/xxx/explain from=127.0.0.1:36420 latency=3.755165ms 30:47.268 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/query/xxx/explain from=127.0.0.1:36422 error="method PUT not allowed" 30:47.268 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/query/xxx/explain from=127.0.0.1:36422 latency=193.386µs 30:47.272 [ERROR] TestAgent.http: Request error: method=POST url=/v1/query/xxx/explain from=127.0.0.1:36424 error="method POST not allowed" 30:47.272 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/query/xxx/explain from=127.0.0.1:36424 latency=151.739µs 30:47.273 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/query/xxx/explain from=127.0.0.1:36426 error="method DELETE not allowed" 30:47.273 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/query/xxx/explain from=127.0.0.1:36426 latency=495.715µs 30:47.275 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/query/xxx/explain from=127.0.0.1:36428 error="method HEAD not allowed" 30:47.275 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/query/xxx/explain from=127.0.0.1:36428 latency=28.849µs 30:47.276 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/query/xxx/explain from=127.0.0.1:36428 latency=569.88µs 30:47.277 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/query from=127.0.0.1:36430 latency=395.374µs 30:47.277 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/query from=127.0.0.1:36432 error="method PUT not allowed" 30:47.277 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/query from=127.0.0.1:36432 latency=117.568µs 30:47.278 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/query from=127.0.0.1:36434 latency=281.927µs 30:47.280 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/query from=127.0.0.1:36436 error="method DELETE not allowed" 30:47.280 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/query from=127.0.0.1:36436 latency=157.806µs 30:47.284 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/query from=127.0.0.1:36438 error="method HEAD not allowed" 30:47.284 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/query from=127.0.0.1:36438 latency=32.144µs 30:47.285 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/query from=127.0.0.1:36438 latency=4.281µs 30:47.299 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/node-services/ from=127.0.0.1:36438 latency=13.028851ms 30:47.300 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/node-services/ from=127.0.0.1:36440 error="method PUT not allowed" 30:47.300 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/node-services/ from=127.0.0.1:36440 latency=196.806µs 30:47.301 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/node-services/ from=127.0.0.1:36442 error="method POST not allowed" 30:47.310 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/node-services/ from=127.0.0.1:36442 latency=9.480555ms 30:47.314 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/node-services/ from=127.0.0.1:36444 error="method DELETE not allowed" 30:47.315 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/node-services/ from=127.0.0.1:36444 latency=1.526683ms 30:47.317 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/node-services/ from=127.0.0.1:36448 error="method HEAD not allowed" 30:47.317 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/node-services/ from=127.0.0.1:36448 latency=25.926µs 30:47.317 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/node-services/ from=127.0.0.1:36448 latency=2.554µs 30:47.317 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/leave from=127.0.0.1:36448 error="method GET not allowed" 30:47.317 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/leave from=127.0.0.1:36448 latency=131.259µs 30:47.318 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/leave from=127.0.0.1:36450 error="Permission denied" 30:47.318 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/leave from=127.0.0.1:36450 latency=183.513µs 30:47.319 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/leave from=127.0.0.1:36452 error="method POST not allowed" 30:47.319 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/leave from=127.0.0.1:36452 latency=119.176µs 30:47.320 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/leave from=127.0.0.1:36454 error="method DELETE not allowed" 30:47.324 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/leave from=127.0.0.1:36454 latency=1.445469ms 30:47.325 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/leave from=127.0.0.1:36456 error="method HEAD not allowed" 30:47.325 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/leave from=127.0.0.1:36456 latency=65.709µs 30:47.326 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/leave from=127.0.0.1:36456 latency=3.298µs 30:47.326 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/check/warn/ from=127.0.0.1:36456 error="method GET not allowed" 30:47.326 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/check/warn/ from=127.0.0.1:36456 latency=244.001µs 30:47.327 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/check/warn/ from=127.0.0.1:36458 error="Unknown check """ 30:47.327 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/warn/ from=127.0.0.1:36458 latency=203.341µs 30:47.327 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/check/warn/ from=127.0.0.1:36460 error="method POST not allowed" 30:47.328 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/check/warn/ from=127.0.0.1:36460 latency=114.293µs 30:47.332 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/check/warn/ from=127.0.0.1:36462 error="method DELETE not allowed" 30:47.333 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/check/warn/ from=127.0.0.1:36462 latency=283.014µs 30:47.333 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/check/warn/ from=127.0.0.1:36464 error="method HEAD not allowed" 30:47.333 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/check/warn/ from=127.0.0.1:36464 latency=21.518µs 30:47.334 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/check/warn/ from=127.0.0.1:36464 latency=2.615µs 30:47.334 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/service/deregister/ from=127.0.0.1:36464 error="method GET not allowed" 30:47.334 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/deregister/ from=127.0.0.1:36464 latency=108.335µs 30:47.334 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/service/deregister/ from=127.0.0.1:36466 error="Unknown service {"" {}}" 30:47.336 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/deregister/ from=127.0.0.1:36466 latency=1.186009ms 30:47.342 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/service/deregister/ from=127.0.0.1:36468 error="method POST not allowed" 30:47.343 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/service/deregister/ from=127.0.0.1:36468 latency=308.965µs 30:47.346 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/service/deregister/ from=127.0.0.1:36472 error="method DELETE not allowed" 30:47.346 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/service/deregister/ from=127.0.0.1:36472 latency=136.421µs 30:47.346 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/service/deregister/ from=127.0.0.1:36474 error="method HEAD not allowed" 30:47.346 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/service/deregister/ from=127.0.0.1:36474 latency=23.251µs 30:47.348 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/service/deregister/ from=127.0.0.1:36474 latency=3.497µs 30:47.348 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/state/ from=127.0.0.1:36474 latency=219.483µs 30:47.349 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/health/state/ from=127.0.0.1:36476 error="method PUT not allowed" 30:47.349 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/health/state/ from=127.0.0.1:36476 latency=204.039µs 30:47.350 [ERROR] TestAgent.http: Request error: method=POST url=/v1/health/state/ from=127.0.0.1:36478 error="method POST not allowed" 30:47.350 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/health/state/ from=127.0.0.1:36478 latency=126.441µs 30:47.350 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/health/state/ from=127.0.0.1:36480 error="method DELETE not allowed" 30:47.350 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/health/state/ from=127.0.0.1:36480 latency=111.675µs 30:47.351 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/health/state/ from=127.0.0.1:36482 error="method HEAD not allowed" 30:47.351 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/health/state/ from=127.0.0.1:36482 latency=19.515µs 30:47.351 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/health/state/ from=127.0.0.1:36482 latency=2.394µs 30:47.351 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/connect/ from=127.0.0.1:36482 latency=117.732µs 30:47.355 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/health/connect/ from=127.0.0.1:36484 error="method PUT not allowed" 30:47.355 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/health/connect/ from=127.0.0.1:36484 latency=134.312µs 30:47.364 [ERROR] TestAgent.http: Request error: method=POST url=/v1/health/connect/ from=127.0.0.1:36486 error="method POST not allowed" 30:47.364 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/health/connect/ from=127.0.0.1:36486 latency=226.612µs 30:47.365 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/health/connect/ from=127.0.0.1:36488 error="method DELETE not allowed" 30:47.365 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/health/connect/ from=127.0.0.1:36488 latency=114.195µs 30:47.366 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/health/connect/ from=127.0.0.1:36490 error="method HEAD not allowed" 30:47.366 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/health/connect/ from=127.0.0.1:36490 latency=20.772µs 30:47.366 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/health/connect/ from=127.0.0.1:36490 latency=2.591µs 30:47.366 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/list from=127.0.0.1:36490 error="Permission denied" 30:47.366 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/list from=127.0.0.1:36490 latency=218.089µs 30:47.367 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/list from=127.0.0.1:36492 error="method PUT not allowed" 30:47.367 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/list from=127.0.0.1:36492 latency=110.577µs 30:47.368 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/list from=127.0.0.1:36494 error="method POST not allowed" 30:47.368 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/list from=127.0.0.1:36494 latency=152.618µs 30:47.368 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/list from=127.0.0.1:36496 error="method DELETE not allowed" 30:47.368 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/list from=127.0.0.1:36496 latency=148.425µs 30:47.369 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/list from=127.0.0.1:36498 error="method HEAD not allowed" 30:47.369 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/list from=127.0.0.1:36498 latency=20.768µs 30:47.369 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/list from=127.0.0.1:36498 latency=2.933µs 30:47.370 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/rules/translate from=127.0.0.1:36498 error="method GET not allowed" 30:47.370 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/rules/translate from=127.0.0.1:36498 latency=113.106µs 30:47.370 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/rules/translate from=127.0.0.1:36500 error="method PUT not allowed" 30:47.370 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/rules/translate from=127.0.0.1:36500 latency=97.942µs 30:47.371 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/rules/translate from=127.0.0.1:36502 error="Permission denied" 30:47.371 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/rules/translate from=127.0.0.1:36502 latency=168.981µs 30:47.371 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/rules/translate from=127.0.0.1:36504 error="method DELETE not allowed" 30:47.372 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/rules/translate from=127.0.0.1:36504 latency=104.89µs 30:47.376 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/rules/translate from=127.0.0.1:36506 error="method HEAD not allowed" 30:47.376 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/rules/translate from=127.0.0.1:36506 latency=22.948µs 30:47.376 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/rules/translate from=127.0.0.1:36506 latency=3.185µs 30:47.376 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/self from=127.0.0.1:36506 error="Permission denied" 30:47.376 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:36506 latency=187.016µs 30:47.377 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/self from=127.0.0.1:36508 error="method PUT not allowed" 30:47.377 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/self from=127.0.0.1:36508 latency=100.891µs 30:47.378 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/self from=127.0.0.1:36510 error="method POST not allowed" 30:47.378 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/self from=127.0.0.1:36510 latency=109.839µs 30:47.378 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/self from=127.0.0.1:36512 error="method DELETE not allowed" 30:47.378 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/self from=127.0.0.1:36512 latency=106.072µs 30:47.379 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/self from=127.0.0.1:36514 error="method HEAD not allowed" 30:47.379 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/self from=127.0.0.1:36514 latency=20.227µs 30:47.379 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/self from=127.0.0.1:36514 latency=2.558µs 30:47.379 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/role from=127.0.0.1:36514 error="method GET not allowed" 30:47.379 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role from=127.0.0.1:36514 latency=108.412µs 30:47.384 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/role from=127.0.0.1:36516 error="Bad request: Role decoding failed: EOF" 30:47.384 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:36516 latency=167.209µs 30:47.387 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/role from=127.0.0.1:36518 error="method POST not allowed" 30:47.387 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/role from=127.0.0.1:36518 latency=122.526µs 30:47.388 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/role from=127.0.0.1:36520 error="method DELETE not allowed" 30:47.388 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/role from=127.0.0.1:36520 latency=148.709µs 30:47.392 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/role from=127.0.0.1:36522 error="method HEAD not allowed" 30:47.392 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/role from=127.0.0.1:36522 latency=26.723µs 30:47.392 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/role from=127.0.0.1:36522 latency=3.241µs 30:47.393 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/tokens from=127.0.0.1:36522 error="Permission denied" 30:47.393 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/tokens from=127.0.0.1:36522 latency=260.44µs 30:47.393 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/tokens from=127.0.0.1:36524 error="method PUT not allowed" 30:47.393 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/tokens from=127.0.0.1:36524 latency=99.091µs 30:47.394 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/tokens from=127.0.0.1:36526 error="method POST not allowed" 30:47.394 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/tokens from=127.0.0.1:36526 latency=177.922µs 30:47.395 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/tokens from=127.0.0.1:36528 error="method DELETE not allowed" 30:47.395 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/tokens from=127.0.0.1:36528 latency=170.471µs 30:47.396 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/tokens from=127.0.0.1:36530 error="method HEAD not allowed" 30:47.396 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/tokens from=127.0.0.1:36530 latency=51.674µs 30:47.396 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/tokens from=127.0.0.1:36530 latency=2.308µs 30:47.397 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:36530 latency=276.9µs 30:47.397 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/checks from=127.0.0.1:36532 error="method PUT not allowed" 30:47.397 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/checks from=127.0.0.1:36532 latency=137.307µs 30:47.398 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/checks from=127.0.0.1:36534 error="method POST not allowed" 30:47.398 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/checks from=127.0.0.1:36534 latency=106.31µs 30:47.399 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/checks from=127.0.0.1:36536 error="method DELETE not allowed" 30:47.399 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/checks from=127.0.0.1:36536 latency=297.205µs 30:47.399 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/checks from=127.0.0.1:36538 error="method HEAD not allowed" 30:47.399 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/checks from=127.0.0.1:36538 latency=22.182µs 30:47.400 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/checks from=127.0.0.1:36538 latency=2.499µs 30:47.400 [ERROR] TestAgent.http: Request error: method=GET url=/v1/internal/federation-state/ from=127.0.0.1:36538 error="Bad request: Missing datacenter name" 30:47.400 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/federation-state/ from=127.0.0.1:36538 latency=129.629µs 30:47.404 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/federation-state/ from=127.0.0.1:36540 error="method PUT not allowed" 30:47.404 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/federation-state/ from=127.0.0.1:36540 latency=190.041µs 30:47.405 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/federation-state/ from=127.0.0.1:36542 error="method POST not allowed" 30:47.405 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/federation-state/ from=127.0.0.1:36542 latency=155.724µs 30:47.407 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/federation-state/ from=127.0.0.1:36544 error="method DELETE not allowed" 30:47.407 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/federation-state/ from=127.0.0.1:36544 latency=136.844µs 30:47.408 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/federation-state/ from=127.0.0.1:36546 error="method HEAD not allowed" 30:47.408 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/federation-state/ from=127.0.0.1:36546 latency=26.954µs 30:47.409 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/federation-state/ from=127.0.0.1:36546 latency=2.28µs 30:47.412 [ERROR] TestAgent.http: Request error: method=GET url=/v1/operator/autopilot/configuration from=127.0.0.1:36546 error="Permission denied" 30:47.412 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/autopilot/configuration from=127.0.0.1:36546 latency=292.793µs 30:47.413 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/operator/autopilot/configuration from=127.0.0.1:36548 error="Bad request: Error parsing autopilot config: EOF" 30:47.413 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/operator/autopilot/configuration from=127.0.0.1:36548 latency=217.837µs 30:47.413 [ERROR] TestAgent.http: Request error: method=POST url=/v1/operator/autopilot/configuration from=127.0.0.1:36550 error="method POST not allowed" 30:47.414 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/operator/autopilot/configuration from=127.0.0.1:36550 latency=116.259µs 30:47.414 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/operator/autopilot/configuration from=127.0.0.1:36552 error="method DELETE not allowed" 30:47.415 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/autopilot/configuration from=127.0.0.1:36552 latency=140.273µs 30:47.415 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/operator/autopilot/configuration from=127.0.0.1:36554 error="method HEAD not allowed" 30:47.415 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/operator/autopilot/configuration from=127.0.0.1:36554 latency=25.115µs 30:47.416 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/operator/autopilot/configuration from=127.0.0.1:36554 latency=3.573µs 30:47.419 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36554 latency=268.069µs 30:47.419 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36556 error="method PUT not allowed" 30:47.420 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36556 latency=225.201µs 30:47.420 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36558 error="method POST not allowed" 30:47.421 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36558 latency=152.401µs 30:47.421 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36560 error="method DELETE not allowed" 30:47.421 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36560 latency=207.782µs 30:47.422 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36562 error="method HEAD not allowed" 30:47.422 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36562 latency=25.944µs 30:47.422 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/federation-states/mesh-gateways from=127.0.0.1:36562 latency=2.362µs 30:47.422 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/role/ from=127.0.0.1:36562 error="Bad request: Missing role ID" 30:47.422 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/ from=127.0.0.1:36562 latency=114.537µs 30:47.423 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/role/ from=127.0.0.1:36564 error="Bad request: Role decoding failed: EOF" 30:47.423 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/ from=127.0.0.1:36564 latency=153.337µs 30:47.424 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/role/ from=127.0.0.1:36566 error="method POST not allowed" 30:47.424 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/role/ from=127.0.0.1:36566 latency=139.219µs 30:47.425 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/role/ from=127.0.0.1:36568 error="Bad request: Missing role ID" 30:47.425 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/role/ from=127.0.0.1:36568 latency=135.226µs 30:47.426 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/role/ from=127.0.0.1:36570 error="method HEAD not allowed" 30:47.426 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/role/ from=127.0.0.1:36570 latency=25.337µs 30:47.426 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/role/ from=127.0.0.1:36570 latency=2.714µs 30:47.426 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/health/service/name/ from=127.0.0.1:36570 error="Bad request: Missing service Name" 30:47.426 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/health/service/name/ from=127.0.0.1:36570 latency=115.01µs 30:47.427 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/health/service/name/ from=127.0.0.1:36572 error="method PUT not allowed" 30:47.427 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/health/service/name/ from=127.0.0.1:36572 latency=138.242µs 30:47.428 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/health/service/name/ from=127.0.0.1:36574 error="method POST not allowed" 30:47.428 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/health/service/name/ from=127.0.0.1:36574 latency=149.168µs 30:47.428 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/health/service/name/ from=127.0.0.1:36576 error="method DELETE not allowed" 30:47.428 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/health/service/name/ from=127.0.0.1:36576 latency=106.87µs 30:47.429 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/health/service/name/ from=127.0.0.1:36578 error="method HEAD not allowed" 30:47.429 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/health/service/name/ from=127.0.0.1:36578 latency=19.628µs 30:47.429 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/health/service/name/ from=127.0.0.1:36578 latency=2.591µs 30:47.430 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/datacenters from=127.0.0.1:36578 latency=325.142µs 30:47.430 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/datacenters from=127.0.0.1:36580 error="method PUT not allowed" 30:47.430 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/datacenters from=127.0.0.1:36580 latency=112.401µs 30:47.440 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/datacenters from=127.0.0.1:36582 error="method POST not allowed" 30:47.440 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/datacenters from=127.0.0.1:36582 latency=116.337µs 30:47.441 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/datacenters from=127.0.0.1:36584 error="method DELETE not allowed" 30:47.441 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/datacenters from=127.0.0.1:36584 latency=125.158µs 30:47.441 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/datacenters from=127.0.0.1:36586 error="method HEAD not allowed" 30:47.441 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/datacenters from=127.0.0.1:36586 latency=20.059µs 30:47.441 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/datacenters from=127.0.0.1:36586 latency=2.527µs 30:47.442 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/info/ from=127.0.0.1:36586 latency=131.632µs 30:47.442 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/info/ from=127.0.0.1:36588 error="method PUT not allowed" 30:47.443 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/info/ from=127.0.0.1:36588 latency=172.703µs 30:47.443 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/info/ from=127.0.0.1:36590 error="method POST not allowed" 30:47.443 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/info/ from=127.0.0.1:36590 latency=124.367µs 30:47.448 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/info/ from=127.0.0.1:36592 error="method DELETE not allowed" 30:47.448 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/info/ from=127.0.0.1:36592 latency=152.438µs 30:47.449 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/info/ from=127.0.0.1:36594 error="method HEAD not allowed" 30:47.449 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/info/ from=127.0.0.1:36594 latency=24.342µs 30:47.449 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/info/ from=127.0.0.1:36594 latency=2.59µs 30:47.449 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/check/update/ from=127.0.0.1:36594 error="method GET not allowed" 30:47.450 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/check/update/ from=127.0.0.1:36594 latency=110.769µs 30:47.450 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/update/ from=127.0.0.1:36596 latency=146.469µs 30:47.451 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/check/update/ from=127.0.0.1:36598 error="method POST not allowed" 30:47.451 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/check/update/ from=127.0.0.1:36598 latency=97.159µs 30:47.451 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/check/update/ from=127.0.0.1:36600 error="method DELETE not allowed" 30:47.451 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/check/update/ from=127.0.0.1:36600 latency=85.345µs 30:47.452 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/check/update/ from=127.0.0.1:36602 error="method HEAD not allowed" 30:47.452 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/check/update/ from=127.0.0.1:36602 latency=22.28µs 30:47.452 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/check/update/ from=127.0.0.1:36602 latency=3.166µs 30:47.452 [ERROR] TestAgent.http: Request error: method=GET url=/v1/config from=127.0.0.1:36602 error="method GET not allowed" 30:47.452 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config from=127.0.0.1:36602 latency=137.152µs 30:47.453 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/config from=127.0.0.1:36604 error="Bad request: Request decoding failed: EOF" 30:47.453 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:36604 latency=135.623µs 30:47.454 [ERROR] TestAgent.http: Request error: method=POST url=/v1/config from=127.0.0.1:36606 error="method POST not allowed" 30:47.454 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/config from=127.0.0.1:36606 latency=146.289µs 30:47.455 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/config from=127.0.0.1:36608 error="method DELETE not allowed" 30:47.455 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/config from=127.0.0.1:36608 latency=155.834µs 30:47.456 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/config from=127.0.0.1:36610 error="method HEAD not allowed" 30:47.456 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/config from=127.0.0.1:36610 latency=57.22µs 30:47.457 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/config from=127.0.0.1:36610 latency=2.432µs 30:47.457 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.457 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/ui/services from=127.0.0.1:36610 latency=391.374µs 30:47.458 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/ui/services from=127.0.0.1:36612 error="method PUT not allowed" 30:47.458 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/ui/services from=127.0.0.1:36612 latency=162.258µs 30:47.458 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/ui/services from=127.0.0.1:36614 error="method POST not allowed" 30:47.459 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/ui/services from=127.0.0.1:36614 latency=154.95µs 30:47.459 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/ui/services from=127.0.0.1:36616 error="method DELETE not allowed" 30:47.460 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/ui/services from=127.0.0.1:36616 latency=161.176µs 30:47.460 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/ui/services from=127.0.0.1:36618 error="method HEAD not allowed" 30:47.460 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/ui/services from=127.0.0.1:36618 latency=20.795µs 30:47.461 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/ui/services from=127.0.0.1:36618 latency=2.895µs 30:47.461 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/health/service/id/ from=127.0.0.1:36618 error="Bad request: Missing serviceID" 30:47.461 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/health/service/id/ from=127.0.0.1:36618 latency=134.334µs 30:47.462 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/health/service/id/ from=127.0.0.1:36620 error="method PUT not allowed" 30:47.462 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/health/service/id/ from=127.0.0.1:36620 latency=95.866µs 30:47.463 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/health/service/id/ from=127.0.0.1:36622 error="method POST not allowed" 30:47.463 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/health/service/id/ from=127.0.0.1:36622 latency=136.823µs 30:47.464 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/health/service/id/ from=127.0.0.1:36624 error="method DELETE not allowed" 30:47.464 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/health/service/id/ from=127.0.0.1:36624 latency=157µs 30:47.465 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/health/service/id/ from=127.0.0.1:36626 error="method HEAD not allowed" 30:47.465 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/health/service/id/ from=127.0.0.1:36626 latency=21.489µs 30:47.465 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/health/service/id/ from=127.0.0.1:36626 latency=2.51µs 30:47.466 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/node/ from=127.0.0.1:36626 latency=113.228µs 30:47.466 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/node/ from=127.0.0.1:36628 error="method PUT not allowed" 30:47.466 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/node/ from=127.0.0.1:36628 latency=129.113µs 30:47.467 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/node/ from=127.0.0.1:36630 error="method POST not allowed" 30:47.467 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/node/ from=127.0.0.1:36630 latency=138.589µs 30:47.468 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/node/ from=127.0.0.1:36632 error="method DELETE not allowed" 30:47.468 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/node/ from=127.0.0.1:36632 latency=143.712µs 30:47.468 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/node/ from=127.0.0.1:36634 error="method HEAD not allowed" 30:47.468 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/node/ from=127.0.0.1:36634 latency=21.084µs 30:47.469 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/node/ from=127.0.0.1:36634 latency=3.018µs 30:47.469 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/datacenters from=127.0.0.1:36634 latency=285.656µs 30:47.470 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/coordinate/datacenters from=127.0.0.1:36636 error="method PUT not allowed" 30:47.470 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/coordinate/datacenters from=127.0.0.1:36636 latency=169.415µs 30:47.471 [ERROR] TestAgent.http: Request error: method=POST url=/v1/coordinate/datacenters from=127.0.0.1:36638 error="method POST not allowed" 30:47.471 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/coordinate/datacenters from=127.0.0.1:36638 latency=131.219µs 30:47.472 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/coordinate/datacenters from=127.0.0.1:36640 error="method DELETE not allowed" 30:47.472 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/coordinate/datacenters from=127.0.0.1:36640 latency=119.148µs 30:47.476 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/coordinate/datacenters from=127.0.0.1:36642 error="method HEAD not allowed" 30:47.476 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/coordinate/datacenters from=127.0.0.1:36642 latency=79.049µs 30:47.477 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/coordinate/datacenters from=127.0.0.1:36642 latency=3.048µs 30:47.478 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/info/ from=127.0.0.1:36642 latency=125.966µs 30:47.478 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/session/info/ from=127.0.0.1:36644 error="method PUT not allowed" 30:47.478 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/info/ from=127.0.0.1:36644 latency=113.829µs 30:47.479 [ERROR] TestAgent.http: Request error: method=POST url=/v1/session/info/ from=127.0.0.1:36646 error="method POST not allowed" 30:47.479 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/session/info/ from=127.0.0.1:36646 latency=122.509µs 30:47.480 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/session/info/ from=127.0.0.1:36648 error="method DELETE not allowed" 30:47.480 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/session/info/ from=127.0.0.1:36648 latency=217.858µs 30:47.485 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/session/info/ from=127.0.0.1:36650 error="method HEAD not allowed" 30:47.485 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/session/info/ from=127.0.0.1:36650 latency=29.729µs 30:47.485 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/session/info/ from=127.0.0.1:36650 latency=3.087µs 30:47.486 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/auth-methods from=127.0.0.1:36650 error="Permission denied" 30:47.486 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-methods from=127.0.0.1:36650 latency=306.829µs 30:47.487 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/auth-methods from=127.0.0.1:36652 error="method PUT not allowed" 30:47.487 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-methods from=127.0.0.1:36652 latency=134.869µs 30:47.488 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/auth-methods from=127.0.0.1:36654 error="method POST not allowed" 30:47.488 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/auth-methods from=127.0.0.1:36654 latency=145.471µs 30:47.488 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/auth-methods from=127.0.0.1:36656 error="method DELETE not allowed" 30:47.488 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/auth-methods from=127.0.0.1:36656 latency=116.201µs 30:47.489 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/auth-methods from=127.0.0.1:36658 error="method HEAD not allowed" 30:47.489 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/auth-methods from=127.0.0.1:36658 latency=20.849µs 30:47.489 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/auth-methods from=127.0.0.1:36658 latency=2.837µs 30:47.490 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/check/deregister/ from=127.0.0.1:36658 error="method GET not allowed" 30:47.490 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/check/deregister/ from=127.0.0.1:36658 latency=127.783µs 30:47.490 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/check/deregister/ from=127.0.0.1:36660 error="Unknown check """ 30:47.490 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/deregister/ from=127.0.0.1:36660 latency=197.355µs 30:47.491 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/check/deregister/ from=127.0.0.1:36662 error="method POST not allowed" 30:47.491 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/check/deregister/ from=127.0.0.1:36662 latency=127.102µs 30:47.492 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/check/deregister/ from=127.0.0.1:36664 error="method DELETE not allowed" 30:47.492 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/check/deregister/ from=127.0.0.1:36664 latency=166.837µs 30:47.493 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/check/deregister/ from=127.0.0.1:36666 error="method HEAD not allowed" 30:47.493 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/check/deregister/ from=127.0.0.1:36666 latency=22.331µs 30:47.493 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/check/deregister/ from=127.0.0.1:36666 latency=2.108µs 30:47.494 [DEBUG] TestAgent.acl: dropping service from result due to ACLs: service=consul 30:47.494 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/services from=127.0.0.1:36666 latency=298.396µs 30:47.494 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/services from=127.0.0.1:36670 error="method PUT not allowed" 30:47.494 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/services from=127.0.0.1:36670 latency=86.327µs 30:47.495 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/services from=127.0.0.1:36672 error="method POST not allowed" 30:47.495 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/services from=127.0.0.1:36672 latency=148.734µs 30:47.496 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/services from=127.0.0.1:36674 error="method DELETE not allowed" 30:47.496 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/services from=127.0.0.1:36674 latency=174.957µs 30:47.496 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/services from=127.0.0.1:36676 error="method HEAD not allowed" 30:47.496 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/services from=127.0.0.1:36676 latency=23.615µs 30:47.497 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/services from=127.0.0.1:36676 latency=3.068µs 30:47.497 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/roles from=127.0.0.1:36676 error="Permission denied" 30:47.497 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/roles from=127.0.0.1:36676 latency=237.436µs 30:47.498 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/roles from=127.0.0.1:36678 error="method PUT not allowed" 30:47.498 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/roles from=127.0.0.1:36678 latency=127.522µs 30:47.498 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/roles from=127.0.0.1:36680 error="method POST not allowed" 30:47.499 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/roles from=127.0.0.1:36680 latency=110.602µs 30:47.499 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/roles from=127.0.0.1:36682 error="method DELETE not allowed" 30:47.499 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/roles from=127.0.0.1:36682 latency=137.312µs 30:47.500 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/roles from=127.0.0.1:36684 error="method HEAD not allowed" 30:47.500 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/roles from=127.0.0.1:36684 latency=16.893µs 30:47.506 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/roles from=127.0.0.1:36684 latency=4.033µs 30:47.506 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/join/ from=127.0.0.1:36684 error="method GET not allowed" 30:47.506 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/join/ from=127.0.0.1:36684 latency=125.204µs 30:47.507 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/join/ from=127.0.0.1:36686 error="Permission denied" 30:47.507 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/join/ from=127.0.0.1:36686 latency=211.496µs 30:47.507 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/join/ from=127.0.0.1:36688 error="method POST not allowed" 30:47.508 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/join/ from=127.0.0.1:36688 latency=135.613µs 30:47.512 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/join/ from=127.0.0.1:36690 error="method DELETE not allowed" 30:47.512 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/join/ from=127.0.0.1:36690 latency=160.267µs 30:47.513 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/join/ from=127.0.0.1:36692 error="method HEAD not allowed" 30:47.513 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/join/ from=127.0.0.1:36692 latency=20.587µs 30:47.513 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/join/ from=127.0.0.1:36692 latency=2.997µs 30:47.513 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/check/fail/ from=127.0.0.1:36692 error="method GET not allowed" 30:47.514 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/check/fail/ from=127.0.0.1:36692 latency=106.662µs 30:47.514 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/check/fail/ from=127.0.0.1:36694 error="Unknown check """ 30:47.514 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/fail/ from=127.0.0.1:36694 latency=178.855µs 30:47.515 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/check/fail/ from=127.0.0.1:36696 error="method POST not allowed" 30:47.515 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/check/fail/ from=127.0.0.1:36696 latency=101.498µs 30:47.515 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/check/fail/ from=127.0.0.1:36698 error="method DELETE not allowed" 30:47.515 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/check/fail/ from=127.0.0.1:36698 latency=106.099µs 30:47.520 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/check/fail/ from=127.0.0.1:36700 error="method HEAD not allowed" 30:47.520 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/check/fail/ from=127.0.0.1:36700 latency=27.84µs 30:47.520 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/check/fail/ from=127.0.0.1:36700 latency=2.553µs 30:47.521 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36700 latency=129.248µs 30:47.522 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36702 error="method PUT not allowed" 30:47.522 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36702 latency=151.109µs 30:47.522 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36704 error="method POST not allowed" 30:47.522 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36704 latency=152.895µs 30:47.523 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36706 error="method DELETE not allowed" 30:47.523 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36706 latency=139.427µs 30:47.524 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36708 error="method HEAD not allowed" 30:47.524 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36708 latency=23.545µs 30:47.524 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/ui/gateway-services-nodes/ from=127.0.0.1:36708 latency=2.73µs 30:47.524 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/connect/authorize from=127.0.0.1:36708 error="method GET not allowed" 30:47.525 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/connect/authorize from=127.0.0.1:36708 latency=116.159µs 30:47.525 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/connect/authorize from=127.0.0.1:36710 error="method PUT not allowed" 30:47.525 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/connect/authorize from=127.0.0.1:36710 latency=106.905µs 30:47.526 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/connect/authorize from=127.0.0.1:36712 error="Bad request: Request decode failed: EOF" 30:47.526 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/connect/authorize from=127.0.0.1:36712 latency=165.178µs 30:47.527 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/connect/authorize from=127.0.0.1:36714 error="method DELETE not allowed" 30:47.527 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/connect/authorize from=127.0.0.1:36714 latency=113.133µs 30:47.531 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/connect/authorize from=127.0.0.1:36716 error="method HEAD not allowed" 30:47.531 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/connect/authorize from=127.0.0.1:36716 latency=26.113µs 30:47.533 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/connect/authorize from=127.0.0.1:36716 latency=3.71µs 30:47.534 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:36716 latency=370.951µs 30:47.534 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/connect/intentions from=127.0.0.1:36718 error="method PUT not allowed" 30:47.534 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/intentions from=127.0.0.1:36718 latency=104.631µs 30:47.535 [ERROR] TestAgent.http: Request error: method=POST url=/v1/connect/intentions from=127.0.0.1:36720 error="Failed to decode request body: EOF" 30:47.535 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:36720 latency=105.012µs 30:47.535 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/connect/intentions from=127.0.0.1:36722 error="method DELETE not allowed" 30:47.535 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/connect/intentions from=127.0.0.1:36722 latency=95.189µs 30:47.536 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/connect/intentions from=127.0.0.1:36724 error="method HEAD not allowed" 30:47.536 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/connect/intentions from=127.0.0.1:36724 latency=20.843µs 30:47.536 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/connect/intentions from=127.0.0.1:36724 latency=2.523µs 30:47.536 [ERROR] TestAgent.http: Request error: method=GET url=/v1/event/fire/ from=127.0.0.1:36724 error="method GET not allowed" 30:47.536 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/event/fire/ from=127.0.0.1:36724 latency=132.099µs 30:47.537 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/event/fire/ from=127.0.0.1:36726 latency=100.463µs 30:47.538 [ERROR] TestAgent.http: Request error: method=POST url=/v1/event/fire/ from=127.0.0.1:36728 error="method POST not allowed" 30:47.538 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/event/fire/ from=127.0.0.1:36728 latency=120.835µs 30:47.538 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/event/fire/ from=127.0.0.1:36730 error="method DELETE not allowed" 30:47.539 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/event/fire/ from=127.0.0.1:36730 latency=133.234µs 30:47.539 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/event/fire/ from=127.0.0.1:36732 error="method HEAD not allowed" 30:47.539 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/event/fire/ from=127.0.0.1:36732 latency=20.912µs 30:47.539 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/event/fire/ from=127.0.0.1:36732 latency=2.496µs 30:47.540 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/nodes from=127.0.0.1:36732 latency=238.629µs 30:47.540 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/coordinate/nodes from=127.0.0.1:36734 error="method PUT not allowed" 30:47.540 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/coordinate/nodes from=127.0.0.1:36734 latency=99.166µs 30:47.541 [ERROR] TestAgent.http: Request error: method=POST url=/v1/coordinate/nodes from=127.0.0.1:36736 error="method POST not allowed" 30:47.541 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/coordinate/nodes from=127.0.0.1:36736 latency=97.548µs 30:47.541 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/coordinate/nodes from=127.0.0.1:36738 error="method DELETE not allowed" 30:47.542 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/coordinate/nodes from=127.0.0.1:36738 latency=97.56µs 30:47.542 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/coordinate/nodes from=127.0.0.1:36740 error="method HEAD not allowed" 30:47.542 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/coordinate/nodes from=127.0.0.1:36740 latency=18.219µs 30:47.542 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/coordinate/nodes from=127.0.0.1:36740 latency=3.027µs 30:47.543 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/checks/ from=127.0.0.1:36740 latency=120.381µs 30:47.543 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/health/checks/ from=127.0.0.1:36742 error="method PUT not allowed" 30:47.543 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/health/checks/ from=127.0.0.1:36742 latency=154.404µs 30:47.544 [ERROR] TestAgent.http: Request error: method=POST url=/v1/health/checks/ from=127.0.0.1:36744 error="method POST not allowed" 30:47.544 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/health/checks/ from=127.0.0.1:36744 latency=135.449µs 30:47.545 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/health/checks/ from=127.0.0.1:36746 error="method DELETE not allowed" 30:47.545 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/health/checks/ from=127.0.0.1:36746 latency=87.68µs 30:47.545 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/health/checks/ from=127.0.0.1:36748 error="method HEAD not allowed" 30:47.545 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/health/checks/ from=127.0.0.1:36748 latency=17.725µs 30:47.546 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/health/checks/ from=127.0.0.1:36748 latency=2.334µs 30:47.546 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/host from=127.0.0.1:36748 error="Permission denied" 30:47.546 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/host from=127.0.0.1:36748 latency=225.399µs 30:47.547 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/host from=127.0.0.1:36750 error="method PUT not allowed" 30:47.547 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/host from=127.0.0.1:36750 latency=125.384µs 30:47.547 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/host from=127.0.0.1:36752 error="method POST not allowed" 30:47.547 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/host from=127.0.0.1:36752 latency=127.026µs 30:47.548 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/host from=127.0.0.1:36754 error="method DELETE not allowed" 30:47.548 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/host from=127.0.0.1:36754 latency=124.804µs 30:47.549 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/host from=127.0.0.1:36756 error="method HEAD not allowed" 30:47.549 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/host from=127.0.0.1:36756 latency=20.583µs 30:47.549 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/host from=127.0.0.1:36756 latency=2.86µs 30:47.549 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/binding-rule/ from=127.0.0.1:36756 error="Bad request: Missing binding rule ID" 30:47.550 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/ from=127.0.0.1:36756 latency=132.01µs 30:47.550 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/binding-rule/ from=127.0.0.1:36758 error="Bad request: BindingRule decoding failed: EOF" 30:47.550 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/ from=127.0.0.1:36758 latency=155.18µs 30:47.551 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/binding-rule/ from=127.0.0.1:36760 error="method POST not allowed" 30:47.551 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/binding-rule/ from=127.0.0.1:36760 latency=104.184µs 30:47.551 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/binding-rule/ from=127.0.0.1:36762 error="Bad request: Missing binding rule ID" 30:47.551 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/ from=127.0.0.1:36762 latency=97.104µs 30:47.552 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/binding-rule/ from=127.0.0.1:36764 error="method HEAD not allowed" 30:47.552 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/binding-rule/ from=127.0.0.1:36764 latency=18.21µs 30:47.552 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/binding-rule/ from=127.0.0.1:36764 latency=2.464µs 30:47.552 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/ui/node/ from=127.0.0.1:36764 latency=107.604µs 30:47.553 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/ui/node/ from=127.0.0.1:36766 error="method PUT not allowed" 30:47.553 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/ui/node/ from=127.0.0.1:36766 latency=139.28µs 30:47.554 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/ui/node/ from=127.0.0.1:36768 error="method POST not allowed" 30:47.554 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/ui/node/ from=127.0.0.1:36768 latency=122.374µs 30:47.555 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/ui/node/ from=127.0.0.1:36770 error="method DELETE not allowed" 30:47.555 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/ui/node/ from=127.0.0.1:36770 latency=114.608µs 30:47.555 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/ui/node/ from=127.0.0.1:36772 error="method HEAD not allowed" 30:47.555 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/ui/node/ from=127.0.0.1:36772 latency=15.62µs 30:47.555 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/ui/node/ from=127.0.0.1:36772 latency=2.091µs 30:47.556 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/destroy/ from=127.0.0.1:36772 error="method GET not allowed" 30:47.556 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/destroy/ from=127.0.0.1:36772 latency=144.231µs 30:47.564 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/destroy/ from=127.0.0.1:36774 latency=99.439µs 30:47.565 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/destroy/ from=127.0.0.1:36776 error="method POST not allowed" 30:47.565 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/destroy/ from=127.0.0.1:36776 latency=104.079µs 30:47.565 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/destroy/ from=127.0.0.1:36778 error="method DELETE not allowed" 30:47.565 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/destroy/ from=127.0.0.1:36778 latency=173.927µs 30:47.566 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/destroy/ from=127.0.0.1:36780 error="method HEAD not allowed" 30:47.566 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/destroy/ from=127.0.0.1:36780 latency=24.524µs 30:47.566 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/destroy/ from=127.0.0.1:36780 latency=3.005µs 30:47.567 [ERROR] TestAgent.http: Request error: method=GET url=/v1/coordinate/node/ from=127.0.0.1:36780 error="Permission denied" 30:47.567 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/node/ from=127.0.0.1:36780 latency=280.322µs 30:47.568 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/coordinate/node/ from=127.0.0.1:36782 error="method PUT not allowed" 30:47.568 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/coordinate/node/ from=127.0.0.1:36782 latency=109.55µs 30:47.569 [ERROR] TestAgent.http: Request error: method=POST url=/v1/coordinate/node/ from=127.0.0.1:36784 error="method POST not allowed" 30:47.569 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/coordinate/node/ from=127.0.0.1:36784 latency=168.32µs 30:47.570 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/coordinate/node/ from=127.0.0.1:36786 error="method DELETE not allowed" 30:47.570 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/coordinate/node/ from=127.0.0.1:36786 latency=184.558µs 30:47.571 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/coordinate/node/ from=127.0.0.1:36788 error="method HEAD not allowed" 30:47.571 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/coordinate/node/ from=127.0.0.1:36788 latency=25.137µs 30:47.571 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/coordinate/node/ from=127.0.0.1:36788 latency=3.003µs 30:47.571 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/node/ from=127.0.0.1:36788 latency=135.666µs 30:47.572 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/session/node/ from=127.0.0.1:36790 error="method PUT not allowed" 30:47.572 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/node/ from=127.0.0.1:36790 latency=123.592µs 30:47.573 [ERROR] TestAgent.http: Request error: method=POST url=/v1/session/node/ from=127.0.0.1:36792 error="method POST not allowed" 30:47.573 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/session/node/ from=127.0.0.1:36792 latency=123.832µs 30:47.574 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/session/node/ from=127.0.0.1:36794 error="method DELETE not allowed" 30:47.574 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/session/node/ from=127.0.0.1:36794 latency=115.392µs 30:47.574 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/session/node/ from=127.0.0.1:36796 error="method HEAD not allowed" 30:47.574 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/session/node/ from=127.0.0.1:36796 latency=20.474µs 30:47.574 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/session/node/ from=127.0.0.1:36796 latency=2.481µs 30:47.575 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/auth-method from=127.0.0.1:36796 error="method GET not allowed" 30:47.575 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method from=127.0.0.1:36796 latency=97.448µs 30:47.575 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/auth-method from=127.0.0.1:36798 error="Bad request: AuthMethod decoding failed: EOF" 30:47.576 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:36798 latency=147.566µs 30:47.577 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/auth-method from=127.0.0.1:36800 error="method POST not allowed" 30:47.577 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/auth-method from=127.0.0.1:36800 latency=169.835µs 30:47.577 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/auth-method from=127.0.0.1:36802 error="method DELETE not allowed" 30:47.578 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/auth-method from=127.0.0.1:36802 latency=145.521µs 30:47.578 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/auth-method from=127.0.0.1:36804 error="method HEAD not allowed" 30:47.578 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/auth-method from=127.0.0.1:36804 latency=19.693µs 30:47.578 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/auth-method from=127.0.0.1:36804 latency=2.669µs 30:47.579 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/service/maintenance/ from=127.0.0.1:36804 error="method GET not allowed" 30:47.579 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/maintenance/ from=127.0.0.1:36804 latency=123.741µs 30:47.579 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/maintenance/ from=127.0.0.1:36806 latency=131.575µs 30:47.580 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/service/maintenance/ from=127.0.0.1:36808 error="method POST not allowed" 30:47.580 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/service/maintenance/ from=127.0.0.1:36808 latency=130.92µs 30:47.581 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/service/maintenance/ from=127.0.0.1:36810 error="method DELETE not allowed" 30:47.581 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/service/maintenance/ from=127.0.0.1:36810 latency=126.509µs 30:47.582 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/service/maintenance/ from=127.0.0.1:36812 error="method HEAD not allowed" 30:47.582 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/service/maintenance/ from=127.0.0.1:36812 latency=23.253µs 30:47.582 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/service/maintenance/ from=127.0.0.1:36812 latency=2.679µs 30:47.582 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/connect/ from=127.0.0.1:36812 latency=117.167µs 30:47.583 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/connect/ from=127.0.0.1:36814 error="method PUT not allowed" 30:47.583 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/connect/ from=127.0.0.1:36814 latency=150.379µs 30:47.584 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/connect/ from=127.0.0.1:36816 error="method POST not allowed" 30:47.584 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/connect/ from=127.0.0.1:36816 latency=120.383µs 30:47.584 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/connect/ from=127.0.0.1:36818 error="method DELETE not allowed" 30:47.584 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/connect/ from=127.0.0.1:36818 latency=104.981µs 30:47.585 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/connect/ from=127.0.0.1:36820 error="method HEAD not allowed" 30:47.585 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/connect/ from=127.0.0.1:36820 latency=24.132µs 30:47.585 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/connect/ from=127.0.0.1:36820 latency=2.63µs 30:47.586 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/ from=127.0.0.1:36820 latency=96.238µs 30:47.586 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/ from=127.0.0.1:36822 latency=114.928µs 30:47.587 [ERROR] TestAgent.http: Request error: method=POST url=/v1/kv/ from=127.0.0.1:36824 error="method POST not allowed" 30:47.587 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/kv/ from=127.0.0.1:36824 latency=141.171µs 30:47.587 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/ from=127.0.0.1:36826 latency=118.282µs 30:47.588 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/kv/ from=127.0.0.1:36828 error="method HEAD not allowed" 30:47.588 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/kv/ from=127.0.0.1:36828 latency=23.418µs 30:47.588 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/kv/ from=127.0.0.1:36828 latency=2.907µs 30:47.589 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/logout from=127.0.0.1:36828 error="method GET not allowed" 30:47.589 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/logout from=127.0.0.1:36828 latency=120.225µs 30:47.589 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/logout from=127.0.0.1:36830 error="method PUT not allowed" 30:47.589 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/logout from=127.0.0.1:36830 latency=110.807µs 30:47.590 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/logout from=127.0.0.1:36832 error="ACL not found" 30:47.590 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:36832 latency=129.391µs 30:47.591 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/logout from=127.0.0.1:36834 error="method DELETE not allowed" 30:47.591 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/logout from=127.0.0.1:36834 latency=165.314µs 30:47.591 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/logout from=127.0.0.1:36836 error="method HEAD not allowed" 30:47.591 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/logout from=127.0.0.1:36836 latency=20.451µs 30:47.592 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/logout from=127.0.0.1:36836 latency=2.968µs 30:47.592 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/policies from=127.0.0.1:36836 error="Permission denied" 30:47.592 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policies from=127.0.0.1:36836 latency=286.981µs 30:47.593 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/policies from=127.0.0.1:36838 error="method PUT not allowed" 30:47.593 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policies from=127.0.0.1:36838 latency=256.262µs 30:47.594 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/policies from=127.0.0.1:36840 error="method POST not allowed" 30:47.594 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/policies from=127.0.0.1:36840 latency=118.655µs 30:47.595 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/policies from=127.0.0.1:36842 error="method DELETE not allowed" 30:47.595 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/policies from=127.0.0.1:36842 latency=144.725µs 30:47.595 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/policies from=127.0.0.1:36844 error="method HEAD not allowed" 30:47.595 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/policies from=127.0.0.1:36844 latency=19.77µs 30:47.596 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/policies from=127.0.0.1:36844 latency=2.56µs 30:47.600 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/policy from=127.0.0.1:36844 error="method GET not allowed" 30:47.600 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy from=127.0.0.1:36844 latency=152.74µs 30:47.601 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/policy from=127.0.0.1:36846 error="Bad request: Policy decoding failed: EOF" 30:47.601 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:36846 latency=120.525µs 30:47.601 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/policy from=127.0.0.1:36848 error="method POST not allowed" 30:47.601 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/policy from=127.0.0.1:36848 latency=114.857µs 30:47.602 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/policy from=127.0.0.1:36850 error="method DELETE not allowed" 30:47.602 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/policy from=127.0.0.1:36850 latency=117.013µs 30:47.602 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/policy from=127.0.0.1:36852 error="method HEAD not allowed" 30:47.602 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/policy from=127.0.0.1:36852 latency=17.972µs 30:47.603 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/policy from=127.0.0.1:36852 latency=4.553µs 30:47.605 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/ca/roots from=127.0.0.1:36852 latency=428.354µs 30:47.607 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/connect/ca/roots from=127.0.0.1:36854 error="method PUT not allowed" 30:47.607 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/ca/roots from=127.0.0.1:36854 latency=134.319µs 30:47.607 [ERROR] TestAgent.http: Request error: method=POST url=/v1/connect/ca/roots from=127.0.0.1:36856 error="method POST not allowed" 30:47.607 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/ca/roots from=127.0.0.1:36856 latency=127.546µs 30:47.608 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/connect/ca/roots from=127.0.0.1:36858 error="method DELETE not allowed" 30:47.608 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/connect/ca/roots from=127.0.0.1:36858 latency=84.69µs 30:47.609 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/connect/ca/roots from=127.0.0.1:36860 error="method HEAD not allowed" 30:47.609 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/connect/ca/roots from=127.0.0.1:36860 latency=21.731µs 30:47.609 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/connect/ca/roots from=127.0.0.1:36860 latency=2.883µs 30:47.609 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/ingress/ from=127.0.0.1:36860 latency=119.364µs 30:47.610 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/health/ingress/ from=127.0.0.1:36862 error="method PUT not allowed" 30:47.610 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/health/ingress/ from=127.0.0.1:36862 latency=149.201µs 30:47.612 [ERROR] TestAgent.http: Request error: method=POST url=/v1/health/ingress/ from=127.0.0.1:36864 error="method POST not allowed" 30:47.612 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/health/ingress/ from=127.0.0.1:36864 latency=175.02µs 30:47.612 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/health/ingress/ from=127.0.0.1:36866 error="method DELETE not allowed" 30:47.612 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/health/ingress/ from=127.0.0.1:36866 latency=142.157µs 30:47.613 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/health/ingress/ from=127.0.0.1:36868 error="method HEAD not allowed" 30:47.613 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/health/ingress/ from=127.0.0.1:36868 latency=23.417µs 30:47.614 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/health/ingress/ from=127.0.0.1:36868 latency=2.936µs 30:47.614 [ERROR] TestAgent.http: Request error: method=GET url=/v1/operator/raft/configuration from=127.0.0.1:36868 error="Permission denied" 30:47.614 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/raft/configuration from=127.0.0.1:36868 latency=260.548µs 30:47.615 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/operator/raft/configuration from=127.0.0.1:36870 error="method PUT not allowed" 30:47.615 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/operator/raft/configuration from=127.0.0.1:36870 latency=125.596µs 30:47.616 [ERROR] TestAgent.http: Request error: method=POST url=/v1/operator/raft/configuration from=127.0.0.1:36872 error="method POST not allowed" 30:47.616 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/operator/raft/configuration from=127.0.0.1:36872 latency=207.68µs 30:47.617 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/operator/raft/configuration from=127.0.0.1:36874 error="method DELETE not allowed" 30:47.617 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/raft/configuration from=127.0.0.1:36874 latency=136.317µs 30:47.617 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/operator/raft/configuration from=127.0.0.1:36876 error="method HEAD not allowed" 30:47.617 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/operator/raft/configuration from=127.0.0.1:36876 latency=70.686µs 30:47.618 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/operator/raft/configuration from=127.0.0.1:36876 latency=2.632µs 30:47.618 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/role/name/ from=127.0.0.1:36876 error="Bad request: Missing role Name" 30:47.618 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/name/ from=127.0.0.1:36876 latency=177.508µs 30:47.619 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/role/name/ from=127.0.0.1:36878 error="method PUT not allowed" 30:47.619 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/name/ from=127.0.0.1:36878 latency=150.58µs 30:47.620 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/role/name/ from=127.0.0.1:36880 error="method POST not allowed" 30:47.620 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/role/name/ from=127.0.0.1:36880 latency=103.362µs 30:47.620 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/role/name/ from=127.0.0.1:36882 error="method DELETE not allowed" 30:47.621 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/role/name/ from=127.0.0.1:36882 latency=117.466µs 30:47.621 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/role/name/ from=127.0.0.1:36884 error="method HEAD not allowed" 30:47.621 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/role/name/ from=127.0.0.1:36884 latency=21.27µs 30:47.622 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/role/name/ from=127.0.0.1:36884 latency=2.523µs 30:47.622 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/binding-rules from=127.0.0.1:36884 error="Permission denied" 30:47.622 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:36884 latency=229.596µs 30:47.623 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/binding-rules from=127.0.0.1:36886 error="method PUT not allowed" 30:47.623 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rules from=127.0.0.1:36886 latency=191.825µs 30:47.623 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/binding-rules from=127.0.0.1:36888 error="method POST not allowed" 30:47.624 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/binding-rules from=127.0.0.1:36888 latency=142.235µs 30:47.624 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/binding-rules from=127.0.0.1:36890 error="method DELETE not allowed" 30:47.624 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rules from=127.0.0.1:36890 latency=117.528µs 30:47.625 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/binding-rules from=127.0.0.1:36892 error="method HEAD not allowed" 30:47.625 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/binding-rules from=127.0.0.1:36892 latency=22.114µs 30:47.625 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/binding-rules from=127.0.0.1:36892 latency=3.117µs 30:47.626 [ERROR] TestAgent.http: Request error: method=GET url=/v1/internal/acl/authorize from=127.0.0.1:36892 error="method GET not allowed" 30:47.626 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/acl/authorize from=127.0.0.1:36892 latency=143.091µs 30:47.626 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/acl/authorize from=127.0.0.1:36894 error="method PUT not allowed" 30:47.626 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/acl/authorize from=127.0.0.1:36894 latency=110.303µs 30:47.627 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/acl/authorize from=127.0.0.1:36896 error="Bad request: Failed to decode request body: EOF" 30:47.627 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/acl/authorize from=127.0.0.1:36896 latency=121.156µs 30:47.628 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/acl/authorize from=127.0.0.1:36898 error="method DELETE not allowed" 30:47.628 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/acl/authorize from=127.0.0.1:36898 latency=142.475µs 30:47.628 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/acl/authorize from=127.0.0.1:36900 error="method HEAD not allowed" 30:47.629 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/acl/authorize from=127.0.0.1:36900 latency=19.534µs 30:47.629 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/acl/authorize from=127.0.0.1:36900 latency=2.613µs 30:47.629 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ from=127.0.0.1:36900 latency=293.297µs 30:47.630 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/config/ from=127.0.0.1:36902 error="method PUT not allowed" 30:47.630 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config/ from=127.0.0.1:36902 latency=129.449µs 30:47.631 [ERROR] TestAgent.http: Request error: method=POST url=/v1/config/ from=127.0.0.1:36904 error="method POST not allowed" 30:47.631 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/config/ from=127.0.0.1:36904 latency=148.431µs 30:47.632 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/config/ from=127.0.0.1:36906 latency=107.18µs 30:47.632 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/config/ from=127.0.0.1:36908 error="method HEAD not allowed" 30:47.632 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/config/ from=127.0.0.1:36908 latency=16.079µs 30:47.633 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/config/ from=127.0.0.1:36908 latency=2.203µs 30:47.633 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/event/list from=127.0.0.1:36908 latency=209.881µs 30:47.634 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/event/list from=127.0.0.1:36910 error="method PUT not allowed" 30:47.634 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/event/list from=127.0.0.1:36910 latency=99.258µs 30:47.634 [ERROR] TestAgent.http: Request error: method=POST url=/v1/event/list from=127.0.0.1:36912 error="method POST not allowed" 30:47.634 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/event/list from=127.0.0.1:36912 latency=91.778µs 30:47.635 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/event/list from=127.0.0.1:36914 error="method DELETE not allowed" 30:47.635 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/event/list from=127.0.0.1:36914 latency=117.121µs 30:47.636 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/event/list from=127.0.0.1:36916 error="method HEAD not allowed" 30:47.636 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/event/list from=127.0.0.1:36916 latency=21.925µs 30:47.636 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/event/list from=127.0.0.1:36916 latency=3.346µs 30:47.636 [ERROR] TestAgent.http: Request error: method=GET url=/v1/snapshot from=127.0.0.1:36916 error="Permission denied" 30:47.637 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/snapshot from=127.0.0.1:36916 latency=210.658µs 30:47.637 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/snapshot from=127.0.0.1:36918 error="Permission denied" 30:47.637 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:36918 latency=215.975µs 30:47.638 [ERROR] TestAgent.http: Request error: method=POST url=/v1/snapshot from=127.0.0.1:36920 error="method POST not allowed" 30:47.638 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/snapshot from=127.0.0.1:36920 latency=119.797µs 30:47.639 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/snapshot from=127.0.0.1:36922 error="method DELETE not allowed" 30:47.639 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/snapshot from=127.0.0.1:36922 latency=114.73µs 30:47.639 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/snapshot from=127.0.0.1:36924 error="method HEAD not allowed" 30:47.639 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/snapshot from=127.0.0.1:36924 latency=21.93µs 30:47.640 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/snapshot from=127.0.0.1:36924 latency=2.568µs 30:47.640 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/metrics from=127.0.0.1:36924 error="Permission denied" 30:47.640 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/metrics from=127.0.0.1:36924 latency=185.845µs 30:47.641 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/metrics from=127.0.0.1:36926 error="method PUT not allowed" 30:47.641 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/metrics from=127.0.0.1:36926 latency=172.263µs 30:47.642 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/metrics from=127.0.0.1:36930 error="method POST not allowed" 30:47.642 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/metrics from=127.0.0.1:36930 latency=135.455µs 30:47.643 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/metrics from=127.0.0.1:36932 error="method DELETE not allowed" 30:47.643 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/metrics from=127.0.0.1:36932 latency=110.262µs 30:47.643 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/metrics from=127.0.0.1:36934 error="method HEAD not allowed" 30:47.643 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/metrics from=127.0.0.1:36934 latency=19.729µs 30:47.644 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/metrics from=127.0.0.1:36934 latency=2.674µs 30:47.644 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:36934 latency=181.002µs 30:47.645 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/services from=127.0.0.1:36936 error="method PUT not allowed" 30:47.645 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/services from=127.0.0.1:36936 latency=104.33µs 30:47.646 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/services from=127.0.0.1:36938 error="method POST not allowed" 30:47.646 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/services from=127.0.0.1:36938 latency=138.575µs 30:47.646 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/services from=127.0.0.1:36940 error="method DELETE not allowed" 30:47.646 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/services from=127.0.0.1:36940 latency=142.004µs 30:47.647 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/services from=127.0.0.1:36942 error="method HEAD not allowed" 30:47.647 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/services from=127.0.0.1:36942 latency=25.484µs 30:47.647 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/services from=127.0.0.1:36942 latency=2.701µs 30:47.648 [ERROR] TestAgent.http: Request error: method=GET url=/v1/operator/keyring from=127.0.0.1:36942 error="Reading keyring denied by ACLs" 30:47.648 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/keyring from=127.0.0.1:36942 latency=238.347µs 30:47.648 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/operator/keyring from=127.0.0.1:36944 error="Bad request: Request decode failed: EOF" 30:47.649 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/operator/keyring from=127.0.0.1:36944 latency=126.89µs 30:47.649 [ERROR] TestAgent.http: Request error: method=POST url=/v1/operator/keyring from=127.0.0.1:36946 error="Bad request: Request decode failed: EOF" 30:47.649 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/operator/keyring from=127.0.0.1:36946 latency=141.944µs 30:47.650 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/operator/keyring from=127.0.0.1:36948 error="Bad request: Request decode failed: EOF" 30:47.650 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/keyring from=127.0.0.1:36948 latency=112.843µs 30:47.650 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/operator/keyring from=127.0.0.1:36950 error="method HEAD not allowed" 30:47.650 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/operator/keyring from=127.0.0.1:36950 latency=33.808µs 30:47.651 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/operator/keyring from=127.0.0.1:36950 latency=4.08µs 30:47.651 [ERROR] TestAgent.http: Request error: method=GET url=/v1/session/create from=127.0.0.1:36950 error="method GET not allowed" 30:47.651 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/create from=127.0.0.1:36950 latency=181.077µs 30:47.652 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/session/create from=127.0.0.1:36952 error="Permission denied" 30:47.652 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:36952 latency=232.227µs 30:47.653 [ERROR] TestAgent.http: Request error: method=POST url=/v1/session/create from=127.0.0.1:36954 error="method POST not allowed" 30:47.653 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/session/create from=127.0.0.1:36954 latency=232.42µs 30:47.654 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/session/create from=127.0.0.1:36956 error="method DELETE not allowed" 30:47.654 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/session/create from=127.0.0.1:36956 latency=120.728µs 30:47.654 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/session/create from=127.0.0.1:36958 error="method HEAD not allowed" 30:47.654 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/session/create from=127.0.0.1:36958 latency=30.429µs 30:47.655 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/session/create from=127.0.0.1:36958 latency=3.321µs 30:47.655 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/update from=127.0.0.1:36958 error="method GET not allowed" 30:47.655 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/update from=127.0.0.1:36958 latency=120.976µs 30:47.656 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/update from=127.0.0.1:36960 latency=128.343µs 30:47.656 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/update from=127.0.0.1:36962 error="method POST not allowed" 30:47.656 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/update from=127.0.0.1:36962 latency=107.463µs 30:47.657 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/update from=127.0.0.1:36964 error="method DELETE not allowed" 30:47.657 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/update from=127.0.0.1:36964 latency=106.015µs 30:47.657 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/update from=127.0.0.1:36966 error="method HEAD not allowed" 30:47.657 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/update from=127.0.0.1:36966 latency=21.23µs 30:47.658 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/update from=127.0.0.1:36966 latency=3.075µs 30:47.658 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/clone/ from=127.0.0.1:36966 error="method GET not allowed" 30:47.658 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/clone/ from=127.0.0.1:36966 latency=133.062µs 30:47.659 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/clone/ from=127.0.0.1:36968 latency=152.164µs 30:47.659 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/clone/ from=127.0.0.1:36970 error="method POST not allowed" 30:47.660 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/clone/ from=127.0.0.1:36970 latency=114.095µs 30:47.660 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/clone/ from=127.0.0.1:36972 error="method DELETE not allowed" 30:47.660 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/clone/ from=127.0.0.1:36972 latency=86.312µs 30:47.661 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/clone/ from=127.0.0.1:36974 error="method HEAD not allowed" 30:47.661 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/clone/ from=127.0.0.1:36974 latency=19.402µs 30:47.661 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/clone/ from=127.0.0.1:36974 latency=2.164µs 30:47.661 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/token/ from=127.0.0.1:36974 error="method GET not allowed" 30:47.661 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/token/ from=127.0.0.1:36974 latency=86.885µs 30:47.662 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/token/ from=127.0.0.1:36976 error="Permission denied" 30:47.662 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/token/ from=127.0.0.1:36976 latency=204.617µs 30:47.663 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/token/ from=127.0.0.1:36978 error="method POST not allowed" 30:47.663 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/token/ from=127.0.0.1:36978 latency=100.098µs 30:47.663 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/token/ from=127.0.0.1:36980 error="method DELETE not allowed" 30:47.664 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/token/ from=127.0.0.1:36980 latency=131.502µs 30:47.664 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/token/ from=127.0.0.1:36982 error="method HEAD not allowed" 30:47.664 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/token/ from=127.0.0.1:36982 latency=37.395µs 30:47.664 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/token/ from=127.0.0.1:36982 latency=2.619µs 30:47.665 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/token/ from=127.0.0.1:36982 error="Bad request: Missing token ID" 30:47.665 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/ from=127.0.0.1:36982 latency=108.524µs 30:47.665 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/token/ from=127.0.0.1:36984 error="Bad request: Token decoding failed: EOF" 30:47.665 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/ from=127.0.0.1:36984 latency=92.171µs 30:47.666 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/token/ from=127.0.0.1:36986 error="method POST not allowed" 30:47.667 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/token/ from=127.0.0.1:36986 latency=177.833µs 30:47.667 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/token/ from=127.0.0.1:36988 error="Bad request: Missing token ID" 30:47.667 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/token/ from=127.0.0.1:36988 latency=90.277µs 30:47.668 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/token/ from=127.0.0.1:36990 error="method HEAD not allowed" 30:47.668 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/token/ from=127.0.0.1:36990 latency=19.682µs 30:47.668 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/token/ from=127.0.0.1:36990 latency=5.347µs 30:47.668 [ERROR] TestAgent.http: Request error: method=GET url=/v1/coordinate/update from=127.0.0.1:36990 error="method GET not allowed" 30:47.669 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/update from=127.0.0.1:36990 latency=134.252µs 30:47.669 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/coordinate/update from=127.0.0.1:36992 latency=118.046µs 30:47.670 [ERROR] TestAgent.http: Request error: method=POST url=/v1/coordinate/update from=127.0.0.1:36994 error="method POST not allowed" 30:47.670 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/coordinate/update from=127.0.0.1:36994 latency=134.315µs 30:47.670 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/coordinate/update from=127.0.0.1:36996 error="method DELETE not allowed" 30:47.670 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/coordinate/update from=127.0.0.1:36996 latency=113.856µs 30:47.671 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/coordinate/update from=127.0.0.1:36998 error="method HEAD not allowed" 30:47.671 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/coordinate/update from=127.0.0.1:36998 latency=18.381µs 30:47.671 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/coordinate/update from=127.0.0.1:36998 latency=2.55µs 30:47.672 [ERROR] TestAgent.http: Request error: method=GET url=/v1/internal/federation-states from=127.0.0.1:36998 error="Permission denied" 30:47.673 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/federation-states from=127.0.0.1:36998 latency=309.498µs 30:47.673 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/federation-states from=127.0.0.1:37000 error="method PUT not allowed" 30:47.674 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/federation-states from=127.0.0.1:37000 latency=142.444µs 30:47.674 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/federation-states from=127.0.0.1:37002 error="method POST not allowed" 30:47.674 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/federation-states from=127.0.0.1:37002 latency=127.448µs 30:47.675 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/federation-states from=127.0.0.1:37004 error="method DELETE not allowed" 30:47.675 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/federation-states from=127.0.0.1:37004 latency=113.498µs 30:47.676 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/federation-states from=127.0.0.1:37006 error="method HEAD not allowed" 30:47.676 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/federation-states from=127.0.0.1:37006 latency=16.567µs 30:47.676 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/federation-states from=127.0.0.1:37006 latency=2.352µs 30:47.676 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/rules/translate/ from=127.0.0.1:37006 error="Bad request: Missing token ID" 30:47.676 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/rules/translate/ from=127.0.0.1:37006 latency=101.153µs 30:47.677 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/rules/translate/ from=127.0.0.1:37008 error="method PUT not allowed" 30:47.677 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/rules/translate/ from=127.0.0.1:37008 latency=112.995µs 30:47.678 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/rules/translate/ from=127.0.0.1:37010 error="method POST not allowed" 30:47.678 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/rules/translate/ from=127.0.0.1:37010 latency=101.153µs 30:47.678 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/rules/translate/ from=127.0.0.1:37012 error="method DELETE not allowed" 30:47.678 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/rules/translate/ from=127.0.0.1:37012 latency=146.43µs 30:47.679 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/rules/translate/ from=127.0.0.1:37014 error="method HEAD not allowed" 30:47.679 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/rules/translate/ from=127.0.0.1:37014 latency=29.054µs 30:47.679 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/rules/translate/ from=127.0.0.1:37014 latency=2.897µs 30:47.680 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/ from=127.0.0.1:37014 latency=232.688µs 30:47.681 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/service/ from=127.0.0.1:37016 error="method PUT not allowed" 30:47.681 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/ from=127.0.0.1:37016 latency=144.508µs 30:47.683 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/service/ from=127.0.0.1:37018 error="method POST not allowed" 30:47.684 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/service/ from=127.0.0.1:37018 latency=124.961µs 30:47.693 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/service/ from=127.0.0.1:37022 error="method DELETE not allowed" 30:47.693 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/service/ from=127.0.0.1:37022 latency=162.398µs 30:47.693 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/service/ from=127.0.0.1:37024 error="method HEAD not allowed" 30:47.693 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/service/ from=127.0.0.1:37024 latency=20.866µs 30:47.694 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/service/ from=127.0.0.1:37024 latency=2.538µs 30:47.694 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/service/ from=127.0.0.1:37024 latency=122.991µs 30:47.695 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/service/ from=127.0.0.1:37026 error="method PUT not allowed" 30:47.695 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/service/ from=127.0.0.1:37026 latency=94.251µs 30:47.695 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/service/ from=127.0.0.1:37028 error="method POST not allowed" 30:47.695 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/service/ from=127.0.0.1:37028 latency=133.489µs 30:47.698 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/service/ from=127.0.0.1:37030 error="method DELETE not allowed" 30:47.698 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/service/ from=127.0.0.1:37030 latency=163.377µs 30:47.700 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/service/ from=127.0.0.1:37032 error="method HEAD not allowed" 30:47.700 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/service/ from=127.0.0.1:37032 latency=25.965µs 30:47.700 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/service/ from=127.0.0.1:37032 latency=2.825µs 30:47.701 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/connect/ca/roots from=127.0.0.1:37032 latency=428.091µs 30:47.702 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/connect/ca/roots from=127.0.0.1:37036 error="method PUT not allowed" 30:47.702 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/connect/ca/roots from=127.0.0.1:37036 latency=120.394µs 30:47.703 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/connect/ca/roots from=127.0.0.1:37038 error="method POST not allowed" 30:47.703 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/connect/ca/roots from=127.0.0.1:37038 latency=117.669µs 30:47.704 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/connect/ca/roots from=127.0.0.1:37040 error="method DELETE not allowed" 30:47.704 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/connect/ca/roots from=127.0.0.1:37040 latency=141.421µs 30:47.704 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/connect/ca/roots from=127.0.0.1:37042 error="method HEAD not allowed" 30:47.704 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/connect/ca/roots from=127.0.0.1:37042 latency=29.355µs 30:47.705 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/connect/ca/roots from=127.0.0.1:37042 latency=2.516µs 30:47.705 [ERROR] TestAgent.http: Request error: method=GET url=/v1/connect/intentions/ from=127.0.0.1:37042 error="Bad request: failed intention lookup: index error: UUID must be 36 characters" 30:47.705 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/ from=127.0.0.1:37042 latency=268.163µs 30:47.706 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/connect/intentions/ from=127.0.0.1:37044 error="Bad request: Request decode failed: EOF" 30:47.706 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/intentions/ from=127.0.0.1:37044 latency=135.956µs 30:47.707 [ERROR] TestAgent.http: Request error: method=POST url=/v1/connect/intentions/ from=127.0.0.1:37046 error="method POST not allowed" 30:47.707 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions/ from=127.0.0.1:37046 latency=145.489µs 30:47.708 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/connect/intentions/ from=127.0.0.1:37048 error="Intention lookup failed: failed intention lookup: index error: UUID must be 36 characters" 30:47.708 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/connect/intentions/ from=127.0.0.1:37048 latency=236.973µs 30:47.708 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/connect/intentions/ from=127.0.0.1:37050 error="method HEAD not allowed" 30:47.708 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/connect/intentions/ from=127.0.0.1:37050 latency=22.259µs 30:47.709 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/connect/intentions/ from=127.0.0.1:37050 latency=3.087µs 30:47.709 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/binding-rule from=127.0.0.1:37050 error="method GET not allowed" 30:47.709 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule from=127.0.0.1:37050 latency=116.76µs 30:47.711 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:37054 error="Bad request: BindingRule decoding failed: EOF" 30:47.711 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:37054 latency=149.359µs 30:47.712 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/binding-rule from=127.0.0.1:37056 error="method POST not allowed" 30:47.712 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/binding-rule from=127.0.0.1:37056 latency=143.231µs 30:47.712 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/binding-rule from=127.0.0.1:37058 error="method DELETE not allowed" 30:47.712 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule from=127.0.0.1:37058 latency=145.327µs 30:47.713 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/binding-rule from=127.0.0.1:37060 error="method HEAD not allowed" 30:47.713 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/binding-rule from=127.0.0.1:37060 latency=24.78µs 30:47.713 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/binding-rule from=127.0.0.1:37060 latency=2.246µs 30:47.714 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/token from=127.0.0.1:37060 error="method GET not allowed" 30:47.714 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token from=127.0.0.1:37060 latency=121.119µs 30:47.715 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/token from=127.0.0.1:37062 error="Bad request: Token decoding failed: EOF" 30:47.715 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:37062 latency=130.633µs 30:47.716 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/token from=127.0.0.1:37064 error="method POST not allowed" 30:47.716 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/token from=127.0.0.1:37064 latency=125.35µs 30:47.716 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/token from=127.0.0.1:37066 error="method DELETE not allowed" 30:47.717 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/token from=127.0.0.1:37066 latency=116.675µs 30:47.717 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/token from=127.0.0.1:37068 error="method HEAD not allowed" 30:47.717 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/token from=127.0.0.1:37068 latency=26.652µs 30:47.718 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/token from=127.0.0.1:37068 latency=2.773µs 30:47.718 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/gateway-services/ from=127.0.0.1:37068 latency=98.151µs 30:47.719 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/gateway-services/ from=127.0.0.1:37070 error="method PUT not allowed" 30:47.719 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/gateway-services/ from=127.0.0.1:37070 latency=124.292µs 30:47.719 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/gateway-services/ from=127.0.0.1:37072 error="method POST not allowed" 30:47.719 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/gateway-services/ from=127.0.0.1:37072 latency=98.669µs 30:47.720 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/gateway-services/ from=127.0.0.1:37074 error="method DELETE not allowed" 30:47.720 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/gateway-services/ from=127.0.0.1:37074 latency=163.358µs 30:47.721 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/gateway-services/ from=127.0.0.1:37076 error="method HEAD not allowed" 30:47.721 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/gateway-services/ from=127.0.0.1:37076 latency=22.55µs 30:47.721 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/gateway-services/ from=127.0.0.1:37076 latency=2.667µs 30:47.721 [ERROR] TestAgent.http: Request error: method=GET url=/v1/connect/ca/configuration from=127.0.0.1:37076 error="Permission denied" 30:47.722 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/ca/configuration from=127.0.0.1:37076 latency=227.367µs 30:47.722 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/connect/ca/configuration from=127.0.0.1:37078 error="Bad request: Request decode failed: EOF" 30:47.722 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/ca/configuration from=127.0.0.1:37078 latency=92.634µs 30:47.723 [ERROR] TestAgent.http: Request error: method=POST url=/v1/connect/ca/configuration from=127.0.0.1:37080 error="method POST not allowed" 30:47.723 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/ca/configuration from=127.0.0.1:37080 latency=104.327µs 30:47.723 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/connect/ca/configuration from=127.0.0.1:37082 error="method DELETE not allowed" 30:47.723 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/connect/ca/configuration from=127.0.0.1:37082 latency=108.037µs 30:47.724 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/connect/ca/configuration from=127.0.0.1:37084 error="method HEAD not allowed" 30:47.724 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/connect/ca/configuration from=127.0.0.1:37084 latency=22.764µs 30:47.724 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/connect/ca/configuration from=127.0.0.1:37084 latency=4.15µs 30:47.724 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37084 error="URI must be either service or agent" 30:47.725 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37084 latency=220.877µs 30:47.725 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37086 error="method PUT not allowed" 30:47.725 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37086 latency=136.234µs 30:47.726 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37088 error="method POST not allowed" 30:47.726 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37088 latency=159.05µs 30:47.727 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37090 error="method DELETE not allowed" 30:47.727 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37090 latency=136.475µs 30:47.727 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37092 error="method HEAD not allowed" 30:47.727 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37092 latency=18.44µs 30:47.728 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/connect/ca/leaf/ from=127.0.0.1:37092 latency=2.119µs 30:47.728 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/service/ from=127.0.0.1:37092 latency=118.167µs 30:47.728 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/health/service/ from=127.0.0.1:37094 error="method PUT not allowed" 30:47.729 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/health/service/ from=127.0.0.1:37094 latency=107.507µs 30:47.729 [ERROR] TestAgent.http: Request error: method=POST url=/v1/health/service/ from=127.0.0.1:37096 error="method POST not allowed" 30:47.729 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/health/service/ from=127.0.0.1:37096 latency=88.822µs 30:47.730 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/health/service/ from=127.0.0.1:37098 error="method DELETE not allowed" 30:47.730 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/health/service/ from=127.0.0.1:37098 latency=133.793µs 30:47.730 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/health/service/ from=127.0.0.1:37100 error="method HEAD not allowed" 30:47.730 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/health/service/ from=127.0.0.1:37100 latency=20.472µs 30:47.730 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/health/service/ from=127.0.0.1:37100 latency=2.769µs 30:47.731 [ERROR] TestAgent.http: Request error: method=GET url=/v1/session/destroy/ from=127.0.0.1:37100 error="method GET not allowed" 30:47.731 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/destroy/ from=127.0.0.1:37100 latency=121.607µs 30:47.731 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/ from=127.0.0.1:37102 latency=111.872µs 30:47.732 [ERROR] TestAgent.http: Request error: method=POST url=/v1/session/destroy/ from=127.0.0.1:37104 error="method POST not allowed" 30:47.732 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/session/destroy/ from=127.0.0.1:37104 latency=131.138µs 30:47.733 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/session/destroy/ from=127.0.0.1:37106 error="method DELETE not allowed" 30:47.733 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/session/destroy/ from=127.0.0.1:37106 latency=137.462µs 30:47.733 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/session/destroy/ from=127.0.0.1:37108 error="method HEAD not allowed" 30:47.733 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/session/destroy/ from=127.0.0.1:37108 latency=21.671µs 30:47.734 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/session/destroy/ from=127.0.0.1:37108 latency=2.707µs 30:47.734 [ERROR] TestAgent.http: Request error: method=GET url=/v1/session/renew/ from=127.0.0.1:37108 error="method GET not allowed" 30:47.734 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/renew/ from=127.0.0.1:37108 latency=115.406µs 30:47.735 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/renew/ from=127.0.0.1:37110 latency=93.192µs 30:47.735 [ERROR] TestAgent.http: Request error: method=POST url=/v1/session/renew/ from=127.0.0.1:37112 error="method POST not allowed" 30:47.735 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/session/renew/ from=127.0.0.1:37112 latency=114.861µs 30:47.735 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/session/renew/ from=127.0.0.1:37114 error="method DELETE not allowed" 30:47.736 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/session/renew/ from=127.0.0.1:37114 latency=122.36µs 30:47.736 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/session/renew/ from=127.0.0.1:37116 error="method HEAD not allowed" 30:47.736 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/session/renew/ from=127.0.0.1:37116 latency=23.164µs 30:47.736 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/session/renew/ from=127.0.0.1:37116 latency=3.323µs 30:47.737 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/bootstrap from=127.0.0.1:37116 error="method GET not allowed" 30:47.737 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/bootstrap from=127.0.0.1:37116 latency=122.506µs 30:47.738 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/bootstrap from=127.0.0.1:37118 latency=192.504µs 30:47.738 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/bootstrap from=127.0.0.1:37120 error="method POST not allowed" 30:47.738 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/bootstrap from=127.0.0.1:37120 latency=95.757µs 30:47.739 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/bootstrap from=127.0.0.1:37122 error="method DELETE not allowed" 30:47.739 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/bootstrap from=127.0.0.1:37122 latency=95.37µs 30:47.739 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/bootstrap from=127.0.0.1:37124 error="method HEAD not allowed" 30:47.739 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/bootstrap from=127.0.0.1:37124 latency=17.977µs 30:47.739 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/bootstrap from=127.0.0.1:37124 latency=2.523µs 30:47.740 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/check/pass/ from=127.0.0.1:37124 error="method GET not allowed" 30:47.740 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/check/pass/ from=127.0.0.1:37124 latency=110.08µs 30:47.740 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/check/pass/ from=127.0.0.1:37126 error="Unknown check """ 30:47.740 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/pass/ from=127.0.0.1:37126 latency=153.955µs 30:47.741 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/check/pass/ from=127.0.0.1:37128 error="method POST not allowed" 30:47.741 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/check/pass/ from=127.0.0.1:37128 latency=128.631µs 30:47.741 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/check/pass/ from=127.0.0.1:37130 error="method DELETE not allowed" 30:47.742 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/check/pass/ from=127.0.0.1:37130 latency=122.58µs 30:47.742 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/check/pass/ from=127.0.0.1:37132 error="method HEAD not allowed" 30:47.742 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/check/pass/ from=127.0.0.1:37132 latency=21.416µs 30:47.742 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/check/pass/ from=127.0.0.1:37132 latency=2.867µs 30:47.743 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/node/ from=127.0.0.1:37132 latency=118.12µs 30:47.743 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/health/node/ from=127.0.0.1:37134 error="method PUT not allowed" 30:47.743 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/health/node/ from=127.0.0.1:37134 latency=103.977µs 30:47.744 [ERROR] TestAgent.http: Request error: method=POST url=/v1/health/node/ from=127.0.0.1:37136 error="method POST not allowed" 30:47.744 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/health/node/ from=127.0.0.1:37136 latency=101.006µs 30:47.744 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/health/node/ from=127.0.0.1:37138 error="method DELETE not allowed" 30:47.744 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/health/node/ from=127.0.0.1:37138 latency=113.52µs 30:47.745 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/health/node/ from=127.0.0.1:37140 error="method HEAD not allowed" 30:47.745 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/health/node/ from=127.0.0.1:37140 latency=24.134µs 30:47.745 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/health/node/ from=127.0.0.1:37140 latency=2.412µs 30:47.745 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/status/leader from=127.0.0.1:37140 latency=131.73µs 30:47.746 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/status/leader from=127.0.0.1:37142 error="method PUT not allowed" 30:47.746 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/status/leader from=127.0.0.1:37142 latency=148.578µs 30:47.747 [ERROR] TestAgent.http: Request error: method=POST url=/v1/status/leader from=127.0.0.1:37144 error="method POST not allowed" 30:47.747 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/status/leader from=127.0.0.1:37144 latency=116.483µs 30:47.747 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/status/leader from=127.0.0.1:37146 error="method DELETE not allowed" 30:47.747 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/status/leader from=127.0.0.1:37146 latency=126.462µs 30:47.748 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/status/leader from=127.0.0.1:37148 error="method HEAD not allowed" 30:47.748 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/status/leader from=127.0.0.1:37148 latency=21.116µs 30:47.748 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/status/leader from=127.0.0.1:37148 latency=2.956µs 30:47.749 [DEBUG] TestAgent: dropping node from result due to ACLs: node=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d accessorID=00000000-0000-0000-0000-000000000002 30:47.749 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/members from=127.0.0.1:37148 latency=284.376µs 30:47.749 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/members from=127.0.0.1:37150 error="method PUT not allowed" 30:47.749 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/members from=127.0.0.1:37150 latency=112.412µs 30:47.750 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/members from=127.0.0.1:37152 error="method POST not allowed" 30:47.750 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/members from=127.0.0.1:37152 latency=94.616µs 30:47.750 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/members from=127.0.0.1:37154 error="method DELETE not allowed" 30:47.750 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/members from=127.0.0.1:37154 latency=116.439µs 30:47.751 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/members from=127.0.0.1:37156 error="method HEAD not allowed" 30:47.751 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/members from=127.0.0.1:37156 latency=19.04µs 30:47.751 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/members from=127.0.0.1:37156 latency=2.771µs 30:47.752 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.752 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/internal/ui/nodes from=127.0.0.1:37156 latency=348.939µs 30:47.752 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/internal/ui/nodes from=127.0.0.1:37158 error="method PUT not allowed" 30:47.752 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/internal/ui/nodes from=127.0.0.1:37158 latency=102.328µs 30:47.753 [ERROR] TestAgent.http: Request error: method=POST url=/v1/internal/ui/nodes from=127.0.0.1:37160 error="method POST not allowed" 30:47.753 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/internal/ui/nodes from=127.0.0.1:37160 latency=127.184µs 30:47.754 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/internal/ui/nodes from=127.0.0.1:37162 error="method DELETE not allowed" 30:47.754 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/internal/ui/nodes from=127.0.0.1:37162 latency=133.846µs 30:47.754 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/internal/ui/nodes from=127.0.0.1:37164 error="method HEAD not allowed" 30:47.754 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/internal/ui/nodes from=127.0.0.1:37164 latency=18.922µs 30:47.754 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/internal/ui/nodes from=127.0.0.1:37164 latency=2.309µs 30:47.755 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/list from=127.0.0.1:37164 latency=261.56µs 30:47.755 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/session/list from=127.0.0.1:37166 error="method PUT not allowed" 30:47.756 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/list from=127.0.0.1:37166 latency=97.86µs 30:47.756 [ERROR] TestAgent.http: Request error: method=POST url=/v1/session/list from=127.0.0.1:37168 error="method POST not allowed" 30:47.756 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/session/list from=127.0.0.1:37168 latency=96.508µs 30:47.757 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/session/list from=127.0.0.1:37170 error="method DELETE not allowed" 30:47.757 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/session/list from=127.0.0.1:37170 latency=98.173µs 30:47.757 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/session/list from=127.0.0.1:37172 error="method HEAD not allowed" 30:47.757 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/session/list from=127.0.0.1:37172 latency=20.386µs 30:47.757 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/session/list from=127.0.0.1:37172 latency=2.794µs 30:47.758 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/login from=127.0.0.1:37172 error="method GET not allowed" 30:47.758 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/login from=127.0.0.1:37172 latency=101.417µs 30:47.758 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/login from=127.0.0.1:37174 error="method PUT not allowed" 30:47.758 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/login from=127.0.0.1:37174 latency=109.007µs 30:47.759 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/login from=127.0.0.1:37176 error="Bad request: Failed to decode request body: EOF" 30:47.759 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:37176 latency=115.203µs 30:47.760 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/login from=127.0.0.1:37178 error="method DELETE not allowed" 30:47.760 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/login from=127.0.0.1:37178 latency=94.723µs 30:47.760 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/login from=127.0.0.1:37180 error="method HEAD not allowed" 30:47.760 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/login from=127.0.0.1:37180 latency=19.238µs 30:47.760 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/login from=127.0.0.1:37180 latency=2.58µs 30:47.761 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8e7e7fa1-24c8-b84f-b504-0a6d0fb54e6d 30:47.761 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes from=127.0.0.1:37180 latency=204.329µs 30:47.761 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/catalog/nodes from=127.0.0.1:37182 error="method PUT not allowed" 30:47.761 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/nodes from=127.0.0.1:37182 latency=110.77µs 30:47.762 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/nodes from=127.0.0.1:37184 error="method POST not allowed" 30:47.762 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/nodes from=127.0.0.1:37184 latency=96.63µs 30:47.762 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/nodes from=127.0.0.1:37186 error="method DELETE not allowed" 30:47.762 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/nodes from=127.0.0.1:37186 latency=133.495µs 30:47.763 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/nodes from=127.0.0.1:37188 error="method HEAD not allowed" 30:47.763 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/nodes from=127.0.0.1:37188 latency=22.246µs 30:47.763 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/nodes from=127.0.0.1:37188 latency=2.735µs 30:47.764 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/replication from=127.0.0.1:37188 latency=262.496µs 30:47.764 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/replication from=127.0.0.1:37190 error="method PUT not allowed" 30:47.764 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/replication from=127.0.0.1:37190 latency=99.792µs 30:47.765 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/replication from=127.0.0.1:37192 error="method POST not allowed" 30:47.765 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/replication from=127.0.0.1:37192 latency=124.999µs 30:47.766 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/replication from=127.0.0.1:37194 error="method DELETE not allowed" 30:47.766 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/replication from=127.0.0.1:37194 latency=118.14µs 30:47.766 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/replication from=127.0.0.1:37196 error="method HEAD not allowed" 30:47.766 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/replication from=127.0.0.1:37196 latency=19.45µs 30:47.766 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/replication from=127.0.0.1:37196 latency=2.362µs 30:47.767 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/policy/name/ from=127.0.0.1:37196 error="Bad request: Missing policy Name" 30:47.767 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy/name/ from=127.0.0.1:37196 latency=104.128µs 30:47.767 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/policy/name/ from=127.0.0.1:37198 error="method PUT not allowed" 30:47.767 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy/name/ from=127.0.0.1:37198 latency=117.718µs 30:47.768 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/policy/name/ from=127.0.0.1:37200 error="method POST not allowed" 30:47.768 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/policy/name/ from=127.0.0.1:37200 latency=107.587µs 30:47.768 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/policy/name/ from=127.0.0.1:37202 error="method DELETE not allowed" 30:47.769 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/policy/name/ from=127.0.0.1:37202 latency=96.784µs 30:47.769 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/policy/name/ from=127.0.0.1:37204 error="method HEAD not allowed" 30:47.769 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/policy/name/ from=127.0.0.1:37204 latency=21.017µs 30:47.769 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/policy/name/ from=127.0.0.1:37204 latency=2.744µs 30:47.770 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/policy/ from=127.0.0.1:37204 error="Bad request: Missing policy ID" 30:47.770 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy/ from=127.0.0.1:37204 latency=105.659µs 30:47.770 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/policy/ from=127.0.0.1:37206 error="Bad request: Policy decoding failed: EOF" 30:47.770 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy/ from=127.0.0.1:37206 latency=108.328µs 30:47.771 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/policy/ from=127.0.0.1:37208 error="method POST not allowed" 30:47.771 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/policy/ from=127.0.0.1:37208 latency=98.016µs 30:47.771 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/policy/ from=127.0.0.1:37210 error="Bad request: Missing policy ID" 30:47.771 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/policy/ from=127.0.0.1:37210 latency=97.069µs 30:47.772 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/policy/ from=127.0.0.1:37212 error="method HEAD not allowed" 30:47.772 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/policy/ from=127.0.0.1:37212 latency=19.226µs 30:47.772 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/policy/ from=127.0.0.1:37212 latency=2.471µs 30:47.772 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/force-leave/ from=127.0.0.1:37212 error="method GET not allowed" 30:47.773 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/force-leave/ from=127.0.0.1:37212 latency=120.927µs 30:47.773 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/force-leave/ from=127.0.0.1:37214 error="Permission denied" 30:47.773 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/force-leave/ from=127.0.0.1:37214 latency=168.75µs 30:47.774 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/force-leave/ from=127.0.0.1:37216 error="method POST not allowed" 30:47.774 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/force-leave/ from=127.0.0.1:37216 latency=131.316µs 30:47.774 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/force-leave/ from=127.0.0.1:37218 error="method DELETE not allowed" 30:47.775 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/force-leave/ from=127.0.0.1:37218 latency=128.177µs 30:47.775 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/force-leave/ from=127.0.0.1:37220 error="method HEAD not allowed" 30:47.775 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/force-leave/ from=127.0.0.1:37220 latency=21.192µs 30:47.775 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/force-leave/ from=127.0.0.1:37220 latency=2.627µs 30:47.776 [ERROR] TestAgent.http: Request error: method=GET url=/v1/catalog/deregister from=127.0.0.1:37220 error="method GET not allowed" 30:47.776 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/deregister from=127.0.0.1:37220 latency=131.846µs 30:47.776 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/deregister from=127.0.0.1:37222 latency=111.302µs 30:47.777 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/deregister from=127.0.0.1:37224 error="method POST not allowed" 30:47.777 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/deregister from=127.0.0.1:37224 latency=136.162µs 30:47.777 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/deregister from=127.0.0.1:37226 error="method DELETE not allowed" 30:47.778 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/deregister from=127.0.0.1:37226 latency=111.512µs 30:47.778 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/deregister from=127.0.0.1:37228 error="method HEAD not allowed" 30:47.778 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/deregister from=127.0.0.1:37228 latency=17.322µs 30:47.778 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/deregister from=127.0.0.1:37228 latency=2.378µs 30:47.779 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/auth-method/ from=127.0.0.1:37228 error="Bad request: Missing auth method name" 30:47.779 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/ from=127.0.0.1:37228 latency=133.257µs 30:47.779 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/auth-method/ from=127.0.0.1:37230 error="Bad request: AuthMethod decoding failed: EOF" 30:47.779 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/ from=127.0.0.1:37230 latency=124.204µs 30:47.780 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/auth-method/ from=127.0.0.1:37232 error="method POST not allowed" 30:47.780 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/auth-method/ from=127.0.0.1:37232 latency=124.606µs 30:47.781 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/auth-method/ from=127.0.0.1:37234 error="Bad request: Missing auth method name" 30:47.781 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/auth-method/ from=127.0.0.1:37234 latency=96.176µs 30:47.781 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/auth-method/ from=127.0.0.1:37236 error="method HEAD not allowed" 30:47.781 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/auth-method/ from=127.0.0.1:37236 latency=17.708µs 30:47.781 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/auth-method/ from=127.0.0.1:37236 latency=2.595µs 30:47.782 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/token/self from=127.0.0.1:37236 error="ACL not found" 30:47.782 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:37236 latency=174.841µs 30:47.782 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/token/self from=127.0.0.1:37238 error="method PUT not allowed" 30:47.782 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/self from=127.0.0.1:37238 latency=116.05µs 30:47.783 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/token/self from=127.0.0.1:37240 error="method POST not allowed" 30:47.783 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/token/self from=127.0.0.1:37240 latency=119.837µs 30:47.784 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/token/self from=127.0.0.1:37242 error="method DELETE not allowed" 30:47.784 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/token/self from=127.0.0.1:37242 latency=118.822µs 30:47.789 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/token/self from=127.0.0.1:37244 error="method HEAD not allowed" 30:47.789 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/token/self from=127.0.0.1:37244 latency=29.406µs 30:47.790 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/token/self from=127.0.0.1:37244 latency=3.125µs 30:47.790 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/service/register from=127.0.0.1:37244 error="method GET not allowed" 30:47.790 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/register from=127.0.0.1:37244 latency=126.667µs 30:47.791 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:37246 latency=115.978µs 30:47.791 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/service/register from=127.0.0.1:37248 error="method POST not allowed" 30:47.791 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/service/register from=127.0.0.1:37248 latency=117.581µs 30:47.793 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/service/register from=127.0.0.1:37250 error="method DELETE not allowed" 30:47.793 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/service/register from=127.0.0.1:37250 latency=137.652µs 30:47.794 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/service/register from=127.0.0.1:37252 error="method HEAD not allowed" 30:47.794 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/service/register from=127.0.0.1:37252 latency=20.752µs 30:47.794 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/service/register from=127.0.0.1:37252 latency=2.575µs 30:47.795 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/create from=127.0.0.1:37252 error="method GET not allowed" 30:47.795 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/create from=127.0.0.1:37252 latency=150.325µs 30:47.796 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/create from=127.0.0.1:37254 error="Permission denied" 30:47.796 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/create from=127.0.0.1:37254 latency=336.014µs 30:47.796 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/create from=127.0.0.1:37256 error="method POST not allowed" 30:47.797 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/create from=127.0.0.1:37256 latency=96.842µs 30:47.797 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/acl/create from=127.0.0.1:37258 error="method DELETE not allowed" 30:47.797 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/create from=127.0.0.1:37258 latency=113.804µs 30:47.798 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/acl/create from=127.0.0.1:37260 error="method HEAD not allowed" 30:47.798 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/acl/create from=127.0.0.1:37260 latency=13.964µs 30:47.798 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/acl/create from=127.0.0.1:37260 latency=2.055µs 30:47.798 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/check/register from=127.0.0.1:37260 error="method GET not allowed" 30:47.798 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/check/register from=127.0.0.1:37260 latency=108.228µs 30:47.799 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/register from=127.0.0.1:37262 latency=106.247µs 30:47.799 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/check/register from=127.0.0.1:37264 error="method POST not allowed" 30:47.800 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/check/register from=127.0.0.1:37264 latency=201.549µs 30:47.804 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/check/register from=127.0.0.1:37266 error="method DELETE not allowed" 30:47.804 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/check/register from=127.0.0.1:37266 latency=136.182µs 30:47.805 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/check/register from=127.0.0.1:37268 error="method HEAD not allowed" 30:47.805 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/check/register from=127.0.0.1:37268 latency=25.145µs 30:47.805 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/check/register from=127.0.0.1:37268 latency=2.938µs 30:47.806 [ERROR] TestAgent.http: Request error: method=GET url=/v1/connect/intentions/check from=127.0.0.1:37268 error="required query parameter 'source' not set" 30:47.806 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/check from=127.0.0.1:37268 latency=142.496µs 30:47.806 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/connect/intentions/check from=127.0.0.1:37270 error="method PUT not allowed" 30:47.807 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/intentions/check from=127.0.0.1:37270 latency=132.862µs 30:47.807 [ERROR] TestAgent.http: Request error: method=POST url=/v1/connect/intentions/check from=127.0.0.1:37272 error="method POST not allowed" 30:47.807 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions/check from=127.0.0.1:37272 latency=93.014µs 30:47.808 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/connect/intentions/check from=127.0.0.1:37274 error="method DELETE not allowed" 30:47.808 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/connect/intentions/check from=127.0.0.1:37274 latency=119.829µs 30:47.808 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/connect/intentions/check from=127.0.0.1:37276 error="method HEAD not allowed" 30:47.808 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/connect/intentions/check from=127.0.0.1:37276 latency=22.293µs 30:47.809 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/connect/intentions/check from=127.0.0.1:37276 latency=2.475µs 30:47.809 [ERROR] TestAgent.http: Request error: method=GET url=/v1/discovery-chain/ from=127.0.0.1:37276 error="Bad request: Missing chain name" 30:47.809 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/discovery-chain/ from=127.0.0.1:37276 latency=115.585µs 30:47.810 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/discovery-chain/ from=127.0.0.1:37278 error="method PUT not allowed" 30:47.810 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/discovery-chain/ from=127.0.0.1:37278 latency=135.431µs 30:47.810 [ERROR] TestAgent.http: Request error: method=POST url=/v1/discovery-chain/ from=127.0.0.1:37280 error="Bad request: Missing chain name" 30:47.810 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/discovery-chain/ from=127.0.0.1:37280 latency=123.373µs 30:47.811 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/discovery-chain/ from=127.0.0.1:37282 error="method DELETE not allowed" 30:47.811 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/discovery-chain/ from=127.0.0.1:37282 latency=129.005µs 30:47.812 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/discovery-chain/ from=127.0.0.1:37284 error="method HEAD not allowed" 30:47.812 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/discovery-chain/ from=127.0.0.1:37284 latency=22.492µs 30:47.812 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/discovery-chain/ from=127.0.0.1:37284 latency=4.841µs 30:47.812 [ERROR] TestAgent.http: Request error: method=GET url=/v1/operator/raft/peer from=127.0.0.1:37284 error="method GET not allowed" 30:47.812 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/raft/peer from=127.0.0.1:37284 latency=113.462µs 30:47.813 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/operator/raft/peer from=127.0.0.1:37286 error="method PUT not allowed" 30:47.813 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/operator/raft/peer from=127.0.0.1:37286 latency=110.723µs 30:47.813 [ERROR] TestAgent.http: Request error: method=POST url=/v1/operator/raft/peer from=127.0.0.1:37288 error="method POST not allowed" 30:47.814 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/operator/raft/peer from=127.0.0.1:37288 latency=110.435µs 30:47.814 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/operator/raft/peer from=127.0.0.1:37290 error="Bad request: Must specify either ?id with the server's ID or ?address with IP:port of peer to remove" 30:47.814 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/raft/peer from=127.0.0.1:37290 latency=163.496µs 30:47.815 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/operator/raft/peer from=127.0.0.1:37292 error="method HEAD not allowed" 30:47.815 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/operator/raft/peer from=127.0.0.1:37292 latency=22.198µs 30:47.815 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/operator/raft/peer from=127.0.0.1:37292 latency=2.746µs 30:47.815 [ERROR] TestAgent.http: Request error: method=GET url=/v1/operator/autopilot/health from=127.0.0.1:37292 error="Permission denied" 30:47.815 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/autopilot/health from=127.0.0.1:37292 latency=227.524µs 30:47.816 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/operator/autopilot/health from=127.0.0.1:37294 error="method PUT not allowed" 30:47.816 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/operator/autopilot/health from=127.0.0.1:37294 latency=125.291µs 30:47.817 [ERROR] TestAgent.http: Request error: method=POST url=/v1/operator/autopilot/health from=127.0.0.1:37296 error="method POST not allowed" 30:47.817 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/operator/autopilot/health from=127.0.0.1:37296 latency=106.838µs 30:47.817 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/operator/autopilot/health from=127.0.0.1:37298 error="method DELETE not allowed" 30:47.818 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/autopilot/health from=127.0.0.1:37298 latency=111.593µs 30:47.818 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/operator/autopilot/health from=127.0.0.1:37300 error="method HEAD not allowed" 30:47.818 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/operator/autopilot/health from=127.0.0.1:37300 latency=24.596µs 30:47.818 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/operator/autopilot/health from=127.0.0.1:37300 latency=2.874µs 30:47.819 [ERROR] TestAgent.http: Request error: method=GET url=/v1/txn from=127.0.0.1:37300 error="method GET not allowed" 30:47.819 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/txn from=127.0.0.1:37300 latency=122.355µs 30:47.819 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/txn from=127.0.0.1:37302 latency=100.607µs 30:47.820 [ERROR] TestAgent.http: Request error: method=POST url=/v1/txn from=127.0.0.1:37304 error="method POST not allowed" 30:47.820 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/txn from=127.0.0.1:37304 latency=119.914µs 30:47.820 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/txn from=127.0.0.1:37306 error="method DELETE not allowed" 30:47.820 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/txn from=127.0.0.1:37306 latency=110.466µs 30:47.821 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/txn from=127.0.0.1:37308 error="method HEAD not allowed" 30:47.821 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/txn from=127.0.0.1:37308 latency=19.714µs 30:47.821 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/txn from=127.0.0.1:37308 latency=2.858µs 30:47.821 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/maintenance from=127.0.0.1:37308 error="method GET not allowed" 30:47.822 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/maintenance from=127.0.0.1:37308 latency=129.718µs 30:47.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/maintenance from=127.0.0.1:37310 latency=103.652µs 30:47.823 [ERROR] TestAgent.http: Request error: method=POST url=/v1/agent/maintenance from=127.0.0.1:37312 error="method POST not allowed" 30:47.823 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/agent/maintenance from=127.0.0.1:37312 latency=105.952µs 30:47.823 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/agent/maintenance from=127.0.0.1:37314 error="method DELETE not allowed" 30:47.823 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/agent/maintenance from=127.0.0.1:37314 latency=94.277µs 30:47.824 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/agent/maintenance from=127.0.0.1:37316 error="method HEAD not allowed" 30:47.824 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/agent/maintenance from=127.0.0.1:37316 latency=23.655µs 30:47.824 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/agent/maintenance from=127.0.0.1:37316 latency=2.495µs 30:47.825 [ERROR] TestAgent.http: Request error: method=GET url=/v1/catalog/register from=127.0.0.1:37316 error="method GET not allowed" 30:47.825 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/register from=127.0.0.1:37316 latency=101.28µs 30:47.825 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/catalog/register from=127.0.0.1:37318 latency=118.163µs 30:47.826 [ERROR] TestAgent.http: Request error: method=POST url=/v1/catalog/register from=127.0.0.1:37320 error="method POST not allowed" 30:47.826 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/catalog/register from=127.0.0.1:37320 latency=129.484µs 30:47.826 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/catalog/register from=127.0.0.1:37322 error="method DELETE not allowed" 30:47.827 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/catalog/register from=127.0.0.1:37322 latency=111.229µs 30:47.827 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/catalog/register from=127.0.0.1:37324 error="method HEAD not allowed" 30:47.827 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/catalog/register from=127.0.0.1:37324 latency=23.652µs 30:47.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/catalog/register from=127.0.0.1:37324 latency=3.831µs 30:47.828 [ERROR] TestAgent.http: Request error: method=GET url=/v1/connect/intentions/match from=127.0.0.1:37324 error="required query parameter 'by' not set" 30:47.828 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/match from=127.0.0.1:37324 latency=127.863µs 30:47.828 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/connect/intentions/match from=127.0.0.1:37326 error="method PUT not allowed" 30:47.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/intentions/match from=127.0.0.1:37326 latency=113.825µs 30:47.829 [ERROR] TestAgent.http: Request error: method=POST url=/v1/connect/intentions/match from=127.0.0.1:37328 error="method POST not allowed" 30:47.829 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions/match from=127.0.0.1:37328 latency=101.123µs 30:47.830 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/connect/intentions/match from=127.0.0.1:37330 error="method DELETE not allowed" 30:47.830 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/connect/intentions/match from=127.0.0.1:37330 latency=111.92µs 30:47.830 [ERROR] TestAgent.http: Request error: method=HEAD url=/v1/connect/intentions/match from=127.0.0.1:37332 error="method HEAD not allowed" 30:47.830 [DEBUG] TestAgent.http: Request finished: method=HEAD url=/v1/connect/intentions/match from=127.0.0.1:37332 latency=26.586µs 30:47.830 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=/v1/connect/intentions/match from=127.0.0.1:37332 latency=3.151µs 30:47.831 [INFO] TestAgent: Requesting shutdown 30:47.831 [INFO] TestAgent.server: shutting down server 30:47.831 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:47.831 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:47.831 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:47.831 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:47.831 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:47.831 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:47.831 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:47.831 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:47.831 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:47.831 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:47.831 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:47.831 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:47.831 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:47.831 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:47.842 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:47.848Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:47.848Z [INFO] agent.router.manager: shutting down 30:47.848 [INFO] TestAgent: consul server down 30:47.848 [INFO] TestAgent: shutdown complete 30:47.848 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30282 network=tcp 30:47.848 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30282 network=udp 30:47.848 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30283 network=tcp 30:48.352 [INFO] TestAgent: Waiting for endpoints to shut down 30:48.352 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPI_MethodNotAllowed_OSS (1.38s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query/xxx/execute (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query/xxx/execute (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query/xxx/execute (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query/xxx/execute (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query/xxx/execute (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query/xxx/execute (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query/xxx/explain (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query/xxx/explain (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query/xxx/explain (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query/xxx/explain (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query/xxx/explain (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query/xxx/explain (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/query (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/query (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/query (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/query (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/query (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/query (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/node-services/ (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/node-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/node-services/ (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/node-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/node-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/node-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/leave (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/leave (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/leave (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/leave (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/leave (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/leave (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/warn/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/warn/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/warn/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/warn/ (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/warn/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/warn/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/deregister/ (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/connect/ (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/tokens (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/tokens (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/tokens (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/tokens (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/tokens (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/tokens (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/checks (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/checks (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/checks (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/checks (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/checks (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/checks (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/federation-state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/federation-state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/federation-state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/federation-state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/federation-state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/federation-state/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/federation-states/mesh-gateways (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/federation-states/mesh-gateways (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/federation-states/mesh-gateways (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/federation-states/mesh-gateways (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/federation-states/mesh-gateways (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/federation-states/mesh-gateways (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/health/service/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/health/service/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/health/service/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/health/service/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/health/service/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/health/service/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/datacenters (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/config (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/config (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/config (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/config (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/config (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/config (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/health/service/id/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/health/service/id/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/health/service/id/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/health/service/id/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/health/service/id/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/health/service/id/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/datacenters (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/info/ (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/info/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/auth-methods (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/auth-methods (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/auth-methods (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/auth-methods (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/auth-methods (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/auth-methods (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/roles (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/roles (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/roles (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/roles (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/roles (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/roles (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/gateway-services-nodes/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/gateway-services-nodes/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/gateway-services-nodes/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/gateway-services-nodes/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/gateway-services-nodes/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/gateway-services-nodes/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/checks/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/checks/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/checks/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/checks/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/checks/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/checks/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/host (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/host (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/host (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/host (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/host (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/host (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/connect/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policies (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policies (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policies (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policies (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policies (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policies (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/ingress/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/ingress/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/ingress/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/ingress/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/ingress/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/ingress/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/raft/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/raft/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/raft/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/raft/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/raft/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/raft/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/role/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/role/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/role/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/role/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/role/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/role/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/binding-rules (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/binding-rules (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/binding-rules (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/binding-rules (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/binding-rules (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/binding-rules (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/event/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/event/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/event/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/event/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/event/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/event/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/metrics (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/metrics (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/metrics (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/metrics (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/metrics (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/metrics (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/services (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/federation-states (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/federation-states (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/federation-states (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/federation-states (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/federation-states (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/federation-states (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/rules/translate/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/rules/translate/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/rules/translate/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/rules/translate/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/rules/translate/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/rules/translate/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/ (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/gateway-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/gateway-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/gateway-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/gateway-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/gateway-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/gateway-services/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/connect/ca/leaf/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/connect/ca/leaf/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/connect/ca/leaf/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/connect/ca/leaf/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/connect/ca/leaf/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/connect/ca/leaf/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/service/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/health/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/health/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/health/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/health/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/health/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/health/node/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/status/leader (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/status/leader (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/status/leader (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/status/leader (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/status/leader (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/status/leader (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/members (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/members (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/members (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/members (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/members (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/members (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/internal/ui/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/internal/ui/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/internal/ui/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/internal/ui/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/internal/ui/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/internal/ui/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/session/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/session/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/session/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/session/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/session/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/session/list (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/nodes (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/replication (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/replication (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/replication (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/replication (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/replication (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/replication (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policy/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policy/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policy/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policy/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policy/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policy/name/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/token/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/token/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/token/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/token/self (0.01s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/token/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/token/self (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions/check (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions/check (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions/check (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions/check (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions/check (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions/check (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/operator/autopilot/health (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/operator/autopilot/health (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/operator/autopilot/health (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/operator/autopilot/health (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/operator/autopilot/health (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/operator/autopilot/health (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/txn (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/txn (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/txn (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/txn (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/txn (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/txn (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/GET_/v1/connect/intentions/match (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/PUT_/v1/connect/intentions/match (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/POST_/v1/connect/intentions/match (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/DELETE_/v1/connect/intentions/match (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/HEAD_/v1/connect/intentions/match (0.00s) --- PASS: TestHTTPAPI_MethodNotAllowed_OSS/OPTIONS_/v1/connect/intentions/match (0.00s) === RUN TestHTTPAPI_OptionMethod_OSS [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query/xxx/explain === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query/xxx/execute === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/update/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/config === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/services === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/health/service/id/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/node/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/info/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/auth-methods === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/deregister/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/services === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/datacenters === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/roles === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/join/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/fail/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/connect/authorize === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/event/fire/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/gateway-services-nodes/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/checks/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/host === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/nodes === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/binding-rule/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/node/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/destroy/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/node/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/node/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/connect/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/kv/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/logout === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policies === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policy === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/auth-method === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/ca/roots === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/ingress/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/role/name/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/binding-rules === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/acl/authorize === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/raft/configuration === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/config/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/event/list === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/snapshot === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/services === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/keyring === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/create === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/update === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/clone/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/token/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/metrics === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/token/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/federation-states === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/rules/translate/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/service/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/update === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/connect/ca/roots === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/binding-rule === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/token === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/gateway-services/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/connect/ca/leaf/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/ca/configuration === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/destroy/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/renew/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/bootstrap === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/pass/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/node/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/service/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/members === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/nodes === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/list === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/status/leader === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/login === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/nodes === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/replication === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policy/name/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policy/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/force-leave/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/deregister === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/auth-method/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/token/self === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/register === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/create === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/register === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/discovery-chain/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/raft/peer === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/autopilot/health === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/txn === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/maintenance === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/register === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions/match === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions/check === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/leave === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/warn/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/deregister/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/node-services/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/connect/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/list === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/rules/translate === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/self === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/state/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/role === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/tokens === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/checks === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/federation-state/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/role/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/health/service/name/ === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/datacenters === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/federation-states/mesh-gateways === RUN TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/info/ [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:48.392Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:30:48.392Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:48.444Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:30:48.444Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:48.529 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 Address:127.0.0.1:30294}]" 30:48.530 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715.dc1 127.0.0.1 30:48.530 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 127.0.0.1 2021-10-05T16:30:48.530Z [INFO] agent.router: Initializing LAN area manager 30:48.530 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30289 network=udp 30:48.530 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30294 [Follower]" leader= 30:48.531 [INFO] TestAgent.server: Adding LAN server: server="Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 (Addr: tcp/127.0.0.1:30294) (DC: dc1)" 30:48.531 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715.dc1 area=wan 30:48.531 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30289 network=tcp 30:48.531 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30290 network=tcp 30:48.532 [INFO] TestAgent: started state syncer 30:48.532 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30295 network=tcp 30:48.581 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:48.596 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:48.596 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30294 [Candidate]" term=2 30:48.614 [DEBUG] TestAgent.server.raft: votes: needed=1 30:48.614 [DEBUG] TestAgent.server.raft: vote granted: from=6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 term=2 tally=1 30:48.614 [INFO] TestAgent.server.raft: election won: tally=1 30:48.614 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30294 [Leader]" 30:48.616 [INFO] TestAgent.server: cluster leadership acquired 30:48.616 [INFO] TestAgent.server: New leader elected: payload=Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 30:48.620 [INFO] TestAgent.server: initializing acls 30:48.624 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:48.633 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:48.633 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:48.633 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:48.633 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 30:48.633 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715.dc1 30:48.634 [INFO] TestAgent.server: Updating LAN server: server="Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 (Addr: tcp/127.0.0.1:30294) (DC: dc1)" 30:48.634 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715.dc1 area=wan 30:48.672 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:48.704 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:48.704 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:48.704 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:48.704 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:48.704 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:48.704 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 30:48.704 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 30:48.719 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6a1f0a5a-a272-1030-2c2b-8f01ad9a0715 30:48.724 [INFO] TestAgent.server: federation state anti-entropy synced 30:48.824 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/query/xxx/explain from= latency=127.557µs 30:48.824 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/query from= latency=3.365µs 30:48.824 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/query/ from= latency=14.803µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/query/xxx/execute from= latency=15.6µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/check/update/ from= latency=2.564µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/config from= latency=2.537µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/ui/services from= latency=2.336µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/health/service/id/ from= latency=2.292µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/node/ from= latency=4.436µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/session/info/ from= latency=2.215µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/auth-methods from= latency=2.218µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/check/deregister/ from= latency=2.526µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/services from= latency=2.124µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/coordinate/datacenters from= latency=2.629µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/roles from= latency=2.434µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/join/ from= latency=2.232µs 30:48.825 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/check/fail/ from= latency=2.18µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/connect/authorize from= latency=2.298µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/connect/intentions from= latency=3.245µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/event/fire/ from= latency=2.333µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/ui/gateway-services-nodes/ from= latency=2.25µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/health/checks/ from= latency=2.265µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/host from= latency=2.221µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/coordinate/nodes from= latency=2.38µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/binding-rule/ from= latency=2.579µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/ui/node/ from= latency=2.222µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/destroy/ from= latency=2.449µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/coordinate/node/ from= latency=2.132µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/session/node/ from= latency=2.082µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/service/maintenance/ from= latency=2.346µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/connect/ from= latency=1.985µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/kv/ from= latency=2.115µs 30:48.826 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/logout from= latency=2.187µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/policies from= latency=1.803µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/policy from= latency=1.72µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/auth-method from= latency=1.747µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/connect/ca/roots from= latency=1.826µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/health/ingress/ from= latency=1.809µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/role/name/ from= latency=1.754µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/binding-rules from= latency=1.961µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/acl/authorize from= latency=1.713µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/operator/raft/configuration from= latency=1.624µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/config/ from= latency=1.907µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/event/list from= latency=1.932µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/snapshot from= latency=1.825µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/services from= latency=1.767µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/operator/keyring from= latency=2.086µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/session/create from= latency=1.774µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/update from= latency=1.857µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/clone/ from= latency=1.761µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/token/ from= latency=1.739µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/metrics from= latency=2.219µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/token/ from= latency=2.084µs 30:48.827 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/federation-states from= latency=2.372µs 30:48.828 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/rules/translate/ from= latency=1.784µs 30:48.828 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/service/ from= latency=1.673µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/service/ from= latency=2.931µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/coordinate/update from= latency=2.139µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/connect/ca/roots from= latency=2.182µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/connect/intentions/ from= latency=2.422µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/binding-rule from= latency=2.099µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/token from= latency=2.107µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/gateway-services/ from= latency=2.037µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/connect/ca/leaf/ from= latency=2.047µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/connect/ca/configuration from= latency=2.304µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/session/destroy/ from= latency=2.136µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/session/renew/ from= latency=1.963µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/bootstrap from= latency=2.128µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/check/pass/ from= latency=2.125µs 30:48.837 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/health/node/ from= latency=2.063µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/health/service/ from= latency=2.028µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/members from= latency=1.92µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/ui/nodes from= latency=2.155µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/session/list from= latency=1.99µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/status/leader from= latency=1.946µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/login from= latency=1.974µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/nodes from= latency=1.928µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/replication from= latency=2.025µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/policy/name/ from= latency=1.934µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/policy/ from= latency=2.146µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/force-leave/ from= latency=1.963µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/deregister from= latency=2.032µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/auth-method/ from= latency=2.208µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/token/self from= latency=2.015µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/service/register from= latency=2.114µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/create from= latency=2.033µs 30:48.838 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/check/register from= latency=1.914µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/discovery-chain/ from= latency=1.974µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/operator/raft/peer from= latency=2.505µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/operator/autopilot/health from= latency=2.296µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/txn from= latency=2.204µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/maintenance from= latency=2.344µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/register from= latency=2.293µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/connect/intentions/match from= latency=2.332µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/connect/intentions/check from= latency=2.191µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/leave from= latency=2.238µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/check/warn/ from= latency=2.406µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/service/deregister/ from= latency=2.184µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/node-services/ from= latency=2.255µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/health/connect/ from= latency=2.329µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/list from= latency=2.246µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/rules/translate from= latency=2.34µs 30:48.839 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/self from= latency=2.23µs 30:48.840 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/health/state/ from= latency=2.274µs 30:48.840 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/role from= latency=2.321µs 30:48.845 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/tokens from= latency=3.211µs 30:48.845 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/checks from= latency=2.429µs 30:48.846 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/federation-state/ from= latency=2.37µs 30:48.846 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/operator/autopilot/configuration from= latency=2.49µs 30:48.846 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/role/ from= latency=2.688µs 30:48.846 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/agent/health/service/name/ from= latency=2.239µs 30:48.846 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/catalog/datacenters from= latency=2.399µs 30:48.846 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/internal/federation-states/mesh-gateways from= latency=2.4µs 30:48.846 [DEBUG] TestAgent.http: Request finished: method=OPTIONS url=http://127.0.0.1:30290/v1/acl/info/ from= latency=2.299µs 30:48.846 [INFO] TestAgent: Requesting shutdown 30:48.846 [INFO] TestAgent.server: shutting down server 30:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:48.846 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:48.846 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:48.846 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:48.846 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:48.846 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:48.846 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:48.846 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:48.846 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:48.846 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:48.860 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:48.868Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:48.868Z [INFO] agent.router.manager: shutting down 30:48.868 [INFO] TestAgent: consul server down 30:48.868 [INFO] TestAgent: shutdown complete 30:48.868 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30289 network=tcp 30:48.868 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30289 network=udp 30:48.868 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30290 network=tcp 30:49.369 [INFO] TestAgent: Waiting for endpoints to shut down 30:49.369 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPI_OptionMethod_OSS (0.99s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query/xxx/explain (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/query/xxx/execute (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/config (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/services (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/health/service/id/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/node/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/info/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/auth-methods (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/services (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/datacenters (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/roles (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/gateway-services-nodes/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/checks/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/host (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/nodes (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/node/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/node/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/node/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/connect/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policies (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/ingress/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/role/name/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/binding-rules (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/raft/configuration (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/event/list (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/services (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/metrics (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/federation-states (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/rules/translate/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/ (0.01s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/service/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/connect/ca/roots (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/gateway-services/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/connect/ca/leaf/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/node/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/service/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/members (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/ui/nodes (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/session/list (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/status/leader (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/nodes (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/replication (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policy/name/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/token/self (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/autopilot/health (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/txn (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions/match (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/connect/intentions/check (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/leave (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/check/warn/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/service/deregister/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/node-services/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/connect/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/list (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/self (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/health/state/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/tokens (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/checks (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/federation-state/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/agent/health/service/name/ (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/catalog/datacenters (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/internal/federation-states/mesh-gateways (0.00s) --- PASS: TestHTTPAPI_OptionMethod_OSS/OPTIONS_/v1/acl/info/ (0.00s) === RUN TestHTTPAPI_AllowedNets_OSS [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/internal/acl/authorize === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/config/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/snapshot === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/session/create === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/update === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/clone/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/token/ === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/operator/keyring === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/operator/keyring === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/operator/keyring === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/token/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/token/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/coordinate/update === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/connect/intentions/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/connect/intentions/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/binding-rule === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/token === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/connect/ca/configuration === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/bootstrap === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/pass/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/session/destroy/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/session/renew/ === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/acl/login === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/policy/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/policy/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/force-leave/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/catalog/deregister === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/auth-method/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/auth-method/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/service/register === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/create === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/register === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/txn === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/maintenance === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/catalog/register === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/discovery-chain/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/operator/raft/peer === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/leave === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/warn/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/service/deregister/ === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/acl/rules/translate [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/role === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/operator/autopilot/configuration === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/role/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/role/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/update/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/config === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/deregister/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/join/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/fail/ === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/agent/connect/authorize === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/connect/intentions === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/event/fire/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/binding-rule/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/binding-rule/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/destroy/ === RUN TestHTTPAPI_AllowedNets_OSS/POST_/v1/acl/logout === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/policy === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/auth-method === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/service/maintenance/ === RUN TestHTTPAPI_AllowedNets_OSS/PUT_/v1/kv/ === RUN TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/kv/ [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:49.405Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:30:49.405Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:49.449Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:30:49.449Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:49.552 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ae534b84-0e36-9919-8fd7-cd065de13933 Address:127.0.0.1:30301}]" 30:49.553 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ae534b84-0e36-9919-8fd7-cd065de13933.dc1 127.0.0.1 30:49.553 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ae534b84-0e36-9919-8fd7-cd065de13933 127.0.0.1 2021-10-05T16:30:49.553Z [INFO] agent.router: Initializing LAN area manager 30:49.553 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30301 [Follower]" leader= 30:49.554 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30296 network=udp 30:49.554 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ae534b84-0e36-9919-8fd7-cd065de13933.dc1 area=wan 30:49.554 [INFO] TestAgent.server: Adding LAN server: server="Node-ae534b84-0e36-9919-8fd7-cd065de13933 (Addr: tcp/127.0.0.1:30301) (DC: dc1)" 30:49.554 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30296 network=tcp 30:49.554 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30297 network=tcp 30:49.554 [INFO] TestAgent: started state syncer 30:49.554 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30302 network=tcp 30:49.604 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:49.612 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:49.612 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30301 [Candidate]" term=2 30:49.660 [DEBUG] TestAgent.server.raft: votes: needed=1 30:49.660 [DEBUG] TestAgent.server.raft: vote granted: from=ae534b84-0e36-9919-8fd7-cd065de13933 term=2 tally=1 30:49.660 [INFO] TestAgent.server.raft: election won: tally=1 30:49.660 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30301 [Leader]" 30:49.664 [INFO] TestAgent.server: cluster leadership acquired 30:49.664 [INFO] TestAgent.server: New leader elected: payload=Node-ae534b84-0e36-9919-8fd7-cd065de13933 30:49.682 [INFO] TestAgent.server: initializing acls 30:49.696 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:49.704 [INFO] TestAgent.server: initializing acls 30:49.716 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 30:49.736 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:49.736 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:49.736 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:49.736 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:49.736 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ae534b84-0e36-9919-8fd7-cd065de13933 30:49.736 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ae534b84-0e36-9919-8fd7-cd065de13933.dc1 30:49.736 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ae534b84-0e36-9919-8fd7-cd065de13933.dc1 area=wan 30:49.736 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:49.737 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ae534b84-0e36-9919-8fd7-cd065de13933 30:49.737 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ae534b84-0e36-9919-8fd7-cd065de13933.dc1 30:49.737 [INFO] TestAgent.server: Updating LAN server: server="Node-ae534b84-0e36-9919-8fd7-cd065de13933 (Addr: tcp/127.0.0.1:30301) (DC: dc1)" 30:49.737 [INFO] TestAgent.server: Updating LAN server: server="Node-ae534b84-0e36-9919-8fd7-cd065de13933 (Addr: tcp/127.0.0.1:30301) (DC: dc1)" 30:49.737 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ae534b84-0e36-9919-8fd7-cd065de13933.dc1 area=wan 30:49.780 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:49.802 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:49.802 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:49.802 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:49.802 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:49.802 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:49.803 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ae534b84-0e36-9919-8fd7-cd065de13933 30:49.803 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ae534b84-0e36-9919-8fd7-cd065de13933 30:49.816 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ae534b84-0e36-9919-8fd7-cd065de13933 30:49.816 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ae534b84-0e36-9919-8fd7-cd065de13933 30:49.820 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/internal/acl/authorize from=192.168.1.2:5555 error="Access is restricted" 30:49.820 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/internal/acl/authorize from=192.168.1.2:5555 latency=33.394µs 30:49.820 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/config/ from=192.168.1.2:5555 error="Access is restricted" 30:49.820 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/config/ from=192.168.1.2:5555 latency=14.627µs 30:49.820 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/snapshot from=192.168.1.2:5555 error="Access is restricted" 30:49.820 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/snapshot from=192.168.1.2:5555 latency=14.733µs 30:49.820 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/session/create from=192.168.1.2:5555 error="Access is restricted" 30:49.820 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/session/create from=192.168.1.2:5555 latency=14.377µs 30:49.820 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/update from=192.168.1.2:5555 error="Access is restricted" 30:49.820 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/update from=192.168.1.2:5555 latency=13.886µs 30:49.821 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/clone/ from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/clone/ from=192.168.1.2:5555 latency=14.522µs 30:49.821 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/token/ from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/token/ from=192.168.1.2:5555 latency=14.371µs 30:49.821 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/operator/keyring from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/operator/keyring from=192.168.1.2:5555 latency=13.915µs 30:49.821 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/operator/keyring from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/operator/keyring from=192.168.1.2:5555 latency=14.753µs 30:49.821 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/operator/keyring from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/operator/keyring from=192.168.1.2:5555 latency=13.986µs 30:49.821 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/token/ from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/token/ from=192.168.1.2:5555 latency=14.148µs 30:49.821 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/acl/token/ from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/acl/token/ from=192.168.1.2:5555 latency=13.861µs 30:49.821 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/coordinate/update from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/coordinate/update from=192.168.1.2:5555 latency=13.874µs 30:49.821 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/connect/intentions/ from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/connect/intentions/ from=192.168.1.2:5555 latency=14.007µs 30:49.821 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/connect/intentions/ from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/connect/intentions/ from=192.168.1.2:5555 latency=13.359µs 30:49.821 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/binding-rule from=192.168.1.2:5555 error="Access is restricted" 30:49.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/binding-rule from=192.168.1.2:5555 latency=14.213µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/token from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/token from=192.168.1.2:5555 latency=14.129µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/connect/ca/configuration from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/connect/ca/configuration from=192.168.1.2:5555 latency=12.489µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/bootstrap from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/bootstrap from=192.168.1.2:5555 latency=12.343µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/check/pass/ from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/check/pass/ from=192.168.1.2:5555 latency=12.373µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/session/destroy/ from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/session/destroy/ from=192.168.1.2:5555 latency=13.355µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/session/renew/ from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/session/renew/ from=192.168.1.2:5555 latency=12.613µs 30:49.822 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/acl/login from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/acl/login from=192.168.1.2:5555 latency=11.834µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/policy/ from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/policy/ from=192.168.1.2:5555 latency=14.772µs 30:49.822 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/acl/policy/ from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/acl/policy/ from=192.168.1.2:5555 latency=12.79µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/force-leave/ from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/force-leave/ from=192.168.1.2:5555 latency=12.388µs 30:49.822 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/catalog/deregister from=192.168.1.2:5555 error="Access is restricted" 30:49.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/catalog/deregister from=192.168.1.2:5555 latency=12.637µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/auth-method/ from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/auth-method/ from=192.168.1.2:5555 latency=12.262µs 30:49.823 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/acl/auth-method/ from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/acl/auth-method/ from=192.168.1.2:5555 latency=12.274µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/service/register from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/service/register from=192.168.1.2:5555 latency=12.409µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/create from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/create from=192.168.1.2:5555 latency=32.268µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/check/register from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/check/register from=192.168.1.2:5555 latency=13.903µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/txn from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/txn from=192.168.1.2:5555 latency=12.334µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/maintenance from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/maintenance from=192.168.1.2:5555 latency=12.23µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/catalog/register from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/catalog/register from=192.168.1.2:5555 latency=12.419µs 30:49.823 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/discovery-chain/ from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/discovery-chain/ from=192.168.1.2:5555 latency=12.171µs 30:49.823 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/operator/raft/peer from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/operator/raft/peer from=192.168.1.2:5555 latency=12.737µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/leave from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/leave from=192.168.1.2:5555 latency=12.129µs 30:49.823 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/check/warn/ from=192.168.1.2:5555 error="Access is restricted" 30:49.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/check/warn/ from=192.168.1.2:5555 latency=12.156µs 30:49.824 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/service/deregister/ from=192.168.1.2:5555 error="Access is restricted" 30:49.824 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/service/deregister/ from=192.168.1.2:5555 latency=12.109µs 30:49.828 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/acl/rules/translate from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/acl/rules/translate from=192.168.1.2:5555 latency=28.26µs 30:49.828 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/role from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/role from=192.168.1.2:5555 latency=15.794µs 30:49.828 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/operator/autopilot/configuration from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/operator/autopilot/configuration from=192.168.1.2:5555 latency=13.04µs 30:49.828 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/role/ from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/role/ from=192.168.1.2:5555 latency=12.359µs 30:49.828 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/acl/role/ from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/acl/role/ from=192.168.1.2:5555 latency=13.254µs 30:49.828 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/check/update/ from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/check/update/ from=192.168.1.2:5555 latency=12.494µs 30:49.828 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/config from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/config from=192.168.1.2:5555 latency=12.756µs 30:49.828 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/check/deregister/ from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/check/deregister/ from=192.168.1.2:5555 latency=12.804µs 30:49.828 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/join/ from=192.168.1.2:5555 error="Access is restricted" 30:49.828 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/join/ from=192.168.1.2:5555 latency=12.979µs 30:49.829 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/check/fail/ from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/check/fail/ from=192.168.1.2:5555 latency=12.538µs 30:49.829 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/agent/connect/authorize from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/agent/connect/authorize from=192.168.1.2:5555 latency=12.095µs 30:49.829 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/connect/intentions from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/connect/intentions from=192.168.1.2:5555 latency=12.54µs 30:49.829 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/event/fire/ from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/event/fire/ from=192.168.1.2:5555 latency=14.467µs 30:49.829 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/binding-rule/ from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/binding-rule/ from=192.168.1.2:5555 latency=13.332µs 30:49.829 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/acl/binding-rule/ from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/acl/binding-rule/ from=192.168.1.2:5555 latency=14.309µs 30:49.829 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/destroy/ from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/destroy/ from=192.168.1.2:5555 latency=14.514µs 30:49.829 [ERROR] TestAgent.http: Request error: method=POST url=http://127.0.0.1:30297/v1/acl/logout from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=POST url=http://127.0.0.1:30297/v1/acl/logout from=192.168.1.2:5555 latency=15.083µs 30:49.829 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/policy from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/policy from=192.168.1.2:5555 latency=14.719µs 30:49.829 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/acl/auth-method from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/acl/auth-method from=192.168.1.2:5555 latency=13.526µs 30:49.829 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/agent/service/maintenance/ from=192.168.1.2:5555 error="Access is restricted" 30:49.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/agent/service/maintenance/ from=192.168.1.2:5555 latency=14.259µs 30:49.830 [ERROR] TestAgent.http: Request error: method=PUT url=http://127.0.0.1:30297/v1/kv/ from=192.168.1.2:5555 error="Access is restricted" 30:49.830 [DEBUG] TestAgent.http: Request finished: method=PUT url=http://127.0.0.1:30297/v1/kv/ from=192.168.1.2:5555 latency=13.74µs 30:49.830 [ERROR] TestAgent.http: Request error: method=DELETE url=http://127.0.0.1:30297/v1/kv/ from=192.168.1.2:5555 error="Access is restricted" 30:49.830 [DEBUG] TestAgent.http: Request finished: method=DELETE url=http://127.0.0.1:30297/v1/kv/ from=192.168.1.2:5555 latency=13.797µs 30:49.830 [INFO] TestAgent: Requesting shutdown 30:49.830 [INFO] TestAgent.server: shutting down server 30:49.830 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:49.830 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:49.830 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:49.830 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:49.830 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:49.830 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:49.830 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:49.830 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:49.830 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:49.830 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:49.830 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:49.830 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:49.834 [INFO] TestAgent.server: federation state anti-entropy synced 30:49.834 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:49.844 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:49.852Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:49.852Z [INFO] agent.router.manager: shutting down 30:49.852 [INFO] TestAgent: consul server down 30:49.852 [INFO] TestAgent: shutdown complete 30:49.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30296 network=tcp 30:49.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30296 network=udp 30:49.852 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30297 network=tcp 30:50.353 [INFO] TestAgent: Waiting for endpoints to shut down 30:50.353 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPI_AllowedNets_OSS (0.98s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/internal/acl/authorize (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/config/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/snapshot (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/session/create (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/update (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/clone/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/token/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/operator/keyring (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/token/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/coordinate/update (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/connect/intentions/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/binding-rule (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/token (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/connect/ca/configuration (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/bootstrap (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/pass/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/session/destroy/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/session/renew/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/acl/login (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/policy/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/force-leave/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/catalog/deregister (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/auth-method/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/service/register (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/create (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/register (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/txn (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/maintenance (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/catalog/register (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/discovery-chain/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/operator/raft/peer (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/leave (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/warn/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/service/deregister/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/acl/rules/translate (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/role (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/operator/autopilot/configuration (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/role/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/update/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/config (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/deregister/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/join/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/check/fail/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/agent/connect/authorize (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/connect/intentions (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/event/fire/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/acl/binding-rule/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/destroy/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/POST_/v1/acl/logout (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/policy (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/acl/auth-method (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/agent/service/maintenance/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/PUT_/v1/kv/ (0.00s) --- PASS: TestHTTPAPI_AllowedNets_OSS/DELETE_/v1/kv/ (0.00s) === RUN TestHTTPServer_UnixSocket === PAUSE TestHTTPServer_UnixSocket === RUN TestHTTPServer_UnixSocket_FileExists === PAUSE TestHTTPServer_UnixSocket_FileExists === RUN TestHTTPServer_H2 http_test.go:132: DM-skipped --- SKIP: TestHTTPServer_H2 (0.00s) === RUN TestSetIndex === PAUSE TestSetIndex === RUN TestSetKnownLeader === PAUSE TestSetKnownLeader === RUN TestSetLastContact === PAUSE TestSetLastContact === RUN TestSetMeta === PAUSE TestSetMeta === RUN TestHTTPAPI_BlockEndpoints === PAUSE TestHTTPAPI_BlockEndpoints === RUN TestHTTPAPI_Ban_Nonprintable_Characters [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:50.388Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:50.414Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:50.471 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b077c4db-924d-32ec-0aea-be4aeb683434 Address:127.0.0.1:30308}]" 30:50.471 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30308 [Follower]" leader= 30:50.472 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b077c4db-924d-32ec-0aea-be4aeb683434.dc1 127.0.0.1 30:50.473 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b077c4db-924d-32ec-0aea-be4aeb683434 127.0.0.1 2021-10-05T16:30:50.473Z [INFO] agent.router: Initializing LAN area manager 30:50.473 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30303 network=udp 30:50.473 [INFO] TestAgent.server: Adding LAN server: server="Node-b077c4db-924d-32ec-0aea-be4aeb683434 (Addr: tcp/127.0.0.1:30308) (DC: dc1)" 30:50.473 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b077c4db-924d-32ec-0aea-be4aeb683434.dc1 area=wan 30:50.473 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30303 network=tcp 30:50.474 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30304 network=tcp 30:50.474 [INFO] TestAgent: started state syncer 30:50.474 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30309 network=tcp 30:50.528 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:50.528 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30308 [Candidate]" term=2 30:50.543 [DEBUG] TestAgent.server.raft: votes: needed=1 30:50.543 [DEBUG] TestAgent.server.raft: vote granted: from=b077c4db-924d-32ec-0aea-be4aeb683434 term=2 tally=1 30:50.543 [INFO] TestAgent.server.raft: election won: tally=1 30:50.543 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30308 [Leader]" 30:50.544 [INFO] TestAgent.server: cluster leadership acquired 30:50.544 [INFO] TestAgent.server: New leader elected: payload=Node-b077c4db-924d-32ec-0aea-be4aeb683434 30:50.549 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30308 30:50.588 [INFO] TestAgent: Synced node info 30:50.588 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:50.609 [INFO] TestAgent: Requesting shutdown 30:50.609 [INFO] TestAgent.server: shutting down server 30:50.609 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:50.615 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:50.624Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:50.624Z [INFO] agent.router.manager: shutting down 30:50.624 [INFO] TestAgent: consul server down 30:50.624 [INFO] TestAgent: shutdown complete 30:50.624 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30303 network=tcp 30:50.624 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30303 network=udp 30:50.624 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30304 network=tcp 30:50.624 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 30:50.624 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 30:51.128 [INFO] TestAgent: Waiting for endpoints to shut down 30:51.128 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPI_Ban_Nonprintable_Characters (0.77s) === RUN TestHTTPAPI_Allow_Nonprintable_Characters_With_Flag [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:51.156Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:51.183Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:51.258 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4dc96da2-5144-9f8a-0324-414a018b1cf3 Address:127.0.0.1:30315}]" 30:51.258 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30315 [Follower]" leader= 30:51.258 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4dc96da2-5144-9f8a-0324-414a018b1cf3.dc1 127.0.0.1 30:51.259 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4dc96da2-5144-9f8a-0324-414a018b1cf3 127.0.0.1 2021-10-05T16:30:51.259Z [INFO] agent.router: Initializing LAN area manager 30:51.259 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30310 network=udp 30:51.259 [INFO] TestAgent.server: Adding LAN server: server="Node-4dc96da2-5144-9f8a-0324-414a018b1cf3 (Addr: tcp/127.0.0.1:30315) (DC: dc1)" 30:51.259 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4dc96da2-5144-9f8a-0324-414a018b1cf3.dc1 area=wan 30:51.260 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30310 network=tcp 30:51.260 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30311 network=tcp 30:51.260 [INFO] TestAgent: started state syncer 30:51.260 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30316 network=tcp 30:51.316 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:51.316 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30315 [Candidate]" term=2 30:51.356 [DEBUG] TestAgent.server.raft: votes: needed=1 30:51.356 [DEBUG] TestAgent.server.raft: vote granted: from=4dc96da2-5144-9f8a-0324-414a018b1cf3 term=2 tally=1 30:51.356 [INFO] TestAgent.server.raft: election won: tally=1 30:51.356 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30315 [Leader]" 30:51.356 [INFO] TestAgent.server: cluster leadership acquired 30:51.356 [INFO] TestAgent.server: New leader elected: payload=Node-4dc96da2-5144-9f8a-0324-414a018b1cf3 30:51.376 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30315 30:51.388 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:51.413 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/bad%00ness from= latency=52.232µs 30:51.413 [INFO] TestAgent: Requesting shutdown 30:51.413 [INFO] TestAgent.server: shutting down server 30:51.413 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:51.414 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:51.417 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:51.426Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:51.426Z [INFO] agent.router.manager: shutting down 30:51.432 [INFO] TestAgent: consul server down 30:51.432 [INFO] TestAgent: shutdown complete 30:51.432 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30310 network=tcp 30:51.432 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30310 network=udp 30:51.432 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30311 network=tcp 30:51.432 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 30:51.432 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 30:51.936 [INFO] TestAgent: Waiting for endpoints to shut down 30:51.936 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPI_Allow_Nonprintable_Characters_With_Flag (0.81s) === RUN TestHTTPAPI_TranslateAddrHeader === PAUSE TestHTTPAPI_TranslateAddrHeader === RUN TestHTTPAPIResponseHeaders === PAUSE TestHTTPAPIResponseHeaders === RUN TestUIResponseHeaders === PAUSE TestUIResponseHeaders === RUN TestContentTypeIsJSON === PAUSE TestContentTypeIsJSON === RUN TestHTTP_wrap_obfuscateLog === PAUSE TestHTTP_wrap_obfuscateLog === RUN TestPrettyPrint === PAUSE TestPrettyPrint === RUN TestPrettyPrintBare === PAUSE TestPrettyPrintBare === RUN TestParseSource === PAUSE TestParseSource === RUN TestParseCacheControl === RUN TestParseCacheControl/empty_header === RUN TestParseCacheControl/simple_max-age === RUN TestParseCacheControl/zero_max-age === RUN TestParseCacheControl/must-revalidate === RUN TestParseCacheControl/mixes_age,_must-revalidate === RUN TestParseCacheControl/quoted_max-age === RUN TestParseCacheControl/mixed_case_max-age === RUN TestParseCacheControl/simple_stale-if-error === RUN TestParseCacheControl/combined_with_space === RUN TestParseCacheControl/combined_no_space === RUN TestParseCacheControl/unsupported_directive === RUN TestParseCacheControl/mixed_unsupported_directive === RUN TestParseCacheControl/garbage_value === RUN TestParseCacheControl/garbage_value_with_quotes --- PASS: TestParseCacheControl (0.00s) --- PASS: TestParseCacheControl/empty_header (0.00s) --- PASS: TestParseCacheControl/simple_max-age (0.00s) --- PASS: TestParseCacheControl/zero_max-age (0.00s) --- PASS: TestParseCacheControl/must-revalidate (0.00s) --- PASS: TestParseCacheControl/mixes_age,_must-revalidate (0.00s) --- PASS: TestParseCacheControl/quoted_max-age (0.00s) --- PASS: TestParseCacheControl/mixed_case_max-age (0.00s) --- PASS: TestParseCacheControl/simple_stale-if-error (0.00s) --- PASS: TestParseCacheControl/combined_with_space (0.00s) --- PASS: TestParseCacheControl/combined_no_space (0.00s) --- PASS: TestParseCacheControl/unsupported_directive (0.00s) --- PASS: TestParseCacheControl/mixed_unsupported_directive (0.00s) --- PASS: TestParseCacheControl/garbage_value (0.00s) --- PASS: TestParseCacheControl/garbage_value_with_quotes (0.00s) === RUN TestParseWait === PAUSE TestParseWait === RUN TestPProfHandlers_EnableDebug === PAUSE TestPProfHandlers_EnableDebug === RUN TestPProfHandlers_DisableDebugNoACLs === PAUSE TestPProfHandlers_DisableDebugNoACLs === RUN TestPProfHandlers_ACLs === PAUSE TestPProfHandlers_ACLs === RUN TestParseWait_InvalidTime === PAUSE TestParseWait_InvalidTime === RUN TestParseWait_InvalidIndex === PAUSE TestParseWait_InvalidIndex === RUN TestParseConsistency === PAUSE TestParseConsistency === RUN TestParseConsistencyAndMaxStale [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:51.973Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:52.013Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:52.131 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2 Address:127.0.0.1:30322}]" 30:52.133 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2.dc1 127.0.0.1 30:52.133 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2 127.0.0.1 2021-10-05T16:30:52.133Z [INFO] agent.router: Initializing LAN area manager 30:52.134 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30317 network=udp 30:52.134 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30322 [Follower]" leader= 30:52.134 [INFO] TestAgent.server: Adding LAN server: server="Node-b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2 (Addr: tcp/127.0.0.1:30322) (DC: dc1)" 30:52.134 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2.dc1 area=wan 30:52.134 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30317 network=tcp 30:52.135 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30318 network=tcp 30:52.135 [INFO] TestAgent: started state syncer 30:52.135 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30323 network=tcp 30:52.188 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:52.188 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30322 [Candidate]" term=2 30:52.206 [DEBUG] TestAgent.server.raft: votes: needed=1 30:52.206 [DEBUG] TestAgent.server.raft: vote granted: from=b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2 term=2 tally=1 30:52.206 [INFO] TestAgent.server.raft: election won: tally=1 30:52.206 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30322 [Leader]" 30:52.206 [INFO] TestAgent.server: cluster leadership acquired 30:52.206 [INFO] TestAgent.server: New leader elected: payload=Node-b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2 30:52.217 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30322 30:52.230 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:52.255 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:52.255 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:52.255 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:52.255 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:52.255 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:52.256 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2 30:52.256 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b2e0db46-9f9c-fbbb-38f8-3e3becd7c3a2 30:52.278 [INFO] TestAgent.server: federation state anti-entropy synced 30:52.280 [INFO] TestAgent: Requesting shutdown 30:52.280 [INFO] TestAgent.server: shutting down server 30:52.280 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:52.280 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:52.280 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:52.280 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:52.280 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:52.280 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:52.280 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:52.280 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:52.280 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:52.280 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:52.280 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:52.288 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:52.288Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:52.288Z [INFO] agent.router.manager: shutting down 30:52.288 [INFO] TestAgent: consul server down 30:52.288 [INFO] TestAgent: shutdown complete 30:52.288 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30317 network=tcp 30:52.288 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30317 network=udp 30:52.288 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30318 network=tcp 30:52.792 [INFO] TestAgent: Waiting for endpoints to shut down 30:52.792 [INFO] TestAgent: Endpoints down --- PASS: TestParseConsistencyAndMaxStale (0.85s) === RUN TestParseConsistency_Invalid === PAUSE TestParseConsistency_Invalid === RUN TestACLResolution === PAUSE TestACLResolution === RUN TestEnableWebUI === PAUSE TestEnableWebUI === RUN TestAllowedNets http_test.go:1163: DM-skipped --- SKIP: TestAllowedNets (0.00s) === RUN TestHTTPServer_HandshakeTimeout === PAUSE TestHTTPServer_HandshakeTimeout === RUN TestRPC_HTTPSMaxConnsPerClient === PAUSE TestRPC_HTTPSMaxConnsPerClient === RUN TestIntentionsList_empty === PAUSE TestIntentionsList_empty === RUN TestIntentionsList_values === PAUSE TestIntentionsList_values === RUN TestIntentionsMatch_basic === PAUSE TestIntentionsMatch_basic === RUN TestIntentionsMatch_noBy === PAUSE TestIntentionsMatch_noBy === RUN TestIntentionsMatch_byInvalid === PAUSE TestIntentionsMatch_byInvalid === RUN TestIntentionsMatch_noName === PAUSE TestIntentionsMatch_noName === RUN TestIntentionsCheck_basic === PAUSE TestIntentionsCheck_basic === RUN TestIntentionsCheck_noSource === PAUSE TestIntentionsCheck_noSource === RUN TestIntentionsCheck_noDestination === PAUSE TestIntentionsCheck_noDestination === RUN TestIntentionsCreate_good === PAUSE TestIntentionsCreate_good === RUN TestIntentionsCreate_noBody === PAUSE TestIntentionsCreate_noBody === RUN TestIntentionsSpecificGet_good === PAUSE TestIntentionsSpecificGet_good === RUN TestIntentionsSpecificGet_invalidId === PAUSE TestIntentionsSpecificGet_invalidId === RUN TestIntentionsSpecificUpdate_good === PAUSE TestIntentionsSpecificUpdate_good === RUN TestIntentionsSpecificDelete_good === PAUSE TestIntentionsSpecificDelete_good === RUN TestParseIntentionMatchEntry === RUN TestParseIntentionMatchEntry/foo === RUN TestParseIntentionMatchEntry/foo/bar === RUN TestParseIntentionMatchEntry/foo/bar/baz --- PASS: TestParseIntentionMatchEntry (0.00s) --- PASS: TestParseIntentionMatchEntry/foo (0.00s) --- PASS: TestParseIntentionMatchEntry/foo/bar (0.00s) --- PASS: TestParseIntentionMatchEntry/foo/bar/baz (0.00s) === RUN TestAgent_LoadKeyrings === PAUSE TestAgent_LoadKeyrings === RUN TestAgent_InmemKeyrings === PAUSE TestAgent_InmemKeyrings === RUN TestAgent_InitKeyring === PAUSE TestAgent_InitKeyring === RUN TestAgentKeyring_ACL === PAUSE TestAgentKeyring_ACL === RUN TestValidateLocalOnly --- PASS: TestValidateLocalOnly (0.00s) === RUN TestAgent_KeyringIsMissingKey --- PASS: TestAgent_KeyringIsMissingKey (0.00s) === RUN TestKVSEndpoint_PUT_GET_DELETE === PAUSE TestKVSEndpoint_PUT_GET_DELETE === RUN TestKVSEndpoint_Recurse === PAUSE TestKVSEndpoint_Recurse === RUN TestKVSEndpoint_DELETE_CAS === PAUSE TestKVSEndpoint_DELETE_CAS === RUN TestKVSEndpoint_CAS === PAUSE TestKVSEndpoint_CAS === RUN TestKVSEndpoint_ListKeys === PAUSE TestKVSEndpoint_ListKeys === RUN TestKVSEndpoint_AcquireRelease === PAUSE TestKVSEndpoint_AcquireRelease === RUN TestKVSEndpoint_GET_Raw === PAUSE TestKVSEndpoint_GET_Raw === RUN TestKVSEndpoint_PUT_ConflictingFlags === PAUSE TestKVSEndpoint_PUT_ConflictingFlags === RUN TestKVSEndpoint_GET kvs_endpoint_test.go:477: too slow for testing.Short --- SKIP: TestKVSEndpoint_GET (0.00s) === RUN TestKVSEndpoint_DELETE_ConflictingFlags === PAUSE TestKVSEndpoint_DELETE_ConflictingFlags === RUN TestNewNodeIDFromConfig === RUN TestNewNodeIDFromConfig/a_new_ID_is_generated_when_none_is_specified === RUN TestNewNodeIDFromConfig/running_again_should_get_the_NodeID_that_was_persisted_to_disk === RUN TestNewNodeIDFromConfig/invalid_NodeID_in_config === RUN TestNewNodeIDFromConfig/valid_NodeID_in_config === RUN TestNewNodeIDFromConfig/invalid_NodeID_in_file === RUN TestNewNodeIDFromConfig/valid_NodeID_in_file --- PASS: TestNewNodeIDFromConfig (0.02s) --- PASS: TestNewNodeIDFromConfig/a_new_ID_is_generated_when_none_is_specified (0.01s) --- PASS: TestNewNodeIDFromConfig/running_again_should_get_the_NodeID_that_was_persisted_to_disk (0.00s) --- PASS: TestNewNodeIDFromConfig/invalid_NodeID_in_config (0.00s) --- PASS: TestNewNodeIDFromConfig/valid_NodeID_in_config (0.00s) --- PASS: TestNewNodeIDFromConfig/invalid_NodeID_in_file (0.00s) --- PASS: TestNewNodeIDFromConfig/valid_NodeID_in_file (0.00s) === RUN TestMakeNodeID === RUN TestMakeNodeID/Random_ID_when_HostNodeID_is_disabled === RUN TestMakeNodeID/host-based_ID_when_HostNodeID_is_enabled --- PASS: TestMakeNodeID (0.00s) --- PASS: TestMakeNodeID/Random_ID_when_HostNodeID_is_disabled (0.00s) --- PASS: TestMakeNodeID/host-based_ID_when_HostNodeID_is_enabled (0.00s) === RUN TestNotifyGroup --- PASS: TestNotifyGroup (0.00s) === RUN TestNotifyGroup_Clear --- PASS: TestNotifyGroup_Clear (0.00s) === RUN TestOperator_RaftConfiguration === PAUSE TestOperator_RaftConfiguration === RUN TestOperator_RaftPeer === PAUSE TestOperator_RaftPeer === RUN TestOperator_KeyringInstall === PAUSE TestOperator_KeyringInstall === RUN TestOperator_KeyringList === PAUSE TestOperator_KeyringList === RUN TestOperator_KeyringListLocalOnly === PAUSE TestOperator_KeyringListLocalOnly === RUN TestOperator_KeyringRemove === PAUSE TestOperator_KeyringRemove === RUN TestOperator_KeyringUse === PAUSE TestOperator_KeyringUse === RUN TestOperator_Keyring_InvalidRelayFactor === PAUSE TestOperator_Keyring_InvalidRelayFactor === RUN TestOperator_Keyring_LocalOnly === PAUSE TestOperator_Keyring_LocalOnly === RUN TestOperator_AutopilotGetConfiguration === PAUSE TestOperator_AutopilotGetConfiguration === RUN TestOperator_AutopilotSetConfiguration === PAUSE TestOperator_AutopilotSetConfiguration === RUN TestOperator_AutopilotCASConfiguration === PAUSE TestOperator_AutopilotCASConfiguration === RUN TestOperator_ServerHealth === PAUSE TestOperator_ServerHealth === RUN TestOperator_ServerHealth_Unhealthy === PAUSE TestOperator_ServerHealth_Unhealthy === RUN TestPreparedQuery_Create === PAUSE TestPreparedQuery_Create === RUN TestPreparedQuery_List === PAUSE TestPreparedQuery_List === RUN TestPreparedQuery_Execute === PAUSE TestPreparedQuery_Execute === RUN TestPreparedQuery_ExecuteCached === PAUSE TestPreparedQuery_ExecuteCached === RUN TestPreparedQuery_Explain === PAUSE TestPreparedQuery_Explain === RUN TestPreparedQuery_Get === PAUSE TestPreparedQuery_Get === RUN TestPreparedQuery_Update === PAUSE TestPreparedQuery_Update === RUN TestPreparedQuery_Delete === PAUSE TestPreparedQuery_Delete === RUN TestPreparedQuery_parseLimit === PAUSE TestPreparedQuery_parseLimit === RUN TestPreparedQuery_Integration === PAUSE TestPreparedQuery_Integration === RUN TestRexecWriter remote_exec_test.go:28: DM-skipped --- SKIP: TestRexecWriter (0.00s) === RUN TestRemoteExecGetSpec === PAUSE TestRemoteExecGetSpec === RUN TestRemoteExecGetSpec_ACLToken === PAUSE TestRemoteExecGetSpec_ACLToken === RUN TestRemoteExecGetSpec_ACLAgentToken === PAUSE TestRemoteExecGetSpec_ACLAgentToken === RUN TestRemoteExecGetSpec_ACLDeny === PAUSE TestRemoteExecGetSpec_ACLDeny === RUN TestRemoteExecWrites === PAUSE TestRemoteExecWrites === RUN TestRemoteExecWrites_ACLToken === PAUSE TestRemoteExecWrites_ACLToken === RUN TestRemoteExecWrites_ACLAgentToken === PAUSE TestRemoteExecWrites_ACLAgentToken === RUN TestRemoteExecWrites_ACLDeny === PAUSE TestRemoteExecWrites_ACLDeny === RUN TestHandleRemoteExec === PAUSE TestHandleRemoteExec === RUN TestHandleRemoteExecFailed === PAUSE TestHandleRemoteExecFailed === RUN TestAgent_ServiceHTTPChecksNotification service_checks_test.go:19: DM-Disabled --- SKIP: TestAgent_ServiceHTTPChecksNotification (0.00s) === RUN TestServiceManager_RegisterService [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:52.856Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:52.890Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:52.964 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cfd92bb8-dcbd-d5ac-9a50-2f4ddbf321d2 Address:127.0.0.1:30329}]" 30:52.964 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30329 [Follower]" leader= 30:52.965 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cfd92bb8-dcbd-d5ac-9a50-2f4ddbf321d2.dc1 127.0.0.1 30:52.965 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cfd92bb8-dcbd-d5ac-9a50-2f4ddbf321d2 127.0.0.1 2021-10-05T16:30:52.965Z [INFO] agent.router: Initializing LAN area manager 30:52.966 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30324 network=udp 30:52.966 [INFO] TestAgent.server: Adding LAN server: server="Node-cfd92bb8-dcbd-d5ac-9a50-2f4ddbf321d2 (Addr: tcp/127.0.0.1:30329) (DC: dc1)" 30:52.966 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cfd92bb8-dcbd-d5ac-9a50-2f4ddbf321d2.dc1 area=wan 30:52.966 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30324 network=tcp 30:52.967 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30325 network=tcp 30:52.967 [INFO] TestAgent: started state syncer 30:52.967 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30330 network=tcp 30:53.012 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:53.012 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30329 [Candidate]" term=2 30:53.038 [DEBUG] TestAgent.server.raft: votes: needed=1 30:53.038 [DEBUG] TestAgent.server.raft: vote granted: from=cfd92bb8-dcbd-d5ac-9a50-2f4ddbf321d2 term=2 tally=1 30:53.038 [INFO] TestAgent.server.raft: election won: tally=1 30:53.038 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30329 [Leader]" 30:53.038 [INFO] TestAgent.server: cluster leadership acquired 30:53.038 [INFO] TestAgent.server: New leader elected: payload=Node-cfd92bb8-dcbd-d5ac-9a50-2f4ddbf321d2 30:53.072 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30329 30:53.108 [INFO] TestAgent: Synced node info 30:53.108 [DEBUG] TestAgent: Node info in sync 30:53.142 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:53.191 [INFO] TestAgent: Requesting shutdown 30:53.191 [INFO] TestAgent.server: shutting down server 30:53.191 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:53.196 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:53.204Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:53.204Z [INFO] agent.router.manager: shutting down 30:53.209 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 30:53.209 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 30:53.210 [INFO] TestAgent: consul server down 30:53.210 [INFO] TestAgent: shutdown complete 30:53.210 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30324 network=tcp 30:53.210 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30324 network=udp 30:53.210 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30325 network=tcp 30:53.712 [INFO] TestAgent: Waiting for endpoints to shut down 30:53.712 [INFO] TestAgent: Endpoints down --- PASS: TestServiceManager_RegisterService (0.89s) === RUN TestServiceManager_RegisterSidecar [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:53.751Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:53.791Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:53.884 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3dc83da0-3204-088f-5003-70d69903a4de Address:127.0.0.1:30336}]" 30:53.885 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3dc83da0-3204-088f-5003-70d69903a4de.dc1 127.0.0.1 30:53.885 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3dc83da0-3204-088f-5003-70d69903a4de 127.0.0.1 2021-10-05T16:30:53.885Z [INFO] agent.router: Initializing LAN area manager 30:53.886 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30331 network=udp 30:53.886 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30336 [Follower]" leader= 30:53.886 [INFO] TestAgent.server: Adding LAN server: server="Node-3dc83da0-3204-088f-5003-70d69903a4de (Addr: tcp/127.0.0.1:30336) (DC: dc1)" 30:53.886 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3dc83da0-3204-088f-5003-70d69903a4de.dc1 area=wan 30:53.886 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30331 network=tcp 30:53.887 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30332 network=tcp 30:53.887 [INFO] TestAgent: started state syncer 30:53.887 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30337 network=tcp 30:53.935 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:53.935 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30336 [Candidate]" term=2 30:53.945 [DEBUG] TestAgent.server.raft: votes: needed=1 30:53.945 [DEBUG] TestAgent.server.raft: vote granted: from=3dc83da0-3204-088f-5003-70d69903a4de term=2 tally=1 30:53.945 [INFO] TestAgent.server.raft: election won: tally=1 30:53.945 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30336 [Leader]" 30:53.945 [INFO] TestAgent.server: cluster leadership acquired 30:53.945 [INFO] TestAgent.server: New leader elected: payload=Node-3dc83da0-3204-088f-5003-70d69903a4de 30:53.955 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30336 30:53.975 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:54.009 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:54.009 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:54.009 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:54.009 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:54.009 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:54.009 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3dc83da0-3204-088f-5003-70d69903a4de 30:54.009 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3dc83da0-3204-088f-5003-70d69903a4de 30:54.033 [INFO] TestAgent.server: federation state anti-entropy synced 30:54.041 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 30:54.041 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 30:54.041 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 30:54.041 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 30:54.051 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 30:54.051 [INFO] TestAgent: Requesting shutdown 30:54.051 [INFO] TestAgent.server: shutting down server 30:54.051 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:54.051 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:54.051 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:54.051 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:54.051 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:54.051 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:54.051 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:54.051 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:54.051 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:54.051 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:54.051 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:54.059 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:54.088Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:54.088Z [INFO] agent.router.manager: shutting down 30:54.088 [INFO] TestAgent: consul server down 30:54.088 [INFO] TestAgent: shutdown complete 30:54.088 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30331 network=tcp 30:54.088 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30331 network=udp 30:54.088 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30332 network=tcp 30:54.596 [INFO] TestAgent: Waiting for endpoints to shut down 30:54.596 [INFO] TestAgent: Endpoints down --- PASS: TestServiceManager_RegisterSidecar (0.88s) === RUN TestServiceManager_RegisterMeshGateway [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:54.642Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:54.658Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:54.690 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:71e9cfb8-f69e-cdd2-7184-3523f3c26eb2 Address:127.0.0.1:30343}]" 30:54.691 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-71e9cfb8-f69e-cdd2-7184-3523f3c26eb2.dc1 127.0.0.1 30:54.691 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-71e9cfb8-f69e-cdd2-7184-3523f3c26eb2 127.0.0.1 2021-10-05T16:30:54.691Z [INFO] agent.router: Initializing LAN area manager 30:54.692 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30343 [Follower]" leader= 30:54.692 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30338 network=udp 30:54.692 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30338 network=tcp 30:54.692 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-71e9cfb8-f69e-cdd2-7184-3523f3c26eb2.dc1 area=wan 30:54.692 [INFO] TestAgent.server: Adding LAN server: server="Node-71e9cfb8-f69e-cdd2-7184-3523f3c26eb2 (Addr: tcp/127.0.0.1:30343) (DC: dc1)" 30:54.692 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30339 network=tcp 30:54.692 [INFO] TestAgent: started state syncer 30:54.692 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30344 network=tcp 30:54.760 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:54.760 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30343 [Candidate]" term=2 30:54.778 [DEBUG] TestAgent.server.raft: votes: needed=1 30:54.778 [DEBUG] TestAgent.server.raft: vote granted: from=71e9cfb8-f69e-cdd2-7184-3523f3c26eb2 term=2 tally=1 30:54.778 [INFO] TestAgent.server.raft: election won: tally=1 30:54.778 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30343 [Leader]" 30:54.778 [INFO] TestAgent.server: cluster leadership acquired 30:54.778 [INFO] TestAgent.server: New leader elected: payload=Node-71e9cfb8-f69e-cdd2-7184-3523f3c26eb2 30:54.784 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30343 30:54.808 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:54.834 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:54.834 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:54.834 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:54.834 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:54.834 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:54.834 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-71e9cfb8-f69e-cdd2-7184-3523f3c26eb2 30:54.834 [INFO] TestAgent.server: member joined, marking health alive: member=Node-71e9cfb8-f69e-cdd2-7184-3523f3c26eb2 30:54.835 [INFO] TestAgent: Synced node info 30:54.835 [DEBUG] TestAgent: Node info in sync 30:54.855 [INFO] TestAgent.server: federation state anti-entropy synced 30:55.023 [DEBUG] TestAgent: added local registration for service: service=mesh-gateway 30:55.023 [INFO] TestAgent: Requesting shutdown 30:55.024 [INFO] TestAgent.server: shutting down server 30:55.024 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:55.024 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:55.024 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:55.024 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:55.024 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:55.024 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:55.024 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:55.024 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:55.024 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:55.024 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:55.029 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:55.029Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:55.029Z [INFO] agent.router.manager: shutting down 30:55.029 [INFO] TestAgent: consul server down 30:55.029 [INFO] TestAgent: shutdown complete 30:55.029 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30338 network=tcp 30:55.029 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30338 network=udp 30:55.029 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30339 network=tcp 30:55.532 [INFO] TestAgent: Waiting for endpoints to shut down 30:55.532 [INFO] TestAgent: Endpoints down --- PASS: TestServiceManager_RegisterMeshGateway (0.94s) === RUN TestServiceManager_RegisterTerminatingGateway [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:55.559Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:55.593Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:55.646 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6c0b5397-fbe2-4fa0-6579-1617b6bcc437 Address:127.0.0.1:30350}]" 30:55.646 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30350 [Follower]" leader= 30:55.647 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6c0b5397-fbe2-4fa0-6579-1617b6bcc437.dc1 127.0.0.1 30:55.647 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6c0b5397-fbe2-4fa0-6579-1617b6bcc437 127.0.0.1 2021-10-05T16:30:55.647Z [INFO] agent.router: Initializing LAN area manager 30:55.647 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30345 network=udp 30:55.648 [INFO] TestAgent.server: Adding LAN server: server="Node-6c0b5397-fbe2-4fa0-6579-1617b6bcc437 (Addr: tcp/127.0.0.1:30350) (DC: dc1)" 30:55.648 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6c0b5397-fbe2-4fa0-6579-1617b6bcc437.dc1 area=wan 30:55.648 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30345 network=tcp 30:55.648 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30346 network=tcp 30:55.649 [INFO] TestAgent: started state syncer 30:55.649 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30351 network=tcp 30:55.708 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:55.708 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30350 [Candidate]" term=2 30:55.721 [DEBUG] TestAgent.server.raft: votes: needed=1 30:55.721 [DEBUG] TestAgent.server.raft: vote granted: from=6c0b5397-fbe2-4fa0-6579-1617b6bcc437 term=2 tally=1 30:55.721 [INFO] TestAgent.server.raft: election won: tally=1 30:55.721 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30350 [Leader]" 30:55.721 [INFO] TestAgent.server: cluster leadership acquired 30:55.721 [INFO] TestAgent.server: New leader elected: payload=Node-6c0b5397-fbe2-4fa0-6579-1617b6bcc437 30:55.750 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30350 30:55.790 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:55.825 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:55.825 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:55.825 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:55.825 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:55.825 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:55.826 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6c0b5397-fbe2-4fa0-6579-1617b6bcc437 30:55.826 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6c0b5397-fbe2-4fa0-6579-1617b6bcc437 30:55.858 [INFO] TestAgent.server: federation state anti-entropy synced 30:55.863 [WARN] TestAgent.server.catalog: no terminating-gateway or ingress-gateway associated with this gateway: gateway=terminating-gateway 30:55.864 [WARN] TestAgent.server.catalog: no terminating-gateway or ingress-gateway associated with this gateway: gateway=terminating-gateway 30:55.886 [DEBUG] TestAgent: added local registration for service: service=terminating-gateway 30:55.886 [INFO] TestAgent: Requesting shutdown 30:55.886 [INFO] TestAgent.server: shutting down server 30:55.886 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:55.886 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:55.886 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:55.886 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:55.886 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:55.886 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:55.886 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:55.887 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:55.887 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:55.887 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:55.887 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:55.891 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:55.891Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:55.891Z [INFO] agent.router.manager: shutting down 30:55.891 [INFO] TestAgent: consul server down 30:55.891 [INFO] TestAgent: shutdown complete 30:55.891 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30345 network=tcp 30:55.891 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30345 network=udp 30:55.891 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30346 network=tcp 30:56.392 [INFO] TestAgent: Waiting for endpoints to shut down 30:56.392 [INFO] TestAgent: Endpoints down --- PASS: TestServiceManager_RegisterTerminatingGateway (0.86s) === RUN TestServiceManager_PersistService_API service_manager_test.go:264: DM-disabled --- SKIP: TestServiceManager_PersistService_API (0.00s) === RUN TestServiceManager_PersistService_ConfigFiles === PAUSE TestServiceManager_PersistService_ConfigFiles === RUN TestServiceManager_Disabled [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:56.411Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:56.426Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:56.518 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2acc50cf-1c5f-0877-bae3-1e0a47a8adf6 Address:127.0.0.1:30357}]" 30:56.518 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30357 [Follower]" leader= 30:56.519 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2acc50cf-1c5f-0877-bae3-1e0a47a8adf6.dc1 127.0.0.1 30:56.520 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2acc50cf-1c5f-0877-bae3-1e0a47a8adf6 127.0.0.1 2021-10-05T16:30:56.520Z [INFO] agent.router: Initializing LAN area manager 30:56.520 [INFO] TestAgent.server: Adding LAN server: server="Node-2acc50cf-1c5f-0877-bae3-1e0a47a8adf6 (Addr: tcp/127.0.0.1:30357) (DC: dc1)" 30:56.520 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2acc50cf-1c5f-0877-bae3-1e0a47a8adf6.dc1 area=wan 30:56.520 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30352 network=tcp 30:56.520 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30352 network=udp 30:56.521 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30353 network=tcp 30:56.521 [INFO] TestAgent: started state syncer 30:56.521 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30358 network=tcp 30:56.565 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:56.565 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30357 [Candidate]" term=2 30:56.573 [DEBUG] TestAgent.server.raft: votes: needed=1 30:56.573 [DEBUG] TestAgent.server.raft: vote granted: from=2acc50cf-1c5f-0877-bae3-1e0a47a8adf6 term=2 tally=1 30:56.573 [INFO] TestAgent.server.raft: election won: tally=1 30:56.573 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30357 [Leader]" 30:56.576 [INFO] TestAgent.server: cluster leadership acquired 30:56.576 [INFO] TestAgent.server: New leader elected: payload=Node-2acc50cf-1c5f-0877-bae3-1e0a47a8adf6 30:56.579 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30357 30:56.591 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:56.644 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:56.644 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:56.644 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:56.644 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:56.644 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:56.644 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2acc50cf-1c5f-0877-bae3-1e0a47a8adf6 30:56.644 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2acc50cf-1c5f-0877-bae3-1e0a47a8adf6 30:56.676 [INFO] TestAgent.server: federation state anti-entropy synced 30:56.852 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:56.872 [INFO] TestAgent: Synced node info 30:56.956 [INFO] TestAgent: Requesting shutdown 30:56.956 [INFO] TestAgent.server: shutting down server 30:56.956 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:56.956 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:56.956 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:56.956 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:56.956 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:56.957 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:56.957 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:56.957 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:56.957 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:56.957 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:56.968 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:56.980Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:56.980Z [INFO] agent.router.manager: shutting down 30:56.980 [INFO] TestAgent: consul server down 30:56.980 [INFO] TestAgent: shutdown complete 30:56.980 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30352 network=tcp 30:56.980 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30352 network=udp 30:56.980 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30353 network=tcp 30:57.481 [INFO] TestAgent: Waiting for endpoints to shut down 30:57.481 [INFO] TestAgent: Endpoints down --- PASS: TestServiceManager_Disabled (1.09s) === RUN TestSessionCreate === PAUSE TestSessionCreate === RUN TestSessionCreate_NodeChecks === PAUSE TestSessionCreate_NodeChecks === RUN TestSessionCreate_Delete === PAUSE TestSessionCreate_Delete === RUN TestSessionCreate_DefaultCheck === PAUSE TestSessionCreate_DefaultCheck === RUN TestSessionCreate_NoCheck === PAUSE TestSessionCreate_NoCheck === RUN TestSessionDestroy === PAUSE TestSessionDestroy === RUN TestSessionCustomTTL === PAUSE TestSessionCustomTTL === RUN TestSessionTTLRenew session_endpoint_test.go:493: DM-skipped --- SKIP: TestSessionTTLRenew (0.00s) === RUN TestSessionGet === PAUSE TestSessionGet === RUN TestSessionList === RUN TestSessionList/#00 [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:57.495Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:57.509Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:57.549 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47 Address:127.0.0.1:30364}]" 30:57.550 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47.dc1 127.0.0.1 30:57.550 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47 127.0.0.1 2021-10-05T16:30:57.550Z [INFO] agent.router: Initializing LAN area manager 30:57.550 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30359 network=udp 30:57.550 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30364 [Follower]" leader= 30:57.551 [INFO] TestAgent.server: Adding LAN server: server="Node-ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47 (Addr: tcp/127.0.0.1:30364) (DC: dc1)" 30:57.551 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47.dc1 area=wan 30:57.551 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30359 network=tcp 30:57.551 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30360 network=tcp 30:57.551 [INFO] TestAgent: started state syncer 30:57.551 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30365 network=tcp 30:57.600 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:57.600 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30364 [Candidate]" term=2 30:57.642 [DEBUG] TestAgent.server.raft: votes: needed=1 30:57.643 [DEBUG] TestAgent.server.raft: vote granted: from=ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47 term=2 tally=1 30:57.643 [INFO] TestAgent.server.raft: election won: tally=1 30:57.643 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30364 [Leader]" 30:57.643 [INFO] TestAgent.server: cluster leadership acquired 30:57.643 [INFO] TestAgent.server: New leader elected: payload=Node-ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47 30:57.659 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30364 30:57.696 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:57.742 [INFO] TestAgent: Synced node info 30:57.742 [DEBUG] TestAgent: Node info in sync 30:57.748 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:57.748 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:57.748 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:57.748 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:57.748 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:57.748 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47 30:57.748 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ea6e528b-6bc5-e9e7-57ea-6bb66a7b5b47 30:57.767 [INFO] TestAgent.server: federation state anti-entropy synced 30:57.780 [INFO] TestAgent: Requesting shutdown 30:57.780 [INFO] TestAgent.server: shutting down server 30:57.780 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:57.780 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:57.780 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:57.780 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:57.780 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:57.780 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:57.780 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:57.780 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:57.780 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:57.780 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:57.788 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:57.800Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:57.800Z [INFO] agent.router.manager: shutting down 30:57.800 [INFO] TestAgent: consul server down 30:57.800 [INFO] TestAgent: shutdown complete 30:57.800 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30359 network=tcp 30:57.800 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30359 network=udp 30:57.800 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30360 network=tcp 30:58.304 [INFO] TestAgent: Waiting for endpoints to shut down 30:58.304 [INFO] TestAgent: Endpoints down === RUN TestSessionList/#01 [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:58.337Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:58.363Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:58.448 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d8365a2c-20eb-d7ca-4e96-fb53cfd50638 Address:127.0.0.1:30371}]" 30:58.448 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30371 [Follower]" leader= 30:58.449 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d8365a2c-20eb-d7ca-4e96-fb53cfd50638.dc1 127.0.0.1 30:58.449 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d8365a2c-20eb-d7ca-4e96-fb53cfd50638 127.0.0.1 2021-10-05T16:30:58.449Z [INFO] agent.router: Initializing LAN area manager 30:58.450 [INFO] TestAgent.server: Adding LAN server: server="Node-d8365a2c-20eb-d7ca-4e96-fb53cfd50638 (Addr: tcp/127.0.0.1:30371) (DC: dc1)" 30:58.450 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d8365a2c-20eb-d7ca-4e96-fb53cfd50638.dc1 area=wan 30:58.450 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30366 network=udp 30:58.450 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30366 network=tcp 30:58.450 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30367 network=tcp 30:58.451 [INFO] TestAgent: started state syncer 30:58.451 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30372 network=tcp 30:58.517 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:58.517 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30371 [Candidate]" term=2 30:58.564 [DEBUG] TestAgent.server.raft: votes: needed=1 30:58.564 [DEBUG] TestAgent.server.raft: vote granted: from=d8365a2c-20eb-d7ca-4e96-fb53cfd50638 term=2 tally=1 30:58.564 [INFO] TestAgent.server.raft: election won: tally=1 30:58.564 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30371 [Leader]" 30:58.564 [INFO] TestAgent.server: cluster leadership acquired 30:58.564 [INFO] TestAgent.server: New leader elected: payload=Node-d8365a2c-20eb-d7ca-4e96-fb53cfd50638 30:58.596 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30371 30:58.636 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:58.683 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:58.683 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:58.683 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:58.683 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:58.683 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:58.683 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d8365a2c-20eb-d7ca-4e96-fb53cfd50638 30:58.683 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d8365a2c-20eb-d7ca-4e96-fb53cfd50638 30:58.726 [INFO] TestAgent.server: federation state anti-entropy synced 30:58.860 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:58.878 [INFO] TestAgent: Synced node info 30:58.912 [INFO] TestAgent: Requesting shutdown 30:58.912 [INFO] TestAgent.server: shutting down server 30:58.912 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:58.912 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:58.912 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:58.912 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:58.912 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:58.912 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:58.912 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:58.912 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:58.912 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:58.912 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:58.918 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:58.923Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:58.923Z [INFO] agent.router.manager: shutting down 30:58.923 [INFO] TestAgent: consul server down 30:58.923 [INFO] TestAgent: shutdown complete 30:58.923 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30366 network=tcp 30:58.923 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30366 network=udp 30:58.924 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30367 network=tcp 30:59.427 [INFO] TestAgent: Waiting for endpoints to shut down 30:59.427 [INFO] TestAgent: Endpoints down --- PASS: TestSessionList (1.95s) --- PASS: TestSessionList/#00 (0.82s) --- PASS: TestSessionList/#01 (1.12s) === RUN TestSessionsForNode session_endpoint_test.go:677: DM-skipped --- SKIP: TestSessionsForNode (0.00s) === RUN TestSessionDeleteDestroy === PAUSE TestSessionDeleteDestroy === RUN TestAgent_sidecarServiceFromNodeService === RUN TestAgent_sidecarServiceFromNodeService/no_sidecar [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:30:59.451Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:59.482Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:59.538 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:200a4cd4-6b73-3e1e-611b-faee6771e207 Address:127.0.0.1:30378}]" 30:59.539 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-200a4cd4-6b73-3e1e-611b-faee6771e207.dc1 127.0.0.1 30:59.540 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:30378 [Follower]" leader= 30:59.540 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-200a4cd4-6b73-3e1e-611b-faee6771e207 127.0.0.1 2021-10-05T16:30:59.540Z [INFO] agent.router: Initializing LAN area manager 30:59.540 [INFO] jones.server: Adding LAN server: server="Node-200a4cd4-6b73-3e1e-611b-faee6771e207 (Addr: tcp/127.0.0.1:30378) (DC: dc1)" 30:59.540 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-200a4cd4-6b73-3e1e-611b-faee6771e207.dc1 area=wan 30:59.540 [INFO] jones: Started DNS server: address=127.0.0.1:30373 network=udp 30:59.540 [INFO] jones: Started DNS server: address=127.0.0.1:30373 network=tcp 30:59.541 [INFO] jones: Started HTTP server: address=127.0.0.1:30374 network=tcp 30:59.541 [INFO] jones: started state syncer 30:59.541 [INFO] jones: Started gRPC server: address=127.0.0.1:30379 network=tcp 30:59.584 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 30:59.584 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:30378 [Candidate]" term=2 30:59.632 [DEBUG] jones.server.raft: votes: needed=1 30:59.632 [DEBUG] jones.server.raft: vote granted: from=200a4cd4-6b73-3e1e-611b-faee6771e207 term=2 tally=1 30:59.632 [INFO] jones.server.raft: election won: tally=1 30:59.632 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:30378 [Leader]" 30:59.632 [INFO] jones.server: cluster leadership acquired 30:59.632 [INFO] jones.server: New leader elected: payload=Node-200a4cd4-6b73-3e1e-611b-faee6771e207 30:59.653 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30378 30:59.670 [INFO] jones: Synced node info 30:59.670 [DEBUG] jones: Node info in sync 30:59.702 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:59.728 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 30:59.728 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 30:59.728 [INFO] jones.leader: started routine: routine="federation state pruning" 30:59.728 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 30:59.728 [INFO] jones.leader: started routine: routine="CA root pruning" 30:59.728 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-200a4cd4-6b73-3e1e-611b-faee6771e207 30:59.728 [INFO] jones.server: member joined, marking health alive: member=Node-200a4cd4-6b73-3e1e-611b-faee6771e207 30:59.767 [INFO] jones.server: federation state anti-entropy synced 30:59.908 [INFO] jones: Requesting shutdown 30:59.908 [INFO] jones.server: shutting down server 30:59.908 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 30:59.908 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 30:59.908 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 30:59.908 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 30:59.908 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 30:59.908 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 30:59.908 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 30:59.908 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 30:59.908 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 30:59.908 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 30:59.916 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:59.923Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:59.923Z [INFO] agent.router.manager: shutting down 30:59.923 [INFO] jones: consul server down 30:59.923 [INFO] jones: shutdown complete 30:59.923 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30373 network=tcp 30:59.924 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30373 network=udp 30:59.924 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:30374 network=tcp 31:00.424 [INFO] jones: Waiting for endpoints to shut down 31:00.424 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/all_the_defaults [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:00.460Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:00.471Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:00.500 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2304aed1-3198-ca22-0a89-641d448fe985 Address:127.0.0.1:30385}]" 31:00.501 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-2304aed1-3198-ca22-0a89-641d448fe985.dc1 127.0.0.1 31:00.502 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-2304aed1-3198-ca22-0a89-641d448fe985 127.0.0.1 2021-10-05T16:31:00.502Z [INFO] agent.router: Initializing LAN area manager 31:00.502 [INFO] jones: Started DNS server: address=127.0.0.1:30380 network=udp 31:00.502 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:30385 [Follower]" leader= 31:00.503 [INFO] jones.server: Adding LAN server: server="Node-2304aed1-3198-ca22-0a89-641d448fe985 (Addr: tcp/127.0.0.1:30385) (DC: dc1)" 31:00.503 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-2304aed1-3198-ca22-0a89-641d448fe985.dc1 area=wan 31:00.503 [INFO] jones: Started DNS server: address=127.0.0.1:30380 network=tcp 31:00.503 [INFO] jones: Started HTTP server: address=127.0.0.1:30381 network=tcp 31:00.503 [INFO] jones: started state syncer 31:00.504 [INFO] jones: Started gRPC server: address=127.0.0.1:30386 network=tcp 31:00.556 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:00.556 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:30385 [Candidate]" term=2 31:00.600 [DEBUG] jones.server.raft: votes: needed=1 31:00.600 [DEBUG] jones.server.raft: vote granted: from=2304aed1-3198-ca22-0a89-641d448fe985 term=2 tally=1 31:00.600 [INFO] jones.server.raft: election won: tally=1 31:00.600 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:30385 [Leader]" 31:00.600 [INFO] jones.server: cluster leadership acquired 31:00.600 [INFO] jones.server: New leader elected: payload=Node-2304aed1-3198-ca22-0a89-641d448fe985 31:00.606 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30385 31:00.652 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:00.711 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:00.711 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:00.711 [INFO] jones.leader: started routine: routine="federation state pruning" 31:00.711 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:00.711 [INFO] jones.leader: started routine: routine="CA root pruning" 31:00.711 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-2304aed1-3198-ca22-0a89-641d448fe985 31:00.711 [INFO] jones.server: member joined, marking health alive: member=Node-2304aed1-3198-ca22-0a89-641d448fe985 31:00.747 [DEBUG] jones: Skipping remote check since it is managed automatically: check=serfHealth 31:00.772 [INFO] jones: Synced node info 31:00.772 [INFO] jones: Requesting shutdown 31:00.772 [INFO] jones.server: shutting down server 31:00.772 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:00.772 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:00.772 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:00.772 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:00.772 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:00.772 [INFO] jones.server: federation state anti-entropy synced 31:00.772 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:00.772 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:00.772 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:00.772 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:00.777 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:00.792Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:00.792Z [INFO] agent.router.manager: shutting down 31:00.792 [INFO] jones: consul server down 31:00.792 [INFO] jones: shutdown complete 31:00.792 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30380 network=tcp 31:00.792 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30380 network=udp 31:00.792 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:30381 network=tcp 31:01.292 [INFO] jones: Waiting for endpoints to shut down 31:01.292 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/all_the_allowed_overrides [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:01.310Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:01.327Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:01.440 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:00033d72-6b94-d4d9-524c-26ffb82367e2 Address:127.0.0.1:30392}]" 31:01.441 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:30392 [Follower]" leader= 31:01.441 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-00033d72-6b94-d4d9-524c-26ffb82367e2.dc1 127.0.0.1 31:01.441 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-00033d72-6b94-d4d9-524c-26ffb82367e2 127.0.0.1 2021-10-05T16:31:01.441Z [INFO] agent.router: Initializing LAN area manager 31:01.442 [INFO] jones: Started DNS server: address=127.0.0.1:30387 network=udp 31:01.442 [INFO] jones.server: Adding LAN server: server="Node-00033d72-6b94-d4d9-524c-26ffb82367e2 (Addr: tcp/127.0.0.1:30392) (DC: dc1)" 31:01.442 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-00033d72-6b94-d4d9-524c-26ffb82367e2.dc1 area=wan 31:01.442 [INFO] jones: Started DNS server: address=127.0.0.1:30387 network=tcp 31:01.443 [INFO] jones: Started HTTP server: address=127.0.0.1:30388 network=tcp 31:01.443 [INFO] jones: started state syncer 31:01.443 [INFO] jones: Started gRPC server: address=127.0.0.1:30393 network=tcp 31:01.482 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:01.482 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:30392 [Candidate]" term=2 31:01.496 [DEBUG] jones.server.raft: votes: needed=1 31:01.496 [DEBUG] jones.server.raft: vote granted: from=00033d72-6b94-d4d9-524c-26ffb82367e2 term=2 tally=1 31:01.496 [INFO] jones.server.raft: election won: tally=1 31:01.496 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:30392 [Leader]" 31:01.496 [INFO] jones.server: cluster leadership acquired 31:01.496 [INFO] jones.server: New leader elected: payload=Node-00033d72-6b94-d4d9-524c-26ffb82367e2 31:01.529 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30392 31:01.552 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:01.591 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:01.591 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:01.591 [INFO] jones.leader: started routine: routine="federation state pruning" 31:01.591 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:01.591 [INFO] jones.leader: started routine: routine="CA root pruning" 31:01.591 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-00033d72-6b94-d4d9-524c-26ffb82367e2 31:01.592 [INFO] jones.server: member joined, marking health alive: member=Node-00033d72-6b94-d4d9-524c-26ffb82367e2 31:01.611 [INFO] jones.server: federation state anti-entropy synced 31:01.614 [DEBUG] jones: Skipping remote check since it is managed automatically: check=serfHealth 31:01.628 [INFO] jones: Synced node info 31:01.628 [DEBUG] jones: Node info in sync 31:01.848 [INFO] jones: Requesting shutdown 31:01.848 [INFO] jones.server: shutting down server 31:01.848 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:01.848 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:01.848 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:01.848 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:01.848 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:01.848 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 31:01.848 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:01.848 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:01.848 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:01.848 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:01.860 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:01.872Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:01.872Z [INFO] agent.router.manager: shutting down 31:01.872 [INFO] jones: consul server down 31:01.872 [INFO] jones: shutdown complete 31:01.872 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30387 network=tcp 31:01.872 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30387 network=udp 31:01.872 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:30388 network=tcp 31:02.372 [INFO] jones: Waiting for endpoints to shut down 31:02.372 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/no_auto_ports_available [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:02.389Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:02.422Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:02.463 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3a155d90-9aaf-1594-4db0-637f04efdb77 Address:127.0.0.1:30399}]" 31:02.463 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:30399 [Follower]" leader= 31:02.464 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-3a155d90-9aaf-1594-4db0-637f04efdb77.dc1 127.0.0.1 31:02.464 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-3a155d90-9aaf-1594-4db0-637f04efdb77 127.0.0.1 2021-10-05T16:31:02.464Z [INFO] agent.router: Initializing LAN area manager 31:02.465 [INFO] jones: Started DNS server: address=127.0.0.1:30394 network=udp 31:02.465 [INFO] jones.server: Adding LAN server: server="Node-3a155d90-9aaf-1594-4db0-637f04efdb77 (Addr: tcp/127.0.0.1:30399) (DC: dc1)" 31:02.465 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-3a155d90-9aaf-1594-4db0-637f04efdb77.dc1 area=wan 31:02.465 [INFO] jones: Started DNS server: address=127.0.0.1:30394 network=tcp 31:02.466 [INFO] jones: Started HTTP server: address=127.0.0.1:30395 network=tcp 31:02.466 [INFO] jones: started state syncer 31:02.466 [INFO] jones: Started gRPC server: address=127.0.0.1:30400 network=tcp 31:02.533 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:02.533 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:30399 [Candidate]" term=2 31:02.544 [DEBUG] jones.server.raft: votes: needed=1 31:02.544 [DEBUG] jones.server.raft: vote granted: from=3a155d90-9aaf-1594-4db0-637f04efdb77 term=2 tally=1 31:02.544 [INFO] jones.server.raft: election won: tally=1 31:02.544 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:30399 [Leader]" 31:02.544 [INFO] jones.server: cluster leadership acquired 31:02.544 [INFO] jones.server: New leader elected: payload=Node-3a155d90-9aaf-1594-4db0-637f04efdb77 31:02.552 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30399 31:02.592 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:02.688 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:02.688 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:02.688 [INFO] jones.leader: started routine: routine="federation state pruning" 31:02.688 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:02.688 [INFO] jones.leader: started routine: routine="CA root pruning" 31:02.688 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-3a155d90-9aaf-1594-4db0-637f04efdb77 31:02.688 [INFO] jones.server: member joined, marking health alive: member=Node-3a155d90-9aaf-1594-4db0-637f04efdb77 31:02.769 [INFO] jones: Synced node info 31:02.784 [INFO] jones.server: federation state anti-entropy synced 31:02.891 [INFO] jones: Requesting shutdown 31:02.891 [INFO] jones.server: shutting down server 31:02.892 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:02.892 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:02.892 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:02.892 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:02.892 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:02.892 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 31:02.892 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:02.892 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:02.892 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:02.892 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:02.897 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:02.898Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:02.898Z [INFO] agent.router.manager: shutting down 31:02.898 [INFO] jones: consul server down 31:02.898 [INFO] jones: shutdown complete 31:02.898 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30394 network=tcp 31:02.898 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30394 network=udp 31:02.898 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:30395 network=tcp 31:03.400 [INFO] jones: Waiting for endpoints to shut down 31:03.400 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/auto_ports_disabled [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:03.450Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:03.497Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:03.556 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:25d1edb7-a18c-25d3-7994-6474993f404e Address:127.0.0.1:30406}]" 31:03.557 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-25d1edb7-a18c-25d3-7994-6474993f404e.dc1 127.0.0.1 31:03.558 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-25d1edb7-a18c-25d3-7994-6474993f404e 127.0.0.1 2021-10-05T16:31:03.558Z [INFO] agent.router: Initializing LAN area manager 31:03.558 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:30406 [Follower]" leader= 31:03.559 [INFO] jones: Started DNS server: address=127.0.0.1:30401 network=udp 31:03.559 [INFO] jones.server: Adding LAN server: server="Node-25d1edb7-a18c-25d3-7994-6474993f404e (Addr: tcp/127.0.0.1:30406) (DC: dc1)" 31:03.559 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-25d1edb7-a18c-25d3-7994-6474993f404e.dc1 area=wan 31:03.559 [INFO] jones: Started DNS server: address=127.0.0.1:30401 network=tcp 31:03.559 [INFO] jones: Started HTTP server: address=127.0.0.1:30402 network=tcp 31:03.560 [INFO] jones: started state syncer 31:03.560 [INFO] jones: Started gRPC server: address=127.0.0.1:30407 network=tcp 31:03.599 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:03.599 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:30406 [Candidate]" term=2 31:03.618 [DEBUG] jones.server.raft: votes: needed=1 31:03.618 [DEBUG] jones.server.raft: vote granted: from=25d1edb7-a18c-25d3-7994-6474993f404e term=2 tally=1 31:03.618 [INFO] jones.server.raft: election won: tally=1 31:03.618 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:30406 [Leader]" 31:03.618 [INFO] jones.server: cluster leadership acquired 31:03.618 [INFO] jones.server: New leader elected: payload=Node-25d1edb7-a18c-25d3-7994-6474993f404e 31:03.626 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30406 31:03.638 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:03.672 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:03.672 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:03.672 [INFO] jones.leader: started routine: routine="federation state pruning" 31:03.672 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:03.672 [INFO] jones.leader: started routine: routine="CA root pruning" 31:03.672 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-25d1edb7-a18c-25d3-7994-6474993f404e 31:03.672 [INFO] jones.server: member joined, marking health alive: member=Node-25d1edb7-a18c-25d3-7994-6474993f404e 31:03.706 [INFO] jones.server: federation state anti-entropy synced 31:03.836 [INFO] jones: Requesting shutdown 31:03.836 [INFO] jones.server: shutting down server 31:03.836 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:03.836 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:03.836 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:03.836 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:03.836 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:03.836 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 31:03.836 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:03.836 [ERROR] jones.anti_entropy: failed to sync remote state: error="No cluster leader" 31:03.836 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:03.836 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:03.836 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:03.848 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:03.860Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:03.860Z [INFO] agent.router.manager: shutting down 31:03.860 [INFO] jones: consul server down 31:03.860 [INFO] jones: shutdown complete 31:03.860 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30401 network=tcp 31:03.860 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30401 network=udp 31:03.860 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:30402 network=tcp 31:04.363 [INFO] jones: Waiting for endpoints to shut down 31:04.363 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/inherit_tags_and_meta [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:04.404Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:04.421Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:04.468 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2 Address:127.0.0.1:30413}]" 31:04.469 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2.dc1 127.0.0.1 31:04.469 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2 127.0.0.1 2021-10-05T16:31:04.469Z [INFO] agent.router: Initializing LAN area manager 31:04.469 [INFO] jones: Started DNS server: address=127.0.0.1:30408 network=udp 31:04.470 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:30413 [Follower]" leader= 31:04.470 [INFO] jones.server: Adding LAN server: server="Node-6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2 (Addr: tcp/127.0.0.1:30413) (DC: dc1)" 31:04.470 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2.dc1 area=wan 31:04.470 [INFO] jones: Started DNS server: address=127.0.0.1:30408 network=tcp 31:04.471 [INFO] jones: Started HTTP server: address=127.0.0.1:30409 network=tcp 31:04.471 [INFO] jones: started state syncer 31:04.471 [INFO] jones: Started gRPC server: address=127.0.0.1:30414 network=tcp 31:04.540 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:04.540 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:30413 [Candidate]" term=2 31:04.584 [DEBUG] jones.server.raft: votes: needed=1 31:04.584 [DEBUG] jones.server.raft: vote granted: from=6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2 term=2 tally=1 31:04.584 [INFO] jones.server.raft: election won: tally=1 31:04.584 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:30413 [Leader]" 31:04.584 [INFO] jones.server: cluster leadership acquired 31:04.584 [INFO] jones.server: New leader elected: payload=Node-6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2 31:04.616 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30413 31:04.668 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:04.728 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:04.728 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:04.728 [INFO] jones.leader: started routine: routine="federation state pruning" 31:04.728 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:04.728 [INFO] jones.leader: started routine: routine="CA root pruning" 31:04.728 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2 31:04.728 [INFO] jones.server: member joined, marking health alive: member=Node-6e9a6dd0-9f43-b7c3-c164-b5dbe729e6f2 31:04.736 [INFO] jones.server: federation state anti-entropy synced 31:04.780 [INFO] jones: Requesting shutdown 31:04.780 [INFO] jones.server: shutting down server 31:04.780 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:04.780 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:04.780 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:04.780 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:04.780 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:04.780 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 31:04.780 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:04.781 [ERROR] jones.anti_entropy: failed to sync remote state: error="No cluster leader" 31:04.781 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:04.781 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:04.781 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:04.786 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:04.804Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:04.804Z [INFO] agent.router.manager: shutting down 31:04.804 [INFO] jones: consul server down 31:04.804 [INFO] jones: shutdown complete 31:04.804 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30408 network=tcp 31:04.804 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30408 network=udp 31:04.804 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:30409 network=tcp 31:05.308 [INFO] jones: Waiting for endpoints to shut down 31:05.308 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/invalid_check_type [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:05.331Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:05.366Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:05.444 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c5d526fd-c62f-424c-e72a-9dec31314d57 Address:127.0.0.1:29400}]" 31:05.444 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:29400 [Follower]" leader= 31:05.445 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-c5d526fd-c62f-424c-e72a-9dec31314d57.dc1 127.0.0.1 31:05.445 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-c5d526fd-c62f-424c-e72a-9dec31314d57 127.0.0.1 2021-10-05T16:31:05.445Z [INFO] agent.router: Initializing LAN area manager 31:05.445 [INFO] jones.server: Adding LAN server: server="Node-c5d526fd-c62f-424c-e72a-9dec31314d57 (Addr: tcp/127.0.0.1:29400) (DC: dc1)" 31:05.445 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-c5d526fd-c62f-424c-e72a-9dec31314d57.dc1 area=wan 31:05.446 [INFO] jones: Started DNS server: address=127.0.0.1:30415 network=udp 31:05.446 [INFO] jones: Started DNS server: address=127.0.0.1:30415 network=tcp 31:05.446 [INFO] jones: Started HTTP server: address=127.0.0.1:30416 network=tcp 31:05.446 [INFO] jones: started state syncer 31:05.446 [INFO] jones: Started gRPC server: address=127.0.0.1:29401 network=tcp 31:05.490 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:05.490 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:29400 [Candidate]" term=2 31:05.511 [DEBUG] jones.server.raft: votes: needed=1 31:05.511 [DEBUG] jones.server.raft: vote granted: from=c5d526fd-c62f-424c-e72a-9dec31314d57 term=2 tally=1 31:05.511 [INFO] jones.server.raft: election won: tally=1 31:05.511 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:29400 [Leader]" 31:05.512 [INFO] jones.server: cluster leadership acquired 31:05.512 [INFO] jones.server: New leader elected: payload=Node-c5d526fd-c62f-424c-e72a-9dec31314d57 31:05.528 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29400 31:05.564 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:05.625 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:05.625 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:05.625 [INFO] jones.leader: started routine: routine="federation state pruning" 31:05.625 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:05.625 [INFO] jones.leader: started routine: routine="CA root pruning" 31:05.625 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-c5d526fd-c62f-424c-e72a-9dec31314d57 31:05.625 [INFO] jones.server: member joined, marking health alive: member=Node-c5d526fd-c62f-424c-e72a-9dec31314d57 31:05.638 [INFO] jones.server: federation state anti-entropy synced 31:05.775 [DEBUG] jones: Skipping remote check since it is managed automatically: check=serfHealth 31:05.779 [INFO] jones: Synced node info 31:05.786 [DEBUG] jones: Skipping remote check since it is managed automatically: check=serfHealth 31:05.786 [DEBUG] jones: Node info in sync 31:05.786 [DEBUG] jones: Node info in sync 31:05.868 [INFO] jones: Requesting shutdown 31:05.868 [INFO] jones.server: shutting down server 31:05.868 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:05.868 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:05.868 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:05.868 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:05.868 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:05.868 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 31:05.868 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:05.868 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:05.868 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:05.868 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:05.876 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:05.882Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:05.882Z [INFO] agent.router.manager: shutting down 31:05.882 [INFO] jones: consul server down 31:05.882 [INFO] jones: shutdown complete 31:05.882 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30415 network=tcp 31:05.882 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:30415 network=udp 31:05.882 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:30416 network=tcp 31:06.384 [INFO] jones: Waiting for endpoints to shut down 31:06.384 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/invalid_meta [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:06.399Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:06.414Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:06.441 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5809bcda-57a1-fa6e-41a1-e2447f9f4954 Address:127.0.0.1:29407}]" 31:06.442 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-5809bcda-57a1-fa6e-41a1-e2447f9f4954.dc1 127.0.0.1 31:06.443 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-5809bcda-57a1-fa6e-41a1-e2447f9f4954 127.0.0.1 2021-10-05T16:31:06.443Z [INFO] agent.router: Initializing LAN area manager 31:06.443 [INFO] jones: Started DNS server: address=127.0.0.1:29402 network=udp 31:06.443 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:29407 [Follower]" leader= 31:06.443 [INFO] jones.server: Adding LAN server: server="Node-5809bcda-57a1-fa6e-41a1-e2447f9f4954 (Addr: tcp/127.0.0.1:29407) (DC: dc1)" 31:06.443 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-5809bcda-57a1-fa6e-41a1-e2447f9f4954.dc1 area=wan 31:06.443 [INFO] jones: Started DNS server: address=127.0.0.1:29402 network=tcp 31:06.444 [INFO] jones: Started HTTP server: address=127.0.0.1:29403 network=tcp 31:06.444 [INFO] jones: started state syncer 31:06.444 [INFO] jones: Started gRPC server: address=127.0.0.1:29408 network=tcp 31:06.508 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:06.508 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:29407 [Candidate]" term=2 31:06.548 [DEBUG] jones.server.raft: votes: needed=1 31:06.548 [DEBUG] jones.server.raft: vote granted: from=5809bcda-57a1-fa6e-41a1-e2447f9f4954 term=2 tally=1 31:06.548 [INFO] jones.server.raft: election won: tally=1 31:06.548 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:29407 [Leader]" 31:06.552 [INFO] jones.server: cluster leadership acquired 31:06.552 [INFO] jones.server: New leader elected: payload=Node-5809bcda-57a1-fa6e-41a1-e2447f9f4954 31:06.567 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29407 31:06.582 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:06.640 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:06.640 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:06.640 [INFO] jones.leader: started routine: routine="federation state pruning" 31:06.640 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:06.640 [INFO] jones.leader: started routine: routine="CA root pruning" 31:06.640 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-5809bcda-57a1-fa6e-41a1-e2447f9f4954 31:06.640 [INFO] jones.server: member joined, marking health alive: member=Node-5809bcda-57a1-fa6e-41a1-e2447f9f4954 31:06.672 [INFO] jones.server: federation state anti-entropy synced 31:06.719 [INFO] jones: Requesting shutdown 31:06.719 [INFO] jones.server: shutting down server 31:06.719 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:06.719 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:06.719 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:06.719 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:06.719 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:06.719 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 31:06.719 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:06.719 [ERROR] jones.anti_entropy: failed to sync remote state: error="No cluster leader" 31:06.719 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:06.719 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:06.719 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:06.730 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:06.736Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:06.736Z [INFO] agent.router.manager: shutting down 31:06.736 [INFO] jones: consul server down 31:06.736 [INFO] jones: shutdown complete 31:06.736 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:29402 network=tcp 31:06.736 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:29402 network=udp 31:06.736 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:29403 network=tcp 31:07.240 [INFO] jones: Waiting for endpoints to shut down 31:07.240 [INFO] jones: Endpoints down === RUN TestAgent_sidecarServiceFromNodeService/re-registering_same_sidecar_with_no_port_should_pick_same_one [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:07.255Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:07.270Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:07.364 [INFO] jones.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a83c5b5d-865a-1aa5-809b-507dbe0c43c2 Address:127.0.0.1:29414}]" 31:07.365 [INFO] jones.server.serf.wan: serf: EventMemberJoin: Node-a83c5b5d-865a-1aa5-809b-507dbe0c43c2.dc1 127.0.0.1 31:07.365 [INFO] jones.server.serf.lan: serf: EventMemberJoin: Node-a83c5b5d-865a-1aa5-809b-507dbe0c43c2 127.0.0.1 2021-10-05T16:31:07.365Z [INFO] agent.router: Initializing LAN area manager 31:07.366 [INFO] jones: Started DNS server: address=127.0.0.1:29409 network=udp 31:07.366 [INFO] jones.server.raft: entering follower state: follower="Node at 127.0.0.1:29414 [Follower]" leader= 31:07.366 [INFO] jones.server: Adding LAN server: server="Node-a83c5b5d-865a-1aa5-809b-507dbe0c43c2 (Addr: tcp/127.0.0.1:29414) (DC: dc1)" 31:07.366 [INFO] jones.server: Handled event for server in area: event=member-join server=Node-a83c5b5d-865a-1aa5-809b-507dbe0c43c2.dc1 area=wan 31:07.366 [INFO] jones: Started DNS server: address=127.0.0.1:29409 network=tcp 31:07.367 [INFO] jones: Started HTTP server: address=127.0.0.1:29410 network=tcp 31:07.367 [INFO] jones: started state syncer 31:07.367 [INFO] jones: Started gRPC server: address=127.0.0.1:29415 network=tcp 31:07.436 [WARN] jones.server.raft: heartbeat timeout reached, starting election: last-leader= 31:07.436 [INFO] jones.server.raft: entering candidate state: node="Node at 127.0.0.1:29414 [Candidate]" term=2 31:07.465 [DEBUG] jones.server.raft: votes: needed=1 31:07.465 [DEBUG] jones.server.raft: vote granted: from=a83c5b5d-865a-1aa5-809b-507dbe0c43c2 term=2 tally=1 31:07.465 [INFO] jones.server.raft: election won: tally=1 31:07.465 [INFO] jones.server.raft: entering leader state: leader="Node at 127.0.0.1:29414 [Leader]" 31:07.468 [INFO] jones.server: cluster leadership acquired 31:07.468 [INFO] jones.server: New leader elected: payload=Node-a83c5b5d-865a-1aa5-809b-507dbe0c43c2 31:07.481 [DEBUG] jones.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29414 31:07.497 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:07.537 [INFO] jones.server.connect: initialized primary datacenter CA with provider: provider=consul 31:07.537 [INFO] jones.leader: started routine: routine="federation state anti-entropy" 31:07.537 [INFO] jones.leader: started routine: routine="federation state pruning" 31:07.537 [INFO] jones.leader: started routine: routine="intermediate cert renew watch" 31:07.537 [INFO] jones.leader: started routine: routine="CA root pruning" 31:07.538 [DEBUG] jones.server: Skipping self join check for node since the cluster is too small: node=Node-a83c5b5d-865a-1aa5-809b-507dbe0c43c2 31:07.538 [INFO] jones.server: member joined, marking health alive: member=Node-a83c5b5d-865a-1aa5-809b-507dbe0c43c2 31:07.550 [INFO] jones.server: federation state anti-entropy synced 31:07.751 [DEBUG] jones: Skipping remote check since it is managed automatically: check=serfHealth 31:07.760 [INFO] jones: Synced node info 31:07.760 [DEBUG] jones: Node info in sync 31:07.809 [INFO] jones: Requesting shutdown 31:07.809 [INFO] jones.server: shutting down server 31:07.809 [DEBUG] jones.leader: stopping routine: routine="federation state pruning" 31:07.809 [DEBUG] jones.leader: stopping routine: routine="intermediate cert renew watch" 31:07.809 [DEBUG] jones.leader: stopping routine: routine="CA root pruning" 31:07.809 [DEBUG] jones.leader: stopping routine: routine="federation state anti-entropy" 31:07.809 [WARN] jones.server.serf.lan: serf: Shutdown without a Leave 31:07.810 [ERROR] jones.server: error performing anti-entropy sync of federation state: error="context canceled" 31:07.810 [DEBUG] jones.leader: stopped routine: routine="federation state anti-entropy" 31:07.810 [DEBUG] jones.leader: stopped routine: routine="federation state pruning" 31:07.810 [DEBUG] jones.leader: stopped routine: routine="intermediate cert renew watch" 31:07.810 [DEBUG] jones.leader: stopped routine: routine="CA root pruning" 31:07.820 [WARN] jones.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:07.824Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:07.824Z [INFO] agent.router.manager: shutting down 31:07.824 [INFO] jones: consul server down 31:07.824 [INFO] jones: shutdown complete 31:07.824 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:29409 network=tcp 31:07.824 [INFO] jones: Stopping server: protocol=DNS address=127.0.0.1:29409 network=udp 31:07.824 [INFO] jones: Stopping server: protocol=HTTP address=127.0.0.1:29410 network=tcp 31:08.324 [INFO] jones: Waiting for endpoints to shut down 31:08.324 [INFO] jones: Endpoints down --- PASS: TestAgent_sidecarServiceFromNodeService (8.90s) --- PASS: TestAgent_sidecarServiceFromNodeService/no_sidecar (1.00s) --- PASS: TestAgent_sidecarServiceFromNodeService/all_the_defaults (0.87s) --- PASS: TestAgent_sidecarServiceFromNodeService/all_the_allowed_overrides (1.08s) --- PASS: TestAgent_sidecarServiceFromNodeService/no_auto_ports_available (1.03s) --- PASS: TestAgent_sidecarServiceFromNodeService/auto_ports_disabled (0.96s) --- PASS: TestAgent_sidecarServiceFromNodeService/inherit_tags_and_meta (0.94s) --- PASS: TestAgent_sidecarServiceFromNodeService/invalid_check_type (1.08s) --- PASS: TestAgent_sidecarServiceFromNodeService/invalid_meta (0.86s) --- PASS: TestAgent_sidecarServiceFromNodeService/re-registering_same_sidecar_with_no_port_should_pick_same_one (1.08s) === RUN TestSnapshot snapshot_endpoint_test.go:16: DM-skipped --- SKIP: TestSnapshot (0.00s) === RUN TestSnapshot_Options === PAUSE TestSnapshot_Options === RUN TestStatusLeader === PAUSE TestStatusLeader === RUN TestStatusLeaderSecondary === PAUSE TestStatusLeaderSecondary === RUN TestStatusPeers === PAUSE TestStatusPeers === RUN TestStatusPeersSecondary === PAUSE TestStatusPeersSecondary === RUN TestDefaultConfig === RUN TestDefaultConfig/#00 === PAUSE TestDefaultConfig/#00 === RUN TestDefaultConfig/#01 === PAUSE TestDefaultConfig/#01 === RUN TestDefaultConfig/#02 === PAUSE TestDefaultConfig/#02 === RUN TestDefaultConfig/#03 === PAUSE TestDefaultConfig/#03 === RUN TestDefaultConfig/#04 === PAUSE TestDefaultConfig/#04 === RUN TestDefaultConfig/#05 === PAUSE TestDefaultConfig/#05 === RUN TestDefaultConfig/#06 === PAUSE TestDefaultConfig/#06 === RUN TestDefaultConfig/#07 === PAUSE TestDefaultConfig/#07 === RUN TestDefaultConfig/#08 === PAUSE TestDefaultConfig/#08 === RUN TestDefaultConfig/#09 === PAUSE TestDefaultConfig/#09 === RUN TestDefaultConfig/#10 === PAUSE TestDefaultConfig/#10 === RUN TestDefaultConfig/#11 === PAUSE TestDefaultConfig/#11 === RUN TestDefaultConfig/#12 === PAUSE TestDefaultConfig/#12 === RUN TestDefaultConfig/#13 === PAUSE TestDefaultConfig/#13 === RUN TestDefaultConfig/#14 === PAUSE TestDefaultConfig/#14 === RUN TestDefaultConfig/#15 === PAUSE TestDefaultConfig/#15 === RUN TestDefaultConfig/#16 === PAUSE TestDefaultConfig/#16 === RUN TestDefaultConfig/#17 === PAUSE TestDefaultConfig/#17 === RUN TestDefaultConfig/#18 === PAUSE TestDefaultConfig/#18 === RUN TestDefaultConfig/#19 === PAUSE TestDefaultConfig/#19 === RUN TestDefaultConfig/#20 === PAUSE TestDefaultConfig/#20 === RUN TestDefaultConfig/#21 === PAUSE TestDefaultConfig/#21 === RUN TestDefaultConfig/#22 === PAUSE TestDefaultConfig/#22 === RUN TestDefaultConfig/#23 === PAUSE TestDefaultConfig/#23 === RUN TestDefaultConfig/#24 === PAUSE TestDefaultConfig/#24 === RUN TestDefaultConfig/#25 === PAUSE TestDefaultConfig/#25 === RUN TestDefaultConfig/#26 === PAUSE TestDefaultConfig/#26 === RUN TestDefaultConfig/#27 === PAUSE TestDefaultConfig/#27 === RUN TestDefaultConfig/#28 === PAUSE TestDefaultConfig/#28 === RUN TestDefaultConfig/#29 === PAUSE TestDefaultConfig/#29 === RUN TestDefaultConfig/#30 === PAUSE TestDefaultConfig/#30 === RUN TestDefaultConfig/#31 === PAUSE TestDefaultConfig/#31 === RUN TestDefaultConfig/#32 === PAUSE TestDefaultConfig/#32 === RUN TestDefaultConfig/#33 === PAUSE TestDefaultConfig/#33 === RUN TestDefaultConfig/#34 === PAUSE TestDefaultConfig/#34 === RUN TestDefaultConfig/#35 === PAUSE TestDefaultConfig/#35 === RUN TestDefaultConfig/#36 === PAUSE TestDefaultConfig/#36 === RUN TestDefaultConfig/#37 === PAUSE TestDefaultConfig/#37 === RUN TestDefaultConfig/#38 === PAUSE TestDefaultConfig/#38 === RUN TestDefaultConfig/#39 === PAUSE TestDefaultConfig/#39 === RUN TestDefaultConfig/#40 === PAUSE TestDefaultConfig/#40 === RUN TestDefaultConfig/#41 === PAUSE TestDefaultConfig/#41 === RUN TestDefaultConfig/#42 === PAUSE TestDefaultConfig/#42 === RUN TestDefaultConfig/#43 === PAUSE TestDefaultConfig/#43 === RUN TestDefaultConfig/#44 === PAUSE TestDefaultConfig/#44 === RUN TestDefaultConfig/#45 === PAUSE TestDefaultConfig/#45 === RUN TestDefaultConfig/#46 === PAUSE TestDefaultConfig/#46 === RUN TestDefaultConfig/#47 === PAUSE TestDefaultConfig/#47 === RUN TestDefaultConfig/#48 === PAUSE TestDefaultConfig/#48 === RUN TestDefaultConfig/#49 === PAUSE TestDefaultConfig/#49 === RUN TestDefaultConfig/#50 === PAUSE TestDefaultConfig/#50 === RUN TestDefaultConfig/#51 === PAUSE TestDefaultConfig/#51 === RUN TestDefaultConfig/#52 === PAUSE TestDefaultConfig/#52 === RUN TestDefaultConfig/#53 === PAUSE TestDefaultConfig/#53 === RUN TestDefaultConfig/#54 === PAUSE TestDefaultConfig/#54 === RUN TestDefaultConfig/#55 === PAUSE TestDefaultConfig/#55 === RUN TestDefaultConfig/#56 === PAUSE TestDefaultConfig/#56 === RUN TestDefaultConfig/#57 === PAUSE TestDefaultConfig/#57 === RUN TestDefaultConfig/#58 === PAUSE TestDefaultConfig/#58 === RUN TestDefaultConfig/#59 === PAUSE TestDefaultConfig/#59 === RUN TestDefaultConfig/#60 === PAUSE TestDefaultConfig/#60 === RUN TestDefaultConfig/#61 === PAUSE TestDefaultConfig/#61 === RUN TestDefaultConfig/#62 === PAUSE TestDefaultConfig/#62 === RUN TestDefaultConfig/#63 === PAUSE TestDefaultConfig/#63 === RUN TestDefaultConfig/#64 === PAUSE TestDefaultConfig/#64 === RUN TestDefaultConfig/#65 === PAUSE TestDefaultConfig/#65 === RUN TestDefaultConfig/#66 === PAUSE TestDefaultConfig/#66 === RUN TestDefaultConfig/#67 === PAUSE TestDefaultConfig/#67 === RUN TestDefaultConfig/#68 === PAUSE TestDefaultConfig/#68 === RUN TestDefaultConfig/#69 === PAUSE TestDefaultConfig/#69 === RUN TestDefaultConfig/#70 === PAUSE TestDefaultConfig/#70 === RUN TestDefaultConfig/#71 === PAUSE TestDefaultConfig/#71 === RUN TestDefaultConfig/#72 === PAUSE TestDefaultConfig/#72 === RUN TestDefaultConfig/#73 === PAUSE TestDefaultConfig/#73 === RUN TestDefaultConfig/#74 === PAUSE TestDefaultConfig/#74 === RUN TestDefaultConfig/#75 === PAUSE TestDefaultConfig/#75 === RUN TestDefaultConfig/#76 === PAUSE TestDefaultConfig/#76 === RUN TestDefaultConfig/#77 === PAUSE TestDefaultConfig/#77 === RUN TestDefaultConfig/#78 === PAUSE TestDefaultConfig/#78 === RUN TestDefaultConfig/#79 === PAUSE TestDefaultConfig/#79 === RUN TestDefaultConfig/#80 === PAUSE TestDefaultConfig/#80 === RUN TestDefaultConfig/#81 === PAUSE TestDefaultConfig/#81 === RUN TestDefaultConfig/#82 === PAUSE TestDefaultConfig/#82 === RUN TestDefaultConfig/#83 === PAUSE TestDefaultConfig/#83 === RUN TestDefaultConfig/#84 === PAUSE TestDefaultConfig/#84 === RUN TestDefaultConfig/#85 === PAUSE TestDefaultConfig/#85 === RUN TestDefaultConfig/#86 === PAUSE TestDefaultConfig/#86 === RUN TestDefaultConfig/#87 === PAUSE TestDefaultConfig/#87 === RUN TestDefaultConfig/#88 === PAUSE TestDefaultConfig/#88 === RUN TestDefaultConfig/#89 === PAUSE TestDefaultConfig/#89 === RUN TestDefaultConfig/#90 === PAUSE TestDefaultConfig/#90 === RUN TestDefaultConfig/#91 === PAUSE TestDefaultConfig/#91 === RUN TestDefaultConfig/#92 === PAUSE TestDefaultConfig/#92 === RUN TestDefaultConfig/#93 === PAUSE TestDefaultConfig/#93 === RUN TestDefaultConfig/#94 === PAUSE TestDefaultConfig/#94 === RUN TestDefaultConfig/#95 === PAUSE TestDefaultConfig/#95 === RUN TestDefaultConfig/#96 === PAUSE TestDefaultConfig/#96 === RUN TestDefaultConfig/#97 === PAUSE TestDefaultConfig/#97 === RUN TestDefaultConfig/#98 === PAUSE TestDefaultConfig/#98 === RUN TestDefaultConfig/#99 === PAUSE TestDefaultConfig/#99 === RUN TestDefaultConfig/#100 === PAUSE TestDefaultConfig/#100 === RUN TestDefaultConfig/#101 === PAUSE TestDefaultConfig/#101 === RUN TestDefaultConfig/#102 === PAUSE TestDefaultConfig/#102 === RUN TestDefaultConfig/#103 === PAUSE TestDefaultConfig/#103 === RUN TestDefaultConfig/#104 === PAUSE TestDefaultConfig/#104 === RUN TestDefaultConfig/#105 === PAUSE TestDefaultConfig/#105 === RUN TestDefaultConfig/#106 === PAUSE TestDefaultConfig/#106 === RUN TestDefaultConfig/#107 === PAUSE TestDefaultConfig/#107 === RUN TestDefaultConfig/#108 === PAUSE TestDefaultConfig/#108 === RUN TestDefaultConfig/#109 === PAUSE TestDefaultConfig/#109 === RUN TestDefaultConfig/#110 === PAUSE TestDefaultConfig/#110 === RUN TestDefaultConfig/#111 === PAUSE TestDefaultConfig/#111 === RUN TestDefaultConfig/#112 === PAUSE TestDefaultConfig/#112 === RUN TestDefaultConfig/#113 === PAUSE TestDefaultConfig/#113 === RUN TestDefaultConfig/#114 === PAUSE TestDefaultConfig/#114 === RUN TestDefaultConfig/#115 === PAUSE TestDefaultConfig/#115 === RUN TestDefaultConfig/#116 === PAUSE TestDefaultConfig/#116 === RUN TestDefaultConfig/#117 === PAUSE TestDefaultConfig/#117 === RUN TestDefaultConfig/#118 === PAUSE TestDefaultConfig/#118 === RUN TestDefaultConfig/#119 === PAUSE TestDefaultConfig/#119 === RUN TestDefaultConfig/#120 === PAUSE TestDefaultConfig/#120 === RUN TestDefaultConfig/#121 === PAUSE TestDefaultConfig/#121 === RUN TestDefaultConfig/#122 === PAUSE TestDefaultConfig/#122 === RUN TestDefaultConfig/#123 === PAUSE TestDefaultConfig/#123 === RUN TestDefaultConfig/#124 === PAUSE TestDefaultConfig/#124 === RUN TestDefaultConfig/#125 === PAUSE TestDefaultConfig/#125 === RUN TestDefaultConfig/#126 === PAUSE TestDefaultConfig/#126 === RUN TestDefaultConfig/#127 === PAUSE TestDefaultConfig/#127 === RUN TestDefaultConfig/#128 === PAUSE TestDefaultConfig/#128 === RUN TestDefaultConfig/#129 === PAUSE TestDefaultConfig/#129 === RUN TestDefaultConfig/#130 === PAUSE TestDefaultConfig/#130 === RUN TestDefaultConfig/#131 === PAUSE TestDefaultConfig/#131 === RUN TestDefaultConfig/#132 === PAUSE TestDefaultConfig/#132 === RUN TestDefaultConfig/#133 === PAUSE TestDefaultConfig/#133 === RUN TestDefaultConfig/#134 === PAUSE TestDefaultConfig/#134 === RUN TestDefaultConfig/#135 === PAUSE TestDefaultConfig/#135 === RUN TestDefaultConfig/#136 === PAUSE TestDefaultConfig/#136 === RUN TestDefaultConfig/#137 === PAUSE TestDefaultConfig/#137 === RUN TestDefaultConfig/#138 === PAUSE TestDefaultConfig/#138 === RUN TestDefaultConfig/#139 === PAUSE TestDefaultConfig/#139 === RUN TestDefaultConfig/#140 === PAUSE TestDefaultConfig/#140 === RUN TestDefaultConfig/#141 === PAUSE TestDefaultConfig/#141 === RUN TestDefaultConfig/#142 === PAUSE TestDefaultConfig/#142 === RUN TestDefaultConfig/#143 === PAUSE TestDefaultConfig/#143 === RUN TestDefaultConfig/#144 === PAUSE TestDefaultConfig/#144 === RUN TestDefaultConfig/#145 === PAUSE TestDefaultConfig/#145 === RUN TestDefaultConfig/#146 === PAUSE TestDefaultConfig/#146 === RUN TestDefaultConfig/#147 === PAUSE TestDefaultConfig/#147 === RUN TestDefaultConfig/#148 === PAUSE TestDefaultConfig/#148 === RUN TestDefaultConfig/#149 === PAUSE TestDefaultConfig/#149 === RUN TestDefaultConfig/#150 === PAUSE TestDefaultConfig/#150 === RUN TestDefaultConfig/#151 === PAUSE TestDefaultConfig/#151 === RUN TestDefaultConfig/#152 === PAUSE TestDefaultConfig/#152 === RUN TestDefaultConfig/#153 === PAUSE TestDefaultConfig/#153 === RUN TestDefaultConfig/#154 === PAUSE TestDefaultConfig/#154 === RUN TestDefaultConfig/#155 === PAUSE TestDefaultConfig/#155 === RUN TestDefaultConfig/#156 === PAUSE TestDefaultConfig/#156 === RUN TestDefaultConfig/#157 === PAUSE TestDefaultConfig/#157 === RUN TestDefaultConfig/#158 === PAUSE TestDefaultConfig/#158 === RUN TestDefaultConfig/#159 === PAUSE TestDefaultConfig/#159 === RUN TestDefaultConfig/#160 === PAUSE TestDefaultConfig/#160 === RUN TestDefaultConfig/#161 === PAUSE TestDefaultConfig/#161 === RUN TestDefaultConfig/#162 === PAUSE TestDefaultConfig/#162 === RUN TestDefaultConfig/#163 === PAUSE TestDefaultConfig/#163 === RUN TestDefaultConfig/#164 === PAUSE TestDefaultConfig/#164 === RUN TestDefaultConfig/#165 === PAUSE TestDefaultConfig/#165 === RUN TestDefaultConfig/#166 === PAUSE TestDefaultConfig/#166 === RUN TestDefaultConfig/#167 === PAUSE TestDefaultConfig/#167 === RUN TestDefaultConfig/#168 === PAUSE TestDefaultConfig/#168 === RUN TestDefaultConfig/#169 === PAUSE TestDefaultConfig/#169 === RUN TestDefaultConfig/#170 === PAUSE TestDefaultConfig/#170 === RUN TestDefaultConfig/#171 === PAUSE TestDefaultConfig/#171 === RUN TestDefaultConfig/#172 === PAUSE TestDefaultConfig/#172 === RUN TestDefaultConfig/#173 === PAUSE TestDefaultConfig/#173 === RUN TestDefaultConfig/#174 === PAUSE TestDefaultConfig/#174 === RUN TestDefaultConfig/#175 === PAUSE TestDefaultConfig/#175 === RUN TestDefaultConfig/#176 === PAUSE TestDefaultConfig/#176 === RUN TestDefaultConfig/#177 === PAUSE TestDefaultConfig/#177 === RUN TestDefaultConfig/#178 === PAUSE TestDefaultConfig/#178 === RUN TestDefaultConfig/#179 === PAUSE TestDefaultConfig/#179 === RUN TestDefaultConfig/#180 === PAUSE TestDefaultConfig/#180 === RUN TestDefaultConfig/#181 === PAUSE TestDefaultConfig/#181 === RUN TestDefaultConfig/#182 === PAUSE TestDefaultConfig/#182 === RUN TestDefaultConfig/#183 === PAUSE TestDefaultConfig/#183 === RUN TestDefaultConfig/#184 === PAUSE TestDefaultConfig/#184 === RUN TestDefaultConfig/#185 === PAUSE TestDefaultConfig/#185 === RUN TestDefaultConfig/#186 === PAUSE TestDefaultConfig/#186 === RUN TestDefaultConfig/#187 === PAUSE TestDefaultConfig/#187 === RUN TestDefaultConfig/#188 === PAUSE TestDefaultConfig/#188 === RUN TestDefaultConfig/#189 === PAUSE TestDefaultConfig/#189 === RUN TestDefaultConfig/#190 === PAUSE TestDefaultConfig/#190 === RUN TestDefaultConfig/#191 === PAUSE TestDefaultConfig/#191 === RUN TestDefaultConfig/#192 === PAUSE TestDefaultConfig/#192 === RUN TestDefaultConfig/#193 === PAUSE TestDefaultConfig/#193 === RUN TestDefaultConfig/#194 === PAUSE TestDefaultConfig/#194 === RUN TestDefaultConfig/#195 === PAUSE TestDefaultConfig/#195 === RUN TestDefaultConfig/#196 === PAUSE TestDefaultConfig/#196 === RUN TestDefaultConfig/#197 === PAUSE TestDefaultConfig/#197 === RUN TestDefaultConfig/#198 === PAUSE TestDefaultConfig/#198 === RUN TestDefaultConfig/#199 === PAUSE TestDefaultConfig/#199 === RUN TestDefaultConfig/#200 === PAUSE TestDefaultConfig/#200 === RUN TestDefaultConfig/#201 === PAUSE TestDefaultConfig/#201 === RUN TestDefaultConfig/#202 === PAUSE TestDefaultConfig/#202 === RUN TestDefaultConfig/#203 === PAUSE TestDefaultConfig/#203 === RUN TestDefaultConfig/#204 === PAUSE TestDefaultConfig/#204 === RUN TestDefaultConfig/#205 === PAUSE TestDefaultConfig/#205 === RUN TestDefaultConfig/#206 === PAUSE TestDefaultConfig/#206 === RUN TestDefaultConfig/#207 === PAUSE TestDefaultConfig/#207 === RUN TestDefaultConfig/#208 === PAUSE TestDefaultConfig/#208 === RUN TestDefaultConfig/#209 === PAUSE TestDefaultConfig/#209 === RUN TestDefaultConfig/#210 === PAUSE TestDefaultConfig/#210 === RUN TestDefaultConfig/#211 === PAUSE TestDefaultConfig/#211 === RUN TestDefaultConfig/#212 === PAUSE TestDefaultConfig/#212 === RUN TestDefaultConfig/#213 === PAUSE TestDefaultConfig/#213 === RUN TestDefaultConfig/#214 === PAUSE TestDefaultConfig/#214 === RUN TestDefaultConfig/#215 === PAUSE TestDefaultConfig/#215 === RUN TestDefaultConfig/#216 === PAUSE TestDefaultConfig/#216 === RUN TestDefaultConfig/#217 === PAUSE TestDefaultConfig/#217 === RUN TestDefaultConfig/#218 === PAUSE TestDefaultConfig/#218 === RUN TestDefaultConfig/#219 === PAUSE TestDefaultConfig/#219 === RUN TestDefaultConfig/#220 === PAUSE TestDefaultConfig/#220 === RUN TestDefaultConfig/#221 === PAUSE TestDefaultConfig/#221 === RUN TestDefaultConfig/#222 === PAUSE TestDefaultConfig/#222 === RUN TestDefaultConfig/#223 === PAUSE TestDefaultConfig/#223 === RUN TestDefaultConfig/#224 === PAUSE TestDefaultConfig/#224 === RUN TestDefaultConfig/#225 === PAUSE TestDefaultConfig/#225 === RUN TestDefaultConfig/#226 === PAUSE TestDefaultConfig/#226 === RUN TestDefaultConfig/#227 === PAUSE TestDefaultConfig/#227 === RUN TestDefaultConfig/#228 === PAUSE TestDefaultConfig/#228 === RUN TestDefaultConfig/#229 === PAUSE TestDefaultConfig/#229 === RUN TestDefaultConfig/#230 === PAUSE TestDefaultConfig/#230 === RUN TestDefaultConfig/#231 === PAUSE TestDefaultConfig/#231 === RUN TestDefaultConfig/#232 === PAUSE TestDefaultConfig/#232 === RUN TestDefaultConfig/#233 === PAUSE TestDefaultConfig/#233 === RUN TestDefaultConfig/#234 === PAUSE TestDefaultConfig/#234 === RUN TestDefaultConfig/#235 === PAUSE TestDefaultConfig/#235 === RUN TestDefaultConfig/#236 === PAUSE TestDefaultConfig/#236 === RUN TestDefaultConfig/#237 === PAUSE TestDefaultConfig/#237 === RUN TestDefaultConfig/#238 === PAUSE TestDefaultConfig/#238 === RUN TestDefaultConfig/#239 === PAUSE TestDefaultConfig/#239 === RUN TestDefaultConfig/#240 === PAUSE TestDefaultConfig/#240 === RUN TestDefaultConfig/#241 === PAUSE TestDefaultConfig/#241 === RUN TestDefaultConfig/#242 === PAUSE TestDefaultConfig/#242 === RUN TestDefaultConfig/#243 === PAUSE TestDefaultConfig/#243 === RUN TestDefaultConfig/#244 === PAUSE TestDefaultConfig/#244 === RUN TestDefaultConfig/#245 === PAUSE TestDefaultConfig/#245 === RUN TestDefaultConfig/#246 === PAUSE TestDefaultConfig/#246 === RUN TestDefaultConfig/#247 === PAUSE TestDefaultConfig/#247 === RUN TestDefaultConfig/#248 === PAUSE TestDefaultConfig/#248 === RUN TestDefaultConfig/#249 === PAUSE TestDefaultConfig/#249 === RUN TestDefaultConfig/#250 === PAUSE TestDefaultConfig/#250 === RUN TestDefaultConfig/#251 === PAUSE TestDefaultConfig/#251 === RUN TestDefaultConfig/#252 === PAUSE TestDefaultConfig/#252 === RUN TestDefaultConfig/#253 === PAUSE TestDefaultConfig/#253 === RUN TestDefaultConfig/#254 === PAUSE TestDefaultConfig/#254 === RUN TestDefaultConfig/#255 === PAUSE TestDefaultConfig/#255 === RUN TestDefaultConfig/#256 === PAUSE TestDefaultConfig/#256 === RUN TestDefaultConfig/#257 === PAUSE TestDefaultConfig/#257 === RUN TestDefaultConfig/#258 === PAUSE TestDefaultConfig/#258 === RUN TestDefaultConfig/#259 === PAUSE TestDefaultConfig/#259 === RUN TestDefaultConfig/#260 === PAUSE TestDefaultConfig/#260 === RUN TestDefaultConfig/#261 === PAUSE TestDefaultConfig/#261 === RUN TestDefaultConfig/#262 === PAUSE TestDefaultConfig/#262 === RUN TestDefaultConfig/#263 === PAUSE TestDefaultConfig/#263 === RUN TestDefaultConfig/#264 === PAUSE TestDefaultConfig/#264 === RUN TestDefaultConfig/#265 === PAUSE TestDefaultConfig/#265 === RUN TestDefaultConfig/#266 === PAUSE TestDefaultConfig/#266 === RUN TestDefaultConfig/#267 === PAUSE TestDefaultConfig/#267 === RUN TestDefaultConfig/#268 === PAUSE TestDefaultConfig/#268 === RUN TestDefaultConfig/#269 === PAUSE TestDefaultConfig/#269 === RUN TestDefaultConfig/#270 === PAUSE TestDefaultConfig/#270 === RUN TestDefaultConfig/#271 === PAUSE TestDefaultConfig/#271 === RUN TestDefaultConfig/#272 === PAUSE TestDefaultConfig/#272 === RUN TestDefaultConfig/#273 === PAUSE TestDefaultConfig/#273 === RUN TestDefaultConfig/#274 === PAUSE TestDefaultConfig/#274 === RUN TestDefaultConfig/#275 === PAUSE TestDefaultConfig/#275 === RUN TestDefaultConfig/#276 === PAUSE TestDefaultConfig/#276 === RUN TestDefaultConfig/#277 === PAUSE TestDefaultConfig/#277 === RUN TestDefaultConfig/#278 === PAUSE TestDefaultConfig/#278 === RUN TestDefaultConfig/#279 === PAUSE TestDefaultConfig/#279 === RUN TestDefaultConfig/#280 === PAUSE TestDefaultConfig/#280 === RUN TestDefaultConfig/#281 === PAUSE TestDefaultConfig/#281 === RUN TestDefaultConfig/#282 === PAUSE TestDefaultConfig/#282 === RUN TestDefaultConfig/#283 === PAUSE TestDefaultConfig/#283 === RUN TestDefaultConfig/#284 === PAUSE TestDefaultConfig/#284 === RUN TestDefaultConfig/#285 === PAUSE TestDefaultConfig/#285 === RUN TestDefaultConfig/#286 === PAUSE TestDefaultConfig/#286 === RUN TestDefaultConfig/#287 === PAUSE TestDefaultConfig/#287 === RUN TestDefaultConfig/#288 === PAUSE TestDefaultConfig/#288 === RUN TestDefaultConfig/#289 === PAUSE TestDefaultConfig/#289 === RUN TestDefaultConfig/#290 === PAUSE TestDefaultConfig/#290 === RUN TestDefaultConfig/#291 === PAUSE TestDefaultConfig/#291 === RUN TestDefaultConfig/#292 === PAUSE TestDefaultConfig/#292 === RUN TestDefaultConfig/#293 === PAUSE TestDefaultConfig/#293 === RUN TestDefaultConfig/#294 === PAUSE TestDefaultConfig/#294 === RUN TestDefaultConfig/#295 === PAUSE TestDefaultConfig/#295 === RUN TestDefaultConfig/#296 === PAUSE TestDefaultConfig/#296 === RUN TestDefaultConfig/#297 === PAUSE TestDefaultConfig/#297 === RUN TestDefaultConfig/#298 === PAUSE TestDefaultConfig/#298 === RUN TestDefaultConfig/#299 === PAUSE TestDefaultConfig/#299 === RUN TestDefaultConfig/#300 === PAUSE TestDefaultConfig/#300 === RUN TestDefaultConfig/#301 === PAUSE TestDefaultConfig/#301 === RUN TestDefaultConfig/#302 === PAUSE TestDefaultConfig/#302 === RUN TestDefaultConfig/#303 === PAUSE TestDefaultConfig/#303 === RUN TestDefaultConfig/#304 === PAUSE TestDefaultConfig/#304 === RUN TestDefaultConfig/#305 === PAUSE TestDefaultConfig/#305 === RUN TestDefaultConfig/#306 === PAUSE TestDefaultConfig/#306 === RUN TestDefaultConfig/#307 === PAUSE TestDefaultConfig/#307 === RUN TestDefaultConfig/#308 === PAUSE TestDefaultConfig/#308 === RUN TestDefaultConfig/#309 === PAUSE TestDefaultConfig/#309 === RUN TestDefaultConfig/#310 === PAUSE TestDefaultConfig/#310 === RUN TestDefaultConfig/#311 === PAUSE TestDefaultConfig/#311 === RUN TestDefaultConfig/#312 === PAUSE TestDefaultConfig/#312 === RUN TestDefaultConfig/#313 === PAUSE TestDefaultConfig/#313 === RUN TestDefaultConfig/#314 === PAUSE TestDefaultConfig/#314 === RUN TestDefaultConfig/#315 === PAUSE TestDefaultConfig/#315 === RUN TestDefaultConfig/#316 === PAUSE TestDefaultConfig/#316 === RUN TestDefaultConfig/#317 === PAUSE TestDefaultConfig/#317 === RUN TestDefaultConfig/#318 === PAUSE TestDefaultConfig/#318 === RUN TestDefaultConfig/#319 === PAUSE TestDefaultConfig/#319 === RUN TestDefaultConfig/#320 === PAUSE TestDefaultConfig/#320 === RUN TestDefaultConfig/#321 === PAUSE TestDefaultConfig/#321 === RUN TestDefaultConfig/#322 === PAUSE TestDefaultConfig/#322 === RUN TestDefaultConfig/#323 === PAUSE TestDefaultConfig/#323 === RUN TestDefaultConfig/#324 === PAUSE TestDefaultConfig/#324 === RUN TestDefaultConfig/#325 === PAUSE TestDefaultConfig/#325 === RUN TestDefaultConfig/#326 === PAUSE TestDefaultConfig/#326 === RUN TestDefaultConfig/#327 === PAUSE TestDefaultConfig/#327 === RUN TestDefaultConfig/#328 === PAUSE TestDefaultConfig/#328 === RUN TestDefaultConfig/#329 === PAUSE TestDefaultConfig/#329 === RUN TestDefaultConfig/#330 === PAUSE TestDefaultConfig/#330 === RUN TestDefaultConfig/#331 === PAUSE TestDefaultConfig/#331 === RUN TestDefaultConfig/#332 === PAUSE TestDefaultConfig/#332 === RUN TestDefaultConfig/#333 === PAUSE TestDefaultConfig/#333 === RUN TestDefaultConfig/#334 === PAUSE TestDefaultConfig/#334 === RUN TestDefaultConfig/#335 === PAUSE TestDefaultConfig/#335 === RUN TestDefaultConfig/#336 === PAUSE TestDefaultConfig/#336 === RUN TestDefaultConfig/#337 === PAUSE TestDefaultConfig/#337 === RUN TestDefaultConfig/#338 === PAUSE TestDefaultConfig/#338 === RUN TestDefaultConfig/#339 === PAUSE TestDefaultConfig/#339 === RUN TestDefaultConfig/#340 === PAUSE TestDefaultConfig/#340 === RUN TestDefaultConfig/#341 === PAUSE TestDefaultConfig/#341 === RUN TestDefaultConfig/#342 === PAUSE TestDefaultConfig/#342 === RUN TestDefaultConfig/#343 === PAUSE TestDefaultConfig/#343 === RUN TestDefaultConfig/#344 === PAUSE TestDefaultConfig/#344 === RUN TestDefaultConfig/#345 === PAUSE TestDefaultConfig/#345 === RUN TestDefaultConfig/#346 === PAUSE TestDefaultConfig/#346 === RUN TestDefaultConfig/#347 === PAUSE TestDefaultConfig/#347 === RUN TestDefaultConfig/#348 === PAUSE TestDefaultConfig/#348 === RUN TestDefaultConfig/#349 === PAUSE TestDefaultConfig/#349 === RUN TestDefaultConfig/#350 === PAUSE TestDefaultConfig/#350 === RUN TestDefaultConfig/#351 === PAUSE TestDefaultConfig/#351 === RUN TestDefaultConfig/#352 === PAUSE TestDefaultConfig/#352 === RUN TestDefaultConfig/#353 === PAUSE TestDefaultConfig/#353 === RUN TestDefaultConfig/#354 === PAUSE TestDefaultConfig/#354 === RUN TestDefaultConfig/#355 === PAUSE TestDefaultConfig/#355 === RUN TestDefaultConfig/#356 === PAUSE TestDefaultConfig/#356 === RUN TestDefaultConfig/#357 === PAUSE TestDefaultConfig/#357 === RUN TestDefaultConfig/#358 === PAUSE TestDefaultConfig/#358 === RUN TestDefaultConfig/#359 === PAUSE TestDefaultConfig/#359 === RUN TestDefaultConfig/#360 === PAUSE TestDefaultConfig/#360 === RUN TestDefaultConfig/#361 === PAUSE TestDefaultConfig/#361 === RUN TestDefaultConfig/#362 === PAUSE TestDefaultConfig/#362 === RUN TestDefaultConfig/#363 === PAUSE TestDefaultConfig/#363 === RUN TestDefaultConfig/#364 === PAUSE TestDefaultConfig/#364 === RUN TestDefaultConfig/#365 === PAUSE TestDefaultConfig/#365 === RUN TestDefaultConfig/#366 === PAUSE TestDefaultConfig/#366 === RUN TestDefaultConfig/#367 === PAUSE TestDefaultConfig/#367 === RUN TestDefaultConfig/#368 === PAUSE TestDefaultConfig/#368 === RUN TestDefaultConfig/#369 === PAUSE TestDefaultConfig/#369 === RUN TestDefaultConfig/#370 === PAUSE TestDefaultConfig/#370 === RUN TestDefaultConfig/#371 === PAUSE TestDefaultConfig/#371 === RUN TestDefaultConfig/#372 === PAUSE TestDefaultConfig/#372 === RUN TestDefaultConfig/#373 === PAUSE TestDefaultConfig/#373 === RUN TestDefaultConfig/#374 === PAUSE TestDefaultConfig/#374 === RUN TestDefaultConfig/#375 === PAUSE TestDefaultConfig/#375 === RUN TestDefaultConfig/#376 === PAUSE TestDefaultConfig/#376 === RUN TestDefaultConfig/#377 === PAUSE TestDefaultConfig/#377 === RUN TestDefaultConfig/#378 === PAUSE TestDefaultConfig/#378 === RUN TestDefaultConfig/#379 === PAUSE TestDefaultConfig/#379 === RUN TestDefaultConfig/#380 === PAUSE TestDefaultConfig/#380 === RUN TestDefaultConfig/#381 === PAUSE TestDefaultConfig/#381 === RUN TestDefaultConfig/#382 === PAUSE TestDefaultConfig/#382 === RUN TestDefaultConfig/#383 === PAUSE TestDefaultConfig/#383 === RUN TestDefaultConfig/#384 === PAUSE TestDefaultConfig/#384 === RUN TestDefaultConfig/#385 === PAUSE TestDefaultConfig/#385 === RUN TestDefaultConfig/#386 === PAUSE TestDefaultConfig/#386 === RUN TestDefaultConfig/#387 === PAUSE TestDefaultConfig/#387 === RUN TestDefaultConfig/#388 === PAUSE TestDefaultConfig/#388 === RUN TestDefaultConfig/#389 === PAUSE TestDefaultConfig/#389 === RUN TestDefaultConfig/#390 === PAUSE TestDefaultConfig/#390 === RUN TestDefaultConfig/#391 === PAUSE TestDefaultConfig/#391 === RUN TestDefaultConfig/#392 === PAUSE TestDefaultConfig/#392 === RUN TestDefaultConfig/#393 === PAUSE TestDefaultConfig/#393 === RUN TestDefaultConfig/#394 === PAUSE TestDefaultConfig/#394 === RUN TestDefaultConfig/#395 === PAUSE TestDefaultConfig/#395 === RUN TestDefaultConfig/#396 === PAUSE TestDefaultConfig/#396 === RUN TestDefaultConfig/#397 === PAUSE TestDefaultConfig/#397 === RUN TestDefaultConfig/#398 === PAUSE TestDefaultConfig/#398 === RUN TestDefaultConfig/#399 === PAUSE TestDefaultConfig/#399 === RUN TestDefaultConfig/#400 === PAUSE TestDefaultConfig/#400 === RUN TestDefaultConfig/#401 === PAUSE TestDefaultConfig/#401 === RUN TestDefaultConfig/#402 === PAUSE TestDefaultConfig/#402 === RUN TestDefaultConfig/#403 === PAUSE TestDefaultConfig/#403 === RUN TestDefaultConfig/#404 === PAUSE TestDefaultConfig/#404 === RUN TestDefaultConfig/#405 === PAUSE TestDefaultConfig/#405 === RUN TestDefaultConfig/#406 === PAUSE TestDefaultConfig/#406 === RUN TestDefaultConfig/#407 === PAUSE TestDefaultConfig/#407 === RUN TestDefaultConfig/#408 === PAUSE TestDefaultConfig/#408 === RUN TestDefaultConfig/#409 === PAUSE TestDefaultConfig/#409 === RUN TestDefaultConfig/#410 === PAUSE TestDefaultConfig/#410 === RUN TestDefaultConfig/#411 === PAUSE TestDefaultConfig/#411 === RUN TestDefaultConfig/#412 === PAUSE TestDefaultConfig/#412 === RUN TestDefaultConfig/#413 === PAUSE TestDefaultConfig/#413 === RUN TestDefaultConfig/#414 === PAUSE TestDefaultConfig/#414 === RUN TestDefaultConfig/#415 === PAUSE TestDefaultConfig/#415 === RUN TestDefaultConfig/#416 === PAUSE TestDefaultConfig/#416 === RUN TestDefaultConfig/#417 === PAUSE TestDefaultConfig/#417 === RUN TestDefaultConfig/#418 === PAUSE TestDefaultConfig/#418 === RUN TestDefaultConfig/#419 === PAUSE TestDefaultConfig/#419 === RUN TestDefaultConfig/#420 === PAUSE TestDefaultConfig/#420 === RUN TestDefaultConfig/#421 === PAUSE TestDefaultConfig/#421 === RUN TestDefaultConfig/#422 === PAUSE TestDefaultConfig/#422 === RUN TestDefaultConfig/#423 === PAUSE TestDefaultConfig/#423 === RUN TestDefaultConfig/#424 === PAUSE TestDefaultConfig/#424 === RUN TestDefaultConfig/#425 === PAUSE TestDefaultConfig/#425 === RUN TestDefaultConfig/#426 === PAUSE TestDefaultConfig/#426 === RUN TestDefaultConfig/#427 === PAUSE TestDefaultConfig/#427 === RUN TestDefaultConfig/#428 === PAUSE TestDefaultConfig/#428 === RUN TestDefaultConfig/#429 === PAUSE TestDefaultConfig/#429 === RUN TestDefaultConfig/#430 === PAUSE TestDefaultConfig/#430 === RUN TestDefaultConfig/#431 === PAUSE TestDefaultConfig/#431 === RUN TestDefaultConfig/#432 === PAUSE TestDefaultConfig/#432 === RUN TestDefaultConfig/#433 === PAUSE TestDefaultConfig/#433 === RUN TestDefaultConfig/#434 === PAUSE TestDefaultConfig/#434 === RUN TestDefaultConfig/#435 === PAUSE TestDefaultConfig/#435 === RUN TestDefaultConfig/#436 === PAUSE TestDefaultConfig/#436 === RUN TestDefaultConfig/#437 === PAUSE TestDefaultConfig/#437 === RUN TestDefaultConfig/#438 === PAUSE TestDefaultConfig/#438 === RUN TestDefaultConfig/#439 === PAUSE TestDefaultConfig/#439 === RUN TestDefaultConfig/#440 === PAUSE TestDefaultConfig/#440 === RUN TestDefaultConfig/#441 === PAUSE TestDefaultConfig/#441 === RUN TestDefaultConfig/#442 === PAUSE TestDefaultConfig/#442 === RUN TestDefaultConfig/#443 === PAUSE TestDefaultConfig/#443 === RUN TestDefaultConfig/#444 === PAUSE TestDefaultConfig/#444 === RUN TestDefaultConfig/#445 === PAUSE TestDefaultConfig/#445 === RUN TestDefaultConfig/#446 === PAUSE TestDefaultConfig/#446 === RUN TestDefaultConfig/#447 === PAUSE TestDefaultConfig/#447 === RUN TestDefaultConfig/#448 === PAUSE TestDefaultConfig/#448 === RUN TestDefaultConfig/#449 === PAUSE TestDefaultConfig/#449 === RUN TestDefaultConfig/#450 === PAUSE TestDefaultConfig/#450 === RUN TestDefaultConfig/#451 === PAUSE TestDefaultConfig/#451 === RUN TestDefaultConfig/#452 === PAUSE TestDefaultConfig/#452 === RUN TestDefaultConfig/#453 === PAUSE TestDefaultConfig/#453 === RUN TestDefaultConfig/#454 === PAUSE TestDefaultConfig/#454 === RUN TestDefaultConfig/#455 === PAUSE TestDefaultConfig/#455 === RUN TestDefaultConfig/#456 === PAUSE TestDefaultConfig/#456 === RUN TestDefaultConfig/#457 === PAUSE TestDefaultConfig/#457 === RUN TestDefaultConfig/#458 === PAUSE TestDefaultConfig/#458 === RUN TestDefaultConfig/#459 === PAUSE TestDefaultConfig/#459 === RUN TestDefaultConfig/#460 === PAUSE TestDefaultConfig/#460 === RUN TestDefaultConfig/#461 === PAUSE TestDefaultConfig/#461 === RUN TestDefaultConfig/#462 === PAUSE TestDefaultConfig/#462 === RUN TestDefaultConfig/#463 === PAUSE TestDefaultConfig/#463 === RUN TestDefaultConfig/#464 === PAUSE TestDefaultConfig/#464 === RUN TestDefaultConfig/#465 === PAUSE TestDefaultConfig/#465 === RUN TestDefaultConfig/#466 === PAUSE TestDefaultConfig/#466 === RUN TestDefaultConfig/#467 === PAUSE TestDefaultConfig/#467 === RUN TestDefaultConfig/#468 === PAUSE TestDefaultConfig/#468 === RUN TestDefaultConfig/#469 === PAUSE TestDefaultConfig/#469 === RUN TestDefaultConfig/#470 === PAUSE TestDefaultConfig/#470 === RUN TestDefaultConfig/#471 === PAUSE TestDefaultConfig/#471 === RUN TestDefaultConfig/#472 === PAUSE TestDefaultConfig/#472 === RUN TestDefaultConfig/#473 === PAUSE TestDefaultConfig/#473 === RUN TestDefaultConfig/#474 === PAUSE TestDefaultConfig/#474 === RUN TestDefaultConfig/#475 === PAUSE TestDefaultConfig/#475 === RUN TestDefaultConfig/#476 === PAUSE TestDefaultConfig/#476 === RUN TestDefaultConfig/#477 === PAUSE TestDefaultConfig/#477 === RUN TestDefaultConfig/#478 === PAUSE TestDefaultConfig/#478 === RUN TestDefaultConfig/#479 === PAUSE TestDefaultConfig/#479 === RUN TestDefaultConfig/#480 === PAUSE TestDefaultConfig/#480 === RUN TestDefaultConfig/#481 === PAUSE TestDefaultConfig/#481 === RUN TestDefaultConfig/#482 === PAUSE TestDefaultConfig/#482 === RUN TestDefaultConfig/#483 === PAUSE TestDefaultConfig/#483 === RUN TestDefaultConfig/#484 === PAUSE TestDefaultConfig/#484 === RUN TestDefaultConfig/#485 === PAUSE TestDefaultConfig/#485 === RUN TestDefaultConfig/#486 === PAUSE TestDefaultConfig/#486 === RUN TestDefaultConfig/#487 === PAUSE TestDefaultConfig/#487 === RUN TestDefaultConfig/#488 === PAUSE TestDefaultConfig/#488 === RUN TestDefaultConfig/#489 === PAUSE TestDefaultConfig/#489 === RUN TestDefaultConfig/#490 === PAUSE TestDefaultConfig/#490 === RUN TestDefaultConfig/#491 === PAUSE TestDefaultConfig/#491 === RUN TestDefaultConfig/#492 === PAUSE TestDefaultConfig/#492 === RUN TestDefaultConfig/#493 === PAUSE TestDefaultConfig/#493 === RUN TestDefaultConfig/#494 === PAUSE TestDefaultConfig/#494 === RUN TestDefaultConfig/#495 === PAUSE TestDefaultConfig/#495 === RUN TestDefaultConfig/#496 === PAUSE TestDefaultConfig/#496 === RUN TestDefaultConfig/#497 === PAUSE TestDefaultConfig/#497 === RUN TestDefaultConfig/#498 === PAUSE TestDefaultConfig/#498 === RUN TestDefaultConfig/#499 === PAUSE TestDefaultConfig/#499 === CONT TestDefaultConfig/#450 === CONT TestDefaultConfig/#346 === CONT TestDefaultConfig/#00 === CONT TestDefaultConfig/#345 === CONT TestDefaultConfig/#217 === CONT TestDefaultConfig/#495 === CONT TestDefaultConfig/#499 === CONT TestDefaultConfig/#498 === CONT TestDefaultConfig/#497 === CONT TestDefaultConfig/#496 === CONT TestDefaultConfig/#332 === CONT TestDefaultConfig/#330 === CONT TestDefaultConfig/#329 === CONT TestDefaultConfig/#328 === CONT TestDefaultConfig/#327 === CONT TestDefaultConfig/#331 === CONT TestDefaultConfig/#326 === CONT TestDefaultConfig/#325 === CONT TestDefaultConfig/#324 === CONT TestDefaultConfig/#323 === CONT TestDefaultConfig/#322 === CONT TestDefaultConfig/#321 === CONT TestDefaultConfig/#320 === CONT TestDefaultConfig/#319 === CONT TestDefaultConfig/#318 === CONT TestDefaultConfig/#317 === CONT TestDefaultConfig/#316 === CONT TestDefaultConfig/#315 === CONT TestDefaultConfig/#314 === CONT TestDefaultConfig/#313 === CONT TestDefaultConfig/#312 === CONT TestDefaultConfig/#311 === CONT TestDefaultConfig/#310 === CONT TestDefaultConfig/#309 === CONT TestDefaultConfig/#308 === CONT TestDefaultConfig/#307 === CONT TestDefaultConfig/#306 === CONT TestDefaultConfig/#305 === CONT TestDefaultConfig/#304 === CONT TestDefaultConfig/#303 === CONT TestDefaultConfig/#302 === CONT TestDefaultConfig/#301 === CONT TestDefaultConfig/#300 === CONT TestDefaultConfig/#299 === CONT TestDefaultConfig/#298 === CONT TestDefaultConfig/#297 [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#296 === CONT TestDefaultConfig/#267 === CONT TestDefaultConfig/#295 === CONT TestDefaultConfig/#294 === CONT TestDefaultConfig/#293 === CONT TestDefaultConfig/#292 === CONT TestDefaultConfig/#291 === CONT TestDefaultConfig/#290 === CONT TestDefaultConfig/#289 === CONT TestDefaultConfig/#288 === CONT TestDefaultConfig/#287 === CONT TestDefaultConfig/#286 === CONT TestDefaultConfig/#285 === CONT TestDefaultConfig/#284 === CONT TestDefaultConfig/#283 === CONT TestDefaultConfig/#282 === CONT TestDefaultConfig/#281 === CONT TestDefaultConfig/#280 === CONT TestDefaultConfig/#278 === CONT TestDefaultConfig/#279 === CONT TestDefaultConfig/#277 === CONT TestDefaultConfig/#276 === CONT TestDefaultConfig/#275 === CONT TestDefaultConfig/#274 === CONT TestDefaultConfig/#273 === CONT TestDefaultConfig/#272 === CONT TestDefaultConfig/#271 === CONT TestDefaultConfig/#270 === CONT TestDefaultConfig/#269 === CONT TestDefaultConfig/#268 === CONT TestDefaultConfig/#266 === CONT TestDefaultConfig/#265 === CONT TestDefaultConfig/#264 === CONT TestDefaultConfig/#263 === CONT TestDefaultConfig/#262 === CONT TestDefaultConfig/#261 === CONT TestDefaultConfig/#260 === CONT TestDefaultConfig/#258 === CONT TestDefaultConfig/#257 === CONT TestDefaultConfig/#256 === CONT TestDefaultConfig/#259 === CONT TestDefaultConfig/#255 === CONT TestDefaultConfig/#254 === CONT TestDefaultConfig/#253 === CONT TestDefaultConfig/#252 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#251 === CONT TestDefaultConfig/#250 === CONT TestDefaultConfig/#249 === CONT TestDefaultConfig/#248 === CONT TestDefaultConfig/#247 === CONT TestDefaultConfig/#246 === CONT TestDefaultConfig/#245 === CONT TestDefaultConfig/#244 === CONT TestDefaultConfig/#243 === CONT TestDefaultConfig/#242 === CONT TestDefaultConfig/#241 === CONT TestDefaultConfig/#240 === CONT TestDefaultConfig/#239 === CONT TestDefaultConfig/#238 === CONT TestDefaultConfig/#237 === CONT TestDefaultConfig/#236 === CONT TestDefaultConfig/#235 === CONT TestDefaultConfig/#234 === CONT TestDefaultConfig/#233 === CONT TestDefaultConfig/#232 === CONT TestDefaultConfig/#231 === CONT TestDefaultConfig/#230 === CONT TestDefaultConfig/#229 === CONT TestDefaultConfig/#228 === CONT TestDefaultConfig/#227 === CONT TestDefaultConfig/#226 === CONT TestDefaultConfig/#225 === CONT TestDefaultConfig/#224 === CONT TestDefaultConfig/#223 === CONT TestDefaultConfig/#222 === CONT TestDefaultConfig/#221 === CONT TestDefaultConfig/#220 === CONT TestDefaultConfig/#219 === CONT TestDefaultConfig/#218 === CONT TestDefaultConfig/#89 === CONT TestDefaultConfig/#449 === CONT TestDefaultConfig/#448 === CONT TestDefaultConfig/#447 === CONT TestDefaultConfig/#195 === CONT TestDefaultConfig/#446 === CONT TestDefaultConfig/#445 === CONT TestDefaultConfig/#444 === CONT TestDefaultConfig/#443 === CONT TestDefaultConfig/#442 === CONT TestDefaultConfig/#441 === CONT TestDefaultConfig/#440 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#439 === CONT TestDefaultConfig/#438 === CONT TestDefaultConfig/#437 === CONT TestDefaultConfig/#436 === CONT TestDefaultConfig/#435 === CONT TestDefaultConfig/#434 === CONT TestDefaultConfig/#433 === CONT TestDefaultConfig/#432 === CONT TestDefaultConfig/#431 === CONT TestDefaultConfig/#430 === CONT TestDefaultConfig/#429 === CONT TestDefaultConfig/#428 === CONT TestDefaultConfig/#427 === CONT TestDefaultConfig/#426 === CONT TestDefaultConfig/#425 === CONT TestDefaultConfig/#194 === CONT TestDefaultConfig/#424 === CONT TestDefaultConfig/#423 === CONT TestDefaultConfig/#193 === CONT TestDefaultConfig/#422 === CONT TestDefaultConfig/#192 === CONT TestDefaultConfig/#421 === CONT TestDefaultConfig/#191 === CONT TestDefaultConfig/#420 === CONT TestDefaultConfig/#190 === CONT TestDefaultConfig/#419 === CONT TestDefaultConfig/#189 === CONT TestDefaultConfig/#418 === CONT TestDefaultConfig/#188 === CONT TestDefaultConfig/#417 === CONT TestDefaultConfig/#187 === CONT TestDefaultConfig/#416 === CONT TestDefaultConfig/#186 === CONT TestDefaultConfig/#415 === CONT TestDefaultConfig/#185 === CONT TestDefaultConfig/#414 === CONT TestDefaultConfig/#184 === CONT TestDefaultConfig/#413 === CONT TestDefaultConfig/#183 === CONT TestDefaultConfig/#412 === CONT TestDefaultConfig/#411 === CONT TestDefaultConfig/#410 === CONT TestDefaultConfig/#409 === CONT TestDefaultConfig/#408 === CONT TestDefaultConfig/#407 === CONT TestDefaultConfig/#406 === CONT TestDefaultConfig/#182 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#404 === CONT TestDefaultConfig/#180 === CONT TestDefaultConfig/#403 === CONT TestDefaultConfig/#405 === CONT TestDefaultConfig/#179 === CONT TestDefaultConfig/#181 === CONT TestDefaultConfig/#402 === CONT TestDefaultConfig/#178 === CONT TestDefaultConfig/#401 === CONT TestDefaultConfig/#177 === CONT TestDefaultConfig/#400 === CONT TestDefaultConfig/#176 === CONT TestDefaultConfig/#399 === CONT TestDefaultConfig/#175 === CONT TestDefaultConfig/#398 === CONT TestDefaultConfig/#397 === CONT TestDefaultConfig/#174 === CONT TestDefaultConfig/#396 === CONT TestDefaultConfig/#173 === CONT TestDefaultConfig/#395 === CONT TestDefaultConfig/#172 === CONT TestDefaultConfig/#394 === CONT TestDefaultConfig/#171 === CONT TestDefaultConfig/#393 === CONT TestDefaultConfig/#170 === CONT TestDefaultConfig/#169 === CONT TestDefaultConfig/#156 === CONT TestDefaultConfig/#168 === CONT TestDefaultConfig/#167 === CONT TestDefaultConfig/#166 === CONT TestDefaultConfig/#165 === CONT TestDefaultConfig/#164 === CONT TestDefaultConfig/#163 === CONT TestDefaultConfig/#162 === CONT TestDefaultConfig/#161 === CONT TestDefaultConfig/#160 === CONT TestDefaultConfig/#159 === CONT TestDefaultConfig/#158 === CONT TestDefaultConfig/#157 === CONT TestDefaultConfig/#155 === CONT TestDefaultConfig/#154 === CONT TestDefaultConfig/#153 === CONT TestDefaultConfig/#152 === CONT TestDefaultConfig/#151 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#150 === CONT TestDefaultConfig/#149 === CONT TestDefaultConfig/#148 === CONT TestDefaultConfig/#147 === CONT TestDefaultConfig/#146 === CONT TestDefaultConfig/#144 === CONT TestDefaultConfig/#143 === CONT TestDefaultConfig/#142 === CONT TestDefaultConfig/#145 === CONT TestDefaultConfig/#141 === CONT TestDefaultConfig/#140 === CONT TestDefaultConfig/#139 === CONT TestDefaultConfig/#138 === CONT TestDefaultConfig/#137 === CONT TestDefaultConfig/#136 === CONT TestDefaultConfig/#135 === CONT TestDefaultConfig/#134 === CONT TestDefaultConfig/#133 === CONT TestDefaultConfig/#132 === CONT TestDefaultConfig/#131 === CONT TestDefaultConfig/#130 === CONT TestDefaultConfig/#129 === CONT TestDefaultConfig/#127 === CONT TestDefaultConfig/#126 === CONT TestDefaultConfig/#125 === CONT TestDefaultConfig/#128 === CONT TestDefaultConfig/#124 === CONT TestDefaultConfig/#123 === CONT TestDefaultConfig/#122 === CONT TestDefaultConfig/#121 === CONT TestDefaultConfig/#120 === CONT TestDefaultConfig/#119 === CONT TestDefaultConfig/#118 === CONT TestDefaultConfig/#117 === CONT TestDefaultConfig/#116 === CONT TestDefaultConfig/#115 === CONT TestDefaultConfig/#114 === CONT TestDefaultConfig/#113 === CONT TestDefaultConfig/#112 === CONT TestDefaultConfig/#111 === CONT TestDefaultConfig/#110 === CONT TestDefaultConfig/#109 === CONT TestDefaultConfig/#108 === CONT TestDefaultConfig/#100 === CONT TestDefaultConfig/#107 === CONT TestDefaultConfig/#106 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#104 === CONT TestDefaultConfig/#103 === CONT TestDefaultConfig/#105 === CONT TestDefaultConfig/#102 === CONT TestDefaultConfig/#101 === CONT TestDefaultConfig/#99 === CONT TestDefaultConfig/#98 === CONT TestDefaultConfig/#97 === CONT TestDefaultConfig/#96 === CONT TestDefaultConfig/#95 === CONT TestDefaultConfig/#94 === CONT TestDefaultConfig/#93 === CONT TestDefaultConfig/#92 === CONT TestDefaultConfig/#91 === CONT TestDefaultConfig/#90 === CONT TestDefaultConfig/#88 === CONT TestDefaultConfig/#87 === CONT TestDefaultConfig/#86 === CONT TestDefaultConfig/#84 === CONT TestDefaultConfig/#83 === CONT TestDefaultConfig/#82 === CONT TestDefaultConfig/#85 === CONT TestDefaultConfig/#81 === CONT TestDefaultConfig/#80 === CONT TestDefaultConfig/#79 === CONT TestDefaultConfig/#78 === CONT TestDefaultConfig/#392 === CONT TestDefaultConfig/#76 === CONT TestDefaultConfig/#390 === CONT TestDefaultConfig/#75 === CONT TestDefaultConfig/#77 === CONT TestDefaultConfig/#391 === CONT TestDefaultConfig/#74 === CONT TestDefaultConfig/#73 === CONT TestDefaultConfig/#72 === CONT TestDefaultConfig/#389 === CONT TestDefaultConfig/#71 === CONT TestDefaultConfig/#388 === CONT TestDefaultConfig/#387 === CONT TestDefaultConfig/#70 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#62 === CONT TestDefaultConfig/#69 === CONT TestDefaultConfig/#68 === CONT TestDefaultConfig/#385 === CONT TestDefaultConfig/#67 === CONT TestDefaultConfig/#384 === CONT TestDefaultConfig/#66 === CONT TestDefaultConfig/#383 === CONT TestDefaultConfig/#65 === CONT TestDefaultConfig/#382 === CONT TestDefaultConfig/#386 === CONT TestDefaultConfig/#64 === CONT TestDefaultConfig/#381 === CONT TestDefaultConfig/#63 === CONT TestDefaultConfig/#380 === CONT TestDefaultConfig/#379 === CONT TestDefaultConfig/#61 === CONT TestDefaultConfig/#60 === CONT TestDefaultConfig/#59 === CONT TestDefaultConfig/#378 === CONT TestDefaultConfig/#376 === CONT TestDefaultConfig/#377 === CONT TestDefaultConfig/#375 === CONT TestDefaultConfig/#58 === CONT TestDefaultConfig/#374 === CONT TestDefaultConfig/#373 === CONT TestDefaultConfig/#57 === CONT TestDefaultConfig/#372 === CONT TestDefaultConfig/#56 === CONT TestDefaultConfig/#55 === CONT TestDefaultConfig/#54 === CONT TestDefaultConfig/#53 === CONT TestDefaultConfig/#52 === CONT TestDefaultConfig/#51 === CONT TestDefaultConfig/#371 === CONT TestDefaultConfig/#50 === CONT TestDefaultConfig/#370 === CONT TestDefaultConfig/#49 === CONT TestDefaultConfig/#369 === CONT TestDefaultConfig/#368 === CONT TestDefaultConfig/#367 === CONT TestDefaultConfig/#48 === CONT TestDefaultConfig/#366 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#365 === CONT TestDefaultConfig/#364 === CONT TestDefaultConfig/#361 === CONT TestDefaultConfig/#360 === CONT TestDefaultConfig/#362 === CONT TestDefaultConfig/#359 === CONT TestDefaultConfig/#363 === CONT TestDefaultConfig/#358 === CONT TestDefaultConfig/#357 === CONT TestDefaultConfig/#356 === CONT TestDefaultConfig/#355 === CONT TestDefaultConfig/#354 === CONT TestDefaultConfig/#353 === CONT TestDefaultConfig/#352 === CONT TestDefaultConfig/#351 === CONT TestDefaultConfig/#349 === CONT TestDefaultConfig/#348 === CONT TestDefaultConfig/#350 === CONT TestDefaultConfig/#347 === CONT TestDefaultConfig/#43 === CONT TestDefaultConfig/#42 === CONT TestDefaultConfig/#41 === CONT TestDefaultConfig/#40 === CONT TestDefaultConfig/#39 === CONT TestDefaultConfig/#38 === CONT TestDefaultConfig/#37 === CONT TestDefaultConfig/#36 === CONT TestDefaultConfig/#35 === CONT TestDefaultConfig/#34 === CONT TestDefaultConfig/#33 === CONT TestDefaultConfig/#32 === CONT TestDefaultConfig/#31 === CONT TestDefaultConfig/#30 === CONT TestDefaultConfig/#29 === CONT TestDefaultConfig/#28 === CONT TestDefaultConfig/#27 === CONT TestDefaultConfig/#26 === CONT TestDefaultConfig/#25 === CONT TestDefaultConfig/#24 === CONT TestDefaultConfig/#23 === CONT TestDefaultConfig/#22 === CONT TestDefaultConfig/#21 === CONT TestDefaultConfig/#19 === CONT TestDefaultConfig/#20 === CONT TestDefaultConfig/#18 === CONT TestDefaultConfig/#17 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#16 === CONT TestDefaultConfig/#15 === CONT TestDefaultConfig/#14 === CONT TestDefaultConfig/#13 === CONT TestDefaultConfig/#12 === CONT TestDefaultConfig/#11 === CONT TestDefaultConfig/#10 === CONT TestDefaultConfig/#09 === CONT TestDefaultConfig/#08 === CONT TestDefaultConfig/#07 === CONT TestDefaultConfig/#06 === CONT TestDefaultConfig/#05 === CONT TestDefaultConfig/#04 === CONT TestDefaultConfig/#02 === CONT TestDefaultConfig/#01 === CONT TestDefaultConfig/#473 === CONT TestDefaultConfig/#494 === CONT TestDefaultConfig/#493 === CONT TestDefaultConfig/#492 === CONT TestDefaultConfig/#03 === CONT TestDefaultConfig/#491 === CONT TestDefaultConfig/#490 === CONT TestDefaultConfig/#489 === CONT TestDefaultConfig/#488 === CONT TestDefaultConfig/#487 === CONT TestDefaultConfig/#486 === CONT TestDefaultConfig/#485 === CONT TestDefaultConfig/#484 === CONT TestDefaultConfig/#483 === CONT TestDefaultConfig/#482 === CONT TestDefaultConfig/#481 === CONT TestDefaultConfig/#480 === CONT TestDefaultConfig/#479 === CONT TestDefaultConfig/#478 === CONT TestDefaultConfig/#477 === CONT TestDefaultConfig/#476 === CONT TestDefaultConfig/#475 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#474 === CONT TestDefaultConfig/#45 === CONT TestDefaultConfig/#46 === CONT TestDefaultConfig/#206 === CONT TestDefaultConfig/#216 === CONT TestDefaultConfig/#215 === CONT TestDefaultConfig/#214 === CONT TestDefaultConfig/#44 === CONT TestDefaultConfig/#212 === CONT TestDefaultConfig/#211 === CONT TestDefaultConfig/#201 === CONT TestDefaultConfig/#210 === CONT TestDefaultConfig/#205 === CONT TestDefaultConfig/#213 === CONT TestDefaultConfig/#209 === CONT TestDefaultConfig/#204 === CONT TestDefaultConfig/#208 === CONT TestDefaultConfig/#203 === CONT TestDefaultConfig/#202 === CONT TestDefaultConfig/#336 === CONT TestDefaultConfig/#207 === CONT TestDefaultConfig/#344 === CONT TestDefaultConfig/#343 === CONT TestDefaultConfig/#342 === CONT TestDefaultConfig/#462 === CONT TestDefaultConfig/#341 === CONT TestDefaultConfig/#472 === CONT TestDefaultConfig/#340 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestDefaultConfig/#471 === CONT TestDefaultConfig/#469 === CONT TestDefaultConfig/#468 === CONT TestDefaultConfig/#470 === CONT TestDefaultConfig/#467 === CONT TestDefaultConfig/#466 === CONT TestDefaultConfig/#465 === CONT TestDefaultConfig/#464 === CONT TestDefaultConfig/#463 === CONT TestDefaultConfig/#339 === CONT TestDefaultConfig/#338 === CONT TestDefaultConfig/#337 === CONT TestDefaultConfig/#198 === CONT TestDefaultConfig/#200 === CONT TestDefaultConfig/#199 === CONT TestDefaultConfig/#335 === CONT TestDefaultConfig/#334 === CONT TestDefaultConfig/#197 === CONT TestDefaultConfig/#333 === CONT TestDefaultConfig/#456 === CONT TestDefaultConfig/#461 === CONT TestDefaultConfig/#460 === CONT TestDefaultConfig/#47 === CONT TestDefaultConfig/#459 === CONT TestDefaultConfig/#458 === CONT TestDefaultConfig/#457 === CONT TestDefaultConfig/#196 === CONT TestDefaultConfig/#453 === CONT TestDefaultConfig/#455 === CONT TestDefaultConfig/#454 === CONT TestDefaultConfig/#452 === CONT TestDefaultConfig/#451 --- PASS: TestDefaultConfig (0.02s) --- PASS: TestDefaultConfig/#346 (0.06s) --- PASS: TestDefaultConfig/#345 (0.06s) --- PASS: TestDefaultConfig/#450 (0.07s) --- PASS: TestDefaultConfig/#00 (0.07s) --- PASS: TestDefaultConfig/#217 (0.07s) --- PASS: TestDefaultConfig/#496 (0.04s) --- PASS: TestDefaultConfig/#498 (0.06s) --- PASS: TestDefaultConfig/#332 (0.03s) --- PASS: TestDefaultConfig/#499 (0.07s) --- PASS: TestDefaultConfig/#495 (0.08s) --- PASS: TestDefaultConfig/#497 (0.06s) --- PASS: TestDefaultConfig/#330 (0.03s) --- PASS: TestDefaultConfig/#327 (0.03s) --- PASS: TestDefaultConfig/#328 (0.03s) --- PASS: TestDefaultConfig/#331 (0.02s) --- PASS: TestDefaultConfig/#329 (0.04s) --- PASS: TestDefaultConfig/#326 (0.02s) --- PASS: TestDefaultConfig/#319 (0.01s) --- PASS: TestDefaultConfig/#322 (0.06s) --- PASS: TestDefaultConfig/#318 (0.06s) --- PASS: TestDefaultConfig/#325 (0.07s) --- PASS: TestDefaultConfig/#324 (0.08s) --- PASS: TestDefaultConfig/#314 (0.01s) --- PASS: TestDefaultConfig/#313 (0.01s) --- PASS: TestDefaultConfig/#316 (0.06s) --- PASS: TestDefaultConfig/#320 (0.07s) --- PASS: TestDefaultConfig/#310 (0.02s) --- PASS: TestDefaultConfig/#323 (0.10s) --- PASS: TestDefaultConfig/#307 (0.02s) --- PASS: TestDefaultConfig/#315 (0.09s) --- PASS: TestDefaultConfig/#309 (0.03s) --- PASS: TestDefaultConfig/#321 (0.10s) --- PASS: TestDefaultConfig/#306 (0.01s) --- PASS: TestDefaultConfig/#308 (0.03s) --- PASS: TestDefaultConfig/#305 (0.01s) --- PASS: TestDefaultConfig/#304 (0.01s) --- PASS: TestDefaultConfig/#312 (0.08s) --- PASS: TestDefaultConfig/#317 (0.14s) --- PASS: TestDefaultConfig/#311 (0.09s) --- PASS: TestDefaultConfig/#298 (0.07s) --- PASS: TestDefaultConfig/#300 (0.07s) --- PASS: TestDefaultConfig/#303 (0.09s) --- PASS: TestDefaultConfig/#296 (0.05s) --- PASS: TestDefaultConfig/#301 (0.09s) --- PASS: TestDefaultConfig/#293 (0.02s) --- PASS: TestDefaultConfig/#294 (0.02s) --- PASS: TestDefaultConfig/#299 (0.09s) --- PASS: TestDefaultConfig/#267 (0.04s) --- PASS: TestDefaultConfig/#302 (0.10s) --- PASS: TestDefaultConfig/#295 (0.05s) --- PASS: TestDefaultConfig/#291 (0.02s) --- PASS: TestDefaultConfig/#288 (0.02s) --- PASS: TestDefaultConfig/#292 (0.03s) --- PASS: TestDefaultConfig/#286 (0.02s) --- PASS: TestDefaultConfig/#290 (0.04s) --- PASS: TestDefaultConfig/#297 (0.14s) --- PASS: TestDefaultConfig/#285 (0.05s) --- PASS: TestDefaultConfig/#284 (0.07s) --- PASS: TestDefaultConfig/#283 (0.07s) --- PASS: TestDefaultConfig/#282 (0.06s) --- PASS: TestDefaultConfig/#279 (0.04s) --- PASS: TestDefaultConfig/#274 (0.01s) --- PASS: TestDefaultConfig/#277 (0.04s) --- PASS: TestDefaultConfig/#280 (0.08s) --- PASS: TestDefaultConfig/#275 (0.02s) --- PASS: TestDefaultConfig/#278 (0.05s) --- PASS: TestDefaultConfig/#276 (0.02s) --- PASS: TestDefaultConfig/#281 (0.08s) --- PASS: TestDefaultConfig/#272 (0.01s) --- PASS: TestDefaultConfig/#287 (0.10s) --- PASS: TestDefaultConfig/#271 (0.01s) --- PASS: TestDefaultConfig/#289 (0.11s) --- PASS: TestDefaultConfig/#264 (0.01s) --- PASS: TestDefaultConfig/#273 (0.02s) --- PASS: TestDefaultConfig/#269 (0.04s) --- PASS: TestDefaultConfig/#266 (0.05s) --- PASS: TestDefaultConfig/#270 (0.05s) --- PASS: TestDefaultConfig/#265 (0.06s) --- PASS: TestDefaultConfig/#268 (0.09s) --- PASS: TestDefaultConfig/#262 (0.08s) --- PASS: TestDefaultConfig/#261 (0.08s) --- PASS: TestDefaultConfig/#253 (0.01s) --- PASS: TestDefaultConfig/#254 (0.02s) --- PASS: TestDefaultConfig/#263 (0.10s) --- PASS: TestDefaultConfig/#257 (0.07s) --- PASS: TestDefaultConfig/#259 (0.06s) --- PASS: TestDefaultConfig/#256 (0.06s) --- PASS: TestDefaultConfig/#250 (0.02s) --- PASS: TestDefaultConfig/#255 (0.06s) --- PASS: TestDefaultConfig/#249 (0.02s) --- PASS: TestDefaultConfig/#258 (0.09s) --- PASS: TestDefaultConfig/#247 (0.01s) --- PASS: TestDefaultConfig/#251 (0.04s) --- PASS: TestDefaultConfig/#252 (0.04s) --- PASS: TestDefaultConfig/#260 (0.11s) --- PASS: TestDefaultConfig/#245 (0.03s) --- PASS: TestDefaultConfig/#241 (0.03s) --- PASS: TestDefaultConfig/#242 (0.05s) --- PASS: TestDefaultConfig/#239 (0.06s) --- PASS: TestDefaultConfig/#248 (0.08s) --- PASS: TestDefaultConfig/#235 (0.02s) --- PASS: TestDefaultConfig/#243 (0.08s) --- PASS: TestDefaultConfig/#240 (0.08s) --- PASS: TestDefaultConfig/#238 (0.07s) --- PASS: TestDefaultConfig/#237 (0.06s) --- PASS: TestDefaultConfig/#246 (0.10s) --- PASS: TestDefaultConfig/#244 (0.10s) --- PASS: TestDefaultConfig/#232 (0.02s) --- PASS: TestDefaultConfig/#230 (0.02s) --- PASS: TestDefaultConfig/#233 (0.03s) --- PASS: TestDefaultConfig/#229 (0.02s) --- PASS: TestDefaultConfig/#231 (0.03s) --- PASS: TestDefaultConfig/#234 (0.04s) --- PASS: TestDefaultConfig/#228 (0.03s) --- PASS: TestDefaultConfig/#221 (0.01s) --- PASS: TestDefaultConfig/#227 (0.03s) --- PASS: TestDefaultConfig/#223 (0.08s) --- PASS: TestDefaultConfig/#226 (0.09s) --- PASS: TestDefaultConfig/#449 (0.01s) --- PASS: TestDefaultConfig/#236 (0.16s) --- PASS: TestDefaultConfig/#224 (0.10s) --- PASS: TestDefaultConfig/#447 (0.01s) --- PASS: TestDefaultConfig/#218 (0.09s) --- PASS: TestDefaultConfig/#222 (0.10s) --- PASS: TestDefaultConfig/#195 (0.01s) --- PASS: TestDefaultConfig/#448 (0.03s) --- PASS: TestDefaultConfig/#219 (0.10s) --- PASS: TestDefaultConfig/#225 (0.12s) --- PASS: TestDefaultConfig/#89 (0.10s) --- PASS: TestDefaultConfig/#220 (0.11s) --- PASS: TestDefaultConfig/#443 (0.01s) --- PASS: TestDefaultConfig/#440 (0.02s) --- PASS: TestDefaultConfig/#439 (0.02s) --- PASS: TestDefaultConfig/#444 (0.05s) --- PASS: TestDefaultConfig/#445 (0.06s) --- PASS: TestDefaultConfig/#441 (0.05s) --- PASS: TestDefaultConfig/#434 (0.05s) --- PASS: TestDefaultConfig/#433 (0.06s) --- PASS: TestDefaultConfig/#436 (0.09s) --- PASS: TestDefaultConfig/#437 (0.10s) --- PASS: TestDefaultConfig/#446 (0.12s) --- PASS: TestDefaultConfig/#429 (0.01s) --- PASS: TestDefaultConfig/#438 (0.11s) --- PASS: TestDefaultConfig/#435 (0.10s) --- PASS: TestDefaultConfig/#425 (0.01s) --- PASS: TestDefaultConfig/#442 (0.12s) --- PASS: TestDefaultConfig/#431 (0.08s) --- PASS: TestDefaultConfig/#423 (0.01s) --- PASS: TestDefaultConfig/#432 (0.08s) --- PASS: TestDefaultConfig/#427 (0.02s) --- PASS: TestDefaultConfig/#192 (0.01s) --- PASS: TestDefaultConfig/#430 (0.05s) --- PASS: TestDefaultConfig/#424 (0.02s) --- PASS: TestDefaultConfig/#428 (0.04s) --- PASS: TestDefaultConfig/#420 (0.01s) --- PASS: TestDefaultConfig/#193 (0.04s) --- PASS: TestDefaultConfig/#194 (0.05s) --- PASS: TestDefaultConfig/#190 (0.05s) --- PASS: TestDefaultConfig/#191 (0.05s) --- PASS: TestDefaultConfig/#188 (0.04s) --- PASS: TestDefaultConfig/#189 (0.06s) --- PASS: TestDefaultConfig/#416 (0.02s) --- PASS: TestDefaultConfig/#422 (0.09s) --- PASS: TestDefaultConfig/#418 (0.07s) --- PASS: TestDefaultConfig/#426 (0.11s) --- PASS: TestDefaultConfig/#421 (0.09s) --- PASS: TestDefaultConfig/#419 (0.09s) --- PASS: TestDefaultConfig/#186 (0.02s) --- PASS: TestDefaultConfig/#184 (0.02s) --- PASS: TestDefaultConfig/#183 (0.02s) --- PASS: TestDefaultConfig/#415 (0.03s) --- PASS: TestDefaultConfig/#185 (0.03s) --- PASS: TestDefaultConfig/#187 (0.05s) --- PASS: TestDefaultConfig/#417 (0.07s) --- PASS: TestDefaultConfig/#411 (0.04s) --- PASS: TestDefaultConfig/#412 (0.05s) --- PASS: TestDefaultConfig/#414 (0.06s) --- PASS: TestDefaultConfig/#407 (0.04s) --- PASS: TestDefaultConfig/#413 (0.07s) --- PASS: TestDefaultConfig/#409 (0.06s) --- PASS: TestDefaultConfig/#182 (0.06s) --- PASS: TestDefaultConfig/#410 (0.08s) --- PASS: TestDefaultConfig/#402 (0.01s) --- PASS: TestDefaultConfig/#408 (0.08s) --- PASS: TestDefaultConfig/#403 (0.04s) --- PASS: TestDefaultConfig/#180 (0.06s) --- PASS: TestDefaultConfig/#406 (0.10s) --- PASS: TestDefaultConfig/#401 (0.03s) --- PASS: TestDefaultConfig/#404 (0.07s) --- PASS: TestDefaultConfig/#179 (0.05s) --- PASS: TestDefaultConfig/#178 (0.04s) --- PASS: TestDefaultConfig/#399 (0.02s) --- PASS: TestDefaultConfig/#400 (0.03s) --- PASS: TestDefaultConfig/#405 (0.07s) --- PASS: TestDefaultConfig/#181 (0.07s) --- PASS: TestDefaultConfig/#175 (0.02s) --- PASS: TestDefaultConfig/#396 (0.03s) --- PASS: TestDefaultConfig/#398 (0.04s) --- PASS: TestDefaultConfig/#177 (0.07s) --- PASS: TestDefaultConfig/#173 (0.04s) --- PASS: TestDefaultConfig/#176 (0.06s) --- PASS: TestDefaultConfig/#397 (0.06s) --- PASS: TestDefaultConfig/#394 (0.07s) --- PASS: TestDefaultConfig/#170 (0.05s) --- PASS: TestDefaultConfig/#168 (0.03s) --- PASS: TestDefaultConfig/#393 (0.06s) --- PASS: TestDefaultConfig/#165 (0.01s) --- PASS: TestDefaultConfig/#156 (0.06s) --- PASS: TestDefaultConfig/#166 (0.02s) --- PASS: TestDefaultConfig/#172 (0.10s) --- PASS: TestDefaultConfig/#169 (0.06s) --- PASS: TestDefaultConfig/#395 (0.11s) --- PASS: TestDefaultConfig/#171 (0.08s) --- PASS: TestDefaultConfig/#174 (0.12s) --- PASS: TestDefaultConfig/#164 (0.03s) --- PASS: TestDefaultConfig/#163 (0.02s) --- PASS: TestDefaultConfig/#167 (0.04s) --- PASS: TestDefaultConfig/#155 (0.03s) --- PASS: TestDefaultConfig/#153 (0.03s) --- PASS: TestDefaultConfig/#162 (0.05s) --- PASS: TestDefaultConfig/#157 (0.04s) --- PASS: TestDefaultConfig/#159 (0.05s) --- PASS: TestDefaultConfig/#161 (0.05s) --- PASS: TestDefaultConfig/#149 (0.04s) --- PASS: TestDefaultConfig/#160 (0.09s) --- PASS: TestDefaultConfig/#158 (0.08s) --- PASS: TestDefaultConfig/#154 (0.08s) --- PASS: TestDefaultConfig/#148 (0.05s) --- PASS: TestDefaultConfig/#151 (0.07s) --- PASS: TestDefaultConfig/#152 (0.09s) --- PASS: TestDefaultConfig/#145 (0.02s) --- PASS: TestDefaultConfig/#142 (0.02s) --- PASS: TestDefaultConfig/#147 (0.07s) --- PASS: TestDefaultConfig/#144 (0.04s) --- PASS: TestDefaultConfig/#143 (0.04s) --- PASS: TestDefaultConfig/#146 (0.07s) --- PASS: TestDefaultConfig/#138 (0.02s) --- PASS: TestDefaultConfig/#140 (0.02s) --- PASS: TestDefaultConfig/#141 (0.03s) --- PASS: TestDefaultConfig/#136 (0.03s) --- PASS: TestDefaultConfig/#150 (0.12s) --- PASS: TestDefaultConfig/#139 (0.05s) --- PASS: TestDefaultConfig/#134 (0.04s) --- PASS: TestDefaultConfig/#135 (0.04s) --- PASS: TestDefaultConfig/#137 (0.06s) --- PASS: TestDefaultConfig/#129 (0.06s) --- PASS: TestDefaultConfig/#133 (0.09s) --- PASS: TestDefaultConfig/#125 (0.05s) --- PASS: TestDefaultConfig/#130 (0.09s) --- PASS: TestDefaultConfig/#132 (0.10s) --- PASS: TestDefaultConfig/#128 (0.06s) --- PASS: TestDefaultConfig/#123 (0.02s) --- PASS: TestDefaultConfig/#120 (0.02s) --- PASS: TestDefaultConfig/#122 (0.02s) --- PASS: TestDefaultConfig/#131 (0.11s) --- PASS: TestDefaultConfig/#124 (0.07s) --- PASS: TestDefaultConfig/#127 (0.08s) --- PASS: TestDefaultConfig/#121 (0.03s) --- PASS: TestDefaultConfig/#119 (0.03s) --- PASS: TestDefaultConfig/#118 (0.03s) --- PASS: TestDefaultConfig/#116 (0.02s) --- PASS: TestDefaultConfig/#126 (0.14s) --- PASS: TestDefaultConfig/#117 (0.07s) --- PASS: TestDefaultConfig/#115 (0.07s) --- PASS: TestDefaultConfig/#111 (0.10s) --- PASS: TestDefaultConfig/#112 (0.11s) --- PASS: TestDefaultConfig/#109 (0.08s) --- PASS: TestDefaultConfig/#114 (0.12s) --- PASS: TestDefaultConfig/#106 (0.05s) --- PASS: TestDefaultConfig/#113 (0.12s) --- PASS: TestDefaultConfig/#104 (0.01s) --- PASS: TestDefaultConfig/#108 (0.11s) --- PASS: TestDefaultConfig/#102 (0.02s) --- PASS: TestDefaultConfig/#110 (0.12s) --- PASS: TestDefaultConfig/#101 (0.02s) --- PASS: TestDefaultConfig/#99 (0.02s) --- PASS: TestDefaultConfig/#96 (0.01s) --- PASS: TestDefaultConfig/#97 (0.02s) --- PASS: TestDefaultConfig/#100 (0.08s) --- PASS: TestDefaultConfig/#98 (0.03s) --- PASS: TestDefaultConfig/#103 (0.04s) --- PASS: TestDefaultConfig/#95 (0.02s) --- PASS: TestDefaultConfig/#107 (0.12s) --- PASS: TestDefaultConfig/#105 (0.08s) --- PASS: TestDefaultConfig/#94 (0.05s) --- PASS: TestDefaultConfig/#91 (0.06s) --- PASS: TestDefaultConfig/#86 (0.07s) --- PASS: TestDefaultConfig/#88 (0.09s) --- PASS: TestDefaultConfig/#93 (0.10s) --- PASS: TestDefaultConfig/#82 (0.04s) --- PASS: TestDefaultConfig/#90 (0.10s) --- PASS: TestDefaultConfig/#85 (0.04s) --- PASS: TestDefaultConfig/#92 (0.10s) --- PASS: TestDefaultConfig/#79 (0.01s) --- PASS: TestDefaultConfig/#81 (0.03s) --- PASS: TestDefaultConfig/#87 (0.10s) --- PASS: TestDefaultConfig/#83 (0.06s) --- PASS: TestDefaultConfig/#76 (0.01s) --- PASS: TestDefaultConfig/#84 (0.07s) --- PASS: TestDefaultConfig/#80 (0.03s) --- PASS: TestDefaultConfig/#390 (0.02s) --- PASS: TestDefaultConfig/#78 (0.03s) --- PASS: TestDefaultConfig/#392 (0.06s) --- PASS: TestDefaultConfig/#72 (0.04s) --- PASS: TestDefaultConfig/#391 (0.05s) --- PASS: TestDefaultConfig/#77 (0.06s) --- PASS: TestDefaultConfig/#75 (0.11s) --- PASS: TestDefaultConfig/#62 (0.07s) --- PASS: TestDefaultConfig/#71 (0.11s) --- PASS: TestDefaultConfig/#388 (0.11s) --- PASS: TestDefaultConfig/#73 (0.13s) --- PASS: TestDefaultConfig/#389 (0.12s) --- PASS: TestDefaultConfig/#74 (0.14s) --- PASS: TestDefaultConfig/#385 (0.02s) --- PASS: TestDefaultConfig/#68 (0.02s) --- PASS: TestDefaultConfig/#387 (0.10s) --- PASS: TestDefaultConfig/#384 (0.02s) --- PASS: TestDefaultConfig/#70 (0.11s) --- PASS: TestDefaultConfig/#66 (0.02s) --- PASS: TestDefaultConfig/#382 (0.02s) --- PASS: TestDefaultConfig/#69 (0.11s) --- PASS: TestDefaultConfig/#65 (0.02s) --- PASS: TestDefaultConfig/#383 (0.03s) --- PASS: TestDefaultConfig/#381 (0.02s) --- PASS: TestDefaultConfig/#67 (0.05s) --- PASS: TestDefaultConfig/#61 (0.03s) --- PASS: TestDefaultConfig/#380 (0.05s) --- PASS: TestDefaultConfig/#386 (0.06s) --- PASS: TestDefaultConfig/#63 (0.07s) --- PASS: TestDefaultConfig/#379 (0.07s) --- PASS: TestDefaultConfig/#378 (0.07s) --- PASS: TestDefaultConfig/#60 (0.08s) --- PASS: TestDefaultConfig/#372 (0.01s) --- PASS: TestDefaultConfig/#58 (0.05s) --- PASS: TestDefaultConfig/#375 (0.05s) --- PASS: TestDefaultConfig/#373 (0.03s) --- PASS: TestDefaultConfig/#55 (0.01s) --- PASS: TestDefaultConfig/#64 (0.12s) --- PASS: TestDefaultConfig/#59 (0.11s) --- PASS: TestDefaultConfig/#374 (0.05s) --- PASS: TestDefaultConfig/#377 (0.07s) --- PASS: TestDefaultConfig/#56 (0.03s) --- PASS: TestDefaultConfig/#52 (0.02s) --- PASS: TestDefaultConfig/#376 (0.09s) --- PASS: TestDefaultConfig/#54 (0.03s) --- PASS: TestDefaultConfig/#57 (0.05s) --- PASS: TestDefaultConfig/#50 (0.03s) --- PASS: TestDefaultConfig/#51 (0.05s) --- PASS: TestDefaultConfig/#53 (0.05s) --- PASS: TestDefaultConfig/#48 (0.05s) --- PASS: TestDefaultConfig/#367 (0.07s) --- PASS: TestDefaultConfig/#366 (0.05s) --- PASS: TestDefaultConfig/#368 (0.07s) --- PASS: TestDefaultConfig/#371 (0.09s) --- PASS: TestDefaultConfig/#365 (0.05s) --- PASS: TestDefaultConfig/#360 (0.01s) --- PASS: TestDefaultConfig/#370 (0.09s) --- PASS: TestDefaultConfig/#49 (0.09s) --- PASS: TestDefaultConfig/#361 (0.02s) --- PASS: TestDefaultConfig/#363 (0.01s) --- PASS: TestDefaultConfig/#364 (0.06s) --- PASS: TestDefaultConfig/#362 (0.02s) --- PASS: TestDefaultConfig/#369 (0.10s) --- PASS: TestDefaultConfig/#356 (0.02s) --- PASS: TestDefaultConfig/#357 (0.02s) --- PASS: TestDefaultConfig/#355 (0.02s) --- PASS: TestDefaultConfig/#350 (0.03s) --- PASS: TestDefaultConfig/#359 (0.06s) --- PASS: TestDefaultConfig/#353 (0.05s) --- PASS: TestDefaultConfig/#354 (0.03s) --- PASS: TestDefaultConfig/#358 (0.06s) --- PASS: TestDefaultConfig/#348 (0.05s) --- PASS: TestDefaultConfig/#352 (0.07s) --- PASS: TestDefaultConfig/#349 (0.07s) --- PASS: TestDefaultConfig/#37 (0.01s) --- PASS: TestDefaultConfig/#42 (0.05s) --- PASS: TestDefaultConfig/#351 (0.10s) --- PASS: TestDefaultConfig/#35 (0.01s) --- PASS: TestDefaultConfig/#43 (0.06s) --- PASS: TestDefaultConfig/#41 (0.06s) --- PASS: TestDefaultConfig/#40 (0.06s) --- PASS: TestDefaultConfig/#33 (0.02s) --- PASS: TestDefaultConfig/#31 (0.01s) --- PASS: TestDefaultConfig/#347 (0.11s) --- PASS: TestDefaultConfig/#36 (0.04s) --- PASS: TestDefaultConfig/#38 (0.06s) --- PASS: TestDefaultConfig/#32 (0.03s) --- PASS: TestDefaultConfig/#28 (0.02s) --- PASS: TestDefaultConfig/#39 (0.08s) --- PASS: TestDefaultConfig/#30 (0.04s) --- PASS: TestDefaultConfig/#27 (0.04s) --- PASS: TestDefaultConfig/#23 (0.05s) --- PASS: TestDefaultConfig/#34 (0.09s) --- PASS: TestDefaultConfig/#29 (0.09s) --- PASS: TestDefaultConfig/#25 (0.09s) --- PASS: TestDefaultConfig/#24 (0.12s) --- PASS: TestDefaultConfig/#22 (0.11s) --- PASS: TestDefaultConfig/#19 (0.09s) --- PASS: TestDefaultConfig/#21 (0.13s) --- PASS: TestDefaultConfig/#17 (0.10s) --- PASS: TestDefaultConfig/#14 (0.04s) --- PASS: TestDefaultConfig/#12 (0.03s) --- PASS: TestDefaultConfig/#26 (0.17s) --- PASS: TestDefaultConfig/#13 (0.04s) --- PASS: TestDefaultConfig/#18 (0.11s) --- PASS: TestDefaultConfig/#11 (0.03s) --- PASS: TestDefaultConfig/#16 (0.10s) --- PASS: TestDefaultConfig/#15 (0.09s) --- PASS: TestDefaultConfig/#05 (0.02s) --- PASS: TestDefaultConfig/#20 (0.14s) --- PASS: TestDefaultConfig/#10 (0.05s) --- PASS: TestDefaultConfig/#08 (0.05s) --- PASS: TestDefaultConfig/#06 (0.05s) --- PASS: TestDefaultConfig/#04 (0.07s) --- PASS: TestDefaultConfig/#07 (0.08s) --- PASS: TestDefaultConfig/#01 (0.08s) --- PASS: TestDefaultConfig/#473 (0.08s) --- PASS: TestDefaultConfig/#492 (0.05s) --- PASS: TestDefaultConfig/#09 (0.12s) --- PASS: TestDefaultConfig/#489 (0.02s) --- PASS: TestDefaultConfig/#02 (0.10s) --- PASS: TestDefaultConfig/#03 (0.05s) --- PASS: TestDefaultConfig/#494 (0.08s) --- PASS: TestDefaultConfig/#488 (0.02s) --- PASS: TestDefaultConfig/#493 (0.08s) --- PASS: TestDefaultConfig/#486 (0.02s) --- PASS: TestDefaultConfig/#484 (0.02s) --- PASS: TestDefaultConfig/#487 (0.03s) --- PASS: TestDefaultConfig/#490 (0.06s) --- PASS: TestDefaultConfig/#482 (0.02s) --- PASS: TestDefaultConfig/#483 (0.03s) --- PASS: TestDefaultConfig/#491 (0.08s) --- PASS: TestDefaultConfig/#485 (0.04s) --- PASS: TestDefaultConfig/#480 (0.06s) --- PASS: TestDefaultConfig/#479 (0.07s) --- PASS: TestDefaultConfig/#478 (0.07s) --- PASS: TestDefaultConfig/#481 (0.09s) --- PASS: TestDefaultConfig/#477 (0.09s) --- PASS: TestDefaultConfig/#214 (0.05s) --- PASS: TestDefaultConfig/#216 (0.07s) --- PASS: TestDefaultConfig/#475 (0.13s) --- PASS: TestDefaultConfig/#44 (0.05s) --- PASS: TestDefaultConfig/#476 (0.14s) --- PASS: TestDefaultConfig/#206 (0.10s) --- PASS: TestDefaultConfig/#211 (0.02s) --- PASS: TestDefaultConfig/#215 (0.09s) --- PASS: TestDefaultConfig/#212 (0.03s) --- PASS: TestDefaultConfig/#210 (0.03s) --- PASS: TestDefaultConfig/#45 (0.16s) --- PASS: TestDefaultConfig/#46 (0.16s) --- PASS: TestDefaultConfig/#204 (0.02s) --- PASS: TestDefaultConfig/#474 (0.17s) --- PASS: TestDefaultConfig/#213 (0.03s) --- PASS: TestDefaultConfig/#205 (0.04s) --- PASS: TestDefaultConfig/#203 (0.02s) --- PASS: TestDefaultConfig/#209 (0.06s) --- PASS: TestDefaultConfig/#201 (0.08s) --- PASS: TestDefaultConfig/#208 (0.08s) --- PASS: TestDefaultConfig/#344 (0.07s) --- PASS: TestDefaultConfig/#336 (0.08s) --- PASS: TestDefaultConfig/#343 (0.11s) --- PASS: TestDefaultConfig/#472 (0.08s) --- PASS: TestDefaultConfig/#342 (0.12s) --- PASS: TestDefaultConfig/#462 (0.12s) --- PASS: TestDefaultConfig/#469 (0.02s) --- PASS: TestDefaultConfig/#202 (0.14s) --- PASS: TestDefaultConfig/#207 (0.14s) --- PASS: TestDefaultConfig/#470 (0.03s) --- PASS: TestDefaultConfig/#341 (0.12s) --- PASS: TestDefaultConfig/#471 (0.08s) --- PASS: TestDefaultConfig/#340 (0.09s) --- PASS: TestDefaultConfig/#464 (0.02s) --- PASS: TestDefaultConfig/#467 (0.03s) --- PASS: TestDefaultConfig/#465 (0.03s) --- PASS: TestDefaultConfig/#466 (0.03s) --- PASS: TestDefaultConfig/#468 (0.05s) --- PASS: TestDefaultConfig/#335 (0.02s) --- PASS: TestDefaultConfig/#337 (0.04s) --- PASS: TestDefaultConfig/#200 (0.04s) --- PASS: TestDefaultConfig/#339 (0.05s) --- PASS: TestDefaultConfig/#463 (0.07s) --- PASS: TestDefaultConfig/#198 (0.06s) --- PASS: TestDefaultConfig/#334 (0.06s) --- PASS: TestDefaultConfig/#199 (0.07s) --- PASS: TestDefaultConfig/#461 (0.05s) --- PASS: TestDefaultConfig/#333 (0.07s) --- PASS: TestDefaultConfig/#338 (0.11s) --- PASS: TestDefaultConfig/#47 (0.06s) --- PASS: TestDefaultConfig/#196 (0.02s) --- PASS: TestDefaultConfig/#456 (0.08s) --- PASS: TestDefaultConfig/#457 (0.05s) --- PASS: TestDefaultConfig/#459 (0.07s) --- PASS: TestDefaultConfig/#453 (0.03s) --- PASS: TestDefaultConfig/#460 (0.08s) --- PASS: TestDefaultConfig/#454 (0.02s) --- PASS: TestDefaultConfig/#455 (0.03s) --- PASS: TestDefaultConfig/#458 (0.07s) --- PASS: TestDefaultConfig/#197 (0.13s) --- PASS: TestDefaultConfig/#452 (0.03s) --- PASS: TestDefaultConfig/#451 (0.03s) === RUN TestTxnEndpoint_Bad_JSON === PAUSE TestTxnEndpoint_Bad_JSON === RUN TestTxnEndpoint_Bad_Size_Item === PAUSE TestTxnEndpoint_Bad_Size_Item === RUN TestTxnEndpoint_Bad_Size_Net === PAUSE TestTxnEndpoint_Bad_Size_Net === RUN TestTxnEndpoint_Bad_Size_Ops === PAUSE TestTxnEndpoint_Bad_Size_Ops === RUN TestTxnEndpoint_KV_Actions === PAUSE TestTxnEndpoint_KV_Actions === RUN TestTxnEndpoint_UpdateCheck === PAUSE TestTxnEndpoint_UpdateCheck === RUN TestUiIndex === PAUSE TestUiIndex === RUN TestUiNodes === PAUSE TestUiNodes === RUN TestUiNodes_Filter === PAUSE TestUiNodes_Filter === RUN TestUiNodeInfo === PAUSE TestUiNodeInfo === RUN TestUiServices === PAUSE TestUiServices === RUN TestUIGatewayServiceNodes_Terminating === PAUSE TestUIGatewayServiceNodes_Terminating === RUN TestUIGatewayServiceNodes_Ingress === PAUSE TestUIGatewayServiceNodes_Ingress === RUN TestUIEndpoint_modifySummaryForGatewayService_UseRequestedDCInsteadOfConfigured --- PASS: TestUIEndpoint_modifySummaryForGatewayService_UseRequestedDCInsteadOfConfigured (0.00s) === RUN TestValidateUserEventParams === PAUSE TestValidateUserEventParams === RUN TestShouldProcessUserEvent === PAUSE TestShouldProcessUserEvent === RUN TestIngestUserEvent === PAUSE TestIngestUserEvent === RUN TestFireReceiveEvent === PAUSE TestFireReceiveEvent === RUN TestUserEventToken === PAUSE TestUserEventToken === RUN TestStringHash === PAUSE TestStringHash === RUN TestSetFilePermissions === PAUSE TestSetFilePermissions === RUN TestDurationFixer --- PASS: TestDurationFixer (0.00s) === RUN TestHelperProcess --- PASS: TestHelperProcess (0.00s) === RUN TestForwardSignals util_test.go:230: DM-skipped --- SKIP: TestForwardSignals (0.00s) === RUN TestMakeWatchHandler [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:11.328Z [DEBUG] TestMakeWatchHandler: watch handler output: watch_handler="bash -c 'echo $CONSUL_INDEX >> handler_index_out && cat >> handler_out'" output= --- PASS: TestMakeWatchHandler (0.01s) === RUN TestMakeHTTPWatchHandler 2021-10-05T16:31:11.329Z [TRACE] TestMakeHTTPWatchHandler: http watch handler output: watch=http://127.0.0.1:42311 output="Ok, i see" --- PASS: TestMakeHTTPWatchHandler (0.00s) === RUN TestMakeWatchPlan === RUN TestMakeWatchPlan/handler_type_script,_with_deprecated_handler_field 2021-10-05T16:31:11.329Z [WARN] The 'handler' field in watches has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/watches.html === RUN TestMakeWatchPlan/handler_type_script,_with_single_arg === RUN TestMakeWatchPlan/handler_type_script,_with_multiple_args_from_slice_of_interface === RUN TestMakeWatchPlan/handler_type_script,_with_multiple_args_from_slice_of_strings === RUN TestMakeWatchPlan/handler_type_script,_with_not_string_args === RUN TestMakeWatchPlan/conflicting_handler 2021-10-05T16:31:11.330Z [WARN] The 'handler' field in watches has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/watches.html === RUN TestMakeWatchPlan/no_handler_type --- PASS: TestMakeWatchPlan (0.00s) --- PASS: TestMakeWatchPlan/handler_type_script,_with_deprecated_handler_field (0.00s) --- PASS: TestMakeWatchPlan/handler_type_script,_with_single_arg (0.00s) --- PASS: TestMakeWatchPlan/handler_type_script,_with_multiple_args_from_slice_of_interface (0.00s) --- PASS: TestMakeWatchPlan/handler_type_script,_with_multiple_args_from_slice_of_strings (0.00s) --- PASS: TestMakeWatchPlan/handler_type_script,_with_not_string_args (0.00s) --- PASS: TestMakeWatchPlan/conflicting_handler (0.00s) --- PASS: TestMakeWatchPlan/no_handler_type (0.00s) === CONT TestACL_Legacy_Disabled_Response === CONT TestSetFilePermissions === CONT TestSessionDeleteDestroy --- PASS: TestSetFilePermissions (0.00s) === CONT TestStringHash --- PASS: TestStringHash (0.00s) === CONT TestUserEventToken === CONT TestPreparedQuery_Get === CONT TestKVSEndpoint_PUT_ConflictingFlags === CONT TestPreparedQuery_Explain === RUN TestPreparedQuery_Explain/#00 === CONT TestPreparedQuery_ExecuteCached === CONT TestPreparedQuery_Execute === RUN TestPreparedQuery_Execute/#00 === CONT TestPreparedQuery_List === RUN TestPreparedQuery_List/#00 === CONT TestIntentionsCheck_noSource === RUN TestPreparedQuery_Get/#00 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestACL_Legacy_Disabled_Response/0 === RUN TestACL_Legacy_Disabled_Response/1 === RUN TestACL_Legacy_Disabled_Response/2 === RUN TestACL_Legacy_Disabled_Response/3 === RUN TestACL_Legacy_Disabled_Response/4 === RUN TestACL_Legacy_Disabled_Response/5 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:11.462Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.491Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.606 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ebca0108-437c-6e1f-b2b2-14a86f4d5f03 Address:127.0.0.1:29477}]" 31:11.606 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29477 [Follower]" leader= 31:11.606 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03.dc1 127.0.0.1 31:11.607 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03 127.0.0.1 2021-10-05T16:31:11.607Z [INFO] agent.router: Initializing LAN area manager 31:11.607 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29486 network=udp 31:11.607 [INFO] TestAgent.server: Adding LAN server: server="Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03 (Addr: tcp/127.0.0.1:29477) (DC: dc1)" 31:11.607 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03.dc1 area=wan 31:11.607 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29486 network=tcp 31:11.608 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29487 network=tcp 31:11.608 [INFO] TestAgent: started state syncer 31:11.608 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29478 network=tcp 31:11.672 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.672 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29477 [Candidate]" term=2 31:11.691 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.691 [DEBUG] TestAgent.server.raft: vote granted: from=ebca0108-437c-6e1f-b2b2-14a86f4d5f03 term=2 tally=1 31:11.691 [INFO] TestAgent.server.raft: election won: tally=1 31:11.691 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29477 [Leader]" 31:11.692 [INFO] TestAgent.server: cluster leadership acquired 31:11.692 [INFO] TestAgent.server: New leader elected: payload=Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03 31:11.703 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29477 31:11.753 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.793 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:11.794 [INFO] TestAgent: Requesting shutdown 31:11.794 [INFO] TestAgent.server: shutting down server 31:11.794 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.794 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:11.799 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:11.805 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.805 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.805 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.805 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.805 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.805 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03 31:11.805 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03 2021-10-05T16:31:11.811Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.811Z [INFO] agent.router.manager: shutting down 31:11.811 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: raft is already shutdown" 31:11.816 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-ebca0108-437c-6e1f-b2b2-14a86f4d5f03 127.0.0.1 29489 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:ebca0108-437c-6e1f-b2b2-14a86f4d5f03 port:29477 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29490] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:11.816 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.816 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.816 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.816 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.816 [INFO] TestAgent: consul server down 31:11.816 [INFO] TestAgent: shutdown complete 31:11.816 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29486 network=tcp 31:11.816 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29486 network=udp 31:11.816 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29487 network=tcp 31:11.816 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:11.816 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.816 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.816 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:12.317 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.317 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Execute/#01 [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:11.423Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.467Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.612 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a3c44a1c-cfc8-56c8-59ff-ae2b194cee27 Address:127.0.0.1:29449}]" 31:11.612 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29449 [Follower]" leader= 31:11.612 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a3c44a1c-cfc8-56c8-59ff-ae2b194cee27.dc1 127.0.0.1 31:11.613 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a3c44a1c-cfc8-56c8-59ff-ae2b194cee27 127.0.0.1 2021-10-05T16:31:11.613Z [INFO] agent.router: Initializing LAN area manager 31:11.613 [INFO] TestAgent.server: Adding LAN server: server="Node-a3c44a1c-cfc8-56c8-59ff-ae2b194cee27 (Addr: tcp/127.0.0.1:29449) (DC: dc1)" 31:11.613 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29444 network=udp 31:11.613 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a3c44a1c-cfc8-56c8-59ff-ae2b194cee27.dc1 area=wan 31:11.613 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29444 network=tcp 31:11.614 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29445 network=tcp 31:11.614 [INFO] TestAgent: started state syncer 31:11.614 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29450 network=tcp 31:11.664 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.664 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29449 [Candidate]" term=2 31:11.712 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.712 [DEBUG] TestAgent.server.raft: vote granted: from=a3c44a1c-cfc8-56c8-59ff-ae2b194cee27 term=2 tally=1 31:11.712 [INFO] TestAgent.server.raft: election won: tally=1 31:11.712 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29449 [Leader]" 31:11.712 [INFO] TestAgent.server: cluster leadership acquired 31:11.712 [INFO] TestAgent.server: New leader elected: payload=Node-a3c44a1c-cfc8-56c8-59ff-ae2b194cee27 31:11.738 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29449 31:11.757 [INFO] TestAgent: Synced node info 31:11.757 [DEBUG] TestAgent: Node info in sync 31:11.799 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:11.799 [INFO] TestAgent: Requesting shutdown 31:11.799 [INFO] TestAgent.server: shutting down server 31:11.799 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.808 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:11.812 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 2021-10-05T16:31:11.818Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.818Z [INFO] agent.router.manager: shutting down 31:11.820 [INFO] TestAgent: consul server down 31:11.820 [INFO] TestAgent: shutdown complete 31:11.820 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29444 network=tcp 31:11.820 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29444 network=udp 31:11.820 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29445 network=tcp 31:11.820 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:12.322 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.322 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_List/#01 2021-10-05T16:31:11.436Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.469Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.601 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e85ccfb2-813a-976e-2100-e4fd69d56f1c Address:127.0.0.1:29484}]" 31:11.601 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c.dc1 127.0.0.1 31:11.601 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29484 [Follower]" leader= 31:11.605 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c 127.0.0.1 2021-10-05T16:31:11.605Z [INFO] agent.router: Initializing LAN area manager 31:11.605 [INFO] TestAgent.server: Adding LAN server: server="Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c (Addr: tcp/127.0.0.1:29484) (DC: dc1)" 31:11.605 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c.dc1 area=wan 31:11.605 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29472 network=udp 31:11.605 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29472 network=tcp 31:11.606 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29473 network=tcp 31:11.606 [INFO] TestAgent: started state syncer 31:11.606 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29485 network=tcp 31:11.664 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.664 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29484 [Candidate]" term=2 31:11.712 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.712 [DEBUG] TestAgent.server.raft: vote granted: from=e85ccfb2-813a-976e-2100-e4fd69d56f1c term=2 tally=1 31:11.712 [INFO] TestAgent.server.raft: election won: tally=1 31:11.712 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29484 [Leader]" 31:11.712 [INFO] TestAgent.server: cluster leadership acquired 31:11.712 [INFO] TestAgent.server: New leader elected: payload=Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c 31:11.736 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29484 31:11.760 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.822 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:11.823 [INFO] TestAgent: Requesting shutdown 31:11.823 [INFO] TestAgent.server: shutting down server 31:11.823 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.823 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:11.831 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.831 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.831 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.831 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.831 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.831 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c 31:11.831 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c 31:11.833 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:11.844Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.844Z [INFO] agent.router.manager: shutting down 31:11.846 [INFO] TestAgent: consul server down 31:11.846 [INFO] TestAgent: shutdown complete 31:11.846 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29472 network=tcp 31:11.846 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29472 network=udp 31:11.846 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29473 network=tcp 31:11.846 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-e85ccfb2-813a-976e-2100-e4fd69d56f1c 127.0.0.1 29475 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:e85ccfb2-813a-976e-2100-e4fd69d56f1c port:29484 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29476] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:11.847 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.847 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.847 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.847 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.847 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.847 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.847 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:12.348 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.348 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_ExecuteCached (1.01s) === CONT TestPProfHandlers_DisableDebugNoACLs 2021-10-05T16:31:11.430Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.471Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.602 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a6b48650-e4ee-6e3b-400d-4619251b720b Address:127.0.0.1:29470}]" 31:11.603 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a6b48650-e4ee-6e3b-400d-4619251b720b.dc1 127.0.0.1 31:11.603 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a6b48650-e4ee-6e3b-400d-4619251b720b 127.0.0.1 2021-10-05T16:31:11.603Z [INFO] agent.router: Initializing LAN area manager 31:11.603 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29465 network=udp 31:11.603 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29470 [Follower]" leader= 31:11.604 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a6b48650-e4ee-6e3b-400d-4619251b720b.dc1 area=wan 31:11.604 [INFO] TestAgent.server: Adding LAN server: server="Node-a6b48650-e4ee-6e3b-400d-4619251b720b (Addr: tcp/127.0.0.1:29470) (DC: dc1)" 31:11.604 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29465 network=tcp 31:11.604 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29466 network=tcp 31:11.604 [INFO] TestAgent: started state syncer 31:11.604 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29471 network=tcp 31:11.671 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.671 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29470 [Candidate]" term=2 31:11.699 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.699 [DEBUG] TestAgent.server.raft: vote granted: from=a6b48650-e4ee-6e3b-400d-4619251b720b term=2 tally=1 31:11.699 [INFO] TestAgent.server.raft: election won: tally=1 31:11.699 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29470 [Leader]" 31:11.699 [INFO] TestAgent.server: cluster leadership acquired 31:11.700 [INFO] TestAgent.server: New leader elected: payload=Node-a6b48650-e4ee-6e3b-400d-4619251b720b 31:11.710 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29470 31:11.751 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.811 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.811 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.811 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.811 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.811 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.811 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a6b48650-e4ee-6e3b-400d-4619251b720b 31:11.811 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a6b48650-e4ee-6e3b-400d-4619251b720b 31:11.824 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:11.824 [INFO] TestAgent: Requesting shutdown 31:11.824 [INFO] TestAgent.server: shutting down server 31:11.824 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.824 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.824 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.824 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.824 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.825 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:11.825 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:11.825 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.825 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.827 [INFO] TestAgent.server: federation state anti-entropy synced 31:11.827 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:11.831 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:11.845Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.845Z [INFO] agent.router.manager: shutting down 31:11.852 [INFO] TestAgent: consul server down 31:11.852 [INFO] TestAgent: shutdown complete 31:11.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29465 network=tcp 31:11.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29465 network=udp 31:11.852 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29466 network=tcp 31:11.852 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-a6b48650-e4ee-6e3b-400d-4619251b720b 127.0.0.1 29468 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:a6b48650-e4ee-6e3b-400d-4619251b720b port:29470 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29469] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:12.356 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.356 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Explain/#01 2021-10-05T16:31:11.365Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:11.365Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.464Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:11.464Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.602 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bf6a905b-b195-c514-588a-a34824c7217a Address:127.0.0.1:29435}]" 31:11.603 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bf6a905b-b195-c514-588a-a34824c7217a.dc1 127.0.0.1 31:11.603 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29435 [Follower]" leader= 31:11.604 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bf6a905b-b195-c514-588a-a34824c7217a 127.0.0.1 2021-10-05T16:31:11.604Z [INFO] agent.router: Initializing LAN area manager 31:11.604 [INFO] TestAgent.server: Adding LAN server: server="Node-bf6a905b-b195-c514-588a-a34824c7217a (Addr: tcp/127.0.0.1:29435) (DC: dc1)" 31:11.604 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29423 network=udp 31:11.605 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29423 network=tcp 31:11.604 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bf6a905b-b195-c514-588a-a34824c7217a.dc1 area=wan 31:11.605 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29424 network=tcp 31:11.605 [INFO] TestAgent: started state syncer 31:11.605 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29436 network=tcp 31:11.655 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:11.655 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.655 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29435 [Candidate]" term=2 31:11.696 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.696 [DEBUG] TestAgent.server.raft: vote granted: from=bf6a905b-b195-c514-588a-a34824c7217a term=2 tally=1 31:11.696 [INFO] TestAgent.server.raft: election won: tally=1 31:11.696 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29435 [Leader]" 31:11.697 [INFO] TestAgent.server: cluster leadership acquired 31:11.697 [INFO] TestAgent.server: New leader elected: payload=Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.708 [INFO] TestAgent.server: initializing acls 31:11.719 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:11.719 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:11.734 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:11.755 [INFO] TestAgent.server: initializing acls 31:11.755 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:11.760 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:11.760 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:11.760 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:11.760 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.760 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-bf6a905b-b195-c514-588a-a34824c7217a.dc1 31:11.760 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-bf6a905b-b195-c514-588a-a34824c7217a.dc1 area=wan 31:11.760 [INFO] TestAgent.server: Updating LAN server: server="Node-bf6a905b-b195-c514-588a-a34824c7217a (Addr: tcp/127.0.0.1:29435) (DC: dc1)" 31:11.769 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:11.769 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:11.769 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.770 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-bf6a905b-b195-c514-588a-a34824c7217a.dc1 31:11.770 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-bf6a905b-b195-c514-588a-a34824c7217a.dc1 area=wan 31:11.770 [INFO] TestAgent.server: Updating LAN server: server="Node-bf6a905b-b195-c514-588a-a34824c7217a (Addr: tcp/127.0.0.1:29435) (DC: dc1)" 31:11.791 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.832 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.832 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.832 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.832 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.832 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.832 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.832 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.853 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.853 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.865 [INFO] TestAgent.server: federation state anti-entropy synced 31:11.874 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-bf6a905b-b195-c514-588a-a34824c7217a 31:11.878 [WARN] TestAgent.server.internal: user event blocked by ACLs: event=foo accessorID= 31:11.878 [WARN] TestAgent.server.internal: user event blocked by ACLs: event=bar accessorID= 31:11.878 [WARN] TestAgent.server.internal: user event blocked by ACLs: event=zip accessorID= 31:11.878 [DEBUG] TestAgent.server: User event: event=baz 31:11.878 [INFO] TestAgent: Requesting shutdown 31:11.878 [DEBUG] TestAgent: new event: event_name=baz event_id=90dedf1c-2a0f-1cb7-98bc-be748175432e 31:11.878 [INFO] TestAgent.server: shutting down server 31:11.878 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.878 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:11.878 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:11.878 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.878 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.878 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.879 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.879 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:11.879 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:11.879 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:11.879 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:11.879 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:11.879 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:11.879 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.879 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.884 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:11.888Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.888Z [INFO] agent.router.manager: shutting down 31:11.888 [INFO] TestAgent: consul server down 31:11.888 [INFO] TestAgent: shutdown complete 31:11.888 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29423 network=tcp 31:11.888 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29423 network=udp 31:11.888 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29424 network=tcp 31:12.389 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.389 [INFO] TestAgent: Endpoints down --- PASS: TestUserEventToken (1.07s) === CONT TestPProfHandlers_EnableDebug 2021-10-05T16:31:11.400Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.474Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.598 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cbc59636-509a-8e64-121b-fcd10cac29a0 Address:127.0.0.1:29456}]" 31:11.599 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cbc59636-509a-8e64-121b-fcd10cac29a0.dc1 127.0.0.1 31:11.599 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cbc59636-509a-8e64-121b-fcd10cac29a0 127.0.0.1 2021-10-05T16:31:11.600Z [INFO] agent.router: Initializing LAN area manager 31:11.600 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29456 [Follower]" leader= 31:11.600 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29451 network=udp 31:11.600 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cbc59636-509a-8e64-121b-fcd10cac29a0.dc1 area=wan 31:11.600 [INFO] TestAgent.server: Adding LAN server: server="Node-cbc59636-509a-8e64-121b-fcd10cac29a0 (Addr: tcp/127.0.0.1:29456) (DC: dc1)" 31:11.600 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29451 network=tcp 31:11.601 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29452 network=tcp 31:11.601 [INFO] TestAgent: started state syncer 31:11.601 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29457 network=tcp 31:11.668 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.668 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29456 [Candidate]" term=2 31:11.700 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.700 [DEBUG] TestAgent.server.raft: vote granted: from=cbc59636-509a-8e64-121b-fcd10cac29a0 term=2 tally=1 31:11.700 [INFO] TestAgent.server.raft: election won: tally=1 31:11.700 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29456 [Leader]" 31:11.701 [INFO] TestAgent.server: cluster leadership acquired 31:11.701 [INFO] TestAgent.server: New leader elected: payload=Node-cbc59636-509a-8e64-121b-fcd10cac29a0 31:11.719 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29456 31:11.743 [INFO] TestAgent: Synced node info 31:11.743 [DEBUG] TestAgent: Node info in sync 31:11.779 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.821 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.821 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.821 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.821 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.821 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.821 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cbc59636-509a-8e64-121b-fcd10cac29a0 31:11.821 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cbc59636-509a-8e64-121b-fcd10cac29a0 31:11.853 [INFO] TestAgent.server: federation state anti-entropy synced 31:11.896 [INFO] TestAgent: Requesting shutdown 31:11.896 [INFO] TestAgent.server: shutting down server 31:11.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.896 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.896 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.896 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.896 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:11.896 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:11.896 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.896 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.896 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:11.904 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:11.912Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.912Z [INFO] agent.router.manager: shutting down 31:11.912 [INFO] TestAgent: consul server down 31:11.912 [INFO] TestAgent: shutdown complete 31:11.912 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29451 network=tcp 31:11.912 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29451 network=udp 31:11.912 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29452 network=tcp 31:12.431 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.431 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsCheck_noSource (1.09s) === CONT TestParseWait --- PASS: TestParseWait (0.00s) === CONT TestParseSource 2021-10-05T16:31:11.371Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.464Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.573 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87 Address:127.0.0.1:29442}]" 31:11.574 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87.dc1 127.0.0.1 31:11.575 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87 127.0.0.1 2021-10-05T16:31:11.575Z [INFO] agent.router: Initializing LAN area manager 31:11.576 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29442 [Follower]" leader= 31:11.577 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87.dc1 area=wan 31:11.577 [INFO] TestAgent.server: Adding LAN server: server="Node-e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87 (Addr: tcp/127.0.0.1:29442) (DC: dc1)" 31:11.577 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29437 network=udp 31:11.577 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29437 network=tcp 31:11.578 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29438 network=tcp 31:11.578 [INFO] TestAgent: started state syncer 31:11.579 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29443 network=tcp 31:11.614 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.615 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29442 [Candidate]" term=2 31:11.624 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.624 [DEBUG] TestAgent.server.raft: vote granted: from=e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87 term=2 tally=1 31:11.624 [INFO] TestAgent.server.raft: election won: tally=1 31:11.624 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29442 [Leader]" 31:11.625 [INFO] TestAgent.server: cluster leadership acquired 31:11.625 [INFO] TestAgent.server: New leader elected: payload=Node-e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87 31:11.631 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29442 31:11.659 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.702 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.703 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.703 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.703 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.703 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.703 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87 31:11.703 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e1608fcf-2ac0-8932-2a2f-ed3a9ee59e87 31:11.741 [INFO] TestAgent.server: federation state anti-entropy synced 31:11.912 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:11.932 [INFO] TestAgent: Synced node info 31:11.946 [INFO] TestAgent: Requesting shutdown 31:11.946 [INFO] TestAgent.server: shutting down server 31:11.946 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.946 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.946 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.946 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.946 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.946 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:11.946 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:11.946 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.946 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:11.946 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.952 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:11.962Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.962Z [INFO] agent.router.manager: shutting down 31:11.962 [INFO] TestAgent: consul server down 31:11.962 [INFO] TestAgent: shutdown complete 31:11.962 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29437 network=tcp 31:11.962 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29437 network=udp 31:11.962 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29438 network=tcp 31:12.464 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.464 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_PUT_ConflictingFlags (1.13s) === CONT TestPrettyPrintBare 2021-10-05T16:31:11.460Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.491Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.606 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:158cfd8d-0dae-7f51-b82d-8603833a76c5 Address:127.0.0.1:29421}]" 31:11.606 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29421 [Follower]" leader= 31:11.607 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-158cfd8d-0dae-7f51-b82d-8603833a76c5.dc1 127.0.0.1 31:11.608 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-158cfd8d-0dae-7f51-b82d-8603833a76c5 127.0.0.1 2021-10-05T16:31:11.608Z [INFO] agent.router: Initializing LAN area manager 31:11.608 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29430 network=udp 31:11.608 [INFO] TestAgent.server: Adding LAN server: server="Node-158cfd8d-0dae-7f51-b82d-8603833a76c5 (Addr: tcp/127.0.0.1:29421) (DC: dc1)" 31:11.608 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-158cfd8d-0dae-7f51-b82d-8603833a76c5.dc1 area=wan 31:11.608 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29430 network=tcp 31:11.609 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29431 network=tcp 31:11.609 [INFO] TestAgent: started state syncer 31:11.609 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29422 network=tcp 31:11.646 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.646 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29421 [Candidate]" term=2 31:11.672 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.672 [DEBUG] TestAgent.server.raft: vote granted: from=158cfd8d-0dae-7f51-b82d-8603833a76c5 term=2 tally=1 31:11.672 [INFO] TestAgent.server.raft: election won: tally=1 31:11.672 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29421 [Leader]" 31:11.672 [INFO] TestAgent.server: cluster leadership acquired 31:11.672 [INFO] TestAgent.server: New leader elected: payload=Node-158cfd8d-0dae-7f51-b82d-8603833a76c5 31:11.691 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29421 31:11.732 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.776 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.776 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.776 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.776 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.776 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.776 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-158cfd8d-0dae-7f51-b82d-8603833a76c5 31:11.776 [INFO] TestAgent.server: member joined, marking health alive: member=Node-158cfd8d-0dae-7f51-b82d-8603833a76c5 31:11.813 [INFO] TestAgent.server: federation state anti-entropy synced 31:11.854 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:11.863 [INFO] TestAgent: Synced node info 31:11.863 [DEBUG] TestAgent: Node info in sync 31:11.963 [INFO] TestAgent: Requesting shutdown 31:11.963 [INFO] TestAgent.server: shutting down server 31:11.963 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.963 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.963 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.963 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.963 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.963 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:11.963 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:11.963 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.963 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.963 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:11.969 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:11.975Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.975Z [INFO] agent.router.manager: shutting down 31:11.975 [INFO] TestAgent: consul server down 31:11.975 [INFO] TestAgent: shutdown complete 31:11.975 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29430 network=tcp 31:11.975 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29430 network=udp 31:11.975 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29431 network=tcp 31:12.475 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.475 [INFO] TestAgent: Endpoints down --- PASS: TestSessionDeleteDestroy (1.15s) === CONT TestPrettyPrint 2021-10-05T16:31:11.378Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.449Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.593 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ba2615cb-1f03-2c7f-25de-cccc5e932578 Address:127.0.0.1:29428}]" 31:11.594 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ba2615cb-1f03-2c7f-25de-cccc5e932578.dc1 127.0.0.1 31:11.594 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29428 [Follower]" leader= 31:11.595 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ba2615cb-1f03-2c7f-25de-cccc5e932578 127.0.0.1 2021-10-05T16:31:11.595Z [INFO] agent.router: Initializing LAN area manager 31:11.595 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29416 network=udp 31:11.595 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ba2615cb-1f03-2c7f-25de-cccc5e932578.dc1 area=wan 31:11.595 [INFO] TestAgent.server: Adding LAN server: server="Node-ba2615cb-1f03-2c7f-25de-cccc5e932578 (Addr: tcp/127.0.0.1:29428) (DC: dc1)" 31:11.595 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29416 network=tcp 31:11.596 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29417 network=tcp 31:11.596 [INFO] TestAgent: started state syncer 31:11.596 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29429 network=tcp 31:11.633 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.633 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29428 [Candidate]" term=2 31:11.659 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.659 [DEBUG] TestAgent.server.raft: vote granted: from=ba2615cb-1f03-2c7f-25de-cccc5e932578 term=2 tally=1 31:11.659 [INFO] TestAgent.server.raft: election won: tally=1 31:11.659 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29428 [Leader]" 31:11.660 [INFO] TestAgent.server: cluster leadership acquired 31:11.660 [INFO] TestAgent.server: New leader elected: payload=Node-ba2615cb-1f03-2c7f-25de-cccc5e932578 31:11.691 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29428 31:11.733 [INFO] TestAgent: Synced node info 31:11.733 [DEBUG] TestAgent: Node info in sync 31:11.758 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.817 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.817 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.817 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.817 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.817 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.817 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ba2615cb-1f03-2c7f-25de-cccc5e932578 31:11.817 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ba2615cb-1f03-2c7f-25de-cccc5e932578 31:11.854 [INFO] TestAgent.server: federation state anti-entropy synced 31:12.000 [INFO] TestAgent: Requesting shutdown 31:12.000 [INFO] TestAgent.server: shutting down server 31:12.000 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:12.000 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:12.000 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:12.000 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:12.000 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:12.000 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:12.001 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:12.001 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:12.001 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:12.001 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:12.005 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:12.010Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:12.010Z [INFO] agent.router.manager: shutting down 31:12.010 [INFO] TestAgent: consul server down 31:12.010 [INFO] TestAgent: shutdown complete 31:12.010 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29416 network=tcp 31:12.010 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29416 network=udp 31:12.010 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29417 network=tcp 31:12.510 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.510 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Legacy_Disabled_Response (1.18s) --- PASS: TestACL_Legacy_Disabled_Response/0 (0.00s) --- PASS: TestACL_Legacy_Disabled_Response/1 (0.00s) --- PASS: TestACL_Legacy_Disabled_Response/2 (0.00s) --- PASS: TestACL_Legacy_Disabled_Response/3 (0.00s) --- PASS: TestACL_Legacy_Disabled_Response/4 (0.00s) --- PASS: TestACL_Legacy_Disabled_Response/5 (0.00s) === CONT TestHTTP_wrap_obfuscateLog 2021-10-05T16:31:11.456Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:11.494Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:11.581 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ab8fdbbe-58a1-affa-32ec-ab709bf18b4f Address:127.0.0.1:29463}]" 31:11.581 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ab8fdbbe-58a1-affa-32ec-ab709bf18b4f.dc1 127.0.0.1 31:11.582 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ab8fdbbe-58a1-affa-32ec-ab709bf18b4f 127.0.0.1 2021-10-05T16:31:11.582Z [INFO] agent.router: Initializing LAN area manager 31:11.592 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29463 [Follower]" leader= 31:11.592 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ab8fdbbe-58a1-affa-32ec-ab709bf18b4f.dc1 area=wan 31:11.592 [INFO] TestAgent.server: Adding LAN server: server="Node-ab8fdbbe-58a1-affa-32ec-ab709bf18b4f (Addr: tcp/127.0.0.1:29463) (DC: dc1)" 31:11.593 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29458 network=udp 31:11.593 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29458 network=tcp 31:11.594 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29459 network=tcp 31:11.594 [INFO] TestAgent: started state syncer 31:11.594 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29464 network=tcp 31:11.644 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:11.644 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29463 [Candidate]" term=2 31:11.692 [DEBUG] TestAgent.server.raft: votes: needed=1 31:11.692 [DEBUG] TestAgent.server.raft: vote granted: from=ab8fdbbe-58a1-affa-32ec-ab709bf18b4f term=2 tally=1 31:11.692 [INFO] TestAgent.server.raft: election won: tally=1 31:11.692 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29463 [Leader]" 31:11.692 [INFO] TestAgent.server: cluster leadership acquired 31:11.692 [INFO] TestAgent.server: New leader elected: payload=Node-ab8fdbbe-58a1-affa-32ec-ab709bf18b4f 31:11.717 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29463 31:11.759 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.844 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.844 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.844 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.844 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.844 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.844 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ab8fdbbe-58a1-affa-32ec-ab709bf18b4f 31:11.844 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ab8fdbbe-58a1-affa-32ec-ab709bf18b4f 31:11.868 [INFO] TestAgent.server: federation state anti-entropy synced 31:11.912 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:11.928 [INFO] TestAgent: Synced node info 31:11.928 [DEBUG] TestAgent: Node info in sync 31:12.020 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:12.020 [INFO] TestAgent: Requesting shutdown 31:12.020 [INFO] TestAgent.server: shutting down server 31:12.020 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:12.020 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:12.020 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:12.020 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:12.020 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:12.020 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:12.020 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:12.020 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:12.020 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:12.020 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:12.028 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:12.036Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:12.036Z [INFO] agent.router.manager: shutting down 31:12.036 [INFO] TestAgent: consul server down 31:12.036 [INFO] TestAgent: shutdown complete 31:12.036 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29458 network=tcp 31:12.036 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29458 network=udp 31:12.036 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29459 network=tcp 31:12.537 [INFO] TestAgent: Waiting for endpoints to shut down 31:12.537 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Get/#01 [WARN] freeport: 10 out of 73 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHTTP_wrap_obfuscateLog//some/url?token=secret1&token=secret2 === RUN TestHTTP_wrap_obfuscateLog//v1/acl/clone/secret1 === RUN TestHTTP_wrap_obfuscateLog//v1/acl/clone/secret1?token=secret2 === RUN TestHTTP_wrap_obfuscateLog//v1/acl/destroy/secret1 === RUN TestHTTP_wrap_obfuscateLog//v1/acl/destroy/secret1?token=secret2 === RUN TestHTTP_wrap_obfuscateLog//v1/acl/info/secret1 === RUN TestHTTP_wrap_obfuscateLog//v1/acl/info/secret1?token=secret2 2021-10-05T16:31:12.391Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.463Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.554 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1a57429d-13af-c063-ed92-4d8e1c83b6b3 Address:127.0.0.1:29505}]" 31:12.555 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1a57429d-13af-c063-ed92-4d8e1c83b6b3.dc1 127.0.0.1 31:12.555 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29505 [Follower]" leader= 31:12.564 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1a57429d-13af-c063-ed92-4d8e1c83b6b3 127.0.0.1 2021-10-05T16:31:12.564Z [INFO] agent.router: Initializing LAN area manager 31:12.564 [INFO] TestAgent.server: Adding LAN server: server="Node-1a57429d-13af-c063-ed92-4d8e1c83b6b3 (Addr: tcp/127.0.0.1:29505) (DC: dc1)" 31:12.564 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1a57429d-13af-c063-ed92-4d8e1c83b6b3.dc1 area=wan 31:12.564 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29514 network=tcp 31:12.564 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29514 network=udp 31:12.565 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29515 network=tcp 31:12.565 [INFO] TestAgent: started state syncer 31:12.565 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29506 network=tcp 31:12.604 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.604 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29505 [Candidate]" term=2 31:12.618 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.618 [DEBUG] TestAgent.server.raft: vote granted: from=1a57429d-13af-c063-ed92-4d8e1c83b6b3 term=2 tally=1 31:12.618 [INFO] TestAgent.server.raft: election won: tally=1 31:12.618 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29505 [Leader]" 31:12.619 [INFO] TestAgent.server: cluster leadership acquired 31:12.619 [INFO] TestAgent.server: New leader elected: payload=Node-1a57429d-13af-c063-ed92-4d8e1c83b6b3 31:12.624 [INFO] TestAgent: Requesting shutdown 31:12.624 [INFO] TestAgent.server: shutting down server 31:12.624 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:12.624 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:12.629 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29505 31:12.639 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:12.651Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:12.651Z [INFO] agent.router.manager: shutting down 31:12.660 [ERROR] TestAgent.server: failed to establish leadership: error="error configuring provider: leadership lost while committing log" 31:12.660 [INFO] TestAgent: consul server down 31:12.660 [INFO] TestAgent: shutdown complete 31:12.660 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29514 network=tcp 31:12.660 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29514 network=udp 31:12.660 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29515 network=tcp 31:13.164 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.164 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Explain/#02 2021-10-05T16:31:12.351Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.437Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.512 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0476889f-c667-bba3-05b3-5964842e4872 Address:127.0.0.1:29491}]" 31:12.512 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0476889f-c667-bba3-05b3-5964842e4872.dc1 127.0.0.1 31:12.513 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0476889f-c667-bba3-05b3-5964842e4872 127.0.0.1 2021-10-05T16:31:12.513Z [INFO] agent.router: Initializing LAN area manager 31:12.513 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29500 network=udp 31:12.513 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29491 [Follower]" leader= 31:12.514 [INFO] TestAgent.server: Adding LAN server: server="Node-0476889f-c667-bba3-05b3-5964842e4872 (Addr: tcp/127.0.0.1:29491) (DC: dc1)" 31:12.514 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0476889f-c667-bba3-05b3-5964842e4872.dc1 area=wan 31:12.514 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29500 network=tcp 31:12.515 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29501 network=tcp 31:12.515 [INFO] TestAgent: started state syncer 31:12.515 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29492 network=tcp 31:12.573 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.573 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29491 [Candidate]" term=2 31:12.598 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.598 [DEBUG] TestAgent.server.raft: vote granted: from=0476889f-c667-bba3-05b3-5964842e4872 term=2 tally=1 31:12.598 [INFO] TestAgent.server.raft: election won: tally=1 31:12.598 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29491 [Leader]" 31:12.604 [INFO] TestAgent.server: cluster leadership acquired 31:12.604 [INFO] TestAgent.server: New leader elected: payload=Node-0476889f-c667-bba3-05b3-5964842e4872 31:12.619 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29491 31:12.648 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.668 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:12.668 [INFO] TestAgent: Requesting shutdown 31:12.668 [INFO] TestAgent.server: shutting down server 31:12.668 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:12.668 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:12.679 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:12.692Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:12.692Z [INFO] agent.router.manager: shutting down 31:12.697 [INFO] TestAgent: consul server down 31:12.697 [INFO] TestAgent: shutdown complete 31:12.697 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29500 network=tcp 31:12.697 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29500 network=udp 31:12.697 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29501 network=tcp 31:12.697 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:12.697 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:12.697 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:12.697 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 31:12.697 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 31:13.200 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.200 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_List (1.86s) --- PASS: TestPreparedQuery_List/#00 (0.99s) --- PASS: TestPreparedQuery_List/#01 (0.88s) === CONT TestContentTypeIsJSON [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:12.332Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.364Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.485 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:06804c88-1e15-b32b-3582-f4eaecefa609 Address:127.0.0.1:29498}]" 31:12.485 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29498 [Follower]" leader= 31:12.505 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-06804c88-1e15-b32b-3582-f4eaecefa609.dc1 127.0.0.1 31:12.506 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-06804c88-1e15-b32b-3582-f4eaecefa609 127.0.0.1 2021-10-05T16:31:12.506Z [INFO] agent.router: Initializing LAN area manager 31:12.506 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29479 network=udp 31:12.506 [INFO] TestAgent.server: Adding LAN server: server="Node-06804c88-1e15-b32b-3582-f4eaecefa609 (Addr: tcp/127.0.0.1:29498) (DC: dc1)" 31:12.506 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29479 network=tcp 31:12.506 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-06804c88-1e15-b32b-3582-f4eaecefa609.dc1 area=wan 31:12.525 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.525 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29498 [Candidate]" term=2 31:12.525 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29480 network=tcp 31:12.526 [INFO] TestAgent: started state syncer 31:12.526 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29499 network=tcp 31:12.592 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.592 [DEBUG] TestAgent.server.raft: vote granted: from=06804c88-1e15-b32b-3582-f4eaecefa609 term=2 tally=1 31:12.592 [INFO] TestAgent.server.raft: election won: tally=1 31:12.592 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29498 [Leader]" 31:12.593 [INFO] TestAgent.server: cluster leadership acquired 31:12.593 [INFO] TestAgent.server: New leader elected: payload=Node-06804c88-1e15-b32b-3582-f4eaecefa609 31:12.618 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29498 31:12.719 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.720 [INFO] TestAgent: Synced node info 31:12.720 [DEBUG] TestAgent: Node info in sync 31:12.759 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:12.759 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:12.759 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:12.759 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:12.759 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:12.759 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-06804c88-1e15-b32b-3582-f4eaecefa609 31:12.759 [INFO] TestAgent.server: member joined, marking health alive: member=Node-06804c88-1e15-b32b-3582-f4eaecefa609 31:12.786 [INFO] TestAgent.server: federation state anti-entropy synced 31:12.884 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:12.884 [INFO] TestAgent: Requesting shutdown 31:12.884 [INFO] TestAgent.server: shutting down server 31:12.884 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:12.884 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:12.884 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:12.884 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:12.884 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:12.884 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:12.884 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:12.884 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:12.884 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:12.884 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:12.890 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:12.900Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:12.900Z [INFO] agent.router.manager: shutting down 31:12.901 [INFO] TestAgent: consul server down 31:12.901 [INFO] TestAgent: shutdown complete 31:12.901 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29479 network=tcp 31:12.901 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29479 network=udp 31:12.901 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29480 network=tcp 31:13.404 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.404 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Execute/#02 2021-10-05T16:31:12.529Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.545Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.605 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5cf3dde9-5e08-3ff0-adf7-70467e260f00 Address:127.0.0.1:29540}]" 31:12.606 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29540 [Follower]" leader= 31:12.610 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5cf3dde9-5e08-3ff0-adf7-70467e260f00.dc1 127.0.0.1 31:12.610 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5cf3dde9-5e08-3ff0-adf7-70467e260f00 127.0.0.1 2021-10-05T16:31:12.610Z [INFO] agent.router: Initializing LAN area manager 31:12.611 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29535 network=udp 31:12.611 [INFO] TestAgent.server: Adding LAN server: server="Node-5cf3dde9-5e08-3ff0-adf7-70467e260f00 (Addr: tcp/127.0.0.1:29540) (DC: dc1)" 31:12.611 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5cf3dde9-5e08-3ff0-adf7-70467e260f00.dc1 area=wan 31:12.611 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29535 network=tcp 31:12.612 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29536 network=tcp 31:12.612 [INFO] TestAgent: started state syncer 31:12.612 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29541 network=tcp 31:12.662 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.662 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29540 [Candidate]" term=2 31:12.704 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.704 [DEBUG] TestAgent.server.raft: vote granted: from=5cf3dde9-5e08-3ff0-adf7-70467e260f00 term=2 tally=1 31:12.704 [INFO] TestAgent.server.raft: election won: tally=1 31:12.704 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29540 [Leader]" 31:12.706 [INFO] TestAgent.server: cluster leadership acquired 31:12.706 [INFO] TestAgent.server: New leader elected: payload=Node-5cf3dde9-5e08-3ff0-adf7-70467e260f00 31:12.722 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29540 31:12.757 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.830 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:12.830 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:12.830 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:12.830 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:12.830 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:12.830 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5cf3dde9-5e08-3ff0-adf7-70467e260f00 31:12.830 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5cf3dde9-5e08-3ff0-adf7-70467e260f00 31:12.864 [INFO] TestAgent.server: federation state anti-entropy synced 31:12.927 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/key?pretty=1 from= latency=138.194µs 31:12.927 [INFO] TestAgent: Requesting shutdown 31:12.927 [INFO] TestAgent.server: shutting down server 31:12.927 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:12.927 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:12.927 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:12.927 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:12.927 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:12.927 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:12.927 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:12.927 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:12.927 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:12.927 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:12.927 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:12.934 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:12.941Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:12.941Z [INFO] agent.router.manager: shutting down 31:12.941 [INFO] TestAgent: consul server down 31:12.941 [INFO] TestAgent: shutdown complete 31:12.941 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29535 network=tcp 31:12.941 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29535 network=udp 31:12.941 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29536 network=tcp 31:13.444 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.444 [INFO] TestAgent: Endpoints down --- PASS: TestPrettyPrint (0.97s) === CONT TestUIResponseHeaders 2021-10-05T16:31:12.391Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.467Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.532 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6 Address:127.0.0.1:29512}]" 31:12.532 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29512 [Follower]" leader= 31:12.547 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6.dc1 127.0.0.1 31:12.549 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6 127.0.0.1 2021-10-05T16:31:12.549Z [INFO] agent.router: Initializing LAN area manager 31:12.550 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29493 network=udp 31:12.550 [INFO] TestAgent.server: Adding LAN server: server="Node-7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6 (Addr: tcp/127.0.0.1:29512) (DC: dc1)" 31:12.550 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6.dc1 area=wan 31:12.550 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29493 network=tcp 31:12.551 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29494 network=tcp 31:12.551 [INFO] TestAgent: started state syncer 31:12.552 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29513 network=tcp 31:12.584 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.584 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29512 [Candidate]" term=2 31:12.619 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.619 [DEBUG] TestAgent.server.raft: vote granted: from=7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6 term=2 tally=1 31:12.619 [INFO] TestAgent.server.raft: election won: tally=1 31:12.619 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29512 [Leader]" 31:12.619 [INFO] TestAgent.server: cluster leadership acquired 31:12.619 [INFO] TestAgent.server: New leader elected: payload=Node-7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6 31:12.647 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29512 31:12.704 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.752 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:12.752 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:12.752 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:12.752 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:12.752 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:12.752 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6 31:12.752 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7cdaeaaa-d8bb-4b2c-1303-e0c70620fdf6 31:12.775 [INFO] TestAgent.server: federation state anti-entropy synced 31:12.815 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:12.839 [INFO] TestAgent: Synced node info 31:12.959 [INFO] TestAgent: Requesting shutdown 31:12.959 [INFO] TestAgent.server: shutting down server 31:12.959 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:12.959 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:12.959 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:12.959 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:12.959 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:12.959 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:12.959 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:12.959 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:12.959 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:12.959 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:12.963 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:12.968Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:12.968Z [INFO] agent.router.manager: shutting down 31:12.968 [INFO] TestAgent: consul server down 31:12.968 [INFO] TestAgent: shutdown complete 31:12.968 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29493 network=tcp 31:12.968 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29493 network=udp 31:12.968 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29494 network=tcp 31:13.469 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.469 [INFO] TestAgent: Endpoints down --- PASS: TestPProfHandlers_DisableDebugNoACLs (1.12s) === CONT TestHTTPAPIResponseHeaders 2021-10-05T16:31:12.526Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.549Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.617 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c7a6ab3a-726e-16a9-c414-b861bb248a06 Address:127.0.0.1:29533}]" 31:12.617 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29533 [Follower]" leader= 31:12.618 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c7a6ab3a-726e-16a9-c414-b861bb248a06.dc1 127.0.0.1 31:12.618 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c7a6ab3a-726e-16a9-c414-b861bb248a06 127.0.0.1 2021-10-05T16:31:12.618Z [INFO] agent.router: Initializing LAN area manager 31:12.619 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29528 network=udp 31:12.619 [INFO] TestAgent.server: Adding LAN server: server="Node-c7a6ab3a-726e-16a9-c414-b861bb248a06 (Addr: tcp/127.0.0.1:29533) (DC: dc1)" 31:12.619 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29528 network=tcp 31:12.619 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c7a6ab3a-726e-16a9-c414-b861bb248a06.dc1 area=wan 31:12.619 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29529 network=tcp 31:12.619 [INFO] TestAgent: started state syncer 31:12.619 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29534 network=tcp 31:12.660 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.660 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29533 [Candidate]" term=2 31:12.693 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.693 [DEBUG] TestAgent.server.raft: vote granted: from=c7a6ab3a-726e-16a9-c414-b861bb248a06 term=2 tally=1 31:12.693 [INFO] TestAgent.server.raft: election won: tally=1 31:12.693 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29533 [Leader]" 31:12.694 [INFO] TestAgent.server: cluster leadership acquired 31:12.694 [INFO] TestAgent.server: New leader elected: payload=Node-c7a6ab3a-726e-16a9-c414-b861bb248a06 31:12.716 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29533 31:12.736 [INFO] TestAgent: Synced node info 31:12.736 [DEBUG] TestAgent: Node info in sync 31:12.767 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.815 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:12.816 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:12.816 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:12.816 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:12.816 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:12.816 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c7a6ab3a-726e-16a9-c414-b861bb248a06 31:12.816 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c7a6ab3a-726e-16a9-c414-b861bb248a06 31:12.852 [INFO] TestAgent.server: federation state anti-entropy synced 31:13.021 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/key?pretty from= latency=29.101µs 31:13.021 [INFO] TestAgent: Requesting shutdown 31:13.021 [INFO] TestAgent.server: shutting down server 31:13.021 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.021 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.021 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.021 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.021 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.021 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.021 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.021 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.021 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.021 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.032 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.037Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.037Z [INFO] agent.router.manager: shutting down 31:13.037 [INFO] TestAgent: consul server down 31:13.037 [INFO] TestAgent: shutdown complete 31:13.037 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29528 network=tcp 31:13.037 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29528 network=udp 31:13.037 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29529 network=tcp 31:13.537 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.537 [INFO] TestAgent: Endpoints down --- PASS: TestPrettyPrintBare (1.07s) === CONT TestHTTPAPI_TranslateAddrHeader [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:12.526Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.557Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.652 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0d48f913-f773-7df0-e52a-2b9dd3eb1f46 Address:127.0.0.1:29526}]" 31:12.652 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0d48f913-f773-7df0-e52a-2b9dd3eb1f46.dc1 127.0.0.1 31:12.653 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0d48f913-f773-7df0-e52a-2b9dd3eb1f46 127.0.0.1 2021-10-05T16:31:12.653Z [INFO] agent.router: Initializing LAN area manager 31:12.656 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29526 [Follower]" leader= 31:12.660 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0d48f913-f773-7df0-e52a-2b9dd3eb1f46.dc1 area=wan 31:12.660 [INFO] TestAgent.server: Adding LAN server: server="Node-0d48f913-f773-7df0-e52a-2b9dd3eb1f46 (Addr: tcp/127.0.0.1:29526) (DC: dc1)" 31:12.664 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29521 network=udp 31:12.664 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29521 network=tcp 31:12.674 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29522 network=tcp 31:12.674 [INFO] TestAgent: started state syncer 31:12.674 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29527 network=tcp 31:12.704 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.704 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29526 [Candidate]" term=2 31:12.749 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.749 [DEBUG] TestAgent.server.raft: vote granted: from=0d48f913-f773-7df0-e52a-2b9dd3eb1f46 term=2 tally=1 31:12.749 [INFO] TestAgent.server.raft: election won: tally=1 31:12.749 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29526 [Leader]" 31:12.751 [INFO] TestAgent.server: cluster leadership acquired 31:12.751 [INFO] TestAgent.server: New leader elected: payload=Node-0d48f913-f773-7df0-e52a-2b9dd3eb1f46 31:12.788 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29526 31:12.833 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.884 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:12.884 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:12.884 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:12.884 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:12.884 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:12.884 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0d48f913-f773-7df0-e52a-2b9dd3eb1f46 31:12.884 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0d48f913-f773-7df0-e52a-2b9dd3eb1f46 31:12.913 [INFO] TestAgent.server: federation state anti-entropy synced 31:12.975 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:12.978 [INFO] TestAgent: Synced node info 31:13.092 [INFO] TestAgent: Requesting shutdown 31:13.092 [INFO] TestAgent.server: shutting down server 31:13.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.092 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.092 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.092 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.092 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.092 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.092 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.100 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.107Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.107Z [INFO] agent.router.manager: shutting down 31:13.107 [INFO] TestAgent: consul server down 31:13.107 [INFO] TestAgent: shutdown complete 31:13.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29521 network=tcp 31:13.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29521 network=udp 31:13.107 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29522 network=tcp 31:13.608 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.608 [INFO] TestAgent: Endpoints down --- PASS: TestParseSource (1.18s) === CONT TestHTTPAPI_BlockEndpoints --- PASS: TestHTTP_wrap_obfuscateLog (1.14s) --- PASS: TestHTTP_wrap_obfuscateLog//some/url?token=secret1&token=secret2 (0.00s) --- PASS: TestHTTP_wrap_obfuscateLog//v1/acl/clone/secret1 (0.00s) --- PASS: TestHTTP_wrap_obfuscateLog//v1/acl/clone/secret1?token=secret2 (0.00s) --- PASS: TestHTTP_wrap_obfuscateLog//v1/acl/destroy/secret1 (0.00s) --- PASS: TestHTTP_wrap_obfuscateLog//v1/acl/destroy/secret1?token=secret2 (0.00s) --- PASS: TestHTTP_wrap_obfuscateLog//v1/acl/info/secret1 (0.00s) --- PASS: TestHTTP_wrap_obfuscateLog//v1/acl/info/secret1?token=secret2 (0.00s) === CONT TestSetMeta --- PASS: TestSetMeta (0.00s) === CONT TestSetLastContact === RUN TestSetLastContact/neg === RUN TestSetLastContact/zero === RUN TestSetLastContact/pos === RUN TestSetLastContact/pos_ms_only --- PASS: TestSetLastContact (0.00s) --- PASS: TestSetLastContact/neg (0.00s) --- PASS: TestSetLastContact/zero (0.00s) --- PASS: TestSetLastContact/pos (0.00s) --- PASS: TestSetLastContact/pos_ms_only (0.00s) === CONT TestSetKnownLeader --- PASS: TestSetKnownLeader (0.00s) === CONT TestSetIndex --- PASS: TestSetIndex (0.00s) === CONT TestHTTPServer_UnixSocket_FileExists 2021-10-05T16:31:12.573Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.620Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.711 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c336e0b8-069c-5861-b782-85b2a7b5d35c Address:127.0.0.1:29554}]" 31:12.711 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29554 [Follower]" leader= 31:12.713 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c336e0b8-069c-5861-b782-85b2a7b5d35c.dc1 127.0.0.1 31:12.714 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c336e0b8-069c-5861-b782-85b2a7b5d35c 127.0.0.1 2021-10-05T16:31:12.714Z [INFO] agent.router: Initializing LAN area manager 31:12.714 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29549 network=udp 31:12.715 [INFO] TestAgent.server: Adding LAN server: server="Node-c336e0b8-069c-5861-b782-85b2a7b5d35c (Addr: tcp/127.0.0.1:29554) (DC: dc1)" 31:12.715 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c336e0b8-069c-5861-b782-85b2a7b5d35c.dc1 area=wan 31:12.715 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29549 network=tcp 31:12.715 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29550 network=tcp 31:12.716 [INFO] TestAgent: started state syncer 31:12.716 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29555 network=tcp 31:12.768 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.768 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29554 [Candidate]" term=2 31:12.816 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.816 [DEBUG] TestAgent.server.raft: vote granted: from=c336e0b8-069c-5861-b782-85b2a7b5d35c term=2 tally=1 31:12.816 [INFO] TestAgent.server.raft: election won: tally=1 31:12.816 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29554 [Leader]" 31:12.817 [INFO] TestAgent.server: cluster leadership acquired 31:12.828 [INFO] TestAgent.server: New leader elected: payload=Node-c336e0b8-069c-5861-b782-85b2a7b5d35c 31:12.844 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29554 31:12.884 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.912 [INFO] TestAgent: Synced node info 31:12.932 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:12.932 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:12.932 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:12.932 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:12.932 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:12.932 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c336e0b8-069c-5861-b782-85b2a7b5d35c 31:12.932 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c336e0b8-069c-5861-b782-85b2a7b5d35c 31:12.944 [INFO] TestAgent.server: federation state anti-entropy synced 31:13.148 [INFO] TestAgent: Requesting shutdown 31:13.148 [INFO] TestAgent.server: shutting down server 31:13.148 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.148 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.148 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.148 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.148 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.148 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.148 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.148 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.148 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.148 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.155 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.168Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.168Z [INFO] agent.router.manager: shutting down 31:13.168 [INFO] TestAgent: consul server down 31:13.168 [INFO] TestAgent: shutdown complete 31:13.168 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29549 network=tcp 31:13.168 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29549 network=udp 31:13.168 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29550 network=tcp 31:13.668 [INFO] TestAgent: Waiting for endpoints to shut down 31:13.668 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_Get (2.33s) --- PASS: TestPreparedQuery_Get/#00 (1.20s) --- PASS: TestPreparedQuery_Get/#01 (1.12s) === CONT TestHTTPServer_UnixSocket [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:13.242Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.285Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.330 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:853672ee-9f85-fb30-bc4a-ff2b8217dae5 Address:127.0.0.1:29568}]" 31:13.330 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29568 [Follower]" leader= 31:13.331 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-853672ee-9f85-fb30-bc4a-ff2b8217dae5.dc1 127.0.0.1 31:13.331 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-853672ee-9f85-fb30-bc4a-ff2b8217dae5 127.0.0.1 2021-10-05T16:31:13.331Z [INFO] agent.router: Initializing LAN area manager 31:13.332 [INFO] TestAgent.server: Adding LAN server: server="Node-853672ee-9f85-fb30-bc4a-ff2b8217dae5 (Addr: tcp/127.0.0.1:29568) (DC: dc1)" 31:13.332 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29563 network=udp 31:13.332 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-853672ee-9f85-fb30-bc4a-ff2b8217dae5.dc1 area=wan 31:13.332 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29563 network=tcp 31:13.333 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29564 network=tcp 31:13.333 [INFO] TestAgent: started state syncer 31:13.333 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29569 network=tcp 31:13.370 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.370 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29568 [Candidate]" term=2 31:13.384 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.384 [DEBUG] TestAgent.server.raft: vote granted: from=853672ee-9f85-fb30-bc4a-ff2b8217dae5 term=2 tally=1 31:13.384 [INFO] TestAgent.server.raft: election won: tally=1 31:13.384 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29568 [Leader]" 31:13.384 [INFO] TestAgent.server: cluster leadership acquired 31:13.385 [INFO] TestAgent.server: New leader elected: payload=Node-853672ee-9f85-fb30-bc4a-ff2b8217dae5 31:13.420 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29568 31:13.468 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.520 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.520 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.520 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.520 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.520 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:13.520 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-853672ee-9f85-fb30-bc4a-ff2b8217dae5 31:13.520 [INFO] TestAgent.server: member joined, marking health alive: member=Node-853672ee-9f85-fb30-bc4a-ff2b8217dae5 31:13.552 [INFO] TestAgent.server: federation state anti-entropy synced 31:13.564 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/key from= latency=35.068µs 31:13.564 [INFO] TestAgent: Requesting shutdown 31:13.564 [INFO] TestAgent.server: shutting down server 31:13.564 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.564 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.564 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.564 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.564 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.564 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.564 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.564 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:13.564 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.564 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.564 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.573 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.589Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.589Z [INFO] agent.router.manager: shutting down 31:13.589 [INFO] TestAgent: consul server down 31:13.589 [INFO] TestAgent: shutdown complete 31:13.589 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29563 network=tcp 31:13.589 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29563 network=udp 31:13.589 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29564 network=tcp 31:14.092 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.092 [INFO] TestAgent: Endpoints down --- PASS: TestContentTypeIsJSON (0.89s) === CONT TestFilterNonPassing --- PASS: TestFilterNonPassing (0.00s) === CONT TestHealthConnectServiceNodes_PassingFilter 2021-10-05T16:31:13.179Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.202Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.268 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f4f7b45e-43b1-c518-b6a9-c7a1054abf26 Address:127.0.0.1:29561}]" 31:13.269 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f4f7b45e-43b1-c518-b6a9-c7a1054abf26.dc1 127.0.0.1 31:13.270 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f4f7b45e-43b1-c518-b6a9-c7a1054abf26 127.0.0.1 2021-10-05T16:31:13.270Z [INFO] agent.router: Initializing LAN area manager 31:13.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29556 network=udp 31:13.270 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29561 [Follower]" leader= 31:13.270 [INFO] TestAgent.server: Adding LAN server: server="Node-f4f7b45e-43b1-c518-b6a9-c7a1054abf26 (Addr: tcp/127.0.0.1:29561) (DC: dc1)" 31:13.270 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f4f7b45e-43b1-c518-b6a9-c7a1054abf26.dc1 area=wan 31:13.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29556 network=tcp 31:13.271 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29557 network=tcp 31:13.271 [INFO] TestAgent: started state syncer 31:13.271 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29562 network=tcp 31:13.310 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.310 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29561 [Candidate]" term=2 31:13.328 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.328 [DEBUG] TestAgent.server.raft: vote granted: from=f4f7b45e-43b1-c518-b6a9-c7a1054abf26 term=2 tally=1 31:13.328 [INFO] TestAgent.server.raft: election won: tally=1 31:13.328 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29561 [Leader]" 31:13.328 [INFO] TestAgent.server: cluster leadership acquired 31:13.329 [INFO] TestAgent.server: New leader elected: payload=Node-f4f7b45e-43b1-c518-b6a9-c7a1054abf26 31:13.335 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29561 31:13.348 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.373 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.373 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.373 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.373 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.373 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:13.373 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f4f7b45e-43b1-c518-b6a9-c7a1054abf26 31:13.373 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f4f7b45e-43b1-c518-b6a9-c7a1054abf26 31:13.396 [INFO] TestAgent.server: federation state anti-entropy synced 31:13.484 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:13.494 [INFO] TestAgent: Synced node info 31:13.494 [DEBUG] TestAgent: Node info in sync 31:13.581 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:13.581 [INFO] TestAgent: Requesting shutdown 31:13.581 [INFO] TestAgent.server: shutting down server 31:13.581 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.581 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.581 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.581 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.581 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.581 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.581 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.581 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.581 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.581 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.587 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.595Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.595Z [INFO] agent.router.manager: shutting down 31:13.595 [INFO] TestAgent: consul server down 31:13.595 [INFO] TestAgent: shutdown complete 31:13.595 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29556 network=tcp 31:13.595 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29556 network=udp 31:13.595 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29557 network=tcp 31:14.096 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.096 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_Explain (2.76s) --- PASS: TestPreparedQuery_Explain/#00 (1.02s) --- PASS: TestPreparedQuery_Explain/#01 (0.81s) --- PASS: TestPreparedQuery_Explain/#02 (0.94s) === CONT TestHealthConnectServiceNodes_Filter 2021-10-05T16:31:13.491Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.507Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.584 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ff1a5866-8df1-c9a7-c473-c43ef2d54cc7 Address:127.0.0.1:29589}]" 31:13.584 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29589 [Follower]" leader= 31:13.585 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ff1a5866-8df1-c9a7-c473-c43ef2d54cc7.dc1 127.0.0.1 31:13.586 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ff1a5866-8df1-c9a7-c473-c43ef2d54cc7 127.0.0.1 2021-10-05T16:31:13.586Z [INFO] agent.router: Initializing LAN area manager 31:13.586 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29584 network=udp 31:13.586 [INFO] TestAgent.server: Adding LAN server: server="Node-ff1a5866-8df1-c9a7-c473-c43ef2d54cc7 (Addr: tcp/127.0.0.1:29589) (DC: dc1)" 31:13.586 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ff1a5866-8df1-c9a7-c473-c43ef2d54cc7.dc1 area=wan 31:13.586 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29584 network=tcp 31:13.587 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29585 network=tcp 31:13.587 [INFO] TestAgent: started state syncer 31:13.587 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29590 network=tcp 31:13.656 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.656 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29589 [Candidate]" term=2 31:13.696 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.696 [DEBUG] TestAgent.server.raft: vote granted: from=ff1a5866-8df1-c9a7-c473-c43ef2d54cc7 term=2 tally=1 31:13.696 [INFO] TestAgent.server.raft: election won: tally=1 31:13.696 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29589 [Leader]" 31:13.697 [INFO] TestAgent.server: cluster leadership acquired 31:13.697 [INFO] TestAgent.server: New leader elected: payload=Node-ff1a5866-8df1-c9a7-c473-c43ef2d54cc7 31:13.740 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29589 31:13.772 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from= latency=3.121µs 31:13.772 [INFO] TestAgent: Requesting shutdown 31:13.772 [INFO] TestAgent.server: shutting down server 31:13.772 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.772 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:13.784 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:13.790 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 2021-10-05T16:31:13.796Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.796Z [INFO] agent.router.manager: shutting down 31:13.812 [INFO] TestAgent: consul server down 31:13.812 [INFO] TestAgent: shutdown complete 31:13.812 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29584 network=tcp 31:13.812 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29584 network=udp 31:13.812 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29585 network=tcp 31:13.812 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:14.316 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.316 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPIResponseHeaders (0.85s) === CONT TestConfig_Apply_IngressGateway [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHealthConnectServiceNodes_PassingFilter/bc_no_query_value === RUN TestHealthConnectServiceNodes_PassingFilter/passing_true === RUN TestHealthConnectServiceNodes_PassingFilter/passing_false === RUN TestHealthConnectServiceNodes_PassingFilter/passing_bad 2021-10-05T16:31:13.440Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.455Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.519 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:728237e0-790c-b61d-7335-7b338ce484a2 Address:127.0.0.1:29575}]" 31:13.520 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-728237e0-790c-b61d-7335-7b338ce484a2.dc1 127.0.0.1 31:13.520 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29575 [Follower]" leader= 31:13.527 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-728237e0-790c-b61d-7335-7b338ce484a2 127.0.0.1 2021-10-05T16:31:13.527Z [INFO] agent.router: Initializing LAN area manager 31:13.527 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29570 network=udp 31:13.528 [INFO] TestAgent.server: Adding LAN server: server="Node-728237e0-790c-b61d-7335-7b338ce484a2 (Addr: tcp/127.0.0.1:29575) (DC: dc1)" 31:13.528 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-728237e0-790c-b61d-7335-7b338ce484a2.dc1 area=wan 31:13.528 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29570 network=tcp 31:13.529 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29571 network=tcp 31:13.529 [INFO] TestAgent: started state syncer 31:13.529 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29576 network=tcp 31:13.572 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.572 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29575 [Candidate]" term=2 31:13.603 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.603 [DEBUG] TestAgent.server.raft: vote granted: from=728237e0-790c-b61d-7335-7b338ce484a2 term=2 tally=1 31:13.603 [INFO] TestAgent.server.raft: election won: tally=1 31:13.603 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29575 [Leader]" 31:13.603 [INFO] TestAgent.server: cluster leadership acquired 31:13.603 [INFO] TestAgent.server: New leader elected: payload=Node-728237e0-790c-b61d-7335-7b338ce484a2 31:13.645 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29575 31:13.694 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.792 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.792 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.792 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.792 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.792 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:13.792 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-728237e0-790c-b61d-7335-7b338ce484a2 31:13.792 [INFO] TestAgent.server: member joined, marking health alive: member=Node-728237e0-790c-b61d-7335-7b338ce484a2 31:13.823 [INFO] TestAgent.server: federation state anti-entropy synced 31:13.859 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:13.859 [INFO] TestAgent: Requesting shutdown 31:13.860 [INFO] TestAgent.server: shutting down server 31:13.860 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.860 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.860 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.860 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.860 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.860 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.860 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:13.860 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.860 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.860 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.860 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.876 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.883Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.883Z [INFO] agent.router.manager: shutting down 31:13.883 [INFO] TestAgent: consul server down 31:13.883 [INFO] TestAgent: shutdown complete 31:13.883 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29570 network=tcp 31:13.883 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29570 network=udp 31:13.883 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29571 network=tcp 31:14.384 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.384 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Execute/#03 2021-10-05T16:31:13.466Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.484Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.532 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cb0299a2-67cf-9372-114a-b16ed03f0e82 Address:127.0.0.1:29582}]" 31:13.533 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cb0299a2-67cf-9372-114a-b16ed03f0e82.dc1 127.0.0.1 31:13.533 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cb0299a2-67cf-9372-114a-b16ed03f0e82 127.0.0.1 2021-10-05T16:31:13.533Z [INFO] agent.router: Initializing LAN area manager 31:13.533 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29577 network=udp 31:13.533 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29582 [Follower]" leader= 31:13.534 [INFO] TestAgent.server: Adding LAN server: server="Node-cb0299a2-67cf-9372-114a-b16ed03f0e82 (Addr: tcp/127.0.0.1:29582) (DC: dc1)" 31:13.534 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cb0299a2-67cf-9372-114a-b16ed03f0e82.dc1 area=wan 31:13.534 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29577 network=tcp 31:13.534 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29578 network=tcp 31:13.534 [INFO] TestAgent: started state syncer 31:13.534 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29583 network=tcp 31:13.588 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.588 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29582 [Candidate]" term=2 31:13.632 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.632 [DEBUG] TestAgent.server.raft: vote granted: from=cb0299a2-67cf-9372-114a-b16ed03f0e82 term=2 tally=1 31:13.632 [INFO] TestAgent.server.raft: election won: tally=1 31:13.632 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29582 [Leader]" 31:13.632 [INFO] TestAgent.server: cluster leadership acquired 31:13.632 [INFO] TestAgent.server: New leader elected: payload=Node-cb0299a2-67cf-9372-114a-b16ed03f0e82 31:13.664 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29582 31:13.687 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.747 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.748 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.748 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.748 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.748 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:13.748 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cb0299a2-67cf-9372-114a-b16ed03f0e82 31:13.748 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cb0299a2-67cf-9372-114a-b16ed03f0e82 31:13.782 [INFO] TestAgent.server: federation state anti-entropy synced 31:13.879 [DEBUG] TestAgent.http: Request finished: method=GET url=/ui from= latency=2.059µs 31:13.879 [INFO] TestAgent: Requesting shutdown 31:13.879 [INFO] TestAgent.server: shutting down server 31:13.879 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.879 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.879 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.879 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.879 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.879 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.879 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.879 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:13.879 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.879 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.879 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.888 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.905Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.905Z [INFO] agent.router.manager: shutting down 31:13.905 [INFO] TestAgent: consul server down 31:13.905 [INFO] TestAgent: shutdown complete 31:13.905 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29577 network=tcp 31:13.905 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29577 network=udp 31:13.905 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29578 network=tcp 31:14.405 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.405 [INFO] TestAgent: Endpoints down --- PASS: TestUIResponseHeaders (0.96s) === CONT TestHealthIngressServiceNodes 2021-10-05T16:31:12.472Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:12.522Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:12.604 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a8d866f0-4982-3824-a284-11cc01bc48fa Address:127.0.0.1:29519}]" 31:12.604 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29519 [Follower]" leader= 31:12.605 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a8d866f0-4982-3824-a284-11cc01bc48fa.dc1 127.0.0.1 31:12.605 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a8d866f0-4982-3824-a284-11cc01bc48fa 127.0.0.1 2021-10-05T16:31:12.605Z [INFO] agent.router: Initializing LAN area manager 31:12.605 [INFO] TestAgent.server: Adding LAN server: server="Node-a8d866f0-4982-3824-a284-11cc01bc48fa (Addr: tcp/127.0.0.1:29519) (DC: dc1)" 31:12.605 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29507 network=udp 31:12.606 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a8d866f0-4982-3824-a284-11cc01bc48fa.dc1 area=wan 31:12.606 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29507 network=tcp 31:12.606 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29508 network=tcp 31:12.606 [INFO] TestAgent: started state syncer 31:12.606 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29520 network=tcp 31:12.660 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:12.660 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29519 [Candidate]" term=2 31:12.695 [DEBUG] TestAgent.server.raft: votes: needed=1 31:12.695 [DEBUG] TestAgent.server.raft: vote granted: from=a8d866f0-4982-3824-a284-11cc01bc48fa term=2 tally=1 31:12.695 [INFO] TestAgent.server.raft: election won: tally=1 31:12.695 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29519 [Leader]" 31:12.695 [INFO] TestAgent.server: cluster leadership acquired 31:12.696 [INFO] TestAgent.server: New leader elected: payload=Node-a8d866f0-4982-3824-a284-11cc01bc48fa 31:12.720 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29519 31:12.755 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:12.816 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:12.816 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:12.816 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:12.816 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:12.816 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:12.816 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a8d866f0-4982-3824-a284-11cc01bc48fa 31:12.816 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a8d866f0-4982-3824-a284-11cc01bc48fa 31:12.890 [INFO] TestAgent.server: federation state anti-entropy synced 31:13.020 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:13.032 [INFO] TestAgent: Synced node info 31:13.032 [DEBUG] TestAgent: Node info in sync 31:13.885 [INFO] TestAgent: Requesting shutdown 31:13.885 [INFO] TestAgent.server: shutting down server 31:13.885 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:13.885 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:13.885 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:13.885 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:13.885 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:13.885 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:13.885 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:13.885 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:13.885 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:13.885 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:13.904 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:13.913Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:13.913Z [INFO] agent.router.manager: shutting down 31:13.913 [INFO] TestAgent: consul server down 31:13.913 [INFO] TestAgent: shutdown complete 31:13.913 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29507 network=tcp 31:13.913 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29507 network=udp 31:13.913 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29508 network=tcp 31:14.420 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.420 [INFO] TestAgent: Endpoints down --- PASS: TestPProfHandlers_EnableDebug (2.01s) === CONT TestHealthConnectServiceNodes [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:13.691Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.743Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.793 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b49badd8-ec0a-7c1b-f5e8-8a58a63d078e Address:127.0.0.1:29610}]" 31:13.794 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b49badd8-ec0a-7c1b-f5e8-8a58a63d078e.dc1 127.0.0.1 31:13.796 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29610 [Follower]" leader= 31:13.796 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b49badd8-ec0a-7c1b-f5e8-8a58a63d078e 127.0.0.1 2021-10-05T16:31:13.796Z [INFO] agent.router: Initializing LAN area manager 31:13.797 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29605 network=udp 31:13.797 [INFO] TestAgent.server: Adding LAN server: server="Node-b49badd8-ec0a-7c1b-f5e8-8a58a63d078e (Addr: tcp/127.0.0.1:29610) (DC: dc1)" 31:13.797 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b49badd8-ec0a-7c1b-f5e8-8a58a63d078e.dc1 area=wan 31:13.797 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29605 network=tcp 31:13.797 [WARN] TestAgent: Replacing socket: path=/tmp/consul-test/TestHTTPServer_UnixSocket_FileExists-consul774297133/test.sock 31:13.798 [INFO] TestAgent: Started HTTP server: address=/tmp/consul-test/TestHTTPServer_UnixSocket_FileExists-consul774297133/test.sock network=unix 31:13.798 [INFO] TestAgent: started state syncer 31:13.799 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29611 network=tcp 31:13.838 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.838 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29610 [Candidate]" term=2 31:13.880 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.880 [DEBUG] TestAgent.server.raft: vote granted: from=b49badd8-ec0a-7c1b-f5e8-8a58a63d078e term=2 tally=1 31:13.880 [INFO] TestAgent.server.raft: election won: tally=1 31:13.880 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29610 [Leader]" 31:13.880 [INFO] TestAgent.server: cluster leadership acquired 31:13.880 [INFO] TestAgent.server: New leader elected: payload=Node-b49badd8-ec0a-7c1b-f5e8-8a58a63d078e 31:13.901 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29610 31:13.937 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.962 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.962 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.962 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.962 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.962 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:13.962 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b49badd8-ec0a-7c1b-f5e8-8a58a63d078e 31:13.963 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b49badd8-ec0a-7c1b-f5e8-8a58a63d078e 31:13.975 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.084 [INFO] TestAgent: Requesting shutdown 31:14.084 [INFO] TestAgent.server: shutting down server 31:14.084 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.084 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.084 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.084 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.084 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.084 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:14.084 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.084 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.084 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.084 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:14.084 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.092 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.100Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.100Z [INFO] agent.router.manager: shutting down 31:14.100 [INFO] TestAgent: consul server down 31:14.100 [INFO] TestAgent: shutdown complete 31:14.100 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29605 network=tcp 31:14.100 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29605 network=udp 31:14.100 [INFO] TestAgent: Stopping server: protocol=HTTP address=/tmp/consul-test/TestHTTPServer_UnixSocket_FileExists-consul774297133/test.sock network=unix 31:14.600 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.600 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPServer_UnixSocket_FileExists (0.95s) === CONT TestHealthServiceNodes_WanTranslation 2021-10-05T16:31:13.729Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.761Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.826 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:18d47604-945b-685b-2920-6b6adbfc0030 Address:127.0.0.1:29617}]" 31:13.827 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-18d47604-945b-685b-2920-6b6adbfc0030.dc1 127.0.0.1 31:13.828 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29617 [Follower]" leader= 31:13.828 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-18d47604-945b-685b-2920-6b6adbfc0030 127.0.0.1 2021-10-05T16:31:13.828Z [INFO] agent.router: Initializing LAN area manager 31:13.828 [INFO] TestAgent.server: Adding LAN server: server="Node-18d47604-945b-685b-2920-6b6adbfc0030 (Addr: tcp/127.0.0.1:29617) (DC: dc1)" 31:13.828 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29612 network=udp 31:13.828 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-18d47604-945b-685b-2920-6b6adbfc0030.dc1 area=wan 31:13.828 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29612 network=tcp 31:13.829 [INFO] TestAgent: Started HTTP server: address=/tmp/consul-test/TestHTTPServer_UnixSocket-consul263894247/test.sock network=unix 31:13.829 [INFO] TestAgent: started state syncer 31:13.829 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29618 network=tcp 31:13.891 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.891 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29617 [Candidate]" term=2 31:13.926 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.926 [DEBUG] TestAgent.server.raft: vote granted: from=18d47604-945b-685b-2920-6b6adbfc0030 term=2 tally=1 31:13.926 [INFO] TestAgent.server.raft: election won: tally=1 31:13.926 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29617 [Leader]" 31:13.926 [INFO] TestAgent.server: cluster leadership acquired 31:13.926 [INFO] TestAgent.server: New leader elected: payload=Node-18d47604-945b-685b-2920-6b6adbfc0030 31:13.939 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29617 31:13.969 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.999 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.999 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.999 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.999 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.999 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.000 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-18d47604-945b-685b-2920-6b6adbfc0030 31:14.000 [INFO] TestAgent.server: member joined, marking health alive: member=Node-18d47604-945b-685b-2920-6b6adbfc0030 31:14.010 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.169 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=@ latency=2.503851ms 31:14.170 [INFO] TestAgent: Requesting shutdown 31:14.170 [INFO] TestAgent.server: shutting down server 31:14.170 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.170 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.170 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.170 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.170 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.170 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:14.170 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.171 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:14.171 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.171 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.171 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.179 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.186Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.186Z [INFO] agent.router.manager: shutting down 31:14.186 [INFO] TestAgent: consul server down 31:14.186 [INFO] TestAgent: shutdown complete 31:14.186 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29612 network=tcp 31:14.186 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29612 network=udp 31:14.186 [INFO] TestAgent: Stopping server: protocol=HTTP address=/tmp/consul-test/TestHTTPServer_UnixSocket-consul263894247/test.sock network=unix 31:14.688 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.688 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPServer_UnixSocket (1.02s) === CONT TestHealthServiceNodes_CheckType 2021-10-05T16:31:13.626Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.673Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.767 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ac814954-052b-3984-c405-3e22bfde2188 Address:127.0.0.1:29603}]" 31:13.767 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ac814954-052b-3984-c405-3e22bfde2188.dc1 127.0.0.1 31:13.768 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29603 [Follower]" leader= 31:13.768 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ac814954-052b-3984-c405-3e22bfde2188 127.0.0.1 2021-10-05T16:31:13.768Z [INFO] agent.router: Initializing LAN area manager 31:13.768 [INFO] TestAgent.server: Adding LAN server: server="Node-ac814954-052b-3984-c405-3e22bfde2188 (Addr: tcp/127.0.0.1:29603) (DC: dc1)" 31:13.769 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ac814954-052b-3984-c405-3e22bfde2188.dc1 area=wan 31:13.769 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29598 network=udp 31:13.769 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29598 network=tcp 31:13.769 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29599 network=tcp 31:13.769 [INFO] TestAgent: started state syncer 31:13.769 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29604 network=tcp 31:13.808 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.808 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29603 [Candidate]" term=2 31:13.849 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.849 [DEBUG] TestAgent.server.raft: vote granted: from=ac814954-052b-3984-c405-3e22bfde2188 term=2 tally=1 31:13.849 [INFO] TestAgent.server.raft: election won: tally=1 31:13.849 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29603 [Leader]" 31:13.850 [INFO] TestAgent.server: cluster leadership acquired 31:13.851 [INFO] TestAgent.server: New leader elected: payload=Node-ac814954-052b-3984-c405-3e22bfde2188 31:13.867 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29603 31:13.889 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.946 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.946 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.946 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.946 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.946 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:13.946 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ac814954-052b-3984-c405-3e22bfde2188 31:13.946 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ac814954-052b-3984-c405-3e22bfde2188 31:13.959 [INFO] TestAgent: Synced node info 31:13.959 [DEBUG] TestAgent: Node info in sync 31:13.971 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.178 [ERROR] TestAgent.http: Request error: method=GET url=/v1/agent/self from= error="Endpoint is blocked by agent configuration" 31:14.178 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from= latency=1.726µs 31:14.178 [INFO] TestAgent: Requesting shutdown 31:14.178 [INFO] TestAgent.server: shutting down server 31:14.178 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.178 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.178 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.178 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.178 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.178 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:14.178 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.178 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.178 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.178 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.186 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.200Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.200Z [INFO] agent.router.manager: shutting down 31:14.200 [INFO] TestAgent: consul server down 31:14.200 [INFO] TestAgent: shutdown complete 31:14.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29598 network=tcp 31:14.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29598 network=udp 31:14.200 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29599 network=tcp 31:14.700 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.700 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPI_BlockEndpoints (1.09s) === CONT TestHealthServiceNodes_PassingFilter [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestHealthIngressServiceNodes/associated_service === RUN TestHealthIngressServiceNodes/non-associated_service 2021-10-05T16:31:14.119Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.152Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.228 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6b34529f-167f-be07-0c46-cf79d83f94cf Address:127.0.0.1:29624}]" 31:14.229 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6b34529f-167f-be07-0c46-cf79d83f94cf.dc1 127.0.0.1 31:14.229 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6b34529f-167f-be07-0c46-cf79d83f94cf 127.0.0.1 2021-10-05T16:31:14.229Z [INFO] agent.router: Initializing LAN area manager 31:14.229 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29619 network=udp 31:14.229 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29624 [Follower]" leader= 31:14.230 [INFO] TestAgent.server: Adding LAN server: server="Node-6b34529f-167f-be07-0c46-cf79d83f94cf (Addr: tcp/127.0.0.1:29624) (DC: dc1)" 31:14.230 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6b34529f-167f-be07-0c46-cf79d83f94cf.dc1 area=wan 31:14.230 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29619 network=tcp 31:14.230 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29620 network=tcp 31:14.230 [INFO] TestAgent: started state syncer 31:14.230 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29625 network=tcp 31:14.282 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.283 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29624 [Candidate]" term=2 31:14.308 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.308 [DEBUG] TestAgent.server.raft: vote granted: from=6b34529f-167f-be07-0c46-cf79d83f94cf term=2 tally=1 31:14.308 [INFO] TestAgent.server.raft: election won: tally=1 31:14.308 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29624 [Leader]" 31:14.308 [INFO] TestAgent.server: cluster leadership acquired 31:14.308 [INFO] TestAgent.server: New leader elected: payload=Node-6b34529f-167f-be07-0c46-cf79d83f94cf 31:14.331 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29624 31:14.353 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.382 [INFO] TestAgent: Requesting shutdown 31:14.383 [INFO] TestAgent.server: shutting down server 31:14.383 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.383 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:14.392 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:14.393 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.393 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.393 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.393 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.393 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.393 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6b34529f-167f-be07-0c46-cf79d83f94cf 31:14.393 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6b34529f-167f-be07-0c46-cf79d83f94cf 2021-10-05T16:31:14.399Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.399Z [INFO] agent.router.manager: shutting down 31:14.417 [INFO] TestAgent: consul server down 31:14.417 [INFO] TestAgent: shutdown complete 31:14.417 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29619 network=tcp 31:14.417 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29619 network=udp 31:14.417 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29620 network=tcp 31:14.417 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-6b34529f-167f-be07-0c46-cf79d83f94cf 127.0.0.1 29622 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:6b34529f-167f-be07-0c46-cf79d83f94cf port:29624 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29623] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:14.417 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.417 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.417 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.417 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.418 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.418 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.418 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.918 [INFO] TestAgent: Waiting for endpoints to shut down 31:14.918 [INFO] TestAgent: Endpoints down --- PASS: TestHealthConnectServiceNodes_PassingFilter (0.83s) --- PASS: TestHealthConnectServiceNodes_PassingFilter/bc_no_query_value (0.00s) --- PASS: TestHealthConnectServiceNodes_PassingFilter/passing_true (0.00s) --- PASS: TestHealthConnectServiceNodes_PassingFilter/passing_false (0.00s) --- PASS: TestHealthConnectServiceNodes_PassingFilter/passing_bad (0.00s) === CONT TestHealthServiceNodes_DistanceSort 2021-10-05T16:31:14.139Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.179Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.227 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:66ae3dff-0bee-ea52-1c8d-b87ed964cfef Address:127.0.0.1:29638}]" 31:14.228 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29638 [Follower]" leader= 31:14.228 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-66ae3dff-0bee-ea52-1c8d-b87ed964cfef.dc1 127.0.0.1 31:14.229 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-66ae3dff-0bee-ea52-1c8d-b87ed964cfef 127.0.0.1 2021-10-05T16:31:14.229Z [INFO] agent.router: Initializing LAN area manager 31:14.229 [INFO] TestAgent.server: Adding LAN server: server="Node-66ae3dff-0bee-ea52-1c8d-b87ed964cfef (Addr: tcp/127.0.0.1:29638) (DC: dc1)" 31:14.229 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-66ae3dff-0bee-ea52-1c8d-b87ed964cfef.dc1 area=wan 31:14.230 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29626 network=tcp 31:14.230 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29626 network=udp 31:14.230 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29627 network=tcp 31:14.231 [INFO] TestAgent: started state syncer 31:14.231 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29639 network=tcp 31:14.283 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.283 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29638 [Candidate]" term=2 31:14.304 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.304 [DEBUG] TestAgent.server.raft: vote granted: from=66ae3dff-0bee-ea52-1c8d-b87ed964cfef term=2 tally=1 31:14.304 [INFO] TestAgent.server.raft: election won: tally=1 31:14.304 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29638 [Leader]" 31:14.304 [INFO] TestAgent.server: cluster leadership acquired 31:14.304 [INFO] TestAgent.server: New leader elected: payload=Node-66ae3dff-0bee-ea52-1c8d-b87ed964cfef 31:14.329 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29638 31:14.351 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.395 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.395 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.395 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.395 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.395 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.395 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-66ae3dff-0bee-ea52-1c8d-b87ed964cfef 31:14.395 [INFO] TestAgent.server: member joined, marking health alive: member=Node-66ae3dff-0bee-ea52-1c8d-b87ed964cfef 31:14.436 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:14.447 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.454 [INFO] TestAgent: Synced node info 31:14.454 [DEBUG] TestAgent: Node info in sync 31:14.489 [INFO] TestAgent: Requesting shutdown 31:14.489 [INFO] TestAgent.server: shutting down server 31:14.489 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.489 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.489 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.489 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.489 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.490 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:14.490 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.490 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.490 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.490 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.504 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.512Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.512Z [INFO] agent.router.manager: shutting down 31:14.512 [INFO] TestAgent: consul server down 31:14.512 [INFO] TestAgent: shutdown complete 31:14.512 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29626 network=tcp 31:14.512 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29626 network=udp 31:14.512 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29627 network=tcp 31:15.012 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.012 [INFO] TestAgent: Endpoints down --- PASS: TestHealthConnectServiceNodes_Filter (0.91s) === CONT TestHealthServiceNodes_Filter === RUN TestHealthServiceNodes_PassingFilter/bc_no_query_value === RUN TestHealthServiceNodes_PassingFilter/passing_true === RUN TestHealthServiceNodes_PassingFilter/passing_false === RUN TestHealthServiceNodes_PassingFilter/passing_bad [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:14.347Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.360Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.438 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:94bbf6ae-8d27-f0e6-d140-28448f4b5ebf Address:127.0.0.1:29645}]" 31:14.439 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-94bbf6ae-8d27-f0e6-d140-28448f4b5ebf.dc1 127.0.0.1 31:14.439 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-94bbf6ae-8d27-f0e6-d140-28448f4b5ebf 127.0.0.1 2021-10-05T16:31:14.439Z [INFO] agent.router: Initializing LAN area manager 31:14.440 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29633 network=udp 31:14.440 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29645 [Follower]" leader= 31:14.444 [INFO] TestAgent.server: Adding LAN server: server="Node-94bbf6ae-8d27-f0e6-d140-28448f4b5ebf (Addr: tcp/127.0.0.1:29645) (DC: dc1)" 31:14.445 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-94bbf6ae-8d27-f0e6-d140-28448f4b5ebf.dc1 area=wan 31:14.445 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29633 network=tcp 31:14.446 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29634 network=tcp 31:14.446 [INFO] TestAgent: started state syncer 31:14.446 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29646 network=tcp 31:14.493 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.493 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29645 [Candidate]" term=2 31:14.512 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.512 [DEBUG] TestAgent.server.raft: vote granted: from=94bbf6ae-8d27-f0e6-d140-28448f4b5ebf term=2 tally=1 31:14.512 [INFO] TestAgent.server.raft: election won: tally=1 31:14.512 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29645 [Leader]" 31:14.512 [INFO] TestAgent.server: cluster leadership acquired 31:14.512 [INFO] TestAgent.server: New leader elected: payload=Node-94bbf6ae-8d27-f0e6-d140-28448f4b5ebf 31:14.532 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29645 31:14.573 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.628 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.628 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.628 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.628 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.628 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.628 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-94bbf6ae-8d27-f0e6-d140-28448f4b5ebf 31:14.628 [INFO] TestAgent.server: member joined, marking health alive: member=Node-94bbf6ae-8d27-f0e6-d140-28448f4b5ebf 31:14.640 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.675 [INFO] TestAgent: Requesting shutdown 31:14.675 [INFO] TestAgent.server: shutting down server 31:14.675 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.675 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.675 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.675 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.675 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.675 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:14.675 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.675 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:14.676 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.676 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.676 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.683 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.695Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.695Z [INFO] agent.router.manager: shutting down 31:14.695 [INFO] TestAgent: consul server down 31:14.695 [INFO] TestAgent: shutdown complete 31:14.695 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29633 network=tcp 31:14.695 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29633 network=udp 31:14.695 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29634 network=tcp 31:15.196 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.196 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Apply_IngressGateway (0.88s) === CONT TestHealthServiceNodes_NodeMetaFilter [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:14.447Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.504Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.592 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dfb4eaa1-017d-143c-d566-1dbe6f97a68e Address:127.0.0.1:29659}]" 31:14.593 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dfb4eaa1-017d-143c-d566-1dbe6f97a68e.dc1 127.0.0.1 31:14.593 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dfb4eaa1-017d-143c-d566-1dbe6f97a68e 127.0.0.1 2021-10-05T16:31:14.593Z [INFO] agent.router: Initializing LAN area manager 31:14.593 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29654 network=udp 31:14.593 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29659 [Follower]" leader= 31:14.594 [INFO] TestAgent.server: Adding LAN server: server="Node-dfb4eaa1-017d-143c-d566-1dbe6f97a68e (Addr: tcp/127.0.0.1:29659) (DC: dc1)" 31:14.594 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dfb4eaa1-017d-143c-d566-1dbe6f97a68e.dc1 area=wan 31:14.594 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29654 network=tcp 31:14.594 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29655 network=tcp 31:14.594 [INFO] TestAgent: started state syncer 31:14.594 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29660 network=tcp 31:14.644 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.644 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29659 [Candidate]" term=2 31:14.696 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.696 [DEBUG] TestAgent.server.raft: vote granted: from=dfb4eaa1-017d-143c-d566-1dbe6f97a68e term=2 tally=1 31:14.696 [INFO] TestAgent.server.raft: election won: tally=1 31:14.696 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29659 [Leader]" 31:14.696 [INFO] TestAgent.server: cluster leadership acquired 31:14.696 [INFO] TestAgent.server: New leader elected: payload=Node-dfb4eaa1-017d-143c-d566-1dbe6f97a68e 31:14.728 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29659 31:14.766 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.798 [INFO] TestAgent: Synced node info 31:14.798 [DEBUG] TestAgent: Node info in sync 31:14.824 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.824 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.824 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.824 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.824 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.824 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dfb4eaa1-017d-143c-d566-1dbe6f97a68e 31:14.824 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dfb4eaa1-017d-143c-d566-1dbe6f97a68e 31:14.847 [INFO] TestAgent: Requesting shutdown 31:14.847 [INFO] TestAgent.server: shutting down server 31:14.847 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.847 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.847 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.847 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.847 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.847 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.847 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.847 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.847 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.847 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.851 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.860Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.860Z [INFO] agent.router.manager: shutting down 31:14.860 [INFO] TestAgent: consul server down 31:14.860 [INFO] TestAgent: shutdown complete 31:14.860 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29654 network=tcp 31:14.860 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29654 network=udp 31:14.860 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29655 network=tcp 31:15.360 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.360 [INFO] TestAgent: Endpoints down --- PASS: TestHealthIngressServiceNodes (0.96s) --- PASS: TestHealthIngressServiceNodes/associated_service (0.00s) --- PASS: TestHealthIngressServiceNodes/non-associated_service (0.00s) === CONT TestHealthServiceNodes 2021-10-05T16:31:14.401Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.431Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.555 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3105e377-e6ca-5f2a-b882-8e182bf459c7 Address:127.0.0.1:29652}]" 31:14.556 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3105e377-e6ca-5f2a-b882-8e182bf459c7.dc1 127.0.0.1 31:14.557 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3105e377-e6ca-5f2a-b882-8e182bf459c7 127.0.0.1 2021-10-05T16:31:14.557Z [INFO] agent.router: Initializing LAN area manager 31:14.557 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29647 network=udp 31:14.557 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29652 [Follower]" leader= 31:14.557 [INFO] TestAgent.server: Adding LAN server: server="Node-3105e377-e6ca-5f2a-b882-8e182bf459c7 (Addr: tcp/127.0.0.1:29652) (DC: dc1)" 31:14.557 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3105e377-e6ca-5f2a-b882-8e182bf459c7.dc1 area=wan 31:14.558 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29647 network=tcp 31:14.558 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29648 network=tcp 31:14.558 [INFO] TestAgent: started state syncer 31:14.558 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29653 network=tcp 31:14.596 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.596 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29652 [Candidate]" term=2 31:14.634 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.634 [DEBUG] TestAgent.server.raft: vote granted: from=3105e377-e6ca-5f2a-b882-8e182bf459c7 term=2 tally=1 31:14.634 [INFO] TestAgent.server.raft: election won: tally=1 31:14.634 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29652 [Leader]" 31:14.636 [INFO] TestAgent.server: cluster leadership acquired 31:14.636 [INFO] TestAgent.server: New leader elected: payload=Node-3105e377-e6ca-5f2a-b882-8e182bf459c7 31:14.663 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29652 31:14.692 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.755 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.755 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.755 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.755 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.755 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.755 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3105e377-e6ca-5f2a-b882-8e182bf459c7 31:14.755 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3105e377-e6ca-5f2a-b882-8e182bf459c7 31:14.772 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.802 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:14.812 [INFO] TestAgent: Synced node info 31:14.880 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:14.880 [INFO] TestAgent: Requesting shutdown 31:14.880 [INFO] TestAgent.server: shutting down server 31:14.880 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.880 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.880 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.880 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.880 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.880 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:14.880 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.880 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.880 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.880 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.895 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.908Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.908Z [INFO] agent.router.manager: shutting down 31:14.908 [INFO] TestAgent: consul server down 31:14.908 [INFO] TestAgent: shutdown complete 31:14.908 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29647 network=tcp 31:14.908 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29647 network=udp 31:14.908 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29648 network=tcp 31:15.409 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.409 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Execute/#04 2021-10-05T16:31:14.715Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.750Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.820 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2b33c8d6-f754-5048-c859-15bece5e8a2d Address:127.0.0.1:29680}]" 31:14.820 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29680 [Follower]" leader= 31:14.821 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2b33c8d6-f754-5048-c859-15bece5e8a2d.dc1 127.0.0.1 31:14.822 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2b33c8d6-f754-5048-c859-15bece5e8a2d 127.0.0.1 2021-10-05T16:31:14.822Z [INFO] agent.router: Initializing LAN area manager 31:14.822 [INFO] TestAgent.server: Adding LAN server: server="Node-2b33c8d6-f754-5048-c859-15bece5e8a2d (Addr: tcp/127.0.0.1:29680) (DC: dc1)" 31:14.822 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2b33c8d6-f754-5048-c859-15bece5e8a2d.dc1 area=wan 31:14.822 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29675 network=udp 31:14.822 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29675 network=tcp 31:14.823 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29676 network=tcp 31:14.823 [INFO] TestAgent: started state syncer 31:14.823 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29681 network=tcp 31:14.886 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.886 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29680 [Candidate]" term=2 31:14.907 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.907 [DEBUG] TestAgent.server.raft: vote granted: from=2b33c8d6-f754-5048-c859-15bece5e8a2d term=2 tally=1 31:14.907 [INFO] TestAgent.server.raft: election won: tally=1 31:14.907 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29680 [Leader]" 31:14.907 [INFO] TestAgent.server: cluster leadership acquired 31:14.907 [INFO] TestAgent.server: New leader elected: payload=Node-2b33c8d6-f754-5048-c859-15bece5e8a2d 31:14.917 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29680 31:14.936 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.959 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.959 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.959 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.959 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.959 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.959 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2b33c8d6-f754-5048-c859-15bece5e8a2d 31:14.959 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2b33c8d6-f754-5048-c859-15bece5e8a2d 31:14.976 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.025 [INFO] TestAgent: Requesting shutdown 31:15.025 [INFO] TestAgent.server: shutting down server 31:15.025 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.025 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.025 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.025 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.025 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.025 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.025 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.025 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:15.025 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.025 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.025 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.035 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.044Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.044Z [INFO] agent.router.manager: shutting down 31:15.044 [INFO] TestAgent: consul server down 31:15.044 [INFO] TestAgent: shutdown complete 31:15.044 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29675 network=tcp 31:15.044 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29675 network=udp 31:15.044 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29676 network=tcp 31:15.550 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.550 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceNodes_CheckType (0.86s) === CONT TestHealthServiceChecks_DistanceSort 2021-10-05T16:31:14.487Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.509Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.592 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:718bd739-baa6-2969-59aa-cba7bb38e4c8 Address:127.0.0.1:29666}]" 31:14.593 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-718bd739-baa6-2969-59aa-cba7bb38e4c8.dc1 127.0.0.1 31:14.594 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-718bd739-baa6-2969-59aa-cba7bb38e4c8 127.0.0.1 2021-10-05T16:31:14.594Z [INFO] agent.router: Initializing LAN area manager 31:14.594 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29661 network=udp 31:14.594 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29666 [Follower]" leader= 31:14.594 [INFO] TestAgent.server: Adding LAN server: server="Node-718bd739-baa6-2969-59aa-cba7bb38e4c8 (Addr: tcp/127.0.0.1:29666) (DC: dc1)" 31:14.595 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-718bd739-baa6-2969-59aa-cba7bb38e4c8.dc1 area=wan 31:14.595 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29661 network=tcp 31:14.595 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29662 network=tcp 31:14.595 [INFO] TestAgent: started state syncer 31:14.595 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29667 network=tcp 31:14.655 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.655 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29666 [Candidate]" term=2 31:14.672 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.672 [DEBUG] TestAgent.server.raft: vote granted: from=718bd739-baa6-2969-59aa-cba7bb38e4c8 term=2 tally=1 31:14.672 [INFO] TestAgent.server.raft: election won: tally=1 31:14.672 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29666 [Leader]" 31:14.672 [INFO] TestAgent.server: cluster leadership acquired 31:14.672 [INFO] TestAgent.server: New leader elected: payload=Node-718bd739-baa6-2969-59aa-cba7bb38e4c8 31:14.682 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29666 31:14.720 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.793 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.793 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.793 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.793 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.793 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.793 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-718bd739-baa6-2969-59aa-cba7bb38e4c8 31:14.793 [INFO] TestAgent.server: member joined, marking health alive: member=Node-718bd739-baa6-2969-59aa-cba7bb38e4c8 31:14.809 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.830 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:14.835 [INFO] TestAgent: Synced node info 31:15.030 [INFO] TestAgent: Requesting shutdown 31:15.030 [INFO] TestAgent.server: shutting down server 31:15.030 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.030 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.030 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.030 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.030 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.031 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.031 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.031 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.031 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.031 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.040 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.048Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.048Z [INFO] agent.router.manager: shutting down 31:15.048 [INFO] TestAgent: consul server down 31:15.048 [INFO] TestAgent: shutdown complete 31:15.048 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29661 network=tcp 31:15.048 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29661 network=udp 31:15.048 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29662 network=tcp 31:15.552 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.552 [INFO] TestAgent: Endpoints down --- PASS: TestHealthConnectServiceNodes (1.13s) === CONT TestEventList_ACLFilter [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:14.728Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.743Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.812 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5ccc2f2b-f2ff-26b4-69be-3704e415cdb0 Address:127.0.0.1:29687}]" 31:14.813 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0.dc1 127.0.0.1 31:14.813 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0 127.0.0.1 2021-10-05T16:31:14.813Z [INFO] agent.router: Initializing LAN area manager 31:14.813 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29682 network=udp 31:14.813 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29687 [Follower]" leader= 31:14.814 [INFO] TestAgent.server: Adding LAN server: server="Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0 (Addr: tcp/127.0.0.1:29687) (DC: dc1)" 31:14.814 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29682 network=tcp 31:14.814 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0.dc1 area=wan 31:14.814 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29683 network=tcp 31:14.814 [INFO] TestAgent: started state syncer 31:14.814 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29688 network=tcp 31:14.869 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.869 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29687 [Candidate]" term=2 31:14.883 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.883 [DEBUG] TestAgent.server.raft: vote granted: from=5ccc2f2b-f2ff-26b4-69be-3704e415cdb0 term=2 tally=1 31:14.883 [INFO] TestAgent.server.raft: election won: tally=1 31:14.883 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29687 [Leader]" 31:14.883 [INFO] TestAgent.server: cluster leadership acquired 31:14.883 [INFO] TestAgent.server: New leader elected: payload=Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0 31:14.897 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29687 31:14.913 [WARN] TestAgent.server.fsm: EnsureRegistration failed: error="failed inserting check: Missing service registration on node "Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0"" 31:14.933 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.956 [WARN] TestAgent.server.fsm: EnsureRegistration failed: error="failed inserting check: Missing service registration on node "Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0"" 31:14.973 [INFO] TestAgent: Synced node info 31:14.992 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.992 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.992 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.992 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.992 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.992 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0 31:14.992 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0 31:15.020 [WARN] TestAgent.server.fsm: EnsureRegistration failed: error="failed inserting check: Missing service registration on node "Node-5ccc2f2b-f2ff-26b4-69be-3704e415cdb0"" 31:15.020 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.069 [INFO] TestAgent: Requesting shutdown 31:15.069 [INFO] TestAgent.server: shutting down server 31:15.069 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.069 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.069 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.069 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.069 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.069 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.069 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.069 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.069 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.069 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.079 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.092Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.092Z [INFO] agent.router.manager: shutting down 31:15.092 [INFO] TestAgent: consul server down 31:15.092 [INFO] TestAgent: shutdown complete 31:15.092 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29682 network=tcp 31:15.092 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29682 network=udp 31:15.092 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29683 network=tcp 31:15.592 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.592 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceNodes_PassingFilter (0.89s) --- PASS: TestHealthServiceNodes_PassingFilter/bc_no_query_value (0.00s) --- PASS: TestHealthServiceNodes_PassingFilter/passing_true (0.00s) --- PASS: TestHealthServiceNodes_PassingFilter/passing_false (0.00s) --- PASS: TestHealthServiceNodes_PassingFilter/passing_bad (0.00s) === CONT TestHealthServiceChecks_Filtering 2021-10-05T16:31:14.146Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.165Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.252 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b8166930-c19f-86e3-970d-ce8945e154f8 Address:127.0.0.1:29631}]" 31:14.253 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b8166930-c19f-86e3-970d-ce8945e154f8.dc1 127.0.0.1 31:14.253 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b8166930-c19f-86e3-970d-ce8945e154f8 127.0.0.1 2021-10-05T16:31:14.253Z [INFO] agent.router: Initializing LAN area manager 31:14.253 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29640 network=udp 31:14.253 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29631 [Follower]" leader= 31:14.254 [INFO] TestAgent.server: Adding LAN server: server="Node-b8166930-c19f-86e3-970d-ce8945e154f8 (Addr: tcp/127.0.0.1:29631) (DC: dc1)" 31:14.254 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b8166930-c19f-86e3-970d-ce8945e154f8.dc1 area=wan 31:14.254 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29640 network=tcp 31:14.254 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29641 network=tcp 31:14.254 [INFO] TestAgent: started state syncer 31:14.254 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29632 network=tcp 31:14.300 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.300 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29631 [Candidate]" term=2 31:14.348 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.348 [DEBUG] TestAgent.server.raft: vote granted: from=b8166930-c19f-86e3-970d-ce8945e154f8 term=2 tally=1 31:14.348 [INFO] TestAgent.server.raft: election won: tally=1 31:14.348 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29631 [Leader]" 31:14.348 [INFO] TestAgent.server: cluster leadership acquired 31:14.348 [INFO] TestAgent.server: New leader elected: payload=Node-b8166930-c19f-86e3-970d-ce8945e154f8 31:14.378 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29631 31:14.397 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.484 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.484 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.484 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.484 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.484 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.484 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b8166930-c19f-86e3-970d-ce8945e154f8 31:14.484 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b8166930-c19f-86e3-970d-ce8945e154f8 31:14.532 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.588 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:14.600 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from= latency=3.596µs 31:14.600 [INFO] TestAgent: Requesting shutdown 31:14.600 [INFO] TestAgent.server: shutting down server 31:14.600 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:14.600 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:14.600 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:14.600 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:14.600 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:14.600 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:14.600 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:14.600 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:14.600 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:14.600 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:14.604 [INFO] TestAgent: Synced node info 31:14.608 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:14.616Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:14.616Z [INFO] agent.router.manager: shutting down 31:14.616 [INFO] TestAgent: consul server down 31:14.616 [INFO] TestAgent: shutdown complete 31:14.616 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29640 network=tcp 31:14.616 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29640 network=udp 31:14.616 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29641 network=tcp 31:15.120 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.120 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:13.568Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:13.582Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:13.680 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1bc6abe1-563e-0dcf-6193-6ed50c728cd0 Address:127.0.0.1:29596}]" 31:13.681 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1bc6abe1-563e-0dcf-6193-6ed50c728cd0.dc1 127.0.0.1 31:13.682 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1bc6abe1-563e-0dcf-6193-6ed50c728cd0 127.0.0.1 2021-10-05T16:31:13.682Z [INFO] agent.router: Initializing LAN area manager 31:13.684 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29596 [Follower]" leader= 31:13.685 [INFO] TestAgent.server: Adding LAN server: server="Node-1bc6abe1-563e-0dcf-6193-6ed50c728cd0 (Addr: tcp/127.0.0.1:29596) (DC: dc1)" 31:13.685 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1bc6abe1-563e-0dcf-6193-6ed50c728cd0.dc1 area=wan 31:13.685 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29591 network=tcp 31:13.686 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29591 network=udp 31:13.687 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29592 network=tcp 31:13.687 [INFO] TestAgent: started state syncer 31:13.687 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29597 network=tcp 31:13.728 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:13.728 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29596 [Candidate]" term=2 31:13.776 [DEBUG] TestAgent.server.raft: votes: needed=1 31:13.776 [DEBUG] TestAgent.server.raft: vote granted: from=1bc6abe1-563e-0dcf-6193-6ed50c728cd0 term=2 tally=1 31:13.776 [INFO] TestAgent.server.raft: election won: tally=1 31:13.776 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29596 [Leader]" 31:13.778 [INFO] TestAgent.server: cluster leadership acquired 31:13.778 [INFO] TestAgent.server: New leader elected: payload=Node-1bc6abe1-563e-0dcf-6193-6ed50c728cd0 31:13.804 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29596 31:13.844 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:13.912 [INFO] TestAgent: Synced node info 31:13.912 [DEBUG] TestAgent: Node info in sync 31:13.912 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:13.912 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:13.912 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:13.912 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:13.912 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:13.912 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1bc6abe1-563e-0dcf-6193-6ed50c728cd0 31:13.912 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1bc6abe1-563e-0dcf-6193-6ed50c728cd0 31:13.940 [INFO] TestAgent.server: federation state anti-entropy synced 31:14.112 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from= latency=1.845µs 31:14.666 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:14.666 [DEBUG] TestAgent: Node info in sync 31:15.120 [INFO] TestAgent: Requesting shutdown 31:15.120 [INFO] TestAgent.server: shutting down server 31:15.120 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.120 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.120 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.120 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.120 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.120 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.120 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.120 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.120 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.120 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.125 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.133Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.133Z [INFO] agent.router.manager: shutting down 31:15.133 [INFO] TestAgent: consul server down 31:15.133 [INFO] TestAgent: shutdown complete 31:15.133 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29591 network=tcp 31:15.133 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29591 network=udp 31:15.133 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29592 network=tcp 31:15.633 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.633 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPAPI_TranslateAddrHeader (2.10s) === CONT TestHealthServiceChecks_NodeMetaFilter [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestEventList_ACLFilter/no_token === RUN TestEventList_ACLFilter/root_token 2021-10-05T16:31:14.935Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.952Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.010 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:26e77cfe-3e47-fed6-e39e-129a61fd44c4 Address:127.0.0.1:29694}]" 31:15.011 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-26e77cfe-3e47-fed6-e39e-129a61fd44c4.dc1 127.0.0.1 31:15.012 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-26e77cfe-3e47-fed6-e39e-129a61fd44c4 127.0.0.1 2021-10-05T16:31:15.012Z [INFO] agent.router: Initializing LAN area manager 31:15.012 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29689 network=udp 31:15.012 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29694 [Follower]" leader= 31:15.012 [INFO] TestAgent.server: Adding LAN server: server="Node-26e77cfe-3e47-fed6-e39e-129a61fd44c4 (Addr: tcp/127.0.0.1:29694) (DC: dc1)" 31:15.012 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-26e77cfe-3e47-fed6-e39e-129a61fd44c4.dc1 area=wan 31:15.012 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29689 network=tcp 31:15.013 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29690 network=tcp 31:15.013 [INFO] TestAgent: started state syncer 31:15.013 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29695 network=tcp 31:15.069 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.069 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29694 [Candidate]" term=2 31:15.092 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.092 [DEBUG] TestAgent.server.raft: vote granted: from=26e77cfe-3e47-fed6-e39e-129a61fd44c4 term=2 tally=1 31:15.092 [INFO] TestAgent.server.raft: election won: tally=1 31:15.092 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29694 [Leader]" 31:15.095 [INFO] TestAgent.server: cluster leadership acquired 31:15.095 [INFO] TestAgent.server: New leader elected: payload=Node-26e77cfe-3e47-fed6-e39e-129a61fd44c4 31:15.104 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29694 31:15.122 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.187 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.188 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.188 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.188 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.188 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.188 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-26e77cfe-3e47-fed6-e39e-129a61fd44c4 31:15.188 [INFO] TestAgent.server: member joined, marking health alive: member=Node-26e77cfe-3e47-fed6-e39e-129a61fd44c4 31:15.215 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.388 [INFO] TestAgent: Requesting shutdown 31:15.388 [INFO] TestAgent.server: shutting down server 31:15.388 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.388 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.388 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.388 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.388 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.388 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.388 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.388 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:15.388 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.388 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.388 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.400 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.412Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.412Z [INFO] agent.router.manager: shutting down 31:15.412 [INFO] TestAgent: consul server down 31:15.412 [INFO] TestAgent: shutdown complete 31:15.412 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29689 network=tcp 31:15.412 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29689 network=udp 31:15.412 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29690 network=tcp 31:15.913 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.913 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceNodes_DistanceSort (0.99s) === CONT TestHealthServiceChecks 2021-10-05T16:31:15.031Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.051Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.099 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2f67b19e-d30f-9eeb-1695-83490da357d9 Address:127.0.0.1:29701}]" 31:15.100 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2f67b19e-d30f-9eeb-1695-83490da357d9.dc1 127.0.0.1 31:15.100 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2f67b19e-d30f-9eeb-1695-83490da357d9 127.0.0.1 2021-10-05T16:31:15.100Z [INFO] agent.router: Initializing LAN area manager 31:15.100 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29696 network=udp 31:15.100 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29701 [Follower]" leader= 31:15.101 [INFO] TestAgent.server: Adding LAN server: server="Node-2f67b19e-d30f-9eeb-1695-83490da357d9 (Addr: tcp/127.0.0.1:29701) (DC: dc1)" 31:15.101 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2f67b19e-d30f-9eeb-1695-83490da357d9.dc1 area=wan 31:15.101 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29696 network=tcp 31:15.101 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29697 network=tcp 31:15.101 [INFO] TestAgent: started state syncer 31:15.101 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29702 network=tcp 31:15.140 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.140 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29701 [Candidate]" term=2 31:15.180 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.180 [DEBUG] TestAgent.server.raft: vote granted: from=2f67b19e-d30f-9eeb-1695-83490da357d9 term=2 tally=1 31:15.180 [INFO] TestAgent.server.raft: election won: tally=1 31:15.180 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29701 [Leader]" 31:15.184 [INFO] TestAgent.server: cluster leadership acquired 31:15.184 [INFO] TestAgent.server: New leader elected: payload=Node-2f67b19e-d30f-9eeb-1695-83490da357d9 31:15.203 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29701 31:15.235 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.292 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.292 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.292 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.292 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.292 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.292 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2f67b19e-d30f-9eeb-1695-83490da357d9 31:15.292 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2f67b19e-d30f-9eeb-1695-83490da357d9 31:15.310 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.377 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:15.382 [INFO] TestAgent: Synced node info 31:15.463 [INFO] TestAgent: Requesting shutdown 31:15.463 [INFO] TestAgent.server: shutting down server 31:15.463 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.463 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.463 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.463 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.463 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.463 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.463 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.463 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.463 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.463 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.469 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.475Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.475Z [INFO] agent.router.manager: shutting down 31:15.476 [INFO] TestAgent: consul server down 31:15.476 [INFO] TestAgent: shutdown complete 31:15.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29696 network=tcp 31:15.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29696 network=udp 31:15.476 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29697 network=tcp 31:15.976 [INFO] TestAgent: Waiting for endpoints to shut down 31:15.976 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceNodes_Filter (0.97s) === CONT TestHealthNodeChecks_Filtering [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:15.427Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.454Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.486 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6b6be8c3-242c-cf7a-bce3-43331b03569f Address:127.0.0.1:29736}]" 31:15.487 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6b6be8c3-242c-cf7a-bce3-43331b03569f.dc1 127.0.0.1 31:15.487 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6b6be8c3-242c-cf7a-bce3-43331b03569f 127.0.0.1 2021-10-05T16:31:15.487Z [INFO] agent.router: Initializing LAN area manager 31:15.488 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29724 network=udp 31:15.488 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29736 [Follower]" leader= 31:15.488 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29724 network=tcp 31:15.488 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6b6be8c3-242c-cf7a-bce3-43331b03569f.dc1 area=wan 31:15.488 [INFO] TestAgent.server: Adding LAN server: server="Node-6b6be8c3-242c-cf7a-bce3-43331b03569f (Addr: tcp/127.0.0.1:29736) (DC: dc1)" 31:15.488 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29725 network=tcp 31:15.488 [INFO] TestAgent: started state syncer 31:15.488 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29737 network=tcp 31:15.548 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.548 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29736 [Candidate]" term=2 31:15.604 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.604 [DEBUG] TestAgent.server.raft: vote granted: from=6b6be8c3-242c-cf7a-bce3-43331b03569f term=2 tally=1 31:15.604 [INFO] TestAgent.server.raft: election won: tally=1 31:15.604 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29736 [Leader]" 31:15.604 [INFO] TestAgent.server: cluster leadership acquired 31:15.604 [INFO] TestAgent.server: New leader elected: payload=Node-6b6be8c3-242c-cf7a-bce3-43331b03569f 31:15.632 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:15.632 [INFO] TestAgent: Requesting shutdown 31:15.632 [INFO] TestAgent.server: shutting down server 31:15.632 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.632 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:15.648 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.652Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.652Z [INFO] agent.router.manager: shutting down 31:15.652 [ERROR] TestAgent.server: failed to wait for barrier: error="leadership lost while committing log" 31:15.652 [INFO] TestAgent: consul server down 31:15.652 [INFO] TestAgent: shutdown complete 31:15.652 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29724 network=tcp 31:15.652 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29724 network=udp 31:15.652 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29725 network=tcp 31:16.155 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.155 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Execute/#05 2021-10-05T16:31:15.231Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.248Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.286 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a802ba0c-d8e7-0248-49b1-f2b8cd67b506 Address:127.0.0.1:29715}]" 31:15.286 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a802ba0c-d8e7-0248-49b1-f2b8cd67b506.dc1 127.0.0.1 31:15.287 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a802ba0c-d8e7-0248-49b1-f2b8cd67b506 127.0.0.1 2021-10-05T16:31:15.287Z [INFO] agent.router: Initializing LAN area manager 31:15.287 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29710 network=udp 31:15.287 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29715 [Follower]" leader= 31:15.287 [INFO] TestAgent.server: Adding LAN server: server="Node-a802ba0c-d8e7-0248-49b1-f2b8cd67b506 (Addr: tcp/127.0.0.1:29715) (DC: dc1)" 31:15.287 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a802ba0c-d8e7-0248-49b1-f2b8cd67b506.dc1 area=wan 31:15.288 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29710 network=tcp 31:15.288 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29711 network=tcp 31:15.288 [INFO] TestAgent: started state syncer 31:15.288 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29716 network=tcp 31:15.324 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.324 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29715 [Candidate]" term=2 31:15.350 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.350 [DEBUG] TestAgent.server.raft: vote granted: from=a802ba0c-d8e7-0248-49b1-f2b8cd67b506 term=2 tally=1 31:15.350 [INFO] TestAgent.server.raft: election won: tally=1 31:15.350 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29715 [Leader]" 31:15.351 [INFO] TestAgent.server: cluster leadership acquired 31:15.351 [INFO] TestAgent.server: New leader elected: payload=Node-a802ba0c-d8e7-0248-49b1-f2b8cd67b506 31:15.356 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29715 31:15.375 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.408 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.408 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.408 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.408 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.408 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.408 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a802ba0c-d8e7-0248-49b1-f2b8cd67b506 31:15.408 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a802ba0c-d8e7-0248-49b1-f2b8cd67b506 31:15.436 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.667 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:15.672 [INFO] TestAgent: Synced node info 31:15.716 [INFO] TestAgent: Requesting shutdown 31:15.716 [INFO] TestAgent.server: shutting down server 31:15.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.716 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.716 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.716 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.716 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.717 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.717 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.717 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.721 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.721Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.721Z [INFO] agent.router.manager: shutting down 31:15.721 [INFO] TestAgent: consul server down 31:15.721 [INFO] TestAgent: shutdown complete 31:15.721 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29710 network=tcp 31:15.721 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29710 network=udp 31:15.721 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29711 network=tcp 31:16.221 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.221 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceNodes_NodeMetaFilter (1.02s) === CONT TestHealthNodeChecks 2021-10-05T16:31:15.375Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.390Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.447 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:41e49557-ba27-307b-81f6-b4776c5bf700 Address:127.0.0.1:29722}]" 31:15.447 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29722 [Follower]" leader= 31:15.448 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-41e49557-ba27-307b-81f6-b4776c5bf700.dc1 127.0.0.1 31:15.449 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-41e49557-ba27-307b-81f6-b4776c5bf700 127.0.0.1 2021-10-05T16:31:15.449Z [INFO] agent.router: Initializing LAN area manager 31:15.449 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29717 network=udp 31:15.449 [INFO] TestAgent.server: Adding LAN server: server="Node-41e49557-ba27-307b-81f6-b4776c5bf700 (Addr: tcp/127.0.0.1:29722) (DC: dc1)" 31:15.449 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-41e49557-ba27-307b-81f6-b4776c5bf700.dc1 area=wan 31:15.449 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29717 network=tcp 31:15.450 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29718 network=tcp 31:15.450 [INFO] TestAgent: started state syncer 31:15.450 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29723 network=tcp 31:15.508 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.508 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29722 [Candidate]" term=2 31:15.550 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.550 [DEBUG] TestAgent.server.raft: vote granted: from=41e49557-ba27-307b-81f6-b4776c5bf700 term=2 tally=1 31:15.550 [INFO] TestAgent.server.raft: election won: tally=1 31:15.550 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29722 [Leader]" 31:15.556 [INFO] TestAgent.server: cluster leadership acquired 31:15.556 [INFO] TestAgent.server: New leader elected: payload=Node-41e49557-ba27-307b-81f6-b4776c5bf700 31:15.582 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29722 31:15.608 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.704 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.704 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.704 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.704 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.704 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.704 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-41e49557-ba27-307b-81f6-b4776c5bf700 31:15.704 [INFO] TestAgent.server: member joined, marking health alive: member=Node-41e49557-ba27-307b-81f6-b4776c5bf700 31:15.724 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.754 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:15.770 [INFO] TestAgent: Synced node info 31:15.770 [DEBUG] TestAgent: Node info in sync 31:15.780 [INFO] TestAgent: Requesting shutdown 31:15.780 [INFO] TestAgent.server: shutting down server 31:15.780 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.780 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.780 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.780 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.780 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.780 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:15.780 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.780 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.780 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.780 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.786 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.788Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.788Z [INFO] agent.router.manager: shutting down 31:15.788 [INFO] TestAgent: consul server down 31:15.788 [INFO] TestAgent: shutdown complete 31:15.788 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29717 network=tcp 31:15.788 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29717 network=udp 31:15.788 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29718 network=tcp 31:16.289 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.289 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceNodes (0.93s) === CONT TestHealthChecksInState_DistanceSort [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:15.572Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:15.572Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.586Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:15.586Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.660 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:11dd8592-aac3-1bec-f749-fd3352d02085 Address:127.0.0.1:29743}]" 31:15.661 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-11dd8592-aac3-1bec-f749-fd3352d02085.dc1 127.0.0.1 31:15.661 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-11dd8592-aac3-1bec-f749-fd3352d02085 127.0.0.1 2021-10-05T16:31:15.661Z [INFO] agent.router: Initializing LAN area manager 31:15.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29731 network=udp 31:15.662 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29743 [Follower]" leader= 31:15.662 [INFO] TestAgent.server: Adding LAN server: server="Node-11dd8592-aac3-1bec-f749-fd3352d02085 (Addr: tcp/127.0.0.1:29743) (DC: dc1)" 31:15.662 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-11dd8592-aac3-1bec-f749-fd3352d02085.dc1 area=wan 31:15.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29731 network=tcp 31:15.663 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29732 network=tcp 31:15.663 [INFO] TestAgent: started state syncer 31:15.663 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29744 network=tcp 31:15.709 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.709 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29743 [Candidate]" term=2 31:15.712 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:15.736 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.736 [DEBUG] TestAgent.server.raft: vote granted: from=11dd8592-aac3-1bec-f749-fd3352d02085 term=2 tally=1 31:15.736 [INFO] TestAgent.server.raft: election won: tally=1 31:15.736 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29743 [Leader]" 31:15.736 [INFO] TestAgent.server: cluster leadership acquired 31:15.736 [INFO] TestAgent.server: New leader elected: payload=Node-11dd8592-aac3-1bec-f749-fd3352d02085 31:15.744 [INFO] TestAgent.server: initializing acls 31:15.748 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:15.748 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:15.758 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:15.767 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:15.767 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:15.767 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:15.767 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-11dd8592-aac3-1bec-f749-fd3352d02085 31:15.767 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-11dd8592-aac3-1bec-f749-fd3352d02085.dc1 31:15.767 [INFO] TestAgent.server: Updating LAN server: server="Node-11dd8592-aac3-1bec-f749-fd3352d02085 (Addr: tcp/127.0.0.1:29743) (DC: dc1)" 31:15.767 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-11dd8592-aac3-1bec-f749-fd3352d02085.dc1 area=wan 31:15.778 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.811 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.811 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.811 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.811 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.811 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.811 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-11dd8592-aac3-1bec-f749-fd3352d02085 31:15.811 [INFO] TestAgent.server: member joined, marking health alive: member=Node-11dd8592-aac3-1bec-f749-fd3352d02085 31:15.840 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-11dd8592-aac3-1bec-f749-fd3352d02085 31:15.854 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-11dd8592-aac3-1bec-f749-fd3352d02085 31:15.855 [DEBUG] TestAgent.server: User event: event=foo 31:15.855 [DEBUG] TestAgent: new event: event_name=foo event_id=95f52d37-6651-410d-3bd7-054f4e9bc29f 31:15.855 [INFO] TestAgent: Requesting shutdown 31:15.855 [INFO] TestAgent.server: shutting down server 31:15.855 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:15.855 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:15.855 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:15.855 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:15.855 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:15.855 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:15.855 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.855 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:15.856 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:15.856 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:15.856 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:15.856 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:15.856 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:15.860 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.860 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:15.864 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.865Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.865Z [INFO] agent.router.manager: shutting down 31:15.865 [INFO] TestAgent: consul server down 31:15.865 [INFO] TestAgent: shutdown complete 31:15.865 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29731 network=tcp 31:15.865 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29731 network=udp 31:15.865 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29732 network=tcp 31:16.366 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.366 [INFO] TestAgent: Endpoints down --- PASS: TestEventList_ACLFilter (0.81s) --- PASS: TestEventList_ACLFilter/no_token (0.00s) --- PASS: TestEventList_ACLFilter/root_token (0.00s) === CONT TestHealthChecksInState_Filter 2021-10-05T16:31:15.679Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.708Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.801 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d73f0ebc-50da-f118-b6ee-7fc09def1220 Address:127.0.0.1:29757}]" 31:15.802 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29757 [Follower]" leader= 31:15.804 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d73f0ebc-50da-f118-b6ee-7fc09def1220.dc1 127.0.0.1 31:15.804 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d73f0ebc-50da-f118-b6ee-7fc09def1220 127.0.0.1 2021-10-05T16:31:15.804Z [INFO] agent.router: Initializing LAN area manager 31:15.804 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29752 network=udp 31:15.805 [INFO] TestAgent.server: Adding LAN server: server="Node-d73f0ebc-50da-f118-b6ee-7fc09def1220 (Addr: tcp/127.0.0.1:29757) (DC: dc1)" 31:15.805 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d73f0ebc-50da-f118-b6ee-7fc09def1220.dc1 area=wan 31:15.805 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29752 network=tcp 31:15.805 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29753 network=tcp 31:15.805 [INFO] TestAgent: started state syncer 31:15.805 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29758 network=tcp 31:15.848 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.848 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29757 [Candidate]" term=2 31:15.864 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.864 [DEBUG] TestAgent.server.raft: vote granted: from=d73f0ebc-50da-f118-b6ee-7fc09def1220 term=2 tally=1 31:15.864 [INFO] TestAgent.server.raft: election won: tally=1 31:15.864 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29757 [Leader]" 31:15.864 [INFO] TestAgent.server: cluster leadership acquired 31:15.864 [INFO] TestAgent.server: New leader elected: payload=Node-d73f0ebc-50da-f118-b6ee-7fc09def1220 31:15.882 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29757 31:15.900 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.965 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.965 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.965 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.965 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.965 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.965 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d73f0ebc-50da-f118-b6ee-7fc09def1220 31:15.965 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d73f0ebc-50da-f118-b6ee-7fc09def1220 31:15.982 [INFO] TestAgent.server: federation state anti-entropy synced 31:16.002 [INFO] TestAgent: Requesting shutdown 31:16.002 [INFO] TestAgent.server: shutting down server 31:16.002 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.002 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.002 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.002 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.002 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.002 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.002 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.002 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:16.003 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.003 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.003 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.010 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.011Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.011Z [INFO] agent.router.manager: shutting down 31:16.012 [INFO] TestAgent: consul server down 31:16.012 [INFO] TestAgent: shutdown complete 31:16.012 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29752 network=tcp 31:16.012 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29752 network=udp 31:16.012 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29753 network=tcp 31:16.513 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.513 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceChecks_NodeMetaFilter (0.88s) === CONT TestHealthChecksInState_NodeMetaFilter 2021-10-05T16:31:15.207Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:15.207Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.239Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:15.239Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.332 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7f91a93c-ab77-b65b-e6ce-bcc4804f16e7 Address:127.0.0.1:29708}]" 31:15.333 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7.dc2 127.0.0.1 31:15.333 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7 127.0.0.1 2021-10-05T16:31:15.333Z [INFO] agent.router: Initializing LAN area manager 31:15.333 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29703 network=udp 31:15.333 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29708 [Follower]" leader= 31:15.334 [INFO] TestAgent.server: Adding LAN server: server="Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7 (Addr: tcp/127.0.0.1:29708) (DC: dc2)" 31:15.334 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7.dc2 area=wan 31:15.334 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29703 network=tcp 31:15.335 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29704 network=tcp 31:15.335 [INFO] TestAgent: started state syncer 31:15.335 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29709 network=tcp 31:15.383 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.383 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29708 [Candidate]" term=2 31:15.388 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:15.412 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.412 [DEBUG] TestAgent.server.raft: vote granted: from=7f91a93c-ab77-b65b-e6ce-bcc4804f16e7 term=2 tally=1 31:15.412 [INFO] TestAgent.server.raft: election won: tally=1 31:15.412 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29708 [Leader]" 31:15.412 [INFO] TestAgent.server: cluster leadership acquired 31:15.412 [INFO] TestAgent.server: New leader elected: payload=Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7 31:15.444 [INFO] TestAgent.server: initializing acls 31:15.458 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:15.466 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:15.466 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:15.466 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:15.466 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7 31:15.466 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7.dc2 31:15.467 [INFO] TestAgent.server: Updating LAN server: server="Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7 (Addr: tcp/127.0.0.1:29708) (DC: dc2)" 31:15.467 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7.dc2 area=wan 31:15.468 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:29672] 31:15.471 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29672 31:15.472 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a54e0129-5381-35c7-da81-f1f85d99a931.dc1 127.0.0.1 31:15.472 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:15.472 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a54e0129-5381-35c7-da81-f1f85d99a931.dc1 area=wan 31:15.500 [INFO] TestAgent: Requesting shutdown 31:15.500 [INFO] TestAgent.server: shutting down server 31:15.500 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:15.500 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:15.500 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:15.500 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:15.500 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:15.500 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:15.508 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.519 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:15.529Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.529Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:15.529Z [INFO] agent.router.manager: shutting down 31:15.531 [INFO] TestAgent: consul server down 31:15.531 [INFO] TestAgent: shutdown complete 31:15.531 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29703 network=tcp 31:15.531 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29703 network=udp 31:15.531 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29704 network=tcp 31:15.531 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 31:15.531 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:15.531 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:16.036 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.036 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:14.617Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:14.617Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:14.632Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:14.632Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:14.724 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a54e0129-5381-35c7-da81-f1f85d99a931 Address:127.0.0.1:29673}]" 31:14.725 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a54e0129-5381-35c7-da81-f1f85d99a931.dc1 127.0.0.1 31:14.726 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a54e0129-5381-35c7-da81-f1f85d99a931 127.0.0.1 2021-10-05T16:31:14.726Z [INFO] agent.router: Initializing LAN area manager 31:14.726 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29668 network=udp 31:14.726 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29673 [Follower]" leader= 31:14.726 [INFO] TestAgent.server: Adding LAN server: server="Node-a54e0129-5381-35c7-da81-f1f85d99a931 (Addr: tcp/127.0.0.1:29673) (DC: dc1)" 31:14.726 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a54e0129-5381-35c7-da81-f1f85d99a931.dc1 area=wan 31:14.727 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29668 network=tcp 31:14.727 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29669 network=tcp 31:14.727 [INFO] TestAgent: started state syncer 31:14.727 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29674 network=tcp 31:14.772 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:14.772 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29673 [Candidate]" term=2 31:14.780 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:14.820 [DEBUG] TestAgent.server.raft: votes: needed=1 31:14.820 [DEBUG] TestAgent.server.raft: vote granted: from=a54e0129-5381-35c7-da81-f1f85d99a931 term=2 tally=1 31:14.820 [INFO] TestAgent.server.raft: election won: tally=1 31:14.820 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29673 [Leader]" 31:14.820 [INFO] TestAgent.server: cluster leadership acquired 31:14.820 [INFO] TestAgent.server: New leader elected: payload=Node-a54e0129-5381-35c7-da81-f1f85d99a931 31:14.835 [INFO] TestAgent.server: initializing acls 31:14.839 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:14.850 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:14.850 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:14.850 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:14.850 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a54e0129-5381-35c7-da81-f1f85d99a931 31:14.850 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a54e0129-5381-35c7-da81-f1f85d99a931.dc1 31:14.851 [INFO] TestAgent.server: Updating LAN server: server="Node-a54e0129-5381-35c7-da81-f1f85d99a931 (Addr: tcp/127.0.0.1:29673) (DC: dc1)" 31:14.851 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a54e0129-5381-35c7-da81-f1f85d99a931.dc1 area=wan 31:14.873 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:14.900 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:14.900 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:14.900 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:14.900 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:14.900 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:14.900 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a54e0129-5381-35c7-da81-f1f85d99a931 31:14.900 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a54e0129-5381-35c7-da81-f1f85d99a931 31:14.914 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a54e0129-5381-35c7-da81-f1f85d99a931 31:14.925 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.086 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:15.095 [INFO] TestAgent: Synced node info 31:15.471 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:44032 31:15.472 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7.dc2 127.0.0.1 31:15.472 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7f91a93c-ab77-b65b-e6ce-bcc4804f16e7.dc2 area=wan 31:16.036 [INFO] TestAgent: Requesting shutdown 31:16.037 [INFO] TestAgent.server: shutting down server 31:16.037 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:16.037 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:16.037 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.037 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.037 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.037 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.037 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.037 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.037 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.037 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:16.037 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:16.037 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.037 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.037 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.050 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.052Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.052Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.052Z [INFO] agent.router.manager: shutting down 31:16.052 [INFO] TestAgent: consul server down 31:16.052 [INFO] TestAgent: shutdown complete 31:16.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29668 network=tcp 31:16.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29668 network=udp 31:16.052 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29669 network=tcp 31:16.552 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.552 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceNodes_WanTranslation (1.95s) === CONT TestUUIDToUint64 --- PASS: TestUUIDToUint64 (0.00s) === CONT TestEventList_EventBufOrder [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:15.565Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.580Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.674 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3d77c4fe-1936-7065-f683-e1b28eb8a72f Address:127.0.0.1:29729}]" 31:15.674 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3d77c4fe-1936-7065-f683-e1b28eb8a72f.dc1 127.0.0.1 31:15.675 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3d77c4fe-1936-7065-f683-e1b28eb8a72f 127.0.0.1 2021-10-05T16:31:15.675Z [INFO] agent.router: Initializing LAN area manager 31:15.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29738 network=udp 31:15.675 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29729 [Follower]" leader= 31:15.675 [INFO] TestAgent.server: Adding LAN server: server="Node-3d77c4fe-1936-7065-f683-e1b28eb8a72f (Addr: tcp/127.0.0.1:29729) (DC: dc1)" 31:15.675 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3d77c4fe-1936-7065-f683-e1b28eb8a72f.dc1 area=wan 31:15.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29738 network=tcp 31:15.676 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29739 network=tcp 31:15.676 [INFO] TestAgent: started state syncer 31:15.676 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29730 network=tcp 31:15.733 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.733 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29729 [Candidate]" term=2 31:15.768 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.768 [DEBUG] TestAgent.server.raft: vote granted: from=3d77c4fe-1936-7065-f683-e1b28eb8a72f term=2 tally=1 31:15.768 [INFO] TestAgent.server.raft: election won: tally=1 31:15.768 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29729 [Leader]" 31:15.768 [INFO] TestAgent.server: cluster leadership acquired 31:15.768 [INFO] TestAgent.server: New leader elected: payload=Node-3d77c4fe-1936-7065-f683-e1b28eb8a72f 31:15.790 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29729 31:15.826 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.907 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.907 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.907 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.907 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.907 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.907 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3d77c4fe-1936-7065-f683-e1b28eb8a72f 31:15.907 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3d77c4fe-1936-7065-f683-e1b28eb8a72f 31:15.960 [INFO] TestAgent.server: federation state anti-entropy synced 31:15.998 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:16.007 [INFO] TestAgent: Synced node info 31:16.209 [INFO] TestAgent: Requesting shutdown 31:16.209 [INFO] TestAgent.server: shutting down server 31:16.209 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.209 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.209 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.209 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.209 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.209 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.209 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.209 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.209 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.209 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.216 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.216Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.216Z [INFO] agent.router.manager: shutting down 31:16.216 [INFO] TestAgent: consul server down 31:16.216 [INFO] TestAgent: shutdown complete 31:16.216 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29738 network=tcp 31:16.216 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29738 network=udp 31:16.216 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29739 network=tcp 31:16.719 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.719 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceChecks_DistanceSort (1.17s) === CONT TestEventList_Blocking 2021-10-05T16:31:15.635Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.678Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.758 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2c188c00-c26d-b8dd-12a7-e1284c1324f0 Address:127.0.0.1:29750}]" 31:15.759 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29750 [Follower]" leader= 31:15.759 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2c188c00-c26d-b8dd-12a7-e1284c1324f0.dc1 127.0.0.1 31:15.760 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2c188c00-c26d-b8dd-12a7-e1284c1324f0 127.0.0.1 2021-10-05T16:31:15.760Z [INFO] agent.router: Initializing LAN area manager 31:15.761 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29745 network=udp 31:15.761 [INFO] TestAgent.server: Adding LAN server: server="Node-2c188c00-c26d-b8dd-12a7-e1284c1324f0 (Addr: tcp/127.0.0.1:29750) (DC: dc1)" 31:15.761 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2c188c00-c26d-b8dd-12a7-e1284c1324f0.dc1 area=wan 31:15.761 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29745 network=tcp 31:15.761 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29746 network=tcp 31:15.761 [INFO] TestAgent: started state syncer 31:15.761 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29751 network=tcp 31:15.828 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:15.828 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29750 [Candidate]" term=2 31:15.847 [DEBUG] TestAgent.server.raft: votes: needed=1 31:15.847 [DEBUG] TestAgent.server.raft: vote granted: from=2c188c00-c26d-b8dd-12a7-e1284c1324f0 term=2 tally=1 31:15.847 [INFO] TestAgent.server.raft: election won: tally=1 31:15.847 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29750 [Leader]" 31:15.847 [INFO] TestAgent.server: cluster leadership acquired 31:15.848 [INFO] TestAgent.server: New leader elected: payload=Node-2c188c00-c26d-b8dd-12a7-e1284c1324f0 31:15.855 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29750 31:15.894 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:15.959 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:15.959 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:15.959 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:15.959 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:15.959 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:15.959 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2c188c00-c26d-b8dd-12a7-e1284c1324f0 31:15.959 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2c188c00-c26d-b8dd-12a7-e1284c1324f0 31:15.996 [INFO] TestAgent.server: federation state anti-entropy synced 31:16.075 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:16.083 [INFO] TestAgent: Synced node info 31:16.083 [DEBUG] TestAgent: Node info in sync 31:16.211 [INFO] TestAgent: Requesting shutdown 31:16.211 [INFO] TestAgent.server: shutting down server 31:16.211 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.211 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.211 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.211 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.211 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.211 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.211 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.211 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.211 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.211 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.221 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.224Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.224Z [INFO] agent.router.manager: shutting down 31:16.224 [INFO] TestAgent: consul server down 31:16.224 [INFO] TestAgent: shutdown complete 31:16.224 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29745 network=tcp 31:16.224 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29745 network=udp 31:16.224 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29746 network=tcp 31:16.727 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.727 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceChecks_Filtering (1.14s) === CONT TestEventList_Filter 2021-10-05T16:31:15.928Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:15.942Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:15.989 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:012636c4-6ceb-9afa-b6f0-f364c5de1150 Address:127.0.0.1:29764}]" 31:15.990 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-012636c4-6ceb-9afa-b6f0-f364c5de1150.dc1 127.0.0.1 31:15.991 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-012636c4-6ceb-9afa-b6f0-f364c5de1150 127.0.0.1 2021-10-05T16:31:15.991Z [INFO] agent.router: Initializing LAN area manager 31:15.991 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29764 [Follower]" leader= 31:15.991 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29759 network=udp 31:15.991 [INFO] TestAgent.server: Adding LAN server: server="Node-012636c4-6ceb-9afa-b6f0-f364c5de1150 (Addr: tcp/127.0.0.1:29764) (DC: dc1)" 31:15.991 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-012636c4-6ceb-9afa-b6f0-f364c5de1150.dc1 area=wan 31:15.991 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29759 network=tcp 31:15.992 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29760 network=tcp 31:15.992 [INFO] TestAgent: started state syncer 31:15.992 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29765 network=tcp 31:16.049 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.049 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29764 [Candidate]" term=2 31:16.061 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.061 [DEBUG] TestAgent.server.raft: vote granted: from=012636c4-6ceb-9afa-b6f0-f364c5de1150 term=2 tally=1 31:16.061 [INFO] TestAgent.server.raft: election won: tally=1 31:16.061 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29764 [Leader]" 31:16.062 [INFO] TestAgent.server: cluster leadership acquired 31:16.062 [INFO] TestAgent.server: New leader elected: payload=Node-012636c4-6ceb-9afa-b6f0-f364c5de1150 31:16.068 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29764 31:16.086 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.119 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.119 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.119 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.119 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.119 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.119 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-012636c4-6ceb-9afa-b6f0-f364c5de1150 31:16.119 [INFO] TestAgent.server: member joined, marking health alive: member=Node-012636c4-6ceb-9afa-b6f0-f364c5de1150 31:16.148 [INFO] TestAgent.server: federation state anti-entropy synced 31:16.245 [INFO] TestAgent: Requesting shutdown 31:16.245 [INFO] TestAgent.server: shutting down server 31:16.245 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.245 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.245 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.245 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.245 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.245 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.245 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:16.245 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.245 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.245 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.245 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.251 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.255Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.255Z [INFO] agent.router.manager: shutting down 31:16.255 [INFO] TestAgent: consul server down 31:16.255 [INFO] TestAgent: shutdown complete 31:16.255 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29759 network=tcp 31:16.255 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29759 network=udp 31:16.256 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29760 network=tcp 31:16.756 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.756 [INFO] TestAgent: Endpoints down --- PASS: TestHealthServiceChecks (0.84s) === CONT TestEventList [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:16.169Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.183Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.224 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:155ff33b-d8d9-6582-9c89-92ecda08ebe2 Address:127.0.0.1:29785}]" 31:16.225 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29785 [Follower]" leader= 31:16.225 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-155ff33b-d8d9-6582-9c89-92ecda08ebe2.dc1 127.0.0.1 31:16.226 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-155ff33b-d8d9-6582-9c89-92ecda08ebe2 127.0.0.1 2021-10-05T16:31:16.226Z [INFO] agent.router: Initializing LAN area manager 31:16.226 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29780 network=udp 31:16.226 [INFO] TestAgent.server: Adding LAN server: server="Node-155ff33b-d8d9-6582-9c89-92ecda08ebe2 (Addr: tcp/127.0.0.1:29785) (DC: dc1)" 31:16.226 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-155ff33b-d8d9-6582-9c89-92ecda08ebe2.dc1 area=wan 31:16.226 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29780 network=tcp 31:16.226 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29781 network=tcp 31:16.227 [INFO] TestAgent: started state syncer 31:16.227 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29786 network=tcp 31:16.284 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.284 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29785 [Candidate]" term=2 31:16.299 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.299 [DEBUG] TestAgent.server.raft: vote granted: from=155ff33b-d8d9-6582-9c89-92ecda08ebe2 term=2 tally=1 31:16.299 [INFO] TestAgent.server.raft: election won: tally=1 31:16.299 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29785 [Leader]" 31:16.300 [INFO] TestAgent.server: cluster leadership acquired 31:16.300 [INFO] TestAgent.server: New leader elected: payload=Node-155ff33b-d8d9-6582-9c89-92ecda08ebe2 31:16.306 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29785 31:16.332 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.372 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:16.372 [INFO] TestAgent: Requesting shutdown 31:16.372 [INFO] TestAgent.server: shutting down server 31:16.372 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.372 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:16.384 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.388Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.388Z [INFO] agent.router.manager: shutting down 31:16.396 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 31:16.396 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:16.396 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:16.396 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 31:16.396 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 31:16.396 [INFO] TestAgent: consul server down 31:16.396 [INFO] TestAgent: shutdown complete 31:16.396 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29780 network=tcp 31:16.396 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29780 network=udp 31:16.396 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29781 network=tcp 31:16.900 [INFO] TestAgent: Waiting for endpoints to shut down 31:16.900 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Execute/#06 [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:16.238Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.257Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.332 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:307c4b64-1028-bf98-b5ae-1eeac81b322c Address:127.0.0.1:29834}]" 31:16.333 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-307c4b64-1028-bf98-b5ae-1eeac81b322c.dc1 127.0.0.1 31:16.333 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-307c4b64-1028-bf98-b5ae-1eeac81b322c 127.0.0.1 2021-10-05T16:31:16.333Z [INFO] agent.router: Initializing LAN area manager 31:16.333 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29834 [Follower]" leader= 31:16.333 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29787 network=udp 31:16.334 [INFO] TestAgent.server: Adding LAN server: server="Node-307c4b64-1028-bf98-b5ae-1eeac81b322c (Addr: tcp/127.0.0.1:29834) (DC: dc1)" 31:16.334 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-307c4b64-1028-bf98-b5ae-1eeac81b322c.dc1 area=wan 31:16.335 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29787 network=tcp 31:16.335 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29788 network=tcp 31:16.335 [INFO] TestAgent: started state syncer 31:16.335 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29835 network=tcp 31:16.372 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.372 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29834 [Candidate]" term=2 31:16.415 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.415 [DEBUG] TestAgent.server.raft: vote granted: from=307c4b64-1028-bf98-b5ae-1eeac81b322c term=2 tally=1 31:16.415 [INFO] TestAgent.server.raft: election won: tally=1 31:16.415 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29834 [Leader]" 31:16.415 [INFO] TestAgent.server: cluster leadership acquired 31:16.415 [INFO] TestAgent.server: New leader elected: payload=Node-307c4b64-1028-bf98-b5ae-1eeac81b322c 31:16.425 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29834 31:16.456 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.526 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.526 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.526 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.526 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.526 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.526 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-307c4b64-1028-bf98-b5ae-1eeac81b322c 31:16.526 [INFO] TestAgent.server: member joined, marking health alive: member=Node-307c4b64-1028-bf98-b5ae-1eeac81b322c 31:16.549 [INFO] TestAgent: Requesting shutdown 31:16.549 [INFO] TestAgent.server: shutting down server 31:16.549 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.549 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.549 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.549 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.549 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.549 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:16.549 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.549 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.549 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.557 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.560Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.560Z [INFO] agent.router.manager: shutting down 31:16.583 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 31:16.583 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.583 [INFO] TestAgent: consul server down 31:16.583 [INFO] TestAgent: shutdown complete 31:16.583 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29787 network=tcp 31:16.583 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29787 network=udp 31:16.583 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29788 network=tcp 31:17.084 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.084 [INFO] TestAgent: Endpoints down --- PASS: TestHealthNodeChecks (0.86s) === CONT TestEventFire_token 2021-10-05T16:31:16.001Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.016Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.104 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:545a610f-c303-9ab5-e5b4-92d2d7676e4c Address:127.0.0.1:29778}]" 31:16.105 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-545a610f-c303-9ab5-e5b4-92d2d7676e4c.dc1 127.0.0.1 31:16.105 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-545a610f-c303-9ab5-e5b4-92d2d7676e4c 127.0.0.1 2021-10-05T16:31:16.105Z [INFO] agent.router: Initializing LAN area manager 31:16.106 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29766 network=udp 31:16.106 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29778 [Follower]" leader= 31:16.106 [INFO] TestAgent.server: Adding LAN server: server="Node-545a610f-c303-9ab5-e5b4-92d2d7676e4c (Addr: tcp/127.0.0.1:29778) (DC: dc1)" 31:16.106 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-545a610f-c303-9ab5-e5b4-92d2d7676e4c.dc1 area=wan 31:16.106 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29766 network=tcp 31:16.107 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29767 network=tcp 31:16.107 [INFO] TestAgent: started state syncer 31:16.107 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29779 network=tcp 31:16.168 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.168 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29778 [Candidate]" term=2 31:16.188 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.188 [DEBUG] TestAgent.server.raft: vote granted: from=545a610f-c303-9ab5-e5b4-92d2d7676e4c term=2 tally=1 31:16.188 [INFO] TestAgent.server.raft: election won: tally=1 31:16.188 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29778 [Leader]" 31:16.189 [INFO] TestAgent.server: cluster leadership acquired 31:16.189 [INFO] TestAgent.server: New leader elected: payload=Node-545a610f-c303-9ab5-e5b4-92d2d7676e4c 31:16.204 [INFO] TestAgent: Synced node info 31:16.204 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29778 31:16.240 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.265 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.265 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.265 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.265 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.265 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.265 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-545a610f-c303-9ab5-e5b4-92d2d7676e4c 31:16.265 [INFO] TestAgent.server: member joined, marking health alive: member=Node-545a610f-c303-9ab5-e5b4-92d2d7676e4c 31:16.277 [INFO] TestAgent.server: federation state anti-entropy synced 31:16.566 [INFO] TestAgent: Requesting shutdown 31:16.566 [INFO] TestAgent.server: shutting down server 31:16.566 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.566 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.566 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.566 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.566 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.566 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.566 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.566 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.566 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.566 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.582 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.584Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.584Z [INFO] agent.router.manager: shutting down 31:16.584 [INFO] TestAgent: consul server down 31:16.584 [INFO] TestAgent: shutdown complete 31:16.584 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29766 network=tcp 31:16.584 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29766 network=udp 31:16.584 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29767 network=tcp 31:17.088 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.088 [INFO] TestAgent: Endpoints down --- PASS: TestHealthNodeChecks_Filtering (1.11s) === CONT TestEventFire [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:16.307Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.322Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.416 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c3598f4a-892a-550b-e7f7-7852e3f0d3cd Address:127.0.0.1:29820}]" 31:16.417 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c3598f4a-892a-550b-e7f7-7852e3f0d3cd.dc1 127.0.0.1 31:16.417 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c3598f4a-892a-550b-e7f7-7852e3f0d3cd 127.0.0.1 2021-10-05T16:31:16.417Z [INFO] agent.router: Initializing LAN area manager 31:16.417 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29836 network=udp 31:16.417 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29820 [Follower]" leader= 31:16.418 [INFO] TestAgent.server: Adding LAN server: server="Node-c3598f4a-892a-550b-e7f7-7852e3f0d3cd (Addr: tcp/127.0.0.1:29820) (DC: dc1)" 31:16.418 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c3598f4a-892a-550b-e7f7-7852e3f0d3cd.dc1 area=wan 31:16.418 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29836 network=tcp 31:16.419 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29837 network=tcp 31:16.419 [INFO] TestAgent: started state syncer 31:16.419 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29821 network=tcp 31:16.456 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.456 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29820 [Candidate]" term=2 31:16.505 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.505 [DEBUG] TestAgent.server.raft: vote granted: from=c3598f4a-892a-550b-e7f7-7852e3f0d3cd term=2 tally=1 31:16.505 [INFO] TestAgent.server.raft: election won: tally=1 31:16.505 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29820 [Leader]" 31:16.506 [INFO] TestAgent.server: cluster leadership acquired 31:16.506 [INFO] TestAgent.server: New leader elected: payload=Node-c3598f4a-892a-550b-e7f7-7852e3f0d3cd 31:16.532 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29820 31:16.624 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.725 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.725 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.725 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.725 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.725 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.725 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c3598f4a-892a-550b-e7f7-7852e3f0d3cd 31:16.725 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c3598f4a-892a-550b-e7f7-7852e3f0d3cd 31:16.767 [INFO] TestAgent.server: federation state anti-entropy synced 31:16.779 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:16.788 [INFO] TestAgent: Synced node info 31:16.851 [INFO] TestAgent: Requesting shutdown 31:16.851 [INFO] TestAgent.server: shutting down server 31:16.851 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.851 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.851 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.851 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.851 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.851 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.851 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.851 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.851 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.851 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.857 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.857Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.857Z [INFO] agent.router.manager: shutting down 31:16.858 [INFO] TestAgent: consul server down 31:16.858 [INFO] TestAgent: shutdown complete 31:16.858 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29836 network=tcp 31:16.858 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29836 network=udp 31:16.858 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29837 network=tcp 31:17.358 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.358 [INFO] TestAgent: Endpoints down --- PASS: TestHealthChecksInState_DistanceSort (1.07s) === CONT TestDNS_ReloadConfig_DuringQuery 2021-10-05T16:31:16.426Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.469Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.584 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2d194671-216b-6ab5-e573-3543690ea9ff Address:127.0.0.1:29813}]" 31:16.584 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29813 [Follower]" leader= 31:16.585 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2d194671-216b-6ab5-e573-3543690ea9ff.dc1 127.0.0.1 31:16.585 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2d194671-216b-6ab5-e573-3543690ea9ff 127.0.0.1 2021-10-05T16:31:16.585Z [INFO] agent.router: Initializing LAN area manager 31:16.585 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29822 network=udp 31:16.586 [INFO] TestAgent.server: Adding LAN server: server="Node-2d194671-216b-6ab5-e573-3543690ea9ff (Addr: tcp/127.0.0.1:29813) (DC: dc1)" 31:16.586 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2d194671-216b-6ab5-e573-3543690ea9ff.dc1 area=wan 31:16.586 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29822 network=tcp 31:16.586 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29823 network=tcp 31:16.586 [INFO] TestAgent: started state syncer 31:16.586 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29814 network=tcp 31:16.643 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.643 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29813 [Candidate]" term=2 31:16.682 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.682 [DEBUG] TestAgent.server.raft: vote granted: from=2d194671-216b-6ab5-e573-3543690ea9ff term=2 tally=1 31:16.682 [INFO] TestAgent.server.raft: election won: tally=1 31:16.682 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29813 [Leader]" 31:16.682 [INFO] TestAgent.server: cluster leadership acquired 31:16.682 [INFO] TestAgent.server: New leader elected: payload=Node-2d194671-216b-6ab5-e573-3543690ea9ff 31:16.692 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29813 31:16.724 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.804 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.804 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.804 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.804 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.804 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.804 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2d194671-216b-6ab5-e573-3543690ea9ff 31:16.804 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2d194671-216b-6ab5-e573-3543690ea9ff 31:16.849 [INFO] TestAgent: Requesting shutdown 31:16.849 [INFO] TestAgent.server: shutting down server 31:16.849 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.849 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.849 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.849 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.849 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.849 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:16.849 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.849 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.849 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:16.853 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:16.855Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:16.855Z [INFO] agent.router.manager: shutting down 31:16.859 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 31:16.859 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.859 [INFO] TestAgent: consul server down 31:16.859 [INFO] TestAgent: shutdown complete 31:16.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29822 network=tcp 31:16.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29822 network=udp 31:16.859 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29823 network=tcp 31:17.360 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.360 [INFO] TestAgent: Endpoints down --- PASS: TestHealthChecksInState_Filter (0.99s) === CONT TestDNS_ConfigReload 2021-10-05T16:31:16.535Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.569Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.691 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:64962173-22c3-1051-7176-31498c502c93 Address:127.0.0.1:29827}]" 31:16.691 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29827 [Follower]" leader= 31:16.692 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-64962173-22c3-1051-7176-31498c502c93.dc1 127.0.0.1 31:16.692 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-64962173-22c3-1051-7176-31498c502c93 127.0.0.1 2021-10-05T16:31:16.693Z [INFO] agent.router: Initializing LAN area manager 31:16.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29815 network=udp 31:16.693 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-64962173-22c3-1051-7176-31498c502c93.dc1 area=wan 31:16.693 [INFO] TestAgent.server: Adding LAN server: server="Node-64962173-22c3-1051-7176-31498c502c93 (Addr: tcp/127.0.0.1:29827) (DC: dc1)" 31:16.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29815 network=tcp 31:16.693 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29816 network=tcp 31:16.693 [INFO] TestAgent: started state syncer 31:16.694 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29828 network=tcp 31:16.746 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.746 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29827 [Candidate]" term=2 31:16.777 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.778 [DEBUG] TestAgent.server.raft: vote granted: from=64962173-22c3-1051-7176-31498c502c93 term=2 tally=1 31:16.778 [INFO] TestAgent.server.raft: election won: tally=1 31:16.778 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29827 [Leader]" 31:16.778 [INFO] TestAgent.server: cluster leadership acquired 31:16.778 [INFO] TestAgent.server: New leader elected: payload=Node-64962173-22c3-1051-7176-31498c502c93 31:16.791 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29827 31:16.812 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.852 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.852 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.852 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.852 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.852 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.852 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-64962173-22c3-1051-7176-31498c502c93 31:16.852 [INFO] TestAgent.server: member joined, marking health alive: member=Node-64962173-22c3-1051-7176-31498c502c93 31:16.861 [INFO] TestAgent.server: federation state anti-entropy synced 31:16.994 [INFO] TestAgent: Requesting shutdown 31:16.994 [INFO] TestAgent.server: shutting down server 31:16.994 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:16.994 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:16.994 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:16.994 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:16.994 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:16.995 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:16.995 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:16.995 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:16.995 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:16.995 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:16.995 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.003 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.004Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.004Z [INFO] agent.router.manager: shutting down 31:17.004 [INFO] TestAgent: consul server down 31:17.004 [INFO] TestAgent: shutdown complete 31:17.004 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29815 network=tcp 31:17.004 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29815 network=udp 31:17.004 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29816 network=tcp 31:17.510 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.510 [INFO] TestAgent: Endpoints down --- PASS: TestHealthChecksInState_NodeMetaFilter (1.00s) === CONT TestDNS_Compression_Recurse 2021-10-05T16:31:16.743Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.757Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.802 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a Address:127.0.0.1:29799}]" 31:16.803 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a.dc1 127.0.0.1 31:16.804 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29799 [Follower]" leader= 31:16.805 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a 127.0.0.1 2021-10-05T16:31:16.805Z [INFO] agent.router: Initializing LAN area manager 31:16.805 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29794 network=udp 31:16.805 [INFO] TestAgent.server: Adding LAN server: server="Node-b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a (Addr: tcp/127.0.0.1:29799) (DC: dc1)" 31:16.805 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a.dc1 area=wan 31:16.805 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29794 network=tcp 31:16.806 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29795 network=tcp 31:16.806 [INFO] TestAgent: started state syncer 31:16.806 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29800 network=tcp 31:16.856 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.856 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29799 [Candidate]" term=2 31:16.888 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.888 [DEBUG] TestAgent.server.raft: vote granted: from=b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a term=2 tally=1 31:16.888 [INFO] TestAgent.server.raft: election won: tally=1 31:16.888 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29799 [Leader]" 31:16.888 [INFO] TestAgent.server: cluster leadership acquired 31:16.888 [INFO] TestAgent.server: New leader elected: payload=Node-b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a 31:16.903 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29799 31:16.929 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.959 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.959 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.959 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.959 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.959 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.959 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a 31:16.959 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b8390d63-fbf9-7bc4-1ca0-55b2fbf8899a 31:16.971 [DEBUG] TestAgent.server: User event: event=test 31:16.971 [DEBUG] TestAgent: new event: event_name=test event_id=9c96541c-d639-f905-465b-39f9b47bbd4b 31:16.980 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.022 [DEBUG] TestAgent.server: User event: event=second 31:17.023 [DEBUG] TestAgent: new event: event_name=second event_id=b1b5b921-3841-09e9-f7be-c7701600e98e 31:17.023 [INFO] TestAgent: Requesting shutdown 31:17.023 [INFO] TestAgent.server: shutting down server 31:17.023 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.023 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.023 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.023 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.023 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.023 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.023 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.023 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:17.023 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:17.023 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.023 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.033 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.039Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.039Z [INFO] agent.router.manager: shutting down 31:17.039 [INFO] TestAgent: consul server down 31:17.039 [INFO] TestAgent: shutdown complete 31:17.039 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29794 network=tcp 31:17.039 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29794 network=udp 31:17.039 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29795 network=tcp 31:17.540 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.540 [INFO] TestAgent: Endpoints down --- PASS: TestEventList_Blocking (0.83s) === CONT TestDNS_Compression_ReverseLookup [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:16.594Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.648Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.764 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:28961e16-c6a6-8808-2b2d-7057096efe52 Address:127.0.0.1:29792}]" 31:16.765 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-28961e16-c6a6-8808-2b2d-7057096efe52.dc1 127.0.0.1 31:16.765 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29792 [Follower]" leader= 31:16.765 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-28961e16-c6a6-8808-2b2d-7057096efe52 127.0.0.1 2021-10-05T16:31:16.765Z [INFO] agent.router: Initializing LAN area manager 31:16.766 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29829 network=udp 31:16.766 [INFO] TestAgent.server: Adding LAN server: server="Node-28961e16-c6a6-8808-2b2d-7057096efe52 (Addr: tcp/127.0.0.1:29792) (DC: dc1)" 31:16.766 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29829 network=tcp 31:16.766 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-28961e16-c6a6-8808-2b2d-7057096efe52.dc1 area=wan 31:16.766 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29830 network=tcp 31:16.766 [INFO] TestAgent: started state syncer 31:16.766 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29793 network=tcp 31:16.832 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.832 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29792 [Candidate]" term=2 31:16.856 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.856 [DEBUG] TestAgent.server.raft: vote granted: from=28961e16-c6a6-8808-2b2d-7057096efe52 term=2 tally=1 31:16.856 [INFO] TestAgent.server.raft: election won: tally=1 31:16.856 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29792 [Leader]" 31:16.856 [INFO] TestAgent.server: cluster leadership acquired 31:16.856 [INFO] TestAgent.server: New leader elected: payload=Node-28961e16-c6a6-8808-2b2d-7057096efe52 31:16.866 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29792 31:16.891 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:16.923 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:16.923 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:16.923 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:16.923 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:16.923 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:16.923 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-28961e16-c6a6-8808-2b2d-7057096efe52 31:16.923 [INFO] TestAgent.server: member joined, marking health alive: member=Node-28961e16-c6a6-8808-2b2d-7057096efe52 31:16.941 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.193 [DEBUG] TestAgent.server: User event: event=foo 31:17.193 [DEBUG] TestAgent.server: User event: event=bar 31:17.193 [DEBUG] TestAgent.server: User event: event=foo 31:17.193 [DEBUG] TestAgent.server: User event: event=foo 31:17.193 [DEBUG] TestAgent.server: User event: event=bar 31:17.193 [DEBUG] TestAgent: new event: event_name=foo event_id=8a0a9a01-695d-bdea-a386-f8ae47a22699 31:17.193 [DEBUG] TestAgent: new event: event_name=bar event_id=ce3666a6-4715-36b2-e66b-48e15f609295 31:17.193 [DEBUG] TestAgent: new event: event_name=foo event_id=9d71b9a2-ef39-cbe8-d2d4-0d5dc5f063c9 31:17.193 [DEBUG] TestAgent: new event: event_name=foo event_id=dd76e2f3-eaf7-5f91-23b2-38c4333c90cf 31:17.193 [DEBUG] TestAgent: new event: event_name=bar event_id=a5212e43-4d0e-f227-228c-a79750135f26 31:17.197 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:17.201 [INFO] TestAgent: Synced node info 31:17.201 [DEBUG] TestAgent: Node info in sync 31:17.220 [INFO] TestAgent: Requesting shutdown 31:17.220 [INFO] TestAgent.server: shutting down server 31:17.220 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.220 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.220 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.220 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.220 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.220 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.220 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:17.220 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.220 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.220 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.228 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.231Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.231Z [INFO] agent.router.manager: shutting down 31:17.232 [INFO] TestAgent: consul server down 31:17.232 [INFO] TestAgent: shutdown complete 31:17.232 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29829 network=tcp 31:17.232 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29829 network=udp 31:17.232 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29830 network=tcp 31:17.736 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.736 [INFO] TestAgent: Endpoints down --- PASS: TestEventList_EventBufOrder (1.18s) === CONT TestDNS_Compression_Query 2021-10-05T16:31:16.768Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.794Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.880 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:39416120-ef2c-580a-fe6d-ea1382926361 Address:127.0.0.1:29806}]" 31:16.880 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29806 [Follower]" leader= 31:16.881 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-39416120-ef2c-580a-fe6d-ea1382926361.dc1 127.0.0.1 31:16.881 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-39416120-ef2c-580a-fe6d-ea1382926361 127.0.0.1 2021-10-05T16:31:16.881Z [INFO] agent.router: Initializing LAN area manager 31:16.882 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29801 network=udp 31:16.882 [INFO] TestAgent.server: Adding LAN server: server="Node-39416120-ef2c-580a-fe6d-ea1382926361 (Addr: tcp/127.0.0.1:29806) (DC: dc1)" 31:16.882 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-39416120-ef2c-580a-fe6d-ea1382926361.dc1 area=wan 31:16.882 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29801 network=tcp 31:16.883 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29802 network=tcp 31:16.883 [INFO] TestAgent: started state syncer 31:16.883 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29807 network=tcp 31:16.934 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.934 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29806 [Candidate]" term=2 31:16.947 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.947 [DEBUG] TestAgent.server.raft: vote granted: from=39416120-ef2c-580a-fe6d-ea1382926361 term=2 tally=1 31:16.947 [INFO] TestAgent.server.raft: election won: tally=1 31:16.947 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29806 [Leader]" 31:16.948 [INFO] TestAgent.server: cluster leadership acquired 31:16.948 [INFO] TestAgent.server: New leader elected: payload=Node-39416120-ef2c-580a-fe6d-ea1382926361 31:16.957 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29806 31:16.988 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.023 [INFO] TestAgent: Synced node info 31:17.048 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.048 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.048 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.048 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.048 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.048 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-39416120-ef2c-580a-fe6d-ea1382926361 31:17.048 [INFO] TestAgent.server: member joined, marking health alive: member=Node-39416120-ef2c-580a-fe6d-ea1382926361 31:17.064 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.161 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:17.161 [DEBUG] TestAgent: Node info in sync 31:17.161 [DEBUG] TestAgent: Node info in sync 31:17.260 [DEBUG] TestAgent.server: User event: event=test 31:17.260 [DEBUG] TestAgent.server: User event: event=foo 31:17.260 [DEBUG] TestAgent: new event: event_name=test event_id=b0ff06ce-a517-f997-1fff-1d555d7425b4 31:17.260 [DEBUG] TestAgent: new event: event_name=foo event_id=b07ed4a6-4bc4-61e7-72bc-e33dd9336e95 31:17.286 [INFO] TestAgent: Requesting shutdown 31:17.286 [INFO] TestAgent.server: shutting down server 31:17.286 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.286 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.286 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.286 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.286 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.286 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.286 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:17.286 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.286 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.286 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.293 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.295Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.295Z [INFO] agent.router.manager: shutting down 31:17.295 [INFO] TestAgent: consul server down 31:17.295 [INFO] TestAgent: shutdown complete 31:17.295 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29801 network=tcp 31:17.295 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29801 network=udp 31:17.295 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29802 network=tcp 31:17.796 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.796 [INFO] TestAgent: Endpoints down --- PASS: TestEventList_Filter (1.06s) === CONT TestDNS_Compression_trimUDPResponse 2021-10-05T16:31:16.805Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.857Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:16.890 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1c718b18-3695-a68b-0256-87e875292ed6 Address:127.0.0.1:29771}]" 31:16.890 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29771 [Follower]" leader= 31:16.890 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1c718b18-3695-a68b-0256-87e875292ed6.dc1 127.0.0.1 31:16.891 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1c718b18-3695-a68b-0256-87e875292ed6 127.0.0.1 2021-10-05T16:31:16.891Z [INFO] agent.router: Initializing LAN area manager 31:16.891 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29808 network=udp 31:16.891 [INFO] TestAgent.server: Adding LAN server: server="Node-1c718b18-3695-a68b-0256-87e875292ed6 (Addr: tcp/127.0.0.1:29771) (DC: dc1)" 31:16.892 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29808 network=tcp 31:16.891 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1c718b18-3695-a68b-0256-87e875292ed6.dc1 area=wan 31:16.892 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29809 network=tcp 31:16.892 [INFO] TestAgent: started state syncer 31:16.892 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29772 network=tcp 31:16.954 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:16.954 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29771 [Candidate]" term=2 31:16.967 [DEBUG] TestAgent.server.raft: votes: needed=1 31:16.967 [DEBUG] TestAgent.server.raft: vote granted: from=1c718b18-3695-a68b-0256-87e875292ed6 term=2 tally=1 31:16.967 [INFO] TestAgent.server.raft: election won: tally=1 31:16.967 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29771 [Leader]" 31:16.967 [INFO] TestAgent.server: cluster leadership acquired 31:16.967 [INFO] TestAgent.server: New leader elected: payload=Node-1c718b18-3695-a68b-0256-87e875292ed6 31:16.988 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29771 31:17.017 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.042 [INFO] TestAgent: Synced node info 31:17.056 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.056 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.056 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.056 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.056 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.056 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1c718b18-3695-a68b-0256-87e875292ed6 31:17.056 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1c718b18-3695-a68b-0256-87e875292ed6 31:17.088 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.252 [DEBUG] TestAgent.server: User event: event=test 31:17.252 [DEBUG] TestAgent: new event: event_name=test event_id=7cf19f0a-9827-03f4-d732-4d6d8284f482 31:17.280 [INFO] TestAgent: Requesting shutdown 31:17.281 [INFO] TestAgent.server: shutting down server 31:17.281 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.281 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.281 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.281 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.281 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.281 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.281 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:17.281 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.281 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.281 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.292 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.296Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.296Z [INFO] agent.router.manager: shutting down 31:17.296 [INFO] TestAgent: consul server down 31:17.296 [INFO] TestAgent: shutdown complete 31:17.296 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29808 network=tcp 31:17.296 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29808 network=udp 31:17.296 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29809 network=tcp 31:17.800 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.800 [INFO] TestAgent: Endpoints down --- PASS: TestEventList (1.04s) === CONT TestDNS_syncExtra --- PASS: TestDNS_syncExtra (0.00s) === CONT TestDNS_trimUDPResponse_TrimSizeEDNS --- PASS: TestDNS_trimUDPResponse_TrimSizeEDNS (0.01s) === CONT TestDNS_trimUDPResponse_TrimSize --- PASS: TestDNS_Compression_trimUDPResponse (0.02s) === CONT TestDNS_trimUDPResponse_TrimLimit [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! --- PASS: TestDNS_trimUDPResponse_TrimSize (0.02s) === CONT TestDNS_trimUDPResponse_NoTrim --- PASS: TestDNS_trimUDPResponse_NoTrim (0.03s) === CONT TestDNS_PreparedQuery_AgentSource --- PASS: TestDNS_trimUDPResponse_TrimLimit (0.06s) === CONT TestDNS_InvalidQueries 2021-10-05T16:31:17.163Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.189Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.255 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:016029be-a0f2-a9a7-e961-8c8d988e4af0 Address:127.0.0.1:29855}]" 31:17.256 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29855 [Follower]" leader= 31:17.256 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-016029be-a0f2-a9a7-e961-8c8d988e4af0.dc1 127.0.0.1 31:17.257 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-016029be-a0f2-a9a7-e961-8c8d988e4af0 127.0.0.1 2021-10-05T16:31:17.257Z [INFO] agent.router: Initializing LAN area manager 31:17.257 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29850 network=udp 31:17.257 [INFO] TestAgent.server: Adding LAN server: server="Node-016029be-a0f2-a9a7-e961-8c8d988e4af0 (Addr: tcp/127.0.0.1:29855) (DC: dc1)" 31:17.257 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-016029be-a0f2-a9a7-e961-8c8d988e4af0.dc1 area=wan 31:17.257 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29850 network=tcp 31:17.258 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29851 network=tcp 31:17.258 [INFO] TestAgent: started state syncer 31:17.258 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29856 network=tcp 31:17.312 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.312 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29855 [Candidate]" term=2 31:17.340 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.340 [DEBUG] TestAgent.server.raft: vote granted: from=016029be-a0f2-a9a7-e961-8c8d988e4af0 term=2 tally=1 31:17.340 [INFO] TestAgent.server.raft: election won: tally=1 31:17.340 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29855 [Leader]" 31:17.343 [INFO] TestAgent.server: cluster leadership acquired 31:17.344 [INFO] TestAgent.server: New leader elected: payload=Node-016029be-a0f2-a9a7-e961-8c8d988e4af0 31:17.346 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29855 31:17.388 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.432 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.432 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.432 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.432 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.432 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.432 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-016029be-a0f2-a9a7-e961-8c8d988e4af0 31:17.432 [INFO] TestAgent.server: member joined, marking health alive: member=Node-016029be-a0f2-a9a7-e961-8c8d988e4af0 31:17.447 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.451 [INFO] TestAgent: Requesting shutdown 31:17.451 [INFO] TestAgent.server: shutting down server 31:17.451 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.451 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.451 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.451 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.451 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.451 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.451 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:17.451 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:17.451 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.451 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.451 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.458 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.459Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.459Z [INFO] agent.router.manager: shutting down 31:17.459 [INFO] TestAgent: consul server down 31:17.459 [INFO] TestAgent: shutdown complete 31:17.459 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29850 network=tcp 31:17.459 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29850 network=udp 31:17.459 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29851 network=tcp 31:17.960 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.960 [INFO] TestAgent: Endpoints down --- PASS: TestEventFire (0.87s) === CONT TestDNS_PreparedQuery_AllowStale 2021-10-05T16:31:16.939Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:16.979Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.027 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7de0b201-dbba-b8b8-9134-7ea3d697afa4 Address:127.0.0.1:29841}]" 31:17.027 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29841 [Follower]" leader= 31:17.028 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7de0b201-dbba-b8b8-9134-7ea3d697afa4.dc1 127.0.0.1 31:17.033 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7de0b201-dbba-b8b8-9134-7ea3d697afa4 127.0.0.1 2021-10-05T16:31:17.033Z [INFO] agent.router: Initializing LAN area manager 31:17.034 [INFO] TestAgent.server: Adding LAN server: server="Node-7de0b201-dbba-b8b8-9134-7ea3d697afa4 (Addr: tcp/127.0.0.1:29841) (DC: dc1)" 31:17.034 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7de0b201-dbba-b8b8-9134-7ea3d697afa4.dc1 area=wan 31:17.034 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29773 network=udp 31:17.034 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29773 network=tcp 31:17.034 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29774 network=tcp 31:17.034 [INFO] TestAgent: started state syncer 31:17.035 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29842 network=tcp 31:17.128 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.128 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29841 [Candidate]" term=2 31:17.151 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.151 [DEBUG] TestAgent.server.raft: vote granted: from=7de0b201-dbba-b8b8-9134-7ea3d697afa4 term=2 tally=1 31:17.151 [INFO] TestAgent.server.raft: election won: tally=1 31:17.151 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29841 [Leader]" 31:17.152 [INFO] TestAgent.server: cluster leadership acquired 31:17.152 [INFO] TestAgent.server: New leader elected: payload=Node-7de0b201-dbba-b8b8-9134-7ea3d697afa4 31:17.166 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29841 31:17.188 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.245 [INFO] TestAgent: Synced node info 31:17.245 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.245 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.245 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.245 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.245 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.245 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7de0b201-dbba-b8b8-9134-7ea3d697afa4 31:17.245 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7de0b201-dbba-b8b8-9134-7ea3d697afa4 31:17.262 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.464 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:17.464 [INFO] TestAgent: Requesting shutdown 31:17.464 [INFO] TestAgent.server: shutting down server 31:17.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.464 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.464 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.464 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.464 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.464 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.464 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:17.472 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.476Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.476Z [INFO] agent.router.manager: shutting down 31:17.476 [INFO] TestAgent: consul server down 31:17.476 [INFO] TestAgent: shutdown complete 31:17.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29773 network=tcp 31:17.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29773 network=udp 31:17.476 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29774 network=tcp 31:17.980 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.980 [INFO] TestAgent: Endpoints down === RUN TestPreparedQuery_Execute/#07 2021-10-05T16:31:17.156Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:17.156Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.190Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:17.190Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.226 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7303199b-c3c4-0db7-a874-64abde82a5f3 Address:127.0.0.1:29848}]" 31:17.227 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7303199b-c3c4-0db7-a874-64abde82a5f3.dc1 127.0.0.1 31:17.228 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29848 [Follower]" leader= 31:17.228 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7303199b-c3c4-0db7-a874-64abde82a5f3 127.0.0.1 2021-10-05T16:31:17.228Z [INFO] agent.router: Initializing LAN area manager 31:17.228 [INFO] TestAgent.server: Adding LAN server: server="Node-7303199b-c3c4-0db7-a874-64abde82a5f3 (Addr: tcp/127.0.0.1:29848) (DC: dc1)" 31:17.228 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29843 network=udp 31:17.228 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7303199b-c3c4-0db7-a874-64abde82a5f3.dc1 area=wan 31:17.228 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29843 network=tcp 31:17.229 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29844 network=tcp 31:17.229 [INFO] TestAgent: started state syncer 31:17.229 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29849 network=tcp 31:17.271 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.271 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29848 [Candidate]" term=2 31:17.281 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:17.295 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.295 [DEBUG] TestAgent.server.raft: vote granted: from=7303199b-c3c4-0db7-a874-64abde82a5f3 term=2 tally=1 31:17.295 [INFO] TestAgent.server.raft: election won: tally=1 31:17.295 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29848 [Leader]" 31:17.296 [INFO] TestAgent.server: cluster leadership acquired 31:17.296 [INFO] TestAgent.server: New leader elected: payload=Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.328 [INFO] TestAgent.server: initializing acls 31:17.344 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:17.344 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:17.368 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:17.384 [INFO] TestAgent.server: initializing acls 31:17.384 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:17.415 [INFO] TestAgent: Synced node info 31:17.415 [DEBUG] TestAgent: Node info in sync 31:17.415 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:17.415 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:17.415 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:17.415 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.416 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7303199b-c3c4-0db7-a874-64abde82a5f3.dc1 31:17.416 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:17.416 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:17.416 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.416 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7303199b-c3c4-0db7-a874-64abde82a5f3.dc1 31:17.416 [INFO] TestAgent.server: Updating LAN server: server="Node-7303199b-c3c4-0db7-a874-64abde82a5f3 (Addr: tcp/127.0.0.1:29848) (DC: dc1)" 31:17.416 [INFO] TestAgent.server: Updating LAN server: server="Node-7303199b-c3c4-0db7-a874-64abde82a5f3 (Addr: tcp/127.0.0.1:29848) (DC: dc1)" 31:17.417 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7303199b-c3c4-0db7-a874-64abde82a5f3.dc1 area=wan 31:17.417 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7303199b-c3c4-0db7-a874-64abde82a5f3.dc1 area=wan 31:17.429 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.454 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.454 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.471 [WARN] TestAgent.server.internal: user event blocked by ACLs: event=foo accessorID= 31:17.471 [WARN] TestAgent.server.internal: user event blocked by ACLs: event=bar accessorID= 31:17.471 [INFO] TestAgent: Requesting shutdown 31:17.471 [INFO] TestAgent.server: shutting down server 31:17.471 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:17.471 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:17.471 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.472 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:17.472 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:17.478 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:17.481 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.481 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.481 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.481 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.481 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.481 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.481 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7303199b-c3c4-0db7-a874-64abde82a5f3 2021-10-05T16:31:17.484Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.484Z [INFO] agent.router.manager: shutting down 31:17.488 [INFO] TestAgent: consul server down 31:17.488 [INFO] TestAgent: shutdown complete 31:17.488 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29843 network=tcp 31:17.488 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29843 network=udp 31:17.488 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29844 network=tcp 31:17.488 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-7303199b-c3c4-0db7-a874-64abde82a5f3 127.0.0.1 29846 map[acls:1 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:7303199b-c3c4-0db7-a874-64abde82a5f3 port:29848 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29847] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:17.488 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.488 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7303199b-c3c4-0db7-a874-64abde82a5f3 31:17.489 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-7303199b-c3c4-0db7-a874-64abde82a5f3 127.0.0.1 29846 map[acls:1 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:7303199b-c3c4-0db7-a874-64abde82a5f3 port:29848 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29847] alive 1 5 2 2 5 4}" error="raft is already shutdown" 31:17.489 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.489 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.489 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.489 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.489 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.489 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.489 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.991 [INFO] TestAgent: Waiting for endpoints to shut down 31:17.991 [INFO] TestAgent: Endpoints down --- PASS: TestEventFire_token (0.91s) === CONT TestDNS_AltDomains_Overlap [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:17.402Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.436Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.516 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0dcb57e3-abe6-b8b4-a2a6-36971988d42c Address:127.0.0.1:29862}]" 31:17.516 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29862 [Follower]" leader= 31:17.517 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0dcb57e3-abe6-b8b4-a2a6-36971988d42c.dc1 127.0.0.1 31:17.517 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0dcb57e3-abe6-b8b4-a2a6-36971988d42c 127.0.0.1 2021-10-05T16:31:17.517Z [INFO] agent.router: Initializing LAN area manager 31:17.517 [DEBUG] TestAgent.dns: recursor enabled 31:17.517 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29871 network=udp 31:17.518 [INFO] TestAgent.server: Adding LAN server: server="Node-0dcb57e3-abe6-b8b4-a2a6-36971988d42c (Addr: tcp/127.0.0.1:29862) (DC: dc1)" 31:17.518 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0dcb57e3-abe6-b8b4-a2a6-36971988d42c.dc1 area=wan 31:17.518 [DEBUG] TestAgent.dns: recursor enabled 31:17.518 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29871 network=tcp 31:17.518 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29872 network=tcp 31:17.518 [INFO] TestAgent: started state syncer 31:17.518 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29863 network=tcp 31:17.570 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.570 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29862 [Candidate]" term=2 31:17.583 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.583 [DEBUG] TestAgent.server.raft: vote granted: from=0dcb57e3-abe6-b8b4-a2a6-36971988d42c term=2 tally=1 31:17.583 [INFO] TestAgent.server.raft: election won: tally=1 31:17.583 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29862 [Leader]" 31:17.584 [INFO] TestAgent.server: cluster leadership acquired 31:17.584 [INFO] TestAgent.server: New leader elected: payload=Node-0dcb57e3-abe6-b8b4-a2a6-36971988d42c 31:17.593 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29862 31:17.612 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.641 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.641 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.641 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.641 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.641 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.641 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0dcb57e3-abe6-b8b4-a2a6-36971988d42c 31:17.641 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0dcb57e3-abe6-b8b4-a2a6-36971988d42c 31:17.666 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.747 [INFO] TestAgent: Requesting shutdown 31:17.747 [INFO] TestAgent.server: shutting down server 31:17.747 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.747 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.747 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:17.753 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.757Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.757Z [INFO] agent.router.manager: shutting down 31:17.757 [INFO] TestAgent: consul server down 31:17.757 [INFO] TestAgent: shutdown complete 31:17.757 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29871 network=tcp 31:17.757 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29871 network=udp 31:17.757 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29872 network=tcp 31:18.260 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.260 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ConfigReload (0.91s) === CONT TestDNS_AltDomains_SOA [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:17.390Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.406Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.484 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4945891a-1343-1571-9055-a769bc0019d8 Address:127.0.0.1:29869}]" 31:17.484 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29869 [Follower]" leader= 31:17.484 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4945891a-1343-1571-9055-a769bc0019d8.dc1 127.0.0.1 31:17.485 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4945891a-1343-1571-9055-a769bc0019d8 127.0.0.1 2021-10-05T16:31:17.485Z [INFO] agent.router: Initializing LAN area manager 31:17.486 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29857 network=udp 31:17.486 [INFO] TestAgent.server: Adding LAN server: server="Node-4945891a-1343-1571-9055-a769bc0019d8 (Addr: tcp/127.0.0.1:29869) (DC: dc1)" 31:17.486 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4945891a-1343-1571-9055-a769bc0019d8.dc1 area=wan 31:17.486 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29857 network=tcp 31:17.486 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29858 network=tcp 31:17.486 [INFO] TestAgent: started state syncer 31:17.486 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29870 network=tcp 31:17.540 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.540 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29869 [Candidate]" term=2 31:17.556 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.556 [DEBUG] TestAgent.server.raft: vote granted: from=4945891a-1343-1571-9055-a769bc0019d8 term=2 tally=1 31:17.556 [INFO] TestAgent.server.raft: election won: tally=1 31:17.556 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29869 [Leader]" 31:17.560 [INFO] TestAgent.server: cluster leadership acquired 31:17.560 [INFO] TestAgent.server: New leader elected: payload=Node-4945891a-1343-1571-9055-a769bc0019d8 31:17.564 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29869 31:17.585 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.616 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.616 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.616 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.616 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.616 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.616 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4945891a-1343-1571-9055-a769bc0019d8 31:17.616 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4945891a-1343-1571-9055-a769bc0019d8 31:17.624 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.635 [INFO] TestAgent: Synced node info 31:17.857 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:17.959 [INFO] TestAgent: Requesting shutdown 31:17.959 [INFO] TestAgent.server: shutting down server 31:17.959 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.959 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.968 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:17.980Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:17.980Z [INFO] agent.router.manager: shutting down 31:17.980 [INFO] TestAgent: consul server down 31:17.980 [INFO] TestAgent: shutdown complete 31:17.980 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29857 network=tcp 31:17.980 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29857 network=udp 31:17.980 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29858 network=tcp 31:18.480 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.480 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ReloadConfig_DuringQuery (1.12s) === CONT TestDNS_AltDomains_Service 2021-10-05T16:31:17.523Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.535Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.565 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b69b1b7c-4ed9-2806-6375-540e512a9e06 Address:127.0.0.1:29883}]" 31:17.566 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b69b1b7c-4ed9-2806-6375-540e512a9e06.dc1 127.0.0.1 31:17.566 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b69b1b7c-4ed9-2806-6375-540e512a9e06 127.0.0.1 2021-10-05T16:31:17.566Z [INFO] agent.router: Initializing LAN area manager 31:17.566 [DEBUG] TestAgent.dns: recursor enabled 31:17.567 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29864 network=udp 31:17.567 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29883 [Follower]" leader= 31:17.567 [INFO] TestAgent.server: Adding LAN server: server="Node-b69b1b7c-4ed9-2806-6375-540e512a9e06 (Addr: tcp/127.0.0.1:29883) (DC: dc1)" 31:17.567 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b69b1b7c-4ed9-2806-6375-540e512a9e06.dc1 area=wan 31:17.567 [DEBUG] TestAgent.dns: recursor enabled 31:17.567 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29864 network=tcp 31:17.568 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29865 network=tcp 31:17.568 [INFO] TestAgent: started state syncer 31:17.568 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29884 network=tcp 31:17.624 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.624 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29883 [Candidate]" term=2 31:17.639 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.639 [DEBUG] TestAgent.server.raft: vote granted: from=b69b1b7c-4ed9-2806-6375-540e512a9e06 term=2 tally=1 31:17.639 [INFO] TestAgent.server.raft: election won: tally=1 31:17.639 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29883 [Leader]" 31:17.639 [INFO] TestAgent.server: cluster leadership acquired 31:17.639 [INFO] TestAgent.server: New leader elected: payload=Node-b69b1b7c-4ed9-2806-6375-540e512a9e06 31:17.648 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29883 31:17.666 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.686 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.686 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.686 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.686 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.686 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.686 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b69b1b7c-4ed9-2806-6375-540e512a9e06 31:17.686 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b69b1b7c-4ed9-2806-6375-540e512a9e06 31:17.724 [INFO] TestAgent.server: federation state anti-entropy synced 31:17.932 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:17.944 [INFO] TestAgent: Synced node info 31:17.968 [DEBUG] TestAgent.dns: recurse succeeded for question: question="{apple.com. 255 1}" rtt=299.881µs recursor=127.0.0.1:45602 31:17.968 [DEBUG] TestAgent.dns: request served from client: question="{apple.com. 255 1}" network=udp latency=454.826µs client=127.0.0.1:36935 client_network=udp 31:17.968 [DEBUG] TestAgent.dns: recurse succeeded for question: question="{apple.com. 255 1}" rtt=61.348µs recursor=127.0.0.1:45602 31:17.968 [DEBUG] TestAgent.dns: request served from client: question="{apple.com. 255 1}" network=udp latency=132.685µs client=127.0.0.1:36935 client_network=udp 31:17.968 [INFO] TestAgent: Requesting shutdown 31:17.968 [INFO] TestAgent.server: shutting down server 31:17.968 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:17.968 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:17.968 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:17.968 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:17.968 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:17.969 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:17.969 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:17.969 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:17.969 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:17.969 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:17.991 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.000Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.000Z [INFO] agent.router.manager: shutting down 31:18.000 [INFO] TestAgent: consul server down 31:18.000 [INFO] TestAgent: shutdown complete 31:18.000 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29864 network=tcp 31:18.000 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29864 network=udp 31:18.000 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29865 network=tcp 31:18.502 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.502 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_Compression_Recurse (0.99s) === CONT TestDNS_NonExistingLookupEmptyAorAAAA [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:17.591Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.621Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.716 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7f13133d-42aa-0b47-7c0b-d9d3f039c30e Address:127.0.0.1:29876}]" 31:17.717 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7f13133d-42aa-0b47-7c0b-d9d3f039c30e.dc1 127.0.0.1 31:17.717 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7f13133d-42aa-0b47-7c0b-d9d3f039c30e 127.0.0.1 2021-10-05T16:31:17.717Z [INFO] agent.router: Initializing LAN area manager 31:17.717 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29885 network=udp 31:17.717 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29876 [Follower]" leader= 31:17.718 [INFO] TestAgent.server: Adding LAN server: server="Node-7f13133d-42aa-0b47-7c0b-d9d3f039c30e (Addr: tcp/127.0.0.1:29876) (DC: dc1)" 31:17.718 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7f13133d-42aa-0b47-7c0b-d9d3f039c30e.dc1 area=wan 31:17.718 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29885 network=tcp 31:17.718 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29886 network=tcp 31:17.718 [INFO] TestAgent: started state syncer 31:17.718 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29877 network=tcp 31:17.779 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.779 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29876 [Candidate]" term=2 31:17.828 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.828 [DEBUG] TestAgent.server.raft: vote granted: from=7f13133d-42aa-0b47-7c0b-d9d3f039c30e term=2 tally=1 31:17.828 [INFO] TestAgent.server.raft: election won: tally=1 31:17.828 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29876 [Leader]" 31:17.830 [INFO] TestAgent.server: cluster leadership acquired 31:17.856 [INFO] TestAgent.server: New leader elected: payload=Node-7f13133d-42aa-0b47-7c0b-d9d3f039c30e 31:17.876 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29876 31:17.877 [INFO] TestAgent: Synced node info 31:17.877 [DEBUG] TestAgent: Node info in sync 31:17.936 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:17.996 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:17.996 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:17.996 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:17.996 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:17.996 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:17.996 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7f13133d-42aa-0b47-7c0b-d9d3f039c30e 31:17.996 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7f13133d-42aa-0b47-7c0b-d9d3f039c30e 31:18.012 [DEBUG] TestAgent: Node info in sync 31:18.028 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.107 [DEBUG] TestAgent.dns: request served from client: question="{2.0.0.127.in-addr.arpa. 255 1}" latency=94.891µs client=127.0.0.1:47730 client_network=udp 31:18.107 [DEBUG] TestAgent.dns: request served from client: question="{2.0.0.127.in-addr.arpa. 255 1}" latency=63.382µs client=127.0.0.1:47730 client_network=udp 31:18.108 [INFO] TestAgent: Requesting shutdown 31:18.108 [INFO] TestAgent.server: shutting down server 31:18.108 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.108 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.108 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.108 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.108 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.108 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.108 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.108 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.108 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.108 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.120 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.128Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.128Z [INFO] agent.router.manager: shutting down 31:18.128 [INFO] TestAgent: consul server down 31:18.128 [INFO] TestAgent: shutdown complete 31:18.128 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29885 network=tcp 31:18.128 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29885 network=udp 31:18.128 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29886 network=tcp 31:18.628 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.628 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_Compression_ReverseLookup (1.08s) === CONT TestDNS_NonExistingLookup 2021-10-05T16:31:17.924Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.958Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.043 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:73eb598b-ce0d-9d9f-b0c1-cee5a6f58077 Address:127.0.0.1:29910}]" 31:18.044 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29910 [Follower]" leader= 31:18.044 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-73eb598b-ce0d-9d9f-b0c1-cee5a6f58077.dc1 127.0.0.1 31:18.046 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-73eb598b-ce0d-9d9f-b0c1-cee5a6f58077 127.0.0.1 2021-10-05T16:31:18.046Z [INFO] agent.router: Initializing LAN area manager 31:18.047 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29905 network=udp 31:18.047 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-73eb598b-ce0d-9d9f-b0c1-cee5a6f58077.dc1 area=wan 31:18.047 [INFO] TestAgent.server: Adding LAN server: server="Node-73eb598b-ce0d-9d9f-b0c1-cee5a6f58077 (Addr: tcp/127.0.0.1:29910) (DC: dc1)" 31:18.047 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29905 network=tcp 31:18.047 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29906 network=tcp 31:18.047 [INFO] TestAgent: started state syncer 31:18.047 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29897 network=tcp 31:18.109 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.109 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29910 [Candidate]" term=2 31:18.119 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.119 [DEBUG] TestAgent.server.raft: vote granted: from=73eb598b-ce0d-9d9f-b0c1-cee5a6f58077 term=2 tally=1 31:18.119 [INFO] TestAgent.server.raft: election won: tally=1 31:18.119 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29910 [Leader]" 31:18.120 [INFO] TestAgent.server: cluster leadership acquired 31:18.120 [INFO] TestAgent.server: New leader elected: payload=Node-73eb598b-ce0d-9d9f-b0c1-cee5a6f58077 31:18.132 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29910 31:18.154 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.192 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.192 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.192 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.192 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.192 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.192 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-73eb598b-ce0d-9d9f-b0c1-cee5a6f58077 31:18.192 [INFO] TestAgent.server: member joined, marking health alive: member=Node-73eb598b-ce0d-9d9f-b0c1-cee5a6f58077 31:18.208 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.220 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:18.221 [DEBUG] TestAgent.dns: request served from client: name=foo.query.consul. type=SRV class=IN latency=61.277µs client=127.0.0.1:38063 client_network=udp 31:18.221 [INFO] TestAgent: Requesting shutdown 31:18.221 [INFO] TestAgent.server: shutting down server 31:18.221 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.221 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.221 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.221 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.221 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.221 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.221 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.221 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:18.221 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.221 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.221 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.228 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.236Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.236Z [INFO] agent.router.manager: shutting down 31:18.236 [INFO] TestAgent: consul server down 31:18.236 [INFO] TestAgent: shutdown complete 31:18.236 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29905 network=tcp 31:18.236 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29905 network=udp 31:18.236 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29906 network=tcp 31:18.736 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.736 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_PreparedQuery_AgentSource (0.87s) === CONT TestDNS_NonExistentDC_RPC 2021-10-05T16:31:18.021Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.053Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.132 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a178cba2-5266-786d-32fb-5c1924c82ba8 Address:127.0.0.1:29924}]" 31:18.133 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a178cba2-5266-786d-32fb-5c1924c82ba8.dc1 127.0.0.1 31:18.133 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a178cba2-5266-786d-32fb-5c1924c82ba8 127.0.0.1 2021-10-05T16:31:18.133Z [INFO] agent.router: Initializing LAN area manager 31:18.134 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29919 network=udp 31:18.134 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29924 [Follower]" leader= 31:18.134 [INFO] TestAgent.server: Adding LAN server: server="Node-a178cba2-5266-786d-32fb-5c1924c82ba8 (Addr: tcp/127.0.0.1:29924) (DC: dc1)" 31:18.134 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a178cba2-5266-786d-32fb-5c1924c82ba8.dc1 area=wan 31:18.134 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29919 network=tcp 31:18.135 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29920 network=tcp 31:18.135 [INFO] TestAgent: started state syncer 31:18.135 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29925 network=tcp 31:18.176 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.176 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29924 [Candidate]" term=2 31:18.212 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.212 [DEBUG] TestAgent.server.raft: vote granted: from=a178cba2-5266-786d-32fb-5c1924c82ba8 term=2 tally=1 31:18.212 [INFO] TestAgent.server.raft: election won: tally=1 31:18.212 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29924 [Leader]" 31:18.216 [INFO] TestAgent.server: cluster leadership acquired 31:18.216 [INFO] TestAgent.server: New leader elected: payload=Node-a178cba2-5266-786d-32fb-5c1924c82ba8 31:18.220 [INFO] TestAgent: Requesting shutdown 31:18.220 [INFO] TestAgent.server: shutting down server 31:18.220 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.220 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:18.223 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29924 31:18.228 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.236Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.236Z [INFO] agent.router.manager: shutting down 31:18.241 [INFO] TestAgent: consul server down 31:18.241 [INFO] TestAgent: shutdown complete 31:18.241 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29919 network=tcp 31:18.241 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29919 network=udp 31:18.241 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29920 network=tcp 31:18.241 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:18.241 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:18.744 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.744 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_Execute (7.41s) --- PASS: TestPreparedQuery_Execute/#00 (0.98s) --- PASS: TestPreparedQuery_Execute/#01 (1.09s) --- PASS: TestPreparedQuery_Execute/#02 (0.98s) --- PASS: TestPreparedQuery_Execute/#03 (1.03s) --- PASS: TestPreparedQuery_Execute/#04 (0.75s) --- PASS: TestPreparedQuery_Execute/#05 (0.75s) --- PASS: TestPreparedQuery_Execute/#06 (1.08s) --- PASS: TestPreparedQuery_Execute/#07 (0.76s) === CONT TestDNS_NonExistentDC_Server 2021-10-05T16:31:17.760Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.807Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:17.900 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:40704556-a9bb-282e-1c9a-591bdb3125d7 Address:127.0.0.1:29892}]" 31:17.901 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29892 [Follower]" leader= 31:17.901 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-40704556-a9bb-282e-1c9a-591bdb3125d7.dc1 127.0.0.1 31:17.902 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-40704556-a9bb-282e-1c9a-591bdb3125d7 127.0.0.1 2021-10-05T16:31:17.902Z [INFO] agent.router: Initializing LAN area manager 31:17.902 [INFO] TestAgent.server: Adding LAN server: server="Node-40704556-a9bb-282e-1c9a-591bdb3125d7 (Addr: tcp/127.0.0.1:29892) (DC: dc1)" 31:17.903 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-40704556-a9bb-282e-1c9a-591bdb3125d7.dc1 area=wan 31:17.903 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29878 network=tcp 31:17.903 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29878 network=udp 31:17.920 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29879 network=tcp 31:17.920 [INFO] TestAgent: started state syncer 31:17.920 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29904 network=tcp 31:17.952 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:17.952 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29892 [Candidate]" term=2 31:17.993 [DEBUG] TestAgent.server.raft: votes: needed=1 31:17.993 [DEBUG] TestAgent.server.raft: vote granted: from=40704556-a9bb-282e-1c9a-591bdb3125d7 term=2 tally=1 31:17.993 [INFO] TestAgent.server.raft: election won: tally=1 31:17.993 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29892 [Leader]" 31:17.994 [INFO] TestAgent.server: cluster leadership acquired 31:17.994 [INFO] TestAgent.server: New leader elected: payload=Node-40704556-a9bb-282e-1c9a-591bdb3125d7 31:18.024 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29892 31:18.037 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.065 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.066 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.066 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.066 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.066 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.066 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-40704556-a9bb-282e-1c9a-591bdb3125d7 31:18.066 [INFO] TestAgent.server: member joined, marking health alive: member=Node-40704556-a9bb-282e-1c9a-591bdb3125d7 31:18.098 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.280 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=228.527µs client=127.0.0.1:50501 client_network=udp 31:18.280 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=86.799µs client=127.0.0.1:50501 client_network=udp 31:18.284 [DEBUG] TestAgent.dns: request served from client: name=a94a02d4-9754-b4ba-0e79-e22ac128c369.query.consul. type=SRV class=IN latency=211.573µs client=127.0.0.1:36076 client_network=udp 31:18.285 [DEBUG] TestAgent.dns: request served from client: name=a94a02d4-9754-b4ba-0e79-e22ac128c369.query.consul. type=SRV class=IN latency=170.944µs client=127.0.0.1:36076 client_network=udp 31:18.285 [INFO] TestAgent: Requesting shutdown 31:18.285 [INFO] TestAgent.server: shutting down server 31:18.285 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.285 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.285 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.285 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.285 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.285 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.285 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.285 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:18.285 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.285 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.285 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.292 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.297Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.297Z [INFO] agent.router.manager: shutting down 31:18.297 [INFO] TestAgent: consul server down 31:18.297 [INFO] TestAgent: shutdown complete 31:18.297 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29878 network=tcp 31:18.297 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29878 network=udp 31:18.297 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29879 network=tcp 31:18.800 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.800 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_Compression_Query (1.06s) === CONT TestDNS_AddressLookupIPV6 [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:18.024Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.049Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.104 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ccb62742-af56-3e69-7b3d-b6b98d667e1e Address:127.0.0.1:29931}]" 31:18.104 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29931 [Follower]" leader= 31:18.104 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 31:18.105 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:31:18.105Z [INFO] agent.router: Initializing LAN area manager 31:18.105 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29926 network=udp 31:18.105 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29931) (DC: dc1)" 31:18.105 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29926 network=tcp 31:18.105 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 31:18.106 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29927 network=tcp 31:18.106 [INFO] TestAgent: started state syncer 31:18.106 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29932 network=tcp 31:18.148 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.148 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29931 [Candidate]" term=2 31:18.175 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.175 [DEBUG] TestAgent.server.raft: vote granted: from=ccb62742-af56-3e69-7b3d-b6b98d667e1e term=2 tally=1 31:18.175 [INFO] TestAgent.server.raft: election won: tally=1 31:18.175 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29931 [Leader]" 31:18.176 [INFO] TestAgent.server: cluster leadership acquired 31:18.176 [INFO] TestAgent.server: New leader elected: payload=test-node 31:18.185 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29931 31:18.214 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.260 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.260 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.260 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.260 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.260 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.260 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 31:18.260 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 31:18.304 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.309 [DEBUG] TestAgent.dns: request served from client: name=test-node.node.consul. type=A class=IN latency=106.063µs client=127.0.0.1:52787 client_network=udp 31:18.309 [DEBUG] TestAgent.dns: request served from client: name=test-node.node.test.consul. type=A class=IN latency=51.18µs client=127.0.0.1:49538 client_network=udp 31:18.309 [DEBUG] TestAgent.dns: request served from client: name=test-node.node.dc1.consul. type=A class=IN latency=42.52µs client=127.0.0.1:51183 client_network=udp 31:18.309 [DEBUG] TestAgent.dns: request served from client: name=test-node.node.dc1.test.consul. type=A class=IN latency=44.146µs client=127.0.0.1:48903 client_network=udp 31:18.309 [INFO] TestAgent: Requesting shutdown 31:18.309 [INFO] TestAgent.server: shutting down server 31:18.309 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.310 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.310 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.310 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.310 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.310 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.310 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.310 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:18.310 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.310 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.310 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.315 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.323Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.323Z [INFO] agent.router.manager: shutting down 31:18.323 [INFO] TestAgent: consul server down 31:18.323 [INFO] TestAgent: shutdown complete 31:18.323 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29926 network=tcp 31:18.323 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29926 network=udp 31:18.323 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29927 network=tcp 31:18.824 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.824 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_AltDomains_Overlap (0.83s) === CONT TestDNS_AddressLookup 2021-10-05T16:31:18.000Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.041Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.080 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b15d4001-20c1-177b-bafd-2151ff42bd80 Address:127.0.0.1:29917}]" 31:18.081 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b15d4001-20c1-177b-bafd-2151ff42bd80.dc1 127.0.0.1 31:18.081 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29917 [Follower]" leader= 31:18.082 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b15d4001-20c1-177b-bafd-2151ff42bd80 127.0.0.1 2021-10-05T16:31:18.082Z [INFO] agent.router: Initializing LAN area manager 31:18.082 [INFO] TestAgent.server: Adding LAN server: server="Node-b15d4001-20c1-177b-bafd-2151ff42bd80 (Addr: tcp/127.0.0.1:29917) (DC: dc1)" 31:18.082 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29912 network=udp 31:18.082 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b15d4001-20c1-177b-bafd-2151ff42bd80.dc1 area=wan 31:18.082 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29912 network=tcp 31:18.083 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29913 network=tcp 31:18.083 [INFO] TestAgent: started state syncer 31:18.083 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29918 network=tcp 31:18.126 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.126 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29917 [Candidate]" term=2 31:18.144 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.144 [DEBUG] TestAgent.server.raft: vote granted: from=b15d4001-20c1-177b-bafd-2151ff42bd80 term=2 tally=1 31:18.144 [INFO] TestAgent.server.raft: election won: tally=1 31:18.144 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29917 [Leader]" 31:18.146 [INFO] TestAgent.server: cluster leadership acquired 31:18.146 [INFO] TestAgent.server: New leader elected: payload=Node-b15d4001-20c1-177b-bafd-2151ff42bd80 31:18.157 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29917 31:18.178 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.223 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.223 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.223 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.223 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.223 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.223 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b15d4001-20c1-177b-bafd-2151ff42bd80 31:18.223 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b15d4001-20c1-177b-bafd-2151ff42bd80 31:18.241 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:18.263 [INFO] TestAgent: Synced node info 31:18.263 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.392 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:18.393 [WARN] TestAgent.dns: Query results too stale, re-requesting 31:18.393 [DEBUG] TestAgent.dns: request served from client: name=nope.query.consul. type=SRV class=IN latency=126.13µs client=127.0.0.1:42105 client_network=udp 31:18.393 [INFO] TestAgent: Requesting shutdown 31:18.393 [INFO] TestAgent.server: shutting down server 31:18.393 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.393 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.393 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.393 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.393 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.393 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.393 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.393 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.393 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.393 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.401 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.407Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.407Z [INFO] agent.router.manager: shutting down 31:18.407 [INFO] TestAgent: consul server down 31:18.407 [INFO] TestAgent: shutdown complete 31:18.407 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29912 network=tcp 31:18.407 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29912 network=udp 31:18.407 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29913 network=tcp 31:18.908 [INFO] TestAgent: Waiting for endpoints to shut down 31:18.908 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_PreparedQuery_AllowStale (0.95s) === CONT TestDNS_ServiceLookup_FilterACL === RUN TestDNS_ServiceLookup_FilterACL/ACLToken_==_root 2021-10-05T16:31:17.928Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:17.958Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.009 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6 Address:127.0.0.1:29903}]" 31:18.010 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6.dc1 127.0.0.1 31:18.011 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6 127.0.0.1 2021-10-05T16:31:18.011Z [INFO] agent.router: Initializing LAN area manager 31:18.011 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29898 network=udp 31:18.011 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29903 [Follower]" leader= 31:18.011 [INFO] TestAgent.server: Adding LAN server: server="Node-ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6 (Addr: tcp/127.0.0.1:29903) (DC: dc1)" 31:18.011 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6.dc1 area=wan 31:18.011 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29898 network=tcp 31:18.012 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29899 network=tcp 31:18.012 [INFO] TestAgent: started state syncer 31:18.012 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29911 network=tcp 31:18.069 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.069 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29903 [Candidate]" term=2 31:18.109 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.109 [DEBUG] TestAgent.server.raft: vote granted: from=ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6 term=2 tally=1 31:18.109 [INFO] TestAgent.server.raft: election won: tally=1 31:18.109 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29903 [Leader]" 31:18.109 [INFO] TestAgent.server: cluster leadership acquired 31:18.109 [INFO] TestAgent.server: New leader elected: payload=Node-ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6 31:18.148 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29903 31:18.212 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.273 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.273 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.273 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.273 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.273 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.273 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6 31:18.273 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ec6cfb99-35ac-3caf-4c77-2f8cadbd7dc6 31:18.292 [INFO] TestAgent: Synced node info 31:18.298 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.506 [WARN] TestAgent.dns: QName invalid: qname= 31:18.506 [DEBUG] TestAgent.dns: request served from client: name=consul. type=SRV class=IN latency=102.01µs client=127.0.0.1:47509 client_network=udp 31:18.506 [WARN] TestAgent.dns: QName invalid: qname=node. 31:18.506 [DEBUG] TestAgent.dns: request served from client: name=node.consul. type=SRV class=IN latency=59.985µs client=127.0.0.1:52687 client_network=udp 31:18.506 [WARN] TestAgent.dns: QName invalid: qname=service. 31:18.506 [DEBUG] TestAgent.dns: request served from client: name=service.consul. type=SRV class=IN latency=25.329µs client=127.0.0.1:52448 client_network=udp 31:18.506 [WARN] TestAgent.dns: QName invalid: qname=query. 31:18.506 [DEBUG] TestAgent.dns: request served from client: name=query.consul. type=SRV class=IN latency=22.126µs client=127.0.0.1:36531 client_network=udp 31:18.506 [WARN] TestAgent.dns: QName invalid: qname=foo.node.dc1.extra.more. 31:18.506 [DEBUG] TestAgent.dns: request served from client: name=foo.node.dc1.extra.more.consul. type=SRV class=IN latency=27.302µs client=127.0.0.1:45951 client_network=udp 31:18.506 [WARN] TestAgent.dns: QName invalid: qname=foo.service.dc1.extra.more. 31:18.506 [DEBUG] TestAgent.dns: request served from client: name=foo.service.dc1.extra.more.consul. type=SRV class=IN latency=27.229µs client=127.0.0.1:40428 client_network=udp 31:18.507 [WARN] TestAgent.dns: QName invalid: qname=foo.query.dc1.extra.more. 31:18.507 [DEBUG] TestAgent.dns: request served from client: name=foo.query.dc1.extra.more.consul. type=SRV class=IN latency=30.748µs client=127.0.0.1:37788 client_network=udp 31:18.507 [INFO] TestAgent: Requesting shutdown 31:18.507 [INFO] TestAgent.server: shutting down server 31:18.507 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.507 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.507 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.507 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.507 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.507 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.507 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.507 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.507 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.507 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.517 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.544Z [INFO] agent.router.manager: shutting down 31:18.544 [INFO] TestAgent: consul server down 31:18.544 [INFO] TestAgent: shutdown complete 31:18.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29898 network=tcp 2021-10-05T16:31:18.544Z [INFO] agent.router.manager: shutting down 31:18.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29898 network=udp 31:18.544 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29899 network=tcp 31:19.045 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.045 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_InvalidQueries (1.17s) === CONT TestDNS_ServiceLookup_SRV_RFC_TCP_Default [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:18.289Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.303Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.335 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c97032bf-dcc4-6bd9-224c-1dbf64b2ae19 Address:127.0.0.1:29938}]" 31:18.336 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29938 [Follower]" leader= 31:18.336 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 31:18.337 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:31:18.337Z [INFO] agent.router: Initializing LAN area manager 31:18.337 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29933 network=udp 31:18.337 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29938) (DC: dc1)" 31:18.338 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 31:18.338 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29933 network=tcp 31:18.338 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29934 network=tcp 31:18.338 [INFO] TestAgent: started state syncer 31:18.338 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29939 network=tcp 31:18.393 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.393 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29938 [Candidate]" term=2 31:18.412 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.412 [DEBUG] TestAgent.server.raft: vote granted: from=c97032bf-dcc4-6bd9-224c-1dbf64b2ae19 term=2 tally=1 31:18.412 [INFO] TestAgent.server.raft: election won: tally=1 31:18.413 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29938 [Leader]" 31:18.413 [INFO] TestAgent.server: cluster leadership acquired 31:18.413 [INFO] TestAgent.server: New leader elected: payload=test-node 31:18.426 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29938 31:18.449 [INFO] TestAgent: Synced node info 31:18.449 [DEBUG] TestAgent: Node info in sync 31:18.461 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.500 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.500 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.500 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.500 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.500 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.500 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 31:18.500 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 31:18.556 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.591 [DEBUG] TestAgent.dns: request served from client: name=test-node.node.consul. type=SOA class=IN latency=164.207µs client=127.0.0.1:46784 client_network=udp 31:18.591 [DEBUG] TestAgent.dns: request served from client: name=test-node.node.test-domain. type=SOA class=IN latency=118.972µs client=127.0.0.1:37131 client_network=udp 31:18.591 [INFO] TestAgent: Requesting shutdown 31:18.591 [INFO] TestAgent.server: shutting down server 31:18.591 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.591 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.591 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.591 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.592 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.592 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.592 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.600 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.600 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.600 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.608 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.616Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.616Z [INFO] agent.router.manager: shutting down 31:18.616 [INFO] TestAgent: consul server down 31:18.616 [INFO] TestAgent: shutdown complete 31:18.616 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29933 network=tcp 31:18.616 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29933 network=udp 31:18.616 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29934 network=tcp 31:19.117 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.117 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_AltDomains_SOA (0.86s) === CONT TestDNS_ServiceLookup_SRV_RFC [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:18.508Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.549Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.621 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c82480eb-508f-f6b3-00b9-7374c61bb4ce Address:127.0.0.1:29945}]" 31:18.622 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29945 [Follower]" leader= 31:18.622 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c82480eb-508f-f6b3-00b9-7374c61bb4ce.dc1 127.0.0.1 31:18.622 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c82480eb-508f-f6b3-00b9-7374c61bb4ce 127.0.0.1 2021-10-05T16:31:18.622Z [INFO] agent.router: Initializing LAN area manager 31:18.622 [INFO] TestAgent.server: Adding LAN server: server="Node-c82480eb-508f-f6b3-00b9-7374c61bb4ce (Addr: tcp/127.0.0.1:29945) (DC: dc1)" 31:18.623 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c82480eb-508f-f6b3-00b9-7374c61bb4ce.dc1 area=wan 31:18.623 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29940 network=udp 31:18.623 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29940 network=tcp 31:18.623 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29941 network=tcp 31:18.623 [INFO] TestAgent: started state syncer 31:18.623 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29946 network=tcp 31:18.661 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.661 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29945 [Candidate]" term=2 31:18.680 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.680 [DEBUG] TestAgent.server.raft: vote granted: from=c82480eb-508f-f6b3-00b9-7374c61bb4ce term=2 tally=1 31:18.680 [INFO] TestAgent.server.raft: election won: tally=1 31:18.680 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29945 [Leader]" 31:18.681 [INFO] TestAgent.server: cluster leadership acquired 31:18.681 [INFO] TestAgent.server: New leader elected: payload=Node-c82480eb-508f-f6b3-00b9-7374c61bb4ce 31:18.687 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29945 31:18.700 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.754 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.754 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.754 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.754 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.754 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.754 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c82480eb-508f-f6b3-00b9-7374c61bb4ce 31:18.754 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c82480eb-508f-f6b3-00b9-7374c61bb4ce 31:18.780 [INFO] TestAgent.server: federation state anti-entropy synced 31:18.860 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=313.18µs client=127.0.0.1:49748 client_network=udp 31:18.860 [DEBUG] TestAgent.dns: request served from client: name=db.service.test-domain. type=SRV class=IN latency=81.257µs client=127.0.0.1:49596 client_network=udp 31:18.861 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc1.consul. type=SRV class=IN latency=82.025µs client=127.0.0.1:49159 client_network=udp 31:18.861 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc1.test-domain. type=SRV class=IN latency=88.433µs client=127.0.0.1:35258 client_network=udp 31:18.861 [INFO] TestAgent: Requesting shutdown 31:18.861 [INFO] TestAgent.server: shutting down server 31:18.861 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:18.861 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:18.861 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:18.861 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:18.861 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:18.861 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:18.861 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:18.861 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:18.862 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:18.862 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:18.862 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:18.872 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:18.876Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:18.876Z [INFO] agent.router.manager: shutting down 31:18.877 [INFO] TestAgent: consul server down 31:18.877 [INFO] TestAgent: shutdown complete 31:18.877 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29940 network=tcp 31:18.877 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29940 network=udp 31:18.877 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29941 network=tcp 31:19.380 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.380 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_AltDomains_Service (0.90s) === CONT TestDNS_PreparedQuery_Failover 2021-10-05T16:31:18.577Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.611Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.678 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d6011653-8631-7ea1-042f-7a3f41ce7db3 Address:127.0.0.1:29952}]" 31:18.678 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29952 [Follower]" leader= 31:18.679 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d6011653-8631-7ea1-042f-7a3f41ce7db3.dc1 127.0.0.1 31:18.680 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d6011653-8631-7ea1-042f-7a3f41ce7db3 127.0.0.1 2021-10-05T16:31:18.680Z [INFO] agent.router: Initializing LAN area manager 31:18.680 [INFO] TestAgent.server: Adding LAN server: server="Node-d6011653-8631-7ea1-042f-7a3f41ce7db3 (Addr: tcp/127.0.0.1:29952) (DC: dc1)" 31:18.680 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d6011653-8631-7ea1-042f-7a3f41ce7db3.dc1 area=wan 31:18.680 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29947 network=udp 31:18.680 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29947 network=tcp 31:18.681 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29948 network=tcp 31:18.681 [INFO] TestAgent: started state syncer 31:18.681 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29960 network=tcp 31:18.748 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.748 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29952 [Candidate]" term=2 31:18.795 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.795 [DEBUG] TestAgent.server.raft: vote granted: from=d6011653-8631-7ea1-042f-7a3f41ce7db3 term=2 tally=1 31:18.795 [INFO] TestAgent.server.raft: election won: tally=1 31:18.795 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29952 [Leader]" 31:18.796 [INFO] TestAgent.server: cluster leadership acquired 31:18.796 [INFO] TestAgent.server: New leader elected: payload=Node-d6011653-8631-7ea1-042f-7a3f41ce7db3 31:18.816 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29952 31:18.850 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.910 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.910 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.910 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.910 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.910 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.911 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d6011653-8631-7ea1-042f-7a3f41ce7db3 31:18.911 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d6011653-8631-7ea1-042f-7a3f41ce7db3 31:18.952 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.029 [DEBUG] TestAgent.dns: request served from client: name=webv4.service.consul. type=AAAA class=IN latency=165.87µs client=127.0.0.1:40369 client_network=udp 31:19.029 [DEBUG] TestAgent.dns: request served from client: name=webv4.query.consul. type=AAAA class=IN latency=98.11µs client=127.0.0.1:37562 client_network=udp 31:19.029 [DEBUG] TestAgent.dns: request served from client: name=webv6.service.consul. type=A class=IN latency=71.509µs client=127.0.0.1:42704 client_network=udp 31:19.030 [DEBUG] TestAgent.dns: request served from client: name=webv6.query.consul. type=A class=IN latency=247.541µs client=127.0.0.1:47504 client_network=udp 31:19.030 [INFO] TestAgent: Requesting shutdown 31:19.030 [INFO] TestAgent.server: shutting down server 31:19.030 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.030 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.030 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.030 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.030 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.030 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.030 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.030 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:19.030 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.030 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.030 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.039 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.045Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.045Z [INFO] agent.router.manager: shutting down 31:19.046 [INFO] TestAgent: consul server down 31:19.046 [INFO] TestAgent: shutdown complete 31:19.046 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29947 network=tcp 31:19.046 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29947 network=udp 31:19.046 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29948 network=tcp 31:19.548 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.548 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NonExistingLookupEmptyAorAAAA (1.05s) === CONT TestDNS_PreparedQuery_TTL 2021-10-05T16:31:18.646Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.662Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.710 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:99c01123-d9a3-8075-f47f-f24c0064db1a Address:127.0.0.1:29966}]" 31:18.711 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-99c01123-d9a3-8075-f47f-f24c0064db1a.dc1 127.0.0.1 31:18.711 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-99c01123-d9a3-8075-f47f-f24c0064db1a 127.0.0.1 2021-10-05T16:31:18.711Z [INFO] agent.router: Initializing LAN area manager 31:18.711 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29961 network=udp 31:18.711 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29966 [Follower]" leader= 31:18.712 [INFO] TestAgent.server: Adding LAN server: server="Node-99c01123-d9a3-8075-f47f-f24c0064db1a (Addr: tcp/127.0.0.1:29966) (DC: dc1)" 31:18.712 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-99c01123-d9a3-8075-f47f-f24c0064db1a.dc1 area=wan 31:18.712 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29961 network=tcp 31:18.712 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29962 network=tcp 31:18.712 [INFO] TestAgent: started state syncer 31:18.713 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29953 network=tcp 31:18.776 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.776 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29966 [Candidate]" term=2 31:18.816 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.816 [DEBUG] TestAgent.server.raft: vote granted: from=99c01123-d9a3-8075-f47f-f24c0064db1a term=2 tally=1 31:18.816 [INFO] TestAgent.server.raft: election won: tally=1 31:18.816 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29966 [Leader]" 31:18.819 [INFO] TestAgent.server: cluster leadership acquired 31:18.819 [INFO] TestAgent.server: New leader elected: payload=Node-99c01123-d9a3-8075-f47f-f24c0064db1a 31:18.852 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29966 31:18.856 [INFO] TestAgent: Synced node info 31:18.889 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:18.940 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:18.940 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:18.940 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:18.940 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:18.940 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:18.940 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-99c01123-d9a3-8075-f47f-f24c0064db1a 31:18.940 [INFO] TestAgent.server: member joined, marking health alive: member=Node-99c01123-d9a3-8075-f47f-f24c0064db1a 31:18.968 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.055 [WARN] TestAgent.dns: QName invalid: qname=nonexisting. 31:19.055 [DEBUG] TestAgent.dns: request served from client: name=nonexisting.consul. type=ANY class=IN latency=59.314µs client=127.0.0.1:54813 client_network=udp 31:19.055 [INFO] TestAgent: Requesting shutdown 31:19.055 [INFO] TestAgent.server: shutting down server 31:19.055 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.055 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.055 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.055 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.055 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.055 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.056 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.056 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.056 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.056 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.062 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.067Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.067Z [INFO] agent.router.manager: shutting down 31:19.067 [INFO] TestAgent: consul server down 31:19.067 [INFO] TestAgent: shutdown complete 31:19.067 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29961 network=tcp 31:19.068 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29961 network=udp 31:19.068 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29962 network=tcp 31:19.568 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.568 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NonExistingLookup (0.94s) === CONT TestDNS_ServiceLookup_TTL [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:18.777Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.806Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.868 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1be3134e-66f4-426c-06ff-c3be7e40cb29 Address:127.0.0.1:29973}]" 31:18.869 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1be3134e-66f4-426c-06ff-c3be7e40cb29.dc1 127.0.0.1 31:18.869 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1be3134e-66f4-426c-06ff-c3be7e40cb29 127.0.0.1 2021-10-05T16:31:18.869Z [INFO] agent.router: Initializing LAN area manager 31:18.870 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29968 network=udp 31:18.870 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29973 [Follower]" leader= 31:18.870 [INFO] TestAgent.server: Adding LAN server: server="Node-1be3134e-66f4-426c-06ff-c3be7e40cb29 (Addr: tcp/127.0.0.1:29973) (DC: dc1)" 31:18.870 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1be3134e-66f4-426c-06ff-c3be7e40cb29.dc1 area=wan 31:18.870 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29968 network=tcp 31:18.871 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29969 network=tcp 31:18.871 [INFO] TestAgent: started state syncer 31:18.871 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29974 network=tcp 31:18.927 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.927 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29973 [Candidate]" term=2 31:18.968 [DEBUG] TestAgent.server.raft: votes: needed=1 31:18.968 [DEBUG] TestAgent.server.raft: vote granted: from=1be3134e-66f4-426c-06ff-c3be7e40cb29 term=2 tally=1 31:18.968 [INFO] TestAgent.server.raft: election won: tally=1 31:18.968 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29973 [Leader]" 31:18.968 [INFO] TestAgent.server: cluster leadership acquired 31:18.968 [INFO] TestAgent.server: New leader elected: payload=Node-1be3134e-66f4-426c-06ff-c3be7e40cb29 31:18.996 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29973 31:19.021 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.071 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.071 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.071 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.071 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.071 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.072 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1be3134e-66f4-426c-06ff-c3be7e40cb29 31:19.072 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1be3134e-66f4-426c-06ff-c3be7e40cb29 31:19.094 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.160 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:19.180 [INFO] TestAgent: Synced node info 31:19.180 [DEBUG] TestAgent: Node info in sync 31:19.285 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc2 method=Health.ServiceNodes 31:19.285 [ERROR] TestAgent.dns: rpc error: error="No path to datacenter" 31:19.285 [DEBUG] TestAgent.dns: request served from client: name=consul.service.dc2.consul. type=ANY class=IN latency=137.895µs client=127.0.0.1:56569 client_network=udp 31:19.285 [INFO] TestAgent: Requesting shutdown 31:19.285 [INFO] TestAgent.server: shutting down server 31:19.285 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.285 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.285 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.285 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.285 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.285 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.285 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.285 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.285 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.285 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.293 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.295Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.295Z [INFO] agent.router.manager: shutting down 31:19.295 [INFO] TestAgent: consul server down 31:19.295 [INFO] TestAgent: shutdown complete 31:19.295 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29968 network=tcp 31:19.295 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29968 network=udp 31:19.295 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29969 network=tcp 31:19.796 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.796 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NonExistentDC_Server (1.05s) === CONT TestDNS_NodeLookup_TTL [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:18.863Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.921Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.999 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:830ad23f-b2f5-e70a-b222-caee2c23abfd Address:127.0.0.1:30001}]" 31:19.000 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30001 [Follower]" leader= 31:19.000 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-830ad23f-b2f5-e70a-b222-caee2c23abfd.dc1 127.0.0.1 31:19.001 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-830ad23f-b2f5-e70a-b222-caee2c23abfd 127.0.0.1 2021-10-05T16:31:19.001Z [INFO] agent.router: Initializing LAN area manager 31:19.001 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-830ad23f-b2f5-e70a-b222-caee2c23abfd.dc1 area=wan 31:19.001 [INFO] TestAgent.server: Adding LAN server: server="Node-830ad23f-b2f5-e70a-b222-caee2c23abfd (Addr: tcp/127.0.0.1:30001) (DC: dc1)" 31:19.001 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29996 network=udp 31:19.001 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29996 network=tcp 31:19.002 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29997 network=tcp 31:19.002 [INFO] TestAgent: started state syncer 31:19.002 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29988 network=tcp 31:19.065 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.065 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30001 [Candidate]" term=2 31:19.111 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.111 [DEBUG] TestAgent.server.raft: vote granted: from=830ad23f-b2f5-e70a-b222-caee2c23abfd term=2 tally=1 31:19.111 [INFO] TestAgent.server.raft: election won: tally=1 31:19.111 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30001 [Leader]" 31:19.115 [INFO] TestAgent.server: cluster leadership acquired 31:19.117 [INFO] TestAgent.server: New leader elected: payload=Node-830ad23f-b2f5-e70a-b222-caee2c23abfd 31:19.140 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30001 31:19.196 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.290 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.290 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.290 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.290 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.290 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.290 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-830ad23f-b2f5-e70a-b222-caee2c23abfd 31:19.290 [INFO] TestAgent.server: member joined, marking health alive: member=Node-830ad23f-b2f5-e70a-b222-caee2c23abfd 31:19.300 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.333 [DEBUG] TestAgent.dns: request served from client: name=7f000001.addr.dc1.consul. type=SRV class=IN latency=122.715µs client=127.0.0.1:60632 client_network=udp 31:19.333 [INFO] TestAgent: Requesting shutdown 31:19.334 [INFO] TestAgent.server: shutting down server 31:19.334 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.334 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.334 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.334 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.334 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.334 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.334 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.334 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:19.334 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.334 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.334 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.339 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.341Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.341Z [INFO] agent.router.manager: shutting down 31:19.341 [INFO] TestAgent: consul server down 31:19.341 [INFO] TestAgent: shutdown complete 31:19.341 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29996 network=tcp 31:19.341 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29996 network=udp 31:19.341 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29997 network=tcp 31:19.842 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.842 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_AddressLookup (1.02s) === CONT TestDNS_ServiceLookup_ServiceAddress_CNAME 2021-10-05T16:31:18.939Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:18.939Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.980Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:18.980Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.018 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:82730898-43ad-a510-7761-43d2da8b35e1 Address:127.0.0.1:29994}]" 31:19.019 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-82730898-43ad-a510-7761-43d2da8b35e1.dc1 127.0.0.1 31:19.019 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-82730898-43ad-a510-7761-43d2da8b35e1 127.0.0.1 2021-10-05T16:31:19.019Z [INFO] agent.router: Initializing LAN area manager 31:19.020 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29989 network=udp 31:19.020 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29994 [Follower]" leader= 31:19.020 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-82730898-43ad-a510-7761-43d2da8b35e1.dc1 area=wan 31:19.020 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29989 network=tcp 31:19.020 [INFO] TestAgent.server: Adding LAN server: server="Node-82730898-43ad-a510-7761-43d2da8b35e1 (Addr: tcp/127.0.0.1:29994) (DC: dc1)" 31:19.021 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29990 network=tcp 31:19.021 [INFO] TestAgent: started state syncer 31:19.021 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30002 network=tcp 31:19.071 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:19.091 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.091 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29994 [Candidate]" term=2 31:19.137 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.137 [DEBUG] TestAgent.server.raft: vote granted: from=82730898-43ad-a510-7761-43d2da8b35e1 term=2 tally=1 31:19.137 [INFO] TestAgent.server.raft: election won: tally=1 31:19.137 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29994 [Leader]" 31:19.139 [INFO] TestAgent.server: cluster leadership acquired 31:19.139 [INFO] TestAgent.server: New leader elected: payload=Node-82730898-43ad-a510-7761-43d2da8b35e1 31:19.147 [INFO] TestAgent.server: initializing acls 31:19.156 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:19.156 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:19.172 [INFO] TestAgent.server: initializing acls 31:19.172 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:19.208 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:19.212 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:19.280 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:19.280 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:19.280 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:19.280 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:19.280 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-82730898-43ad-a510-7761-43d2da8b35e1 31:19.280 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-82730898-43ad-a510-7761-43d2da8b35e1.dc1 31:19.280 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-82730898-43ad-a510-7761-43d2da8b35e1.dc1 area=wan 31:19.281 [INFO] TestAgent: Synced node info 31:19.281 [DEBUG] TestAgent: Node info in sync 31:19.281 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:19.281 [INFO] TestAgent.server: Updating LAN server: server="Node-82730898-43ad-a510-7761-43d2da8b35e1 (Addr: tcp/127.0.0.1:29994) (DC: dc1)" 31:19.281 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-82730898-43ad-a510-7761-43d2da8b35e1 31:19.281 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-82730898-43ad-a510-7761-43d2da8b35e1.dc1 31:19.284 [INFO] TestAgent.server: Updating LAN server: server="Node-82730898-43ad-a510-7761-43d2da8b35e1 (Addr: tcp/127.0.0.1:29994) (DC: dc1)" 31:19.284 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-82730898-43ad-a510-7761-43d2da8b35e1.dc1 area=wan 31:19.299 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.303 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-82730898-43ad-a510-7761-43d2da8b35e1 31:19.304 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-82730898-43ad-a510-7761-43d2da8b35e1 31:19.353 [DEBUG] TestAgent.dns: request served from client: name=foo.service.consul. type=A class=IN latency=393.852µs client=127.0.0.1:35967 client_network=udp 31:19.353 [INFO] TestAgent: Requesting shutdown 31:19.354 [INFO] TestAgent.server: shutting down server 31:19.354 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:19.354 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:19.354 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.354 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:19.354 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:19.364 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:19.365 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.365 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.365 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.365 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.365 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.365 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-82730898-43ad-a510-7761-43d2da8b35e1 31:19.365 [INFO] TestAgent.server: member joined, marking health alive: member=Node-82730898-43ad-a510-7761-43d2da8b35e1 2021-10-05T16:31:19.366Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.366Z [INFO] agent.router.manager: shutting down 31:19.384 [INFO] TestAgent: consul server down 31:19.384 [INFO] TestAgent: shutdown complete 31:19.384 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29989 network=tcp 31:19.384 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29989 network=udp 31:19.384 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29990 network=tcp 31:19.384 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-82730898-43ad-a510-7761-43d2da8b35e1 127.0.0.1 29992 map[acls:1 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:82730898-43ad-a510-7761-43d2da8b35e1 port:29994 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29993] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:19.384 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.384 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.384 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.384 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.384 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.384 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.384 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.884 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.884 [INFO] TestAgent: Endpoints down === RUN TestDNS_ServiceLookup_FilterACL/ACLToken_==_anonymous 2021-10-05T16:31:18.826Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.868Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.960 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8c4a7d6f-d645-c88d-8589-0eb1e340567d Address:127.0.0.1:29980}]" 31:18.960 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8c4a7d6f-d645-c88d-8589-0eb1e340567d.dc1 127.0.0.1 31:18.961 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8c4a7d6f-d645-c88d-8589-0eb1e340567d 127.0.0.1 2021-10-05T16:31:18.961Z [INFO] agent.router: Initializing LAN area manager 31:18.961 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29975 network=udp 31:18.961 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29980 [Follower]" leader= 31:18.962 [INFO] TestAgent.server: Adding LAN server: server="Node-8c4a7d6f-d645-c88d-8589-0eb1e340567d (Addr: tcp/127.0.0.1:29980) (DC: dc1)" 31:18.962 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8c4a7d6f-d645-c88d-8589-0eb1e340567d.dc1 area=wan 31:18.962 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29975 network=tcp 31:18.962 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29976 network=tcp 31:18.962 [INFO] TestAgent: started state syncer 31:18.962 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29995 network=tcp 31:19.016 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.016 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29980 [Candidate]" term=2 31:19.038 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.038 [DEBUG] TestAgent.server.raft: vote granted: from=8c4a7d6f-d645-c88d-8589-0eb1e340567d term=2 tally=1 31:19.039 [INFO] TestAgent.server.raft: election won: tally=1 31:19.039 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29980 [Leader]" 31:19.039 [INFO] TestAgent.server: cluster leadership acquired 31:19.039 [INFO] TestAgent.server: New leader elected: payload=Node-8c4a7d6f-d645-c88d-8589-0eb1e340567d 31:19.054 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29980 31:19.089 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.137 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.137 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.137 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.137 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.137 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.138 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8c4a7d6f-d645-c88d-8589-0eb1e340567d 31:19.138 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8c4a7d6f-d645-c88d-8589-0eb1e340567d 31:19.164 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.176 [INFO] TestAgent: Synced node info 31:19.177 [DEBUG] TestAgent: Node info in sync 31:19.392 [DEBUG] TestAgent.dns: request served from client: name=2607002040050808000000000000200e.addr.consul. type=SRV class=IN latency=63.751µs client=127.0.0.1:57859 client_network=udp 31:19.392 [DEBUG] TestAgent.dns: request served from client: name=2607112040051808ffffffffffff200e.addr.consul. type=SRV class=IN latency=18.161µs client=127.0.0.1:38408 client_network=udp 31:19.392 [INFO] TestAgent: Requesting shutdown 31:19.392 [INFO] TestAgent.server: shutting down server 31:19.392 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.392 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.392 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.392 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.392 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.392 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.392 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.392 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.392 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.392 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.400 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.400Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.400Z [INFO] agent.router.manager: shutting down 31:19.400 [INFO] TestAgent: consul server down 31:19.400 [INFO] TestAgent: shutdown complete 31:19.400 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29975 network=tcp 31:19.400 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29975 network=udp 31:19.400 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29976 network=tcp 31:19.902 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.902 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_AddressLookupIPV6 (1.10s) === CONT TestDNS_ServiceLookup_AnswerLimits === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{0_0_0_0_0_0_0_0_0_0_0} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{0_0_0_0_0_0_0_0_0_0_0} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{0_0_0_0_0_0_0_0_0_0_0} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{0_0_0_0_0_0_0_0_0_0_0} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{0_0_0_0_0_0_0_0_0_0_0} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{0_0_0_0_0_0_0_0_0_0_0} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{1_1_1_1_1_1_1_1_1_1_1} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{1_1_1_1_1_1_1_1_1_1_1} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{1_1_1_1_1_1_1_1_1_1_1} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{1_1_1_1_1_1_1_1_1_1_1} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{1_1_1_1_1_1_1_1_1_1_1} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{1_1_1_1_1_1_1_1_1_1_1} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{2_2_2_2_2_2_2_2_2_2_2} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{2_2_2_2_2_2_2_2_2_2_2} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{2_2_2_2_2_2_2_2_2_2_2} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{2_2_2_2_2_2_2_2_2_2_2} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{2_2_2_2_2_2_2_2_2_2_2} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{2_2_2_2_2_2_2_2_2_2_2} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{3_3_3_3_3_3_3_3_3_3_3} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{3_3_3_3_3_3_3_3_3_3_3} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{3_3_3_3_3_3_3_3_3_3_3} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{3_3_3_3_3_3_3_3_3_3_3} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{3_3_3_3_3_3_3_3_3_3_3} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{3_3_3_3_3_3_3_3_3_3_3} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{4_4_4_4_4_4_4_4_4_4_4} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{4_4_4_4_4_4_4_4_4_4_4} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{4_4_4_4_4_4_4_4_4_4_4} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{4_4_4_4_4_4_4_4_4_4_4} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{4_4_4_4_4_4_4_4_4_4_4} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{4_4_4_4_4_4_4_4_4_4_4} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{5_5_5_5_5_5_5_5_5_5_5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{5_5_5_5_5_5_5_5_5_5_5} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{5_5_5_5_5_5_5_5_5_5_5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{5_5_5_5_5_5_5_5_5_5_5} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{5_5_5_5_5_5_5_5_5_5_5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{5_5_5_5_5_5_5_5_5_5_5} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{6_6_6_6_6_6_6_5_6_6_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{6_6_6_6_6_6_6_5_6_6_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{6_6_6_6_6_6_6_5_6_6_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{6_6_6_6_6_6_6_5_6_6_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{6_6_6_6_6_6_6_5_6_6_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{6_6_6_6_6_6_6_5_6_6_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{7_7_7_7_6_7_7_5_7_7_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{7_7_7_7_6_7_7_5_7_7_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{7_7_7_7_6_7_7_5_7_7_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{7_7_7_7_6_7_7_5_7_7_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{7_7_7_7_6_7_7_5_7_7_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{7_7_7_7_6_7_7_5_7_7_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{8_8_8_8_6_8_8_5_8_8_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{8_8_8_8_6_8_8_5_8_8_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{8_8_8_8_6_8_8_5_8_8_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{8_8_8_8_6_8_8_5_8_8_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{8_8_8_8_6_8_8_5_8_8_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{8_8_8_8_6_8_8_5_8_8_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{9_9_8_8_6_8_8_5_8_8_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{9_9_8_8_6_8_8_5_8_8_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{9_9_8_8_6_8_8_5_8_8_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{9_9_8_8_6_8_8_5_8_8_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{9_9_8_8_6_8_8_5_8_8_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{9_9_8_8_6_8_8_5_8_8_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/A_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/A_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} === RUN TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} === PAUSE TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} === CONT TestDNS_ServiceLookup_LargeResponses 2021-10-05T16:31:19.164Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.198Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.344 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4b63fbff-472a-5973-8717-b4b924dc31a5 Address:127.0.0.1:30022}]" 31:19.345 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30022 [Follower]" leader= 31:19.345 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4b63fbff-472a-5973-8717-b4b924dc31a5.dc1 127.0.0.1 31:19.345 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4b63fbff-472a-5973-8717-b4b924dc31a5 127.0.0.1 2021-10-05T16:31:19.345Z [INFO] agent.router: Initializing LAN area manager 31:19.346 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30017 network=udp 31:19.346 [INFO] TestAgent.server: Adding LAN server: server="Node-4b63fbff-472a-5973-8717-b4b924dc31a5 (Addr: tcp/127.0.0.1:30022) (DC: dc1)" 31:19.346 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4b63fbff-472a-5973-8717-b4b924dc31a5.dc1 area=wan 31:19.346 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30017 network=tcp 31:19.347 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30018 network=tcp 31:19.347 [INFO] TestAgent: started state syncer 31:19.347 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30009 network=tcp 31:19.384 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.384 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30022 [Candidate]" term=2 31:19.410 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.410 [DEBUG] TestAgent.server.raft: vote granted: from=4b63fbff-472a-5973-8717-b4b924dc31a5 term=2 tally=1 31:19.410 [INFO] TestAgent.server.raft: election won: tally=1 31:19.410 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30022 [Leader]" 31:19.411 [INFO] TestAgent.server: cluster leadership acquired 31:19.411 [INFO] TestAgent.server: New leader elected: payload=Node-4b63fbff-472a-5973-8717-b4b924dc31a5 31:19.416 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30022 31:19.434 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.470 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.470 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.470 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.470 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.470 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.470 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4b63fbff-472a-5973-8717-b4b924dc31a5 31:19.470 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4b63fbff-472a-5973-8717-b4b924dc31a5 31:19.482 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.508 [DEBUG] TestAgent.dns: request served from client: name=_db._primary.service.dc1.consul. type=SRV class=IN latency=135.849µs client=127.0.0.1:52744 client_network=udp 31:19.509 [DEBUG] TestAgent.dns: request served from client: name=_db._primary.service.consul. type=SRV class=IN latency=99.968µs client=127.0.0.1:43645 client_network=udp 31:19.509 [DEBUG] TestAgent.dns: request served from client: name=_db._primary.dc1.consul. type=SRV class=IN latency=81.416µs client=127.0.0.1:43918 client_network=udp 31:19.509 [DEBUG] TestAgent.dns: request served from client: name=_db._primary.consul. type=SRV class=IN latency=78.541µs client=127.0.0.1:57714 client_network=udp 31:19.509 [INFO] TestAgent: Requesting shutdown 31:19.509 [INFO] TestAgent.server: shutting down server 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.509 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.509 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.509 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.520 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.520Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.520Z [INFO] agent.router.manager: shutting down 31:19.520 [INFO] TestAgent: consul server down 31:19.520 [INFO] TestAgent: shutdown complete 31:19.520 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30017 network=tcp 31:19.520 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30017 network=udp 31:19.520 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30018 network=tcp 31:20.020 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.020 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_SRV_RFC (0.90s) === CONT TestDNS_ServiceLookup_Truncate 2021-10-05T16:31:19.066Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.134Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.217 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6ddf76c0-d92c-846b-18da-61924bb9f012 Address:127.0.0.1:30008}]" 31:19.218 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6ddf76c0-d92c-846b-18da-61924bb9f012.dc1 127.0.0.1 31:19.218 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6ddf76c0-d92c-846b-18da-61924bb9f012 127.0.0.1 2021-10-05T16:31:19.218Z [INFO] agent.router: Initializing LAN area manager 31:19.218 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30003 network=udp 31:19.219 [INFO] TestAgent.server: Adding LAN server: server="Node-6ddf76c0-d92c-846b-18da-61924bb9f012 (Addr: tcp/127.0.0.1:30008) (DC: dc1)" 31:19.219 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6ddf76c0-d92c-846b-18da-61924bb9f012.dc1 area=wan 31:19.220 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30003 network=tcp 31:19.220 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30008 [Follower]" leader= 31:19.220 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30004 network=tcp 31:19.220 [INFO] TestAgent: started state syncer 31:19.220 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29981 network=tcp 31:19.288 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.288 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30008 [Candidate]" term=2 31:19.339 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.339 [DEBUG] TestAgent.server.raft: vote granted: from=6ddf76c0-d92c-846b-18da-61924bb9f012 term=2 tally=1 31:19.339 [INFO] TestAgent.server.raft: election won: tally=1 31:19.339 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30008 [Leader]" 31:19.339 [INFO] TestAgent.server: cluster leadership acquired 31:19.339 [INFO] TestAgent.server: New leader elected: payload=Node-6ddf76c0-d92c-846b-18da-61924bb9f012 31:19.354 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30008 31:19.386 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.420 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.420 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.420 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.420 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.420 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.420 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6ddf76c0-d92c-846b-18da-61924bb9f012 31:19.420 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6ddf76c0-d92c-846b-18da-61924bb9f012 31:19.484 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.484 [INFO] TestAgent: Synced node info 31:19.484 [DEBUG] TestAgent: Node info in sync 31:19.504 [DEBUG] TestAgent.dns: request served from client: name=_db._tcp.service.dc1.consul. type=SRV class=IN latency=236.438µs client=127.0.0.1:43496 client_network=udp 31:19.508 [DEBUG] TestAgent.dns: request served from client: name=_db._tcp.service.consul. type=SRV class=IN latency=179.963µs client=127.0.0.1:48628 client_network=udp 31:19.508 [DEBUG] TestAgent.dns: request served from client: name=_db._tcp.dc1.consul. type=SRV class=IN latency=84.858µs client=127.0.0.1:51942 client_network=udp 31:19.509 [DEBUG] TestAgent.dns: request served from client: name=_db._tcp.consul. type=SRV class=IN latency=92.89µs client=127.0.0.1:56488 client_network=udp 31:19.509 [INFO] TestAgent: Requesting shutdown 31:19.509 [INFO] TestAgent.server: shutting down server 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.509 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.509 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.509 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.509 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.524 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.528Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.528Z [INFO] agent.router.manager: shutting down 31:19.528 [INFO] TestAgent: consul server down 31:19.528 [INFO] TestAgent: shutdown complete 31:19.528 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30003 network=tcp 31:19.528 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30003 network=udp 31:19.528 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30004 network=tcp 31:20.028 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.028 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_SRV_RFC_TCP_Default (0.99s) === CONT TestDNS_TCP_and_UDP_Truncate [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_ServiceLookup_TTL/db.service.consul. === RUN TestDNS_ServiceLookup_TTL/dblb.service.consul. === RUN TestDNS_ServiceLookup_TTL/dk.service.consul. === RUN TestDNS_ServiceLookup_TTL/api.service.consul. === RUN TestDNS_PreparedQuery_TTL/db.query.consul. === RUN TestDNS_PreparedQuery_TTL/db-ttl.query.consul. === RUN TestDNS_PreparedQuery_TTL/dblb.query.consul. === RUN TestDNS_PreparedQuery_TTL/dblb-ttl.query.consul. === RUN TestDNS_PreparedQuery_TTL/dk.query.consul. === RUN TestDNS_PreparedQuery_TTL/dk-ttl.query.consul. === RUN TestDNS_PreparedQuery_TTL/api.query.consul. === RUN TestDNS_PreparedQuery_TTL/api-ttl.query.consul. 31:19.163 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: test-client 127.0.0.1 2021-10-05T16:31:19.163Z [INFO] agent.router: Initializing LAN area manager 31:19.166 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29982 network=udp 31:19.166 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29982 network=tcp 31:19.166 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29983 network=tcp 31:19.166 [INFO] TestAgent: started state syncer 31:19.167 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30016 network=tcp 2021-10-05T16:31:19.167Z [WARN] agent.router.manager: No servers available 31:19.167 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:19.169 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:29957] 31:19.169 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:29957 31:19.172 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: test-server 127.0.0.1 31:19.172 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 31:19.172 [DEBUG] TestAgent: systemd notify failed: error="No socket" 2021-10-05T16:31:19.172Z [WARN] agent.router.manager: No servers available 31:19.172 [INFO] TestAgent.client: adding server: server="test-server (Addr: tcp/127.0.0.1:29959) (DC: dc1)" 31:19.209 [ERROR] TestAgent.client: RPC failed to server: method=Health.ServiceNodes server=127.0.0.1:29959 error="rpc error making call: No path to datacenter" 31:19.209 [ERROR] TestAgent.dns: rpc error: error="rpc error making call: No path to datacenter" 31:19.209 [DEBUG] TestAgent.dns: request served from client: name=consul.service.dc2.consul. type=ANY class=IN latency=334.425µs client=127.0.0.1:53684 client_network=udp 31:19.209 [INFO] TestAgent: Requesting shutdown 31:19.209 [INFO] TestAgent.client: shutting down client 31:19.209 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:19.248 [INFO] TestAgent: consul client down 31:19.248 [INFO] TestAgent: shutdown complete 31:19.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29982 network=tcp 31:19.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29982 network=udp 31:19.248 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29983 network=tcp 31:19.748 [INFO] TestAgent: Waiting for endpoints to shut down 31:19.748 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:18.773Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:18.787Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:18.896 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:eaff7bc0-90cf-8add-5e63-087ec86d3dfb Address:127.0.0.1:29959}]" 31:18.896 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29959 [Follower]" leader= 31:18.897 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-server.dc1 127.0.0.1 31:18.897 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-server 127.0.0.1 2021-10-05T16:31:18.897Z [INFO] agent.router: Initializing LAN area manager 31:18.897 [INFO] TestAgent.server: Adding LAN server: server="test-server (Addr: tcp/127.0.0.1:29959) (DC: dc1)" 31:18.897 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29954 network=udp 31:18.898 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-server.dc1 area=wan 31:18.898 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29954 network=tcp 31:18.898 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29955 network=tcp 31:18.898 [INFO] TestAgent: started state syncer 31:18.898 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29967 network=tcp 31:18.963 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:18.963 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29959 [Candidate]" term=2 31:19.002 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.002 [DEBUG] TestAgent.server.raft: vote granted: from=eaff7bc0-90cf-8add-5e63-087ec86d3dfb term=2 tally=1 31:19.002 [INFO] TestAgent.server.raft: election won: tally=1 31:19.002 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29959 [Leader]" 31:19.003 [INFO] TestAgent.server: cluster leadership acquired 31:19.003 [INFO] TestAgent.server: New leader elected: payload=test-server 31:19.026 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29959 31:19.056 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.128 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.128 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.128 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.128 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.128 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.128 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-server 31:19.128 [INFO] TestAgent.server: member joined, marking health alive: member=test-server 31:19.167 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.170 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:54074 31:19.170 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-client 127.0.0.1 31:19.170 [INFO] TestAgent.server: member joined, marking health alive: member=test-client 31:19.208 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc2 method=Health.ServiceNodes 31:19.265 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:19.280 [INFO] TestAgent: Synced node info 31:19.280 [DEBUG] TestAgent: Node info in sync 31:19.748 [INFO] TestAgent: Requesting shutdown 31:19.748 [INFO] TestAgent.server: shutting down server 31:19.748 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:19.748 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:19.748 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:19.748 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:19.748 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:19.748 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:19.748 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:19.749 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:19.749 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:19.749 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:19.757 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:19.757Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:19.757Z [INFO] agent.router.manager: shutting down 31:19.757 [INFO] TestAgent: consul server down 31:19.757 [INFO] TestAgent: shutdown complete 31:19.757 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29954 network=tcp 31:19.757 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29954 network=udp 31:19.757 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29955 network=tcp 31:20.257 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.257 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NonExistentDC_RPC (1.52s) === CONT TestBinarySearch === RUN TestBinarySearch/binarySearch_12 === RUN TestBinarySearch/binarySearch_256 === RUN TestBinarySearch/binarySearch_512 === RUN TestBinarySearch/binarySearch_8192 === RUN TestBinarySearch/binarySearch_65535 [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestBinarySearch/binarySearch_12#01 === RUN TestBinarySearch/binarySearch_256#01 === RUN TestBinarySearch/binarySearch_512#01 === RUN TestBinarySearch/binarySearch_8192#01 === RUN TestBinarySearch/binarySearch_65535#01 --- PASS: TestBinarySearch (0.13s) --- PASS: TestBinarySearch/binarySearch_12 (0.01s) --- PASS: TestBinarySearch/binarySearch_256 (0.01s) --- PASS: TestBinarySearch/binarySearch_512 (0.01s) --- PASS: TestBinarySearch/binarySearch_8192 (0.01s) --- PASS: TestBinarySearch/binarySearch_65535 (0.02s) --- PASS: TestBinarySearch/binarySearch_12#01 (0.01s) --- PASS: TestBinarySearch/binarySearch_256#01 (0.01s) --- PASS: TestBinarySearch/binarySearch_512#01 (0.01s) --- PASS: TestBinarySearch/binarySearch_8192#01 (0.01s) --- PASS: TestBinarySearch/binarySearch_65535#01 (0.02s) === CONT TestDNS_ServiceLookup_Randomize === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=false#01 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:19.601Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.635Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.720 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:48ba11c9-96e2-5ef4-dd78-25238dcc9c8b Address:127.0.0.1:30029}]" 31:19.721 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-48ba11c9-96e2-5ef4-dd78-25238dcc9c8b.dc1 127.0.0.1 31:19.721 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-48ba11c9-96e2-5ef4-dd78-25238dcc9c8b 127.0.0.1 2021-10-05T16:31:19.721Z [INFO] agent.router: Initializing LAN area manager 31:19.721 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30024 network=udp 31:19.721 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30029 [Follower]" leader= 31:19.722 [INFO] TestAgent.server: Adding LAN server: server="Node-48ba11c9-96e2-5ef4-dd78-25238dcc9c8b (Addr: tcp/127.0.0.1:30029) (DC: dc1)" 31:19.722 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-48ba11c9-96e2-5ef4-dd78-25238dcc9c8b.dc1 area=wan 31:19.722 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30024 network=tcp 31:19.723 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30025 network=tcp 31:19.723 [INFO] TestAgent: started state syncer 31:19.723 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30051 network=tcp 31:19.788 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.788 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30029 [Candidate]" term=2 31:19.825 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.825 [DEBUG] TestAgent.server.raft: vote granted: from=48ba11c9-96e2-5ef4-dd78-25238dcc9c8b term=2 tally=1 31:19.825 [INFO] TestAgent.server.raft: election won: tally=1 31:19.825 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30029 [Leader]" 31:19.830 [INFO] TestAgent.server: cluster leadership acquired 31:19.830 [INFO] TestAgent.server: New leader elected: payload=Node-48ba11c9-96e2-5ef4-dd78-25238dcc9c8b 31:19.862 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30029 31:19.901 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.000 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.000 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.000 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.000 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.000 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.000 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-48ba11c9-96e2-5ef4-dd78-25238dcc9c8b 31:20.000 [INFO] TestAgent.server: member joined, marking health alive: member=Node-48ba11c9-96e2-5ef4-dd78-25238dcc9c8b 31:20.001 [INFO] TestAgent: Synced node info 31:20.040 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.098 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=1.008966ms client=127.0.0.1:42137 client_network=udp 31:20.098 [DEBUG] TestAgent.dns: request served from client: name=dblb.service.consul. type=SRV class=IN latency=292.002µs client=127.0.0.1:53503 client_network=udp 31:20.099 [DEBUG] TestAgent.dns: request served from client: name=dk.service.consul. type=SRV class=IN latency=118.506µs client=127.0.0.1:43107 client_network=udp 31:20.099 [DEBUG] TestAgent.dns: request served from client: name=api.service.consul. type=SRV class=IN latency=184.829µs client=127.0.0.1:50487 client_network=udp 31:20.100 [INFO] TestAgent: Requesting shutdown 31:20.100 [INFO] TestAgent.server: shutting down server 31:20.100 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.100 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.100 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.100 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.100 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.100 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.100 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.100 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.100 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.100 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.107 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.107Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.107Z [INFO] agent.router.manager: shutting down 31:20.107 [INFO] TestAgent: consul server down 31:20.107 [INFO] TestAgent: shutdown complete 31:20.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30024 network=tcp 31:20.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30024 network=udp 31:20.107 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30025 network=tcp 31:20.608 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.608 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_TTL (1.04s) --- PASS: TestDNS_ServiceLookup_TTL/db.service.consul. (0.01s) --- PASS: TestDNS_ServiceLookup_TTL/dblb.service.consul. (0.00s) --- PASS: TestDNS_ServiceLookup_TTL/dk.service.consul. (0.00s) --- PASS: TestDNS_ServiceLookup_TTL/api.service.consul. (0.00s) === CONT TestDNS_ServiceLookup_OnlyPassing 2021-10-05T16:31:19.823Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.836Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.903 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:569a3bbe-9ed5-1568-83b7-783bd6d2bf02 Address:127.0.0.1:30057}]" 31:19.904 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30057 [Follower]" leader= 31:19.905 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-569a3bbe-9ed5-1568-83b7-783bd6d2bf02.dc1 127.0.0.1 31:19.905 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-569a3bbe-9ed5-1568-83b7-783bd6d2bf02 127.0.0.1 2021-10-05T16:31:19.905Z [INFO] agent.router: Initializing LAN area manager 31:19.905 [INFO] TestAgent.server: Adding LAN server: server="Node-569a3bbe-9ed5-1568-83b7-783bd6d2bf02 (Addr: tcp/127.0.0.1:30057) (DC: dc1)" 31:19.905 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-569a3bbe-9ed5-1568-83b7-783bd6d2bf02.dc1 area=wan 31:19.906 [DEBUG] TestAgent.dns: recursor enabled 31:19.906 [DEBUG] TestAgent.dns: recursor enabled 31:19.906 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30052 network=udp 31:19.906 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30052 network=tcp 31:19.925 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30053 network=tcp 31:19.925 [INFO] TestAgent: started state syncer 31:19.926 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30037 network=tcp 31:19.959 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.959 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30057 [Candidate]" term=2 31:19.972 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.972 [DEBUG] TestAgent.server.raft: vote granted: from=569a3bbe-9ed5-1568-83b7-783bd6d2bf02 term=2 tally=1 31:19.972 [INFO] TestAgent.server.raft: election won: tally=1 31:19.972 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30057 [Leader]" 31:19.975 [INFO] TestAgent.server: cluster leadership acquired 31:19.975 [INFO] TestAgent.server: New leader elected: payload=Node-569a3bbe-9ed5-1568-83b7-783bd6d2bf02 31:19.985 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30057 31:20.017 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.080 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.080 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.080 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.080 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.080 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.080 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-569a3bbe-9ed5-1568-83b7-783bd6d2bf02 31:20.080 [INFO] TestAgent.server: member joined, marking health alive: member=Node-569a3bbe-9ed5-1568-83b7-783bd6d2bf02 31:20.108 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.144 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=ANY class=IN latency=91.707µs client=127.0.0.1:40600 client_network=udp 31:20.157 [DEBUG] TestAgent.dns: request served from client: name=bar.node.consul. type=ANY class=IN latency=162.401µs client=127.0.0.1:38417 client_network=udp 31:20.168 [DEBUG] TestAgent.dns: cname recurse RTT for name: name=www.google.com. rtt=235.134µs 31:20.169 [DEBUG] TestAgent.dns: request served from client: name=google.node.consul. type=ANY class=IN latency=691.994µs client=127.0.0.1:53657 client_network=udp 31:20.169 [INFO] TestAgent: Requesting shutdown 31:20.169 [INFO] TestAgent.server: shutting down server 31:20.169 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.169 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.169 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.169 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.169 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.169 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.170 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.170 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:20.170 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.170 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.170 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.182 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.191Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.191Z [INFO] agent.router.manager: shutting down 31:20.191 [INFO] TestAgent: consul server down 31:20.191 [INFO] TestAgent: shutdown complete 31:20.191 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30052 network=tcp 31:20.191 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30052 network=udp 31:20.191 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30053 network=tcp 31:20.692 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.692 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_TTL (0.90s) === CONT TestDNS_ServiceLookup_OnlyFailing 2021-10-05T16:31:19.870Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.899Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.995 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d2d91ece-dc82-79c7-e9ca-ddc559509516 Address:127.0.0.1:30043}]" 31:19.995 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30043 [Follower]" leader= 31:19.996 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d2d91ece-dc82-79c7-e9ca-ddc559509516.dc1 127.0.0.1 31:19.996 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d2d91ece-dc82-79c7-e9ca-ddc559509516 127.0.0.1 2021-10-05T16:31:19.996Z [INFO] agent.router: Initializing LAN area manager 31:19.997 [DEBUG] TestAgent.dns: recursor enabled 31:19.997 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30038 network=udp 31:19.997 [INFO] TestAgent.server: Adding LAN server: server="Node-d2d91ece-dc82-79c7-e9ca-ddc559509516 (Addr: tcp/127.0.0.1:30043) (DC: dc1)" 31:19.997 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d2d91ece-dc82-79c7-e9ca-ddc559509516.dc1 area=wan 31:19.997 [DEBUG] TestAgent.dns: recursor enabled 31:19.997 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30038 network=tcp 31:19.997 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30039 network=tcp 31:19.997 [INFO] TestAgent: started state syncer 31:19.998 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30058 network=tcp 31:20.040 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.040 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30043 [Candidate]" term=2 31:20.069 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.069 [DEBUG] TestAgent.server.raft: vote granted: from=d2d91ece-dc82-79c7-e9ca-ddc559509516 term=2 tally=1 31:20.069 [INFO] TestAgent.server.raft: election won: tally=1 31:20.069 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30043 [Leader]" 31:20.071 [INFO] TestAgent.server: cluster leadership acquired 31:20.071 [INFO] TestAgent.server: New leader elected: payload=Node-d2d91ece-dc82-79c7-e9ca-ddc559509516 31:20.084 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30043 31:20.112 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.138 [INFO] TestAgent: Synced node info 31:20.182 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.182 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.182 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.182 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.182 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.182 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d2d91ece-dc82-79c7-e9ca-ddc559509516 31:20.182 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d2d91ece-dc82-79c7-e9ca-ddc559509516 31:20.206 [DEBUG] TestAgent.dns: cname recurse RTT for name: name=www.google.com. rtt=208.24µs 31:20.206 [DEBUG] TestAgent.dns: request served from client: name=search.service.consul. type=ANY class=IN latency=519.582µs client=127.0.0.1:35927 client_network=udp 31:20.207 [DEBUG] TestAgent.dns: cname recurse RTT for name: name=www.google.com. rtt=277.25µs 31:20.207 [DEBUG] TestAgent.dns: request served from client: name=d11d1265-44a7-fe34-91f8-26a38d42e4c0.query.consul. type=ANY class=IN latency=514.316µs client=127.0.0.1:38917 client_network=udp 31:20.207 [INFO] TestAgent: Requesting shutdown 31:20.207 [INFO] TestAgent.server: shutting down server 31:20.207 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.207 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.207 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.208 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.208 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.208 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.208 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.208 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.218 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:20.224 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.224 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:31:20.226Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.226Z [INFO] agent.router.manager: shutting down 31:20.226 [INFO] TestAgent: consul server down 31:20.226 [INFO] TestAgent: shutdown complete 31:20.226 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30038 network=tcp 31:20.227 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30038 network=udp 31:20.227 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30039 network=tcp 31:20.727 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.727 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_ServiceAddress_CNAME (0.88s) === CONT TestDNS_ServiceLookup_FilterCritical 2021-10-05T16:31:19.564Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.595Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.664 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dab25e5e-d952-7287-5cdd-12bd119a05b6 Address:127.0.0.1:30036}]" 31:19.665 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dab25e5e-d952-7287-5cdd-12bd119a05b6.dc1 127.0.0.1 31:19.665 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dab25e5e-d952-7287-5cdd-12bd119a05b6 127.0.0.1 2021-10-05T16:31:19.665Z [INFO] agent.router: Initializing LAN area manager 31:19.668 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30036 [Follower]" leader= 31:19.669 [INFO] TestAgent.server: Adding LAN server: server="Node-dab25e5e-d952-7287-5cdd-12bd119a05b6 (Addr: tcp/127.0.0.1:30036) (DC: dc1)" 31:19.669 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dab25e5e-d952-7287-5cdd-12bd119a05b6.dc1 area=wan 31:19.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30031 network=udp 31:19.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30031 network=tcp 31:19.676 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30032 network=tcp 31:19.676 [INFO] TestAgent: started state syncer 31:19.676 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30023 network=tcp 31:19.732 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.732 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30036 [Candidate]" term=2 31:19.776 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.776 [DEBUG] TestAgent.server.raft: vote granted: from=dab25e5e-d952-7287-5cdd-12bd119a05b6 term=2 tally=1 31:19.776 [INFO] TestAgent.server.raft: election won: tally=1 31:19.776 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30036 [Leader]" 31:19.782 [INFO] TestAgent.server: cluster leadership acquired 31:19.783 [INFO] TestAgent.server: New leader elected: payload=Node-dab25e5e-d952-7287-5cdd-12bd119a05b6 31:19.795 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30036 31:19.810 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.864 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.864 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.864 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.864 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.864 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.864 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dab25e5e-d952-7287-5cdd-12bd119a05b6 31:19.864 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dab25e5e-d952-7287-5cdd-12bd119a05b6 31:19.902 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.071 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.080 [INFO] TestAgent: Synced node info 31:20.239 [DEBUG] TestAgent.dns: request served from client: name=db.query.consul. type=SRV class=IN latency=508.851µs client=127.0.0.1:47294 client_network=udp 31:20.240 [DEBUG] TestAgent.dns: request served from client: name=db-ttl.query.consul. type=SRV class=IN latency=142.613µs client=127.0.0.1:39129 client_network=udp 31:20.241 [DEBUG] TestAgent.dns: request served from client: name=dblb.query.consul. type=SRV class=IN latency=156.957µs client=127.0.0.1:46507 client_network=udp 31:20.241 [DEBUG] TestAgent.dns: request served from client: name=dblb-ttl.query.consul. type=SRV class=IN latency=131.16µs client=127.0.0.1:48113 client_network=udp 31:20.241 [DEBUG] TestAgent.dns: request served from client: name=dk.query.consul. type=SRV class=IN latency=83.894µs client=127.0.0.1:40490 client_network=udp 31:20.242 [DEBUG] TestAgent.dns: request served from client: name=dk-ttl.query.consul. type=SRV class=IN latency=129.365µs client=127.0.0.1:44179 client_network=udp 31:20.242 [DEBUG] TestAgent.dns: request served from client: name=api.query.consul. type=SRV class=IN latency=96.38µs client=127.0.0.1:42786 client_network=udp 31:20.242 [DEBUG] TestAgent.dns: request served from client: name=api-ttl.query.consul. type=SRV class=IN latency=90.479µs client=127.0.0.1:42082 client_network=udp 31:20.242 [INFO] TestAgent: Requesting shutdown 31:20.242 [INFO] TestAgent.server: shutting down server 31:20.242 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.242 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.242 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.242 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.242 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.243 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.243 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.243 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.243 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.243 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.253 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.260Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.260Z [INFO] agent.router.manager: shutting down 31:20.260 [INFO] TestAgent: consul server down 31:20.260 [INFO] TestAgent: shutdown complete 31:20.260 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30031 network=tcp 31:20.260 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30031 network=udp 31:20.260 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30032 network=tcp 31:20.761 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.761 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_PreparedQuery_TTL (1.21s) --- PASS: TestDNS_PreparedQuery_TTL/db.query.consul. (0.00s) --- PASS: TestDNS_PreparedQuery_TTL/db-ttl.query.consul. (0.00s) --- PASS: TestDNS_PreparedQuery_TTL/dblb.query.consul. (0.00s) --- PASS: TestDNS_PreparedQuery_TTL/dblb-ttl.query.consul. (0.00s) --- PASS: TestDNS_PreparedQuery_TTL/dk.query.consul. (0.00s) --- PASS: TestDNS_PreparedQuery_TTL/dk-ttl.query.consul. (0.00s) --- PASS: TestDNS_PreparedQuery_TTL/api.query.consul. (0.00s) --- PASS: TestDNS_PreparedQuery_TTL/api-ttl.query.consul. (0.00s) === CONT TestDNS_RecursorTimeout [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:19.931Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:19.931Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.979Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:19.979Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.058 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bcdf67dc-1767-71ed-4364-299e1843df77 Address:127.0.0.1:30064}]" 31:20.058 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30064 [Follower]" leader= 31:20.059 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bcdf67dc-1767-71ed-4364-299e1843df77.dc1 127.0.0.1 31:20.059 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bcdf67dc-1767-71ed-4364-299e1843df77 127.0.0.1 2021-10-05T16:31:20.059Z [INFO] agent.router: Initializing LAN area manager 31:20.060 [INFO] TestAgent.server: Adding LAN server: server="Node-bcdf67dc-1767-71ed-4364-299e1843df77 (Addr: tcp/127.0.0.1:30064) (DC: dc1)" 31:20.060 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30059 network=udp 31:20.060 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bcdf67dc-1767-71ed-4364-299e1843df77.dc1 area=wan 31:20.060 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30059 network=tcp 31:20.061 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30060 network=tcp 31:20.061 [INFO] TestAgent: started state syncer 31:20.062 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30044 network=tcp 31:20.104 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.104 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30064 [Candidate]" term=2 31:20.110 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:20.144 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.144 [DEBUG] TestAgent.server.raft: vote granted: from=bcdf67dc-1767-71ed-4364-299e1843df77 term=2 tally=1 31:20.144 [INFO] TestAgent.server.raft: election won: tally=1 31:20.144 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30064 [Leader]" 31:20.145 [INFO] TestAgent.server: cluster leadership acquired 31:20.145 [INFO] TestAgent.server: New leader elected: payload=Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.164 [INFO] TestAgent.server: initializing acls 31:20.173 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:20.173 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.190 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:20.210 [INFO] TestAgent.server: initializing acls 31:20.210 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.232 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.232 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:20.232 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:20.232 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:20.232 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.233 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-bcdf67dc-1767-71ed-4364-299e1843df77.dc1 31:20.233 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-bcdf67dc-1767-71ed-4364-299e1843df77.dc1 area=wan 31:20.233 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.233 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.233 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-bcdf67dc-1767-71ed-4364-299e1843df77.dc1 31:20.234 [INFO] TestAgent.server: Updating LAN server: server="Node-bcdf67dc-1767-71ed-4364-299e1843df77 (Addr: tcp/127.0.0.1:30064) (DC: dc1)" 31:20.234 [INFO] TestAgent.server: Updating LAN server: server="Node-bcdf67dc-1767-71ed-4364-299e1843df77 (Addr: tcp/127.0.0.1:30064) (DC: dc1)" 31:20.234 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-bcdf67dc-1767-71ed-4364-299e1843df77.dc1 area=wan 31:20.271 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.308 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.308 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.308 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.308 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.308 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.308 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.308 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.324 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.324 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.331 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-bcdf67dc-1767-71ed-4364-299e1843df77 31:20.334 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.348 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=foo 31:20.348 [DEBUG] TestAgent.dns: request served from client: name=foo.service.consul. type=A class=IN latency=261.527µs client=127.0.0.1:40927 client_network=udp 31:20.348 [INFO] TestAgent: Requesting shutdown 31:20.348 [INFO] TestAgent.server: shutting down server 31:20.348 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:20.348 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:20.348 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.348 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.348 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.348 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.348 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.348 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.348 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.348 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:20.348 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:20.348 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:20.348 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.348 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.348 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.364 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.374Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.374Z [INFO] agent.router.manager: shutting down 31:20.375 [INFO] TestAgent: consul server down 31:20.375 [INFO] TestAgent: shutdown complete 31:20.375 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30059 network=tcp 31:20.375 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30059 network=udp 31:20.375 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30060 network=tcp 31:20.875 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.875 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_FilterACL (1.97s) --- PASS: TestDNS_ServiceLookup_FilterACL/ACLToken_==_root (0.98s) --- PASS: TestDNS_ServiceLookup_FilterACL/ACLToken_==_anonymous (0.99s) === CONT TestDNS_Recurse_Truncation 2021-10-05T16:31:19.979Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.007Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.109 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:335be017-af5d-921f-e6ff-9e1ffaf82854 Address:127.0.0.1:30050}]" 31:20.109 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30050 [Follower]" leader= 31:20.109 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-335be017-af5d-921f-e6ff-9e1ffaf82854.dc1 127.0.0.1 31:20.110 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-335be017-af5d-921f-e6ff-9e1ffaf82854 127.0.0.1 2021-10-05T16:31:20.110Z [INFO] agent.router: Initializing LAN area manager 31:20.110 [INFO] TestAgent.server: Adding LAN server: server="Node-335be017-af5d-921f-e6ff-9e1ffaf82854 (Addr: tcp/127.0.0.1:30050) (DC: dc1)" 31:20.110 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-335be017-af5d-921f-e6ff-9e1ffaf82854.dc1 area=wan 31:20.110 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30045 network=udp 31:20.110 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30045 network=tcp 31:20.111 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30046 network=tcp 31:20.111 [INFO] TestAgent: started state syncer 31:20.111 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30065 network=tcp 31:20.178 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.178 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30050 [Candidate]" term=2 31:20.211 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.211 [DEBUG] TestAgent.server.raft: vote granted: from=335be017-af5d-921f-e6ff-9e1ffaf82854 term=2 tally=1 31:20.211 [INFO] TestAgent.server.raft: election won: tally=1 31:20.211 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30050 [Leader]" 31:20.212 [INFO] TestAgent.server: cluster leadership acquired 31:20.212 [INFO] TestAgent.server: New leader elected: payload=Node-335be017-af5d-921f-e6ff-9e1ffaf82854 31:20.233 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30050 31:20.266 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.321 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.321 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.321 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.321 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.321 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.321 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-335be017-af5d-921f-e6ff-9e1ffaf82854 31:20.321 [INFO] TestAgent.server: member joined, marking health alive: member=Node-335be017-af5d-921f-e6ff-9e1ffaf82854 31:20.353 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.423 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.433 [INFO] TestAgent: Synced node info 31:20.444 [DEBUG] TestAgent.dns: request served from client: name=_this-is-a-very-very-very-very-very-long-name-for-a-service._primary.service.consul. type=SRV class=IN latency=253.469µs client=127.0.0.1:36942 client_network=udp 31:20.448 [DEBUG] TestAgent.dns: request served from client: name=this-is-a-very-very-very-very-very-long-name-for-a-service.query.consul. type=SRV class=IN latency=229.921µs client=127.0.0.1:43071 client_network=udp 31:20.448 [INFO] TestAgent: Requesting shutdown 31:20.448 [INFO] TestAgent.server: shutting down server 31:20.448 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.448 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.448 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.448 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.448 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.448 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.448 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.448 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.448 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.448 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.464 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.476Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.476Z [INFO] agent.router.manager: shutting down 31:20.476 [INFO] TestAgent: consul server down 31:20.476 [INFO] TestAgent: shutdown complete 31:20.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30045 network=tcp 31:20.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30045 network=udp 31:20.476 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30046 network=tcp 31:20.978 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.978 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_LargeResponses (1.08s) === CONT TestDNS_Recurse [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:20.624Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.641Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.681 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2570725a-7bab-6d94-13ee-4abc6d098f0b Address:127.0.0.1:30106}]" 31:20.681 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30106 [Follower]" leader= 31:20.682 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2570725a-7bab-6d94-13ee-4abc6d098f0b.dc1 127.0.0.1 31:20.682 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2570725a-7bab-6d94-13ee-4abc6d098f0b 127.0.0.1 2021-10-05T16:31:20.682Z [INFO] agent.router: Initializing LAN area manager 31:20.683 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30101 network=udp 31:20.683 [INFO] TestAgent.server: Adding LAN server: server="Node-2570725a-7bab-6d94-13ee-4abc6d098f0b (Addr: tcp/127.0.0.1:30106) (DC: dc1)" 31:20.683 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30101 network=tcp 31:20.683 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2570725a-7bab-6d94-13ee-4abc6d098f0b.dc1 area=wan 31:20.683 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30102 network=tcp 31:20.684 [INFO] TestAgent: started state syncer 31:20.684 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30093 network=tcp 31:20.732 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.732 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30106 [Candidate]" term=2 31:20.751 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.751 [DEBUG] TestAgent.server.raft: vote granted: from=2570725a-7bab-6d94-13ee-4abc6d098f0b term=2 tally=1 31:20.751 [INFO] TestAgent.server.raft: election won: tally=1 31:20.751 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30106 [Leader]" 31:20.752 [INFO] TestAgent.server: cluster leadership acquired 31:20.752 [INFO] TestAgent.server: New leader elected: payload=Node-2570725a-7bab-6d94-13ee-4abc6d098f0b 31:20.764 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30106 31:20.788 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.826 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.826 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.826 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.826 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.826 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.826 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2570725a-7bab-6d94-13ee-4abc6d098f0b 31:20.826 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2570725a-7bab-6d94-13ee-4abc6d098f0b 31:20.854 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.916 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=ANY class=IN latency=269.435µs client=127.0.0.1:50794 client_network=udp 31:20.917 [DEBUG] TestAgent.dns: request served from client: name=783e7916-97bb-478f-138e-b38ca08201ed.query.consul. type=ANY class=IN latency=160.544µs client=127.0.0.1:54379 client_network=udp 31:20.917 [INFO] TestAgent: Requesting shutdown 31:20.917 [INFO] TestAgent.server: shutting down server 31:20.917 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.917 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.917 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:20.927 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.935Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.935Z [INFO] agent.router.manager: shutting down 31:20.935 [INFO] TestAgent: consul server down 31:20.935 [INFO] TestAgent: shutdown complete 31:20.935 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30101 network=tcp 31:20.935 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30101 network=udp 31:20.935 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30102 network=tcp 31:21.436 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.436 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_OnlyPassing (0.83s) === CONT TestDNS_ServiceLookup_Dedup_SRV 2021-10-05T16:31:19.996Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:19.996Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.023Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:20.023Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.136 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a15c335e-06b1-34d9-3c62-e536e966914f Address:127.0.0.1:30071}]" 31:20.137 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a15c335e-06b1-34d9-3c62-e536e966914f.dc2 127.0.0.1 31:20.137 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a15c335e-06b1-34d9-3c62-e536e966914f 127.0.0.1 2021-10-05T16:31:20.137Z [INFO] agent.router: Initializing LAN area manager 31:20.138 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30071 [Follower]" leader= 31:20.138 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30066 network=udp 31:20.138 [INFO] TestAgent.server: Adding LAN server: server="Node-a15c335e-06b1-34d9-3c62-e536e966914f (Addr: tcp/127.0.0.1:30071) (DC: dc2)" 31:20.138 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a15c335e-06b1-34d9-3c62-e536e966914f.dc2 area=wan 31:20.138 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30066 network=tcp 31:20.138 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30067 network=tcp 31:20.139 [INFO] TestAgent: started state syncer 31:20.139 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30072 network=tcp 31:20.188 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:20.198 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.199 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30071 [Candidate]" term=2 31:20.235 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.235 [DEBUG] TestAgent.server.raft: vote granted: from=a15c335e-06b1-34d9-3c62-e536e966914f term=2 tally=1 31:20.235 [INFO] TestAgent.server.raft: election won: tally=1 31:20.235 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30071 [Leader]" 31:20.236 [INFO] TestAgent.server: cluster leadership acquired 31:20.236 [INFO] TestAgent.server: New leader elected: payload=Node-a15c335e-06b1-34d9-3c62-e536e966914f 31:20.256 [INFO] TestAgent.server: initializing acls 31:20.268 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:20.283 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.283 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:20.283 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:20.284 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a15c335e-06b1-34d9-3c62-e536e966914f 31:20.284 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a15c335e-06b1-34d9-3c62-e536e966914f.dc2 31:20.284 [INFO] TestAgent.server: Updating LAN server: server="Node-a15c335e-06b1-34d9-3c62-e536e966914f (Addr: tcp/127.0.0.1:30071) (DC: dc2)" 31:20.284 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a15c335e-06b1-34d9-3c62-e536e966914f.dc2 area=wan 31:20.320 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.358 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.358 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.358 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.358 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.358 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.358 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a15c335e-06b1-34d9-3c62-e536e966914f 31:20.358 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a15c335e-06b1-34d9-3c62-e536e966914f 31:20.374 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a15c335e-06b1-34d9-3c62-e536e966914f 31:20.383 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:30014] 31:20.384 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:30014 31:20.386 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cf57440c-b456-9911-f589-d018e667a573.dc1 127.0.0.1 31:20.386 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:20.386 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cf57440c-b456-9911-f589-d018e667a573.dc1 area=wan 31:20.405 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.415 [INFO] TestAgent: Requesting shutdown 31:20.415 [INFO] TestAgent.server: shutting down server 31:20.415 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.415 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.415 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.415 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:20.415 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:20.415 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.415 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.415 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.415 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.415 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:20.415 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.415 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.415 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.415 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:20.415 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:20.420 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.429Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.429Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.429Z [INFO] agent.router.manager: shutting down 31:20.429 [INFO] TestAgent: consul server down 31:20.429 [INFO] TestAgent: shutdown complete 31:20.429 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30066 network=tcp 31:20.429 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30066 network=udp 31:20.429 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30067 network=tcp 31:20.929 [INFO] TestAgent: Waiting for endpoints to shut down 31:20.929 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:19.404Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:19.404Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:19.423Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:19.423Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:19.513 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cf57440c-b456-9911-f589-d018e667a573 Address:127.0.0.1:30015}]" 31:19.514 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cf57440c-b456-9911-f589-d018e667a573.dc1 127.0.0.1 31:19.514 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cf57440c-b456-9911-f589-d018e667a573 127.0.0.1 2021-10-05T16:31:19.514Z [INFO] agent.router: Initializing LAN area manager 31:19.514 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30010 network=udp 31:19.514 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30015 [Follower]" leader= 31:19.515 [INFO] TestAgent.server: Adding LAN server: server="Node-cf57440c-b456-9911-f589-d018e667a573 (Addr: tcp/127.0.0.1:30015) (DC: dc1)" 31:19.515 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cf57440c-b456-9911-f589-d018e667a573.dc1 area=wan 31:19.515 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30010 network=tcp 31:19.516 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30011 network=tcp 31:19.516 [INFO] TestAgent: started state syncer 31:19.516 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30030 network=tcp 31:19.568 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:19.584 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:19.584 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30015 [Candidate]" term=2 31:19.615 [DEBUG] TestAgent.server.raft: votes: needed=1 31:19.615 [DEBUG] TestAgent.server.raft: vote granted: from=cf57440c-b456-9911-f589-d018e667a573 term=2 tally=1 31:19.615 [INFO] TestAgent.server.raft: election won: tally=1 31:19.615 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30015 [Leader]" 31:19.616 [INFO] TestAgent.server: cluster leadership acquired 31:19.616 [INFO] TestAgent.server: New leader elected: payload=Node-cf57440c-b456-9911-f589-d018e667a573 31:19.644 [INFO] TestAgent.server: initializing acls 31:19.661 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:19.668 [INFO] TestAgent.server: initializing acls 31:19.680 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:19.680 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:19.680 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:19.681 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-cf57440c-b456-9911-f589-d018e667a573 31:19.681 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-cf57440c-b456-9911-f589-d018e667a573.dc1 31:19.681 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-cf57440c-b456-9911-f589-d018e667a573.dc1 area=wan 31:19.681 [INFO] TestAgent.server: Updating LAN server: server="Node-cf57440c-b456-9911-f589-d018e667a573 (Addr: tcp/127.0.0.1:30015) (DC: dc1)" 31:19.696 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:19.696 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:19.696 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-cf57440c-b456-9911-f589-d018e667a573 31:19.696 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-cf57440c-b456-9911-f589-d018e667a573.dc1 31:19.696 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-cf57440c-b456-9911-f589-d018e667a573.dc1 area=wan 31:19.696 [INFO] TestAgent.server: Updating LAN server: server="Node-cf57440c-b456-9911-f589-d018e667a573 (Addr: tcp/127.0.0.1:30015) (DC: dc1)" 31:19.702 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:19.750 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:19.750 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:19.750 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:19.750 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:19.750 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:19.750 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cf57440c-b456-9911-f589-d018e667a573 31:19.750 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cf57440c-b456-9911-f589-d018e667a573 31:19.782 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cf57440c-b456-9911-f589-d018e667a573 31:19.782 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cf57440c-b456-9911-f589-d018e667a573 31:19.786 [INFO] TestAgent.server: federation state anti-entropy synced 31:19.804 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:19.821 [INFO] TestAgent: Synced node info 31:19.821 [DEBUG] TestAgent: Node info in sync 31:20.384 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:56474 31:20.385 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a15c335e-06b1-34d9-3c62-e536e966914f.dc2 127.0.0.1 31:20.385 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a15c335e-06b1-34d9-3c62-e536e966914f.dc2 area=wan 31:20.414 [DEBUG] TestAgent.dns: request served from client: name=my-query.query.consul. type=SRV class=IN latency=1.173061ms client=127.0.0.1:46449 client_network=udp 31:20.688 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.688 [DEBUG] TestAgent: Node info in sync 31:20.929 [INFO] TestAgent: Requesting shutdown 31:20.929 [INFO] TestAgent.server: shutting down server 31:20.929 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:20.929 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.929 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.929 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.929 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.929 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:20.929 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.930 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.930 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.930 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:20.930 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.930 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.930 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.930 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:20.935 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.939Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.939Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.939Z [INFO] agent.router.manager: shutting down 31:20.939 [INFO] TestAgent: consul server down 31:20.939 [INFO] TestAgent: shutdown complete 31:20.939 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30010 network=tcp 31:20.939 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30010 network=udp 31:20.939 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30011 network=tcp 31:21.440 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.440 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_PreparedQuery_Failover (2.06s) === CONT TestDNS_ServiceLookup_Dedup [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:20.741Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.754Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.837 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:30d3d4ed-e198-876b-1eef-73f3e1b216dc Address:127.0.0.1:30113}]" 31:20.838 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-30d3d4ed-e198-876b-1eef-73f3e1b216dc.dc1 127.0.0.1 31:20.838 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-30d3d4ed-e198-876b-1eef-73f3e1b216dc 127.0.0.1 2021-10-05T16:31:20.838Z [INFO] agent.router: Initializing LAN area manager 31:20.839 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30108 network=udp 31:20.839 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30113 [Follower]" leader= 31:20.839 [INFO] TestAgent.server: Adding LAN server: server="Node-30d3d4ed-e198-876b-1eef-73f3e1b216dc (Addr: tcp/127.0.0.1:30113) (DC: dc1)" 31:20.839 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-30d3d4ed-e198-876b-1eef-73f3e1b216dc.dc1 area=wan 31:20.839 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30108 network=tcp 31:20.840 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30109 network=tcp 31:20.840 [INFO] TestAgent: started state syncer 31:20.840 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30114 network=tcp 31:20.901 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.901 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30113 [Candidate]" term=2 31:20.929 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.929 [DEBUG] TestAgent.server.raft: vote granted: from=30d3d4ed-e198-876b-1eef-73f3e1b216dc term=2 tally=1 31:20.929 [INFO] TestAgent.server.raft: election won: tally=1 31:20.929 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30113 [Leader]" 31:20.930 [INFO] TestAgent.server: cluster leadership acquired 31:20.930 [INFO] TestAgent.server: New leader elected: payload=Node-30d3d4ed-e198-876b-1eef-73f3e1b216dc 31:20.942 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30113 31:20.967 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.048 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.048 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.048 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.048 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.048 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.048 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-30d3d4ed-e198-876b-1eef-73f3e1b216dc 31:21.048 [INFO] TestAgent.server: member joined, marking health alive: member=Node-30d3d4ed-e198-876b-1eef-73f3e1b216dc 31:21.082 [INFO] TestAgent: Synced node info 31:21.082 [DEBUG] TestAgent: Node info in sync 31:21.090 [INFO] TestAgent.server: federation state anti-entropy synced 31:21.159 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=ANY class=IN latency=182.422µs client=127.0.0.1:53681 client_network=udp 31:21.159 [DEBUG] TestAgent.dns: request served from client: name=4883eabc-7ad3-49f7-fbeb-9d9e64892dfa.query.consul. type=ANY class=IN latency=153.95µs client=127.0.0.1:42192 client_network=udp 31:21.159 [INFO] TestAgent: Requesting shutdown 31:21.159 [INFO] TestAgent.server: shutting down server 31:21.159 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:21.159 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:21.159 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:21.159 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:21.159 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:21.159 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:21.159 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:21.159 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:21.159 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:21.159 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:21.172 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:21.184Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:21.184Z [INFO] agent.router.manager: shutting down 31:21.184 [INFO] TestAgent: consul server down 31:21.184 [INFO] TestAgent: shutdown complete 31:21.184 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30108 network=tcp 31:21.184 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30108 network=udp 31:21.184 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30109 network=tcp 31:21.685 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.685 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_FilterCritical (0.96s) === CONT TestDNS_ServiceLookup_TagPeriod 2021-10-05T16:31:20.707Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.721Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.772 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2e78d696-93d1-eeab-e674-0678bb85487c Address:127.0.0.1:30099}]" 31:20.772 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30099 [Follower]" leader= 31:20.773 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2e78d696-93d1-eeab-e674-0678bb85487c.dc1 127.0.0.1 31:20.773 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2e78d696-93d1-eeab-e674-0678bb85487c 127.0.0.1 2021-10-05T16:31:20.773Z [INFO] agent.router: Initializing LAN area manager 31:20.773 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30094 network=udp 31:20.774 [INFO] TestAgent.server: Adding LAN server: server="Node-2e78d696-93d1-eeab-e674-0678bb85487c (Addr: tcp/127.0.0.1:30099) (DC: dc1)" 31:20.774 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2e78d696-93d1-eeab-e674-0678bb85487c.dc1 area=wan 31:20.774 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30094 network=tcp 31:20.774 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30095 network=tcp 31:20.774 [INFO] TestAgent: started state syncer 31:20.774 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30107 network=tcp 31:20.848 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.848 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30099 [Candidate]" term=2 31:20.890 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.890 [DEBUG] TestAgent.server.raft: vote granted: from=2e78d696-93d1-eeab-e674-0678bb85487c term=2 tally=1 31:20.890 [INFO] TestAgent.server.raft: election won: tally=1 31:20.890 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30099 [Leader]" 31:20.891 [INFO] TestAgent.server: cluster leadership acquired 31:20.891 [INFO] TestAgent.server: New leader elected: payload=Node-2e78d696-93d1-eeab-e674-0678bb85487c 31:20.911 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30099 31:20.968 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.056 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.056 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.056 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.056 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.056 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.056 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2e78d696-93d1-eeab-e674-0678bb85487c 31:21.056 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2e78d696-93d1-eeab-e674-0678bb85487c 31:21.100 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:21.108 [INFO] TestAgent.server: federation state anti-entropy synced 31:21.131 [INFO] TestAgent: Synced node info 31:21.131 [DEBUG] TestAgent: Node info in sync 31:21.168 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=ANY class=IN latency=164.518µs client=127.0.0.1:52273 client_network=udp 31:21.168 [DEBUG] TestAgent.dns: request served from client: name=d371bf74-dbed-922c-e7a4-bfa659779db3.query.consul. type=ANY class=IN latency=155.257µs client=127.0.0.1:33021 client_network=udp 31:21.168 [INFO] TestAgent: Requesting shutdown 31:21.168 [INFO] TestAgent.server: shutting down server 31:21.168 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:21.168 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:21.168 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:21.168 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:21.168 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:21.168 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:21.168 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:21.168 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:21.168 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:21.168 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:21.180 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:21.192Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:21.192Z [INFO] agent.router.manager: shutting down 31:21.192 [INFO] TestAgent: consul server down 31:21.192 [INFO] TestAgent: shutdown complete 31:21.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30094 network=tcp 31:21.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30094 network=udp 31:21.192 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30095 network=tcp 31:21.693 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.693 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_OnlyFailing (1.00s) === CONT TestDNS_ServiceLookup_PreparedQueryNamePeriod [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:20.892Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.907Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.972 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:19bb75f0-20cf-30d6-bb73-61c9cc13ee6a Address:127.0.0.1:30127}]" 31:20.972 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30127 [Follower]" leader= 31:20.972 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-19bb75f0-20cf-30d6-bb73-61c9cc13ee6a.dc1 127.0.0.1 31:20.973 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-19bb75f0-20cf-30d6-bb73-61c9cc13ee6a 127.0.0.1 2021-10-05T16:31:20.973Z [INFO] agent.router: Initializing LAN area manager 31:20.973 [DEBUG] TestAgent.dns: recursor enabled 31:20.973 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30122 network=udp 31:20.973 [INFO] TestAgent.server: Adding LAN server: server="Node-19bb75f0-20cf-30d6-bb73-61c9cc13ee6a (Addr: tcp/127.0.0.1:30127) (DC: dc1)" 31:20.973 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-19bb75f0-20cf-30d6-bb73-61c9cc13ee6a.dc1 area=wan 31:20.973 [DEBUG] TestAgent.dns: recursor enabled 31:20.973 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30122 network=tcp 31:20.974 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30123 network=tcp 31:20.974 [INFO] TestAgent: started state syncer 31:20.974 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30128 network=tcp 31:21.015 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:21.015 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30127 [Candidate]" term=2 31:21.072 [DEBUG] TestAgent.server.raft: votes: needed=1 31:21.072 [DEBUG] TestAgent.server.raft: vote granted: from=19bb75f0-20cf-30d6-bb73-61c9cc13ee6a term=2 tally=1 31:21.072 [INFO] TestAgent.server.raft: election won: tally=1 31:21.072 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30127 [Leader]" 31:21.079 [INFO] TestAgent.server: cluster leadership acquired 31:21.079 [INFO] TestAgent.server: New leader elected: payload=Node-19bb75f0-20cf-30d6-bb73-61c9cc13ee6a 31:21.105 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30127 31:21.142 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.204 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.204 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.204 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.204 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.204 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.204 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-19bb75f0-20cf-30d6-bb73-61c9cc13ee6a 31:21.204 [INFO] TestAgent.server: member joined, marking health alive: member=Node-19bb75f0-20cf-30d6-bb73-61c9cc13ee6a 31:21.230 [INFO] TestAgent.server: federation state anti-entropy synced 31:21.242 [INFO] TestAgent: Synced node info 31:21.411 [DEBUG] TestAgent.dns: recurse succeeded for question: question="{apple.com. 255 1}" rtt=101.278µs recursor=127.0.0.1:45890 31:21.411 [DEBUG] TestAgent.dns: request served from client: question="{apple.com. 255 1}" network=udp latency=212.951µs client=127.0.0.1:39350 client_network=udp 31:21.411 [INFO] TestAgent: Requesting shutdown 31:21.411 [INFO] TestAgent.server: shutting down server 31:21.411 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:21.411 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:21.411 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:21.411 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:21.411 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:21.411 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:21.412 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:21.412 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:21.412 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:21.412 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:21.418 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:21.428Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:21.428Z [INFO] agent.router.manager: shutting down 31:21.428 [INFO] TestAgent: consul server down 31:21.428 [INFO] TestAgent: shutdown complete 31:21.428 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30122 network=tcp 31:21.428 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30122 network=udp 31:21.428 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30123 network=tcp 31:21.932 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.932 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_Recurse_Truncation (1.06s) === CONT TestDNS_PreparedQueryNearIP 2021-10-05T16:31:20.998Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:21.012Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:21.116 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f Address:127.0.0.1:30134}]" 31:21.117 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f.dc1 127.0.0.1 31:21.117 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f 127.0.0.1 2021-10-05T16:31:21.117Z [INFO] agent.router: Initializing LAN area manager 31:21.117 [DEBUG] TestAgent.dns: recursor enabled 31:21.117 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30129 network=udp 31:21.117 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30134 [Follower]" leader= 31:21.118 [INFO] TestAgent.server: Adding LAN server: server="Node-8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f (Addr: tcp/127.0.0.1:30134) (DC: dc1)" 31:21.118 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f.dc1 area=wan 31:21.118 [DEBUG] TestAgent.dns: recursor enabled 31:21.118 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30129 network=tcp 31:21.119 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30130 network=tcp 31:21.119 [INFO] TestAgent: started state syncer 31:21.119 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30142 network=tcp 31:21.184 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:21.184 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30134 [Candidate]" term=2 31:21.228 [DEBUG] TestAgent.server.raft: votes: needed=1 31:21.228 [DEBUG] TestAgent.server.raft: vote granted: from=8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f term=2 tally=1 31:21.228 [INFO] TestAgent.server.raft: election won: tally=1 31:21.228 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30134 [Leader]" 31:21.229 [INFO] TestAgent.server: cluster leadership acquired 31:21.229 [INFO] TestAgent.server: New leader elected: payload=Node-8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f 31:21.240 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30134 31:21.271 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.336 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.336 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.336 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.336 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.336 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.336 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f 31:21.336 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8d0c015c-d3ef-2fbd-f11a-fda41f5fb24f 31:21.368 [INFO] TestAgent.server: federation state anti-entropy synced 31:21.477 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:21.484 [INFO] TestAgent: Synced node info 31:21.484 [DEBUG] TestAgent: Node info in sync 31:21.493 [DEBUG] TestAgent.dns: recurse succeeded for question: question="{apple.com. 255 1}" rtt=1.178502ms recursor=127.0.0.1:56456 31:21.493 [DEBUG] TestAgent.dns: request served from client: question="{apple.com. 255 1}" network=udp latency=1.34386ms client=127.0.0.1:46774 client_network=udp 31:21.493 [INFO] TestAgent: Requesting shutdown 31:21.493 [INFO] TestAgent.server: shutting down server 31:21.493 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:21.493 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:21.493 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:21.493 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:21.493 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:21.493 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:21.493 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:21.493 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:21.493 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:21.493 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:21.501 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:21.508Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:21.508Z [INFO] agent.router.manager: shutting down 31:21.508 [INFO] TestAgent: consul server down 31:21.508 [INFO] TestAgent: shutdown complete 31:21.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30129 network=tcp 31:21.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30129 network=udp 31:21.508 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30130 network=tcp 31:22.012 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.012 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_Recurse (1.03s) === CONT TestDNS_PreparedQueryNearIPEDNS [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:20.041Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.084Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.142 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb Address:127.0.0.1:30078}]" 31:20.142 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30078 [Follower]" leader= 31:20.143 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb.dc1 127.0.0.1 31:20.144 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb 127.0.0.1 2021-10-05T16:31:20.144Z [INFO] agent.router: Initializing LAN area manager 31:20.144 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30073 network=udp 31:20.144 [INFO] TestAgent.server: Adding LAN server: server="Node-5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb (Addr: tcp/127.0.0.1:30078) (DC: dc1)" 31:20.145 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb.dc1 area=wan 31:20.145 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30073 network=tcp 31:20.145 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30074 network=tcp 31:20.145 [INFO] TestAgent: started state syncer 31:20.145 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30086 network=tcp 31:20.180 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.180 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30078 [Candidate]" term=2 31:20.213 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.213 [DEBUG] TestAgent.server.raft: vote granted: from=5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb term=2 tally=1 31:20.213 [INFO] TestAgent.server.raft: election won: tally=1 31:20.213 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30078 [Leader]" 31:20.214 [INFO] TestAgent.server: cluster leadership acquired 31:20.214 [INFO] TestAgent.server: New leader elected: payload=Node-5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb 31:20.237 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30078 31:20.272 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.330 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.330 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.330 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.330 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.330 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.331 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb 31:20.331 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5a0dc513-8a3a-f4cc-fdf0-b126cc0408bb 31:20.367 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.529 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.536 [INFO] TestAgent: Synced node info 31:20.536 [DEBUG] TestAgent: Node info in sync 31:21.737 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.443149ms client=127.0.0.1:48639 client_network=udp 31:21.746 [DEBUG] TestAgent.dns: request served from client: name=30adc3a5-45f1-47c4-068a-98d5c2c08872.query.consul. type=ANY class=IN latency=1.299808ms client=127.0.0.1:54926 client_network=udp 31:21.746 [INFO] TestAgent: Requesting shutdown 31:21.746 [INFO] TestAgent.server: shutting down server 31:21.746 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:21.746 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:21.746 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:21.746 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:21.746 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:21.746 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:21.746 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:21.746 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:21.746 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:21.746 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:21.757 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:21.759Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:21.759Z [INFO] agent.router.manager: shutting down 31:21.759 [INFO] TestAgent: consul server down 31:21.759 [INFO] TestAgent: shutdown complete 31:21.759 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30073 network=tcp 31:21.759 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30073 network=udp 31:21.759 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30074 network=tcp 31:22.259 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.259 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_Truncate (2.24s) === CONT TestDNS_CaseInsensitiveServiceLookup Added 3 service nodes [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:21.464Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:21.479Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:21.558 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:65140595-d1a6-a3be-abdb-02c3db443646 Address:127.0.0.1:30141}]" 31:21.559 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-65140595-d1a6-a3be-abdb-02c3db443646.dc1 127.0.0.1 31:21.560 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-65140595-d1a6-a3be-abdb-02c3db443646 127.0.0.1 2021-10-05T16:31:21.560Z [INFO] agent.router: Initializing LAN area manager 31:21.560 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30141 [Follower]" leader= 31:21.560 [INFO] TestAgent.server: Adding LAN server: server="Node-65140595-d1a6-a3be-abdb-02c3db443646 (Addr: tcp/127.0.0.1:30141) (DC: dc1)" 31:21.560 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-65140595-d1a6-a3be-abdb-02c3db443646.dc1 area=wan 31:21.560 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30136 network=udp 31:21.560 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30136 network=tcp 31:21.561 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30137 network=tcp 31:21.561 [INFO] TestAgent: started state syncer 31:21.561 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30149 network=tcp 31:21.616 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:21.616 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30141 [Candidate]" term=2 31:21.633 [DEBUG] TestAgent.server.raft: votes: needed=1 31:21.633 [DEBUG] TestAgent.server.raft: vote granted: from=65140595-d1a6-a3be-abdb-02c3db443646 term=2 tally=1 31:21.633 [INFO] TestAgent.server.raft: election won: tally=1 31:21.633 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30141 [Leader]" 31:21.634 [INFO] TestAgent.server: cluster leadership acquired 31:21.634 [INFO] TestAgent.server: New leader elected: payload=Node-65140595-d1a6-a3be-abdb-02c3db443646 31:21.649 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30141 31:21.680 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.734 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.734 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.734 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.734 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.734 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.734 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-65140595-d1a6-a3be-abdb-02c3db443646 31:21.734 [INFO] TestAgent.server: member joined, marking health alive: member=Node-65140595-d1a6-a3be-abdb-02c3db443646 31:21.747 [INFO] TestAgent.server: federation state anti-entropy synced 31:21.881 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=ANY class=IN latency=212.298µs client=127.0.0.1:54761 client_network=udp 31:21.881 [DEBUG] TestAgent.dns: request served from client: name=ac2cba8a-cdb1-7ae7-7c60-0637de8a0079.query.consul. type=ANY class=IN latency=122.248µs client=127.0.0.1:45664 client_network=udp 31:21.881 [INFO] TestAgent: Requesting shutdown 31:21.881 [INFO] TestAgent.server: shutting down server 31:21.881 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:21.881 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:21.881 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:21.881 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:21.881 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:21.881 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:21.881 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:21.881 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:21.881 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:21.881 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:21.881 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:21.887 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:21.888Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:21.888Z [INFO] agent.router.manager: shutting down 31:21.888 [INFO] TestAgent: consul server down 31:21.888 [INFO] TestAgent: shutdown complete 31:21.888 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30136 network=tcp 31:21.888 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30136 network=udp 31:21.888 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30137 network=tcp 31:22.393 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.393 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_Dedup (0.95s) === CONT TestDNS_Lookup_TaggedIPAddresses Added 3 service nodes 2021-10-05T16:31:21.478Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:21.523Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:21.596 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c6c3d66a-2686-d9fb-b6ef-31b3a7200b60 Address:127.0.0.1:30148}]" 31:21.597 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c6c3d66a-2686-d9fb-b6ef-31b3a7200b60.dc1 127.0.0.1 31:21.597 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c6c3d66a-2686-d9fb-b6ef-31b3a7200b60 127.0.0.1 2021-10-05T16:31:21.597Z [INFO] agent.router: Initializing LAN area manager 31:21.598 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30143 network=udp 31:21.598 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30148 [Follower]" leader= 31:21.598 [INFO] TestAgent.server: Adding LAN server: server="Node-c6c3d66a-2686-d9fb-b6ef-31b3a7200b60 (Addr: tcp/127.0.0.1:30148) (DC: dc1)" 31:21.598 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c6c3d66a-2686-d9fb-b6ef-31b3a7200b60.dc1 area=wan 31:21.598 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30143 network=tcp 31:21.599 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30144 network=tcp 31:21.599 [INFO] TestAgent: started state syncer 31:21.599 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30135 network=tcp 31:21.668 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:21.668 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30148 [Candidate]" term=2 31:21.712 [DEBUG] TestAgent.server.raft: votes: needed=1 31:21.712 [DEBUG] TestAgent.server.raft: vote granted: from=c6c3d66a-2686-d9fb-b6ef-31b3a7200b60 term=2 tally=1 31:21.712 [INFO] TestAgent.server.raft: election won: tally=1 31:21.712 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30148 [Leader]" 31:21.713 [INFO] TestAgent.server: cluster leadership acquired 31:21.713 [INFO] TestAgent.server: New leader elected: payload=Node-c6c3d66a-2686-d9fb-b6ef-31b3a7200b60 31:21.748 [INFO] TestAgent: Synced node info 31:21.748 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30148 31:21.809 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.831 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.831 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.831 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.831 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.831 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.831 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c6c3d66a-2686-d9fb-b6ef-31b3a7200b60 31:21.831 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c6c3d66a-2686-d9fb-b6ef-31b3a7200b60 31:21.866 [INFO] TestAgent.server: federation state anti-entropy synced 31:21.912 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=254.585µs client=127.0.0.1:58524 client_network=udp 31:21.916 [DEBUG] TestAgent.dns: request served from client: name=5fea16fc-900a-b57c-aede-5229c5a3c9ad.query.consul. type=SRV class=IN latency=212.006µs client=127.0.0.1:46799 client_network=udp 31:21.916 [INFO] TestAgent: Requesting shutdown 31:21.916 [INFO] TestAgent.server: shutting down server 31:21.916 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:21.916 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:21.916 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:21.916 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:21.916 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:21.916 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:21.916 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:21.916 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:21.916 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:21.916 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:21.924 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:21.926Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:21.926Z [INFO] agent.router.manager: shutting down 31:21.926 [INFO] TestAgent: consul server down 31:21.926 [INFO] TestAgent: shutdown complete 31:21.926 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30143 network=tcp 31:21.926 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30143 network=udp 31:21.927 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30144 network=tcp 31:22.427 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.427 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_Dedup_SRV (0.99s) === CONT TestDNS_ServiceLookup_WanTranslation [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:21.699Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:21.717Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:21.769 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:02ba6f28-c223-ad5f-330f-0bc5311a7098 Address:127.0.0.1:30155}]" 31:21.770 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-02ba6f28-c223-ad5f-330f-0bc5311a7098.dc1 127.0.0.1 31:21.770 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-02ba6f28-c223-ad5f-330f-0bc5311a7098 127.0.0.1 2021-10-05T16:31:21.770Z [INFO] agent.router: Initializing LAN area manager 31:21.771 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30150 network=udp 31:21.771 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30155 [Follower]" leader= 31:21.771 [INFO] TestAgent.server: Adding LAN server: server="Node-02ba6f28-c223-ad5f-330f-0bc5311a7098 (Addr: tcp/127.0.0.1:30155) (DC: dc1)" 31:21.771 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-02ba6f28-c223-ad5f-330f-0bc5311a7098.dc1 area=wan 31:21.771 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30150 network=tcp 31:21.772 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30151 network=tcp 31:21.772 [INFO] TestAgent: started state syncer 31:21.772 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30156 network=tcp 31:21.817 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:21.817 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30155 [Candidate]" term=2 31:21.841 [DEBUG] TestAgent.server.raft: votes: needed=1 31:21.841 [DEBUG] TestAgent.server.raft: vote granted: from=02ba6f28-c223-ad5f-330f-0bc5311a7098 term=2 tally=1 31:21.841 [INFO] TestAgent.server.raft: election won: tally=1 31:21.841 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30155 [Leader]" 31:21.841 [INFO] TestAgent.server: cluster leadership acquired 31:21.841 [INFO] TestAgent.server: New leader elected: payload=Node-02ba6f28-c223-ad5f-330f-0bc5311a7098 31:21.868 [INFO] TestAgent: Synced node info 31:21.868 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30155 31:21.908 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.952 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.952 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.952 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.952 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.952 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.952 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-02ba6f28-c223-ad5f-330f-0bc5311a7098 31:21.952 [INFO] TestAgent.server: member joined, marking health alive: member=Node-02ba6f28-c223-ad5f-330f-0bc5311a7098 31:21.984 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.026 [DEBUG] TestAgent.dns: request served from client: name=v1.primary2.db.service.consul. type=SRV class=IN latency=154.04µs client=127.0.0.1:57186 client_network=udp 31:22.038 [DEBUG] TestAgent.dns: request served from client: name=v1.primary.db.service.consul. type=SRV class=IN latency=188.811µs client=127.0.0.1:34163 client_network=udp 31:22.038 [INFO] TestAgent: Requesting shutdown 31:22.038 [INFO] TestAgent.server: shutting down server 31:22.038 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.038 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.038 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.038 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.038 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.038 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.038 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.038 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.038 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.038 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.043 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:22.047 [INFO] TestAgent: consul server down 31:22.047 [INFO] TestAgent: shutdown complete 31:22.047 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30150 network=tcp 2021-10-05T16:31:22.047Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.047Z [INFO] agent.router.manager: shutting down 31:22.092 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30150 network=udp 31:22.092 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30151 network=tcp 31:22.592 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.592 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_TagPeriod (0.91s) === CONT TestDNS_ServiceLookup_ServiceAddressIPV6 2021-10-05T16:31:20.406Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.425Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.482 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d23f3158-d156-fcae-e549-a6dac38bf3b6 Address:127.0.0.1:30085}]" 31:20.483 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d23f3158-d156-fcae-e549-a6dac38bf3b6.dc1 127.0.0.1 31:20.483 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d23f3158-d156-fcae-e549-a6dac38bf3b6 127.0.0.1 2021-10-05T16:31:20.483Z [INFO] agent.router: Initializing LAN area manager 31:20.484 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30085 [Follower]" leader= 31:20.484 [INFO] TestAgent.server: Adding LAN server: server="Node-d23f3158-d156-fcae-e549-a6dac38bf3b6 (Addr: tcp/127.0.0.1:30085) (DC: dc1)" 31:20.484 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d23f3158-d156-fcae-e549-a6dac38bf3b6.dc1 area=wan 31:20.484 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30080 network=tcp 31:20.485 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30080 network=udp 31:20.486 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30081 network=tcp 31:20.486 [INFO] TestAgent: started state syncer 31:20.486 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30100 network=tcp 31:20.551 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.551 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30085 [Candidate]" term=2 31:20.576 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.576 [DEBUG] TestAgent.server.raft: vote granted: from=d23f3158-d156-fcae-e549-a6dac38bf3b6 term=2 tally=1 31:20.576 [INFO] TestAgent.server.raft: election won: tally=1 31:20.576 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30085 [Leader]" 31:20.577 [INFO] TestAgent.server: cluster leadership acquired 31:20.577 [INFO] TestAgent.server: New leader elected: payload=Node-d23f3158-d156-fcae-e549-a6dac38bf3b6 31:20.588 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30085 31:20.644 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.686 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.686 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.686 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.686 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.686 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.686 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d23f3158-d156-fcae-e549-a6dac38bf3b6 31:20.686 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d23f3158-d156-fcae-e549-a6dac38bf3b6 31:20.706 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.880 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.908 [INFO] TestAgent: Synced node info 31:21.957 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.462271ms client=127.0.0.1:37037 client_network=udp 31:21.959 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.059313ms client=127.0.0.1:50661 client_network=udp 31:21.972 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=13.341911ms client=127.0.0.1:51743 client_network=udp 31:21.977 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.344694ms client=127.0.0.1:46252 client_network=udp 31:21.979 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.202896ms client=127.0.0.1:51374 client_network=udp 31:21.981 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.107572ms client=127.0.0.1:48273 client_network=udp 31:21.985 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.50288ms client=127.0.0.1:33057 client_network=udp 31:22.005 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=16.075438ms client=127.0.0.1:47590 client_network=udp 31:22.007 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=2.00887ms client=127.0.0.1:59495 client_network=udp 31:22.009 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=ANY class=IN latency=1.876095ms client=127.0.0.1:46903 client_network=udp 31:22.019 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=9.73692ms client=127.0.0.1:46111 client_network=udp 31:22.024 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=3.197748ms client=127.0.0.1:60827 client_network=udp 31:22.030 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=3.358319ms client=127.0.0.1:46017 client_network=udp 31:22.087 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=48.744012ms client=127.0.0.1:58217 client_network=udp 31:22.090 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=1.502389ms client=127.0.0.1:60946 client_network=udp 31:22.095 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=4.653404ms client=127.0.0.1:59503 client_network=udp 31:22.098 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=1.195475ms client=127.0.0.1:36550 client_network=udp 31:22.102 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=2.127663ms client=127.0.0.1:59499 client_network=udp 31:22.106 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=1.547409ms client=127.0.0.1:43827 client_network=udp 31:22.113 [DEBUG] TestAgent.dns: request served from client: name=0519b739-1d1a-4cae-588f-ed95d09e9e69.query.consul. type=ANY class=IN latency=1.542701ms client=127.0.0.1:35556 client_network=udp 31:22.121 [INFO] TestAgent: Requesting shutdown 31:22.122 [INFO] TestAgent.server: shutting down server 31:22.122 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.122 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.122 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.122 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.122 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.122 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.122 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.122 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.122 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.122 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.128 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:22.129Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.129Z [INFO] agent.router.manager: shutting down 31:22.129 [INFO] TestAgent: consul server down 31:22.129 [INFO] TestAgent: shutdown complete 31:22.129 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30080 network=tcp 31:22.129 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30080 network=udp 31:22.129 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30081 network=tcp 31:22.630 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.630 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_Randomize (2.25s) === CONT TestDNS_ServiceLookup_ServiceAddress_SRV 2021-10-05T16:31:21.724Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:21.751Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:21.839 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d1675e8e-fe8a-a92f-1bcc-d6feb8e96451 Address:127.0.0.1:30162}]" 31:21.840 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d1675e8e-fe8a-a92f-1bcc-d6feb8e96451.dc1 127.0.0.1 31:21.840 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30162 [Follower]" leader= 31:21.841 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d1675e8e-fe8a-a92f-1bcc-d6feb8e96451 127.0.0.1 2021-10-05T16:31:21.841Z [INFO] agent.router: Initializing LAN area manager 31:21.841 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d1675e8e-fe8a-a92f-1bcc-d6feb8e96451.dc1 area=wan 31:21.841 [INFO] TestAgent.server: Adding LAN server: server="Node-d1675e8e-fe8a-a92f-1bcc-d6feb8e96451 (Addr: tcp/127.0.0.1:30162) (DC: dc1)" 31:21.841 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30157 network=udp 31:21.841 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30157 network=tcp 31:21.842 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30158 network=tcp 31:21.842 [INFO] TestAgent: started state syncer 31:21.842 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30163 network=tcp 31:21.895 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:21.895 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30162 [Candidate]" term=2 31:21.914 [DEBUG] TestAgent.server.raft: votes: needed=1 31:21.914 [DEBUG] TestAgent.server.raft: vote granted: from=d1675e8e-fe8a-a92f-1bcc-d6feb8e96451 term=2 tally=1 31:21.914 [INFO] TestAgent.server.raft: election won: tally=1 31:21.914 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30162 [Leader]" 31:21.916 [INFO] TestAgent.server: cluster leadership acquired 31:21.916 [INFO] TestAgent.server: New leader elected: payload=Node-d1675e8e-fe8a-a92f-1bcc-d6feb8e96451 31:21.925 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30162 31:21.963 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.056 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.056 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.056 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.056 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.056 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.056 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d1675e8e-fe8a-a92f-1bcc-d6feb8e96451 31:22.056 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d1675e8e-fe8a-a92f-1bcc-d6feb8e96451 31:22.121 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.132 [DEBUG] TestAgent.dns: request served from client: name=some.query.we.like.query.consul. type=SRV class=IN latency=240.295µs client=127.0.0.1:57822 client_network=udp 31:22.132 [INFO] TestAgent: Requesting shutdown 31:22.132 [INFO] TestAgent.server: shutting down server 31:22.132 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.132 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.132 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.132 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.132 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.133 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.133 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.133 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:22.133 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.133 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.133 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.137 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:22.141Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.141Z [INFO] agent.router.manager: shutting down 31:22.141 [INFO] TestAgent: consul server down 31:22.141 [INFO] TestAgent: shutdown complete 31:22.141 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30157 network=tcp 31:22.141 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30157 network=udp 31:22.142 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30158 network=tcp 31:22.642 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.642 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_PreparedQueryNamePeriod (0.95s) === CONT TestDNS_ServiceLookup_ServiceAddress_A === RUN TestDNS_Lookup_TaggedIPAddresses/simple-ipv4 === RUN TestDNS_Lookup_TaggedIPAddresses/simple-ipv6 === RUN TestDNS_Lookup_TaggedIPAddresses/ipv4-with-tagged-ipv6 === RUN TestDNS_Lookup_TaggedIPAddresses/ipv6-with-tagged-ipv4 [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:21.967Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.033Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.116 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ca5599d1-4fe0-03aa-23e6-a2ea501a3944 Address:127.0.0.1:30169}]" 31:22.117 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ca5599d1-4fe0-03aa-23e6-a2ea501a3944.dc1 127.0.0.1 31:22.117 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ca5599d1-4fe0-03aa-23e6-a2ea501a3944 127.0.0.1 2021-10-05T16:31:22.117Z [INFO] agent.router: Initializing LAN area manager 31:22.118 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30164 network=udp 31:22.118 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30169 [Follower]" leader= 31:22.118 [INFO] TestAgent.server: Adding LAN server: server="Node-ca5599d1-4fe0-03aa-23e6-a2ea501a3944 (Addr: tcp/127.0.0.1:30169) (DC: dc1)" 31:22.118 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ca5599d1-4fe0-03aa-23e6-a2ea501a3944.dc1 area=wan 31:22.118 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30164 network=tcp 31:22.119 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30165 network=tcp 31:22.119 [INFO] TestAgent: started state syncer 31:22.119 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30170 network=tcp 31:22.179 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.180 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30169 [Candidate]" term=2 31:22.191 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.191 [DEBUG] TestAgent.server.raft: vote granted: from=ca5599d1-4fe0-03aa-23e6-a2ea501a3944 term=2 tally=1 31:22.191 [INFO] TestAgent.server.raft: election won: tally=1 31:22.191 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30169 [Leader]" 31:22.192 [INFO] TestAgent.server: cluster leadership acquired 31:22.192 [INFO] TestAgent.server: New leader elected: payload=Node-ca5599d1-4fe0-03aa-23e6-a2ea501a3944 31:22.198 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30169 31:22.210 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.248 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.248 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.248 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.248 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.248 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.248 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ca5599d1-4fe0-03aa-23e6-a2ea501a3944 31:22.248 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ca5599d1-4fe0-03aa-23e6-a2ea501a3944 31:22.256 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.303 [DEBUG] TestAgent.dns: request served from client: name=some.query.we.like.query.consul. type=A class=IN latency=185.99µs client=127.0.0.1:50686 client_network=udp 31:22.328 [DEBUG] TestAgent.dns: request served from client: name=some.query.we.like.query.consul. type=A class=IN latency=193.554µs client=127.0.0.1:39394 client_network=udp 31:22.328 [INFO] TestAgent: Requesting shutdown 31:22.328 [INFO] TestAgent.server: shutting down server 31:22.328 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.328 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.328 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.328 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.328 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.329 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.329 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.329 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:22.329 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.329 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.329 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.336 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:22.340Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.340Z [INFO] agent.router.manager: shutting down 31:22.340 [INFO] TestAgent: consul server down 31:22.340 [INFO] TestAgent: shutdown complete 31:22.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30164 network=tcp 31:22.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30164 network=udp 31:22.340 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30165 network=tcp 31:22.840 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.840 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_PreparedQueryNearIP (0.91s) === CONT TestDNS_ExternalServiceToConsulCNAMENestedLookup 2021-10-05T16:31:22.098Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.134Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.227 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e4be69e9-f138-bf3d-eb06-42ff2384e2e8 Address:127.0.0.1:30176}]" 31:22.228 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30176 [Follower]" leader= 31:22.228 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e4be69e9-f138-bf3d-eb06-42ff2384e2e8.dc1 127.0.0.1 31:22.229 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e4be69e9-f138-bf3d-eb06-42ff2384e2e8 127.0.0.1 2021-10-05T16:31:22.229Z [INFO] agent.router: Initializing LAN area manager 31:22.229 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30171 network=udp 31:22.229 [INFO] TestAgent.server: Adding LAN server: server="Node-e4be69e9-f138-bf3d-eb06-42ff2384e2e8 (Addr: tcp/127.0.0.1:30176) (DC: dc1)" 31:22.229 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e4be69e9-f138-bf3d-eb06-42ff2384e2e8.dc1 area=wan 31:22.230 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30171 network=tcp 31:22.230 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30172 network=tcp 31:22.230 [INFO] TestAgent: started state syncer 31:22.230 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30184 network=tcp 31:22.294 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.294 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30176 [Candidate]" term=2 31:22.310 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.310 [DEBUG] TestAgent.server.raft: vote granted: from=e4be69e9-f138-bf3d-eb06-42ff2384e2e8 term=2 tally=1 31:22.310 [INFO] TestAgent.server.raft: election won: tally=1 31:22.310 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30176 [Leader]" 31:22.310 [INFO] TestAgent.server: cluster leadership acquired 31:22.310 [INFO] TestAgent.server: New leader elected: payload=Node-e4be69e9-f138-bf3d-eb06-42ff2384e2e8 31:22.325 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30176 31:22.331 [INFO] TestAgent: Synced node info 31:22.331 [DEBUG] TestAgent: Node info in sync 31:22.349 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.448 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.448 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.448 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.448 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.448 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.448 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e4be69e9-f138-bf3d-eb06-42ff2384e2e8 31:22.448 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e4be69e9-f138-bf3d-eb06-42ff2384e2e8 31:22.468 [DEBUG] TestAgent.dns: request served from client: name=some.query.we.like.query.consul. type=A class=IN latency=270.998µs client=127.0.0.1:38880 client_network=udp 31:22.468 [INFO] TestAgent: Requesting shutdown 31:22.468 [INFO] TestAgent.server: shutting down server 31:22.468 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.468 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.468 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.468 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.468 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.468 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.468 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.468 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.484 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:22.489 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.489 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:31:22.492Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.492Z [INFO] agent.router.manager: shutting down 31:22.492 [INFO] TestAgent: consul server down 31:22.492 [INFO] TestAgent: shutdown complete 31:22.492 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30171 network=tcp 31:22.492 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30171 network=udp 31:22.492 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30172 network=tcp 31:22.992 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.992 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_PreparedQueryNearIPEDNS (0.98s) === CONT TestDNS_NSRecords_IPV6 [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_ServiceLookup_WanTranslation/service-wan-from-dc1 === RUN TestDNS_ServiceLookup_WanTranslation/node-addr-from-dc2 === RUN TestDNS_ServiceLookup_WanTranslation/node-wan-from-dc2 === RUN TestDNS_ServiceLookup_WanTranslation/service-addr-from-dc2 === RUN TestDNS_ServiceLookup_WanTranslation/service-wan-from-dc2 2021-10-05T16:31:22.418Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.436Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.484 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:298d7566-c63b-3907-ae95-2d0f72c9f13b Address:127.0.0.1:30183}]" 31:22.485 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30183 [Follower]" leader= 31:22.485 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-298d7566-c63b-3907-ae95-2d0f72c9f13b.dc1 127.0.0.1 31:22.486 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-298d7566-c63b-3907-ae95-2d0f72c9f13b 127.0.0.1 2021-10-05T16:31:22.486Z [INFO] agent.router: Initializing LAN area manager 31:22.486 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30178 network=udp 31:22.486 [INFO] TestAgent.server: Adding LAN server: server="Node-298d7566-c63b-3907-ae95-2d0f72c9f13b (Addr: tcp/127.0.0.1:30183) (DC: dc1)" 31:22.486 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-298d7566-c63b-3907-ae95-2d0f72c9f13b.dc1 area=wan 31:22.487 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30178 network=tcp 31:22.487 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30179 network=tcp 31:22.487 [INFO] TestAgent: started state syncer 31:22.487 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30198 network=tcp 31:22.548 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.548 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30183 [Candidate]" term=2 31:22.577 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.577 [DEBUG] TestAgent.server.raft: vote granted: from=298d7566-c63b-3907-ae95-2d0f72c9f13b term=2 tally=1 31:22.577 [INFO] TestAgent.server.raft: election won: tally=1 31:22.577 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30183 [Leader]" 31:22.580 [INFO] TestAgent.server: cluster leadership acquired 31:22.580 [INFO] TestAgent.server: New leader elected: payload=Node-298d7566-c63b-3907-ae95-2d0f72c9f13b 31:22.587 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30183 31:22.612 [INFO] TestAgent: Synced node info 31:22.617 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.631 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.631 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.631 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.631 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.631 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.631 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-298d7566-c63b-3907-ae95-2d0f72c9f13b 31:22.631 [INFO] TestAgent.server: member joined, marking health alive: member=Node-298d7566-c63b-3907-ae95-2d0f72c9f13b 31:22.667 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.677 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=A class=IN latency=280.84µs client=127.0.0.1:41987 client_network=udp 31:22.677 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=AAAA class=IN latency=215.595µs client=127.0.0.1:42992 client_network=udp 31:22.678 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=A class=IN latency=206.605µs client=127.0.0.1:46814 client_network=udp 31:22.678 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=AAAA class=IN latency=178.474µs client=127.0.0.1:58671 client_network=udp 31:22.679 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=A class=IN latency=77.497µs client=127.0.0.1:37297 client_network=udp 31:22.682 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=AAAA class=IN latency=67.693µs client=127.0.0.1:56904 client_network=udp 31:22.697 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=A class=IN latency=200.03µs client=127.0.0.1:57053 client_network=udp 31:22.697 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=AAAA class=IN latency=106.761µs client=127.0.0.1:48801 client_network=udp 31:22.698 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=A class=IN latency=192.192µs client=127.0.0.1:60111 client_network=udp 31:22.699 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=AAAA class=IN latency=79.916µs client=127.0.0.1:52435 client_network=udp 31:22.699 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=A class=IN latency=39.486µs client=127.0.0.1:42575 client_network=udp 31:22.699 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=AAAA class=IN latency=38.214µs client=127.0.0.1:36831 client_network=udp 31:22.708 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=A class=IN latency=173.466µs client=127.0.0.1:56956 client_network=udp 31:22.708 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=AAAA class=IN latency=97.844µs client=127.0.0.1:36301 client_network=udp 31:22.709 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=A class=IN latency=112.421µs client=127.0.0.1:35455 client_network=udp 31:22.709 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=AAAA class=IN latency=115.287µs client=127.0.0.1:60788 client_network=udp 31:22.709 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=A class=IN latency=64.524µs client=127.0.0.1:55489 client_network=udp 31:22.709 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=AAAA class=IN latency=50.882µs client=127.0.0.1:60065 client_network=udp 31:22.734 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=A class=IN latency=170.781µs client=127.0.0.1:40014 client_network=udp 31:22.734 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=AAAA class=IN latency=111.809µs client=127.0.0.1:46018 client_network=udp 31:22.734 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=A class=IN latency=142.561µs client=127.0.0.1:50795 client_network=udp 31:22.735 [DEBUG] TestAgent.dns: request served from client: name=44df1e6e-f2c8-b137-6960-93ef16d0d6a1.query.consul. type=AAAA class=IN latency=140.211µs client=127.0.0.1:35696 client_network=udp 31:22.735 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=A class=IN latency=65.38µs client=127.0.0.1:32897 client_network=udp 31:22.735 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=AAAA class=IN latency=52.571µs client=127.0.0.1:43614 client_network=udp 31:22.735 [INFO] TestAgent: Requesting shutdown 31:22.735 [INFO] TestAgent.server: shutting down server 31:22.735 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.735 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.736 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.736 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.736 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.736 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.736 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.736 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.744 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.744 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.748 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:22.755Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.755Z [INFO] agent.router.manager: shutting down 31:22.756 [INFO] TestAgent: consul server down 31:22.756 [INFO] TestAgent: shutdown complete 31:22.756 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30178 network=tcp 31:22.756 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30178 network=udp 31:22.756 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30179 network=tcp 31:23.256 [INFO] TestAgent: Waiting for endpoints to shut down 31:23.256 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_Lookup_TaggedIPAddresses (0.86s) --- PASS: TestDNS_Lookup_TaggedIPAddresses/simple-ipv4 (0.01s) --- PASS: TestDNS_Lookup_TaggedIPAddresses/simple-ipv6 (0.02s) --- PASS: TestDNS_Lookup_TaggedIPAddresses/ipv4-with-tagged-ipv6 (0.01s) --- PASS: TestDNS_Lookup_TaggedIPAddresses/ipv6-with-tagged-ipv4 (0.03s) === CONT TestDNS_NSRecords === RUN TestDNS_ServiceLookup_WanTranslation/node-addr-from-dc1 === RUN TestDNS_ServiceLookup_WanTranslation/node-wan-from-dc1 2021-10-05T16:31:22.277Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.293Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.360 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:76e26525-3419-fd26-3d07-c98becf0987c Address:127.0.0.1:30190}]" 31:22.360 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-76e26525-3419-fd26-3d07-c98becf0987c.dc1 127.0.0.1 31:22.361 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-76e26525-3419-fd26-3d07-c98becf0987c 127.0.0.1 2021-10-05T16:31:22.361Z [INFO] agent.router: Initializing LAN area manager 31:22.362 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30185 network=udp 31:22.362 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30190 [Follower]" leader= 31:22.362 [INFO] TestAgent.server: Adding LAN server: server="Node-76e26525-3419-fd26-3d07-c98becf0987c (Addr: tcp/127.0.0.1:30190) (DC: dc1)" 31:22.362 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-76e26525-3419-fd26-3d07-c98becf0987c.dc1 area=wan 31:22.362 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30185 network=tcp 31:22.363 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30186 network=tcp 31:22.363 [INFO] TestAgent: started state syncer 31:22.363 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30177 network=tcp 31:22.408 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.408 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30190 [Candidate]" term=2 31:22.456 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.456 [DEBUG] TestAgent.server.raft: vote granted: from=76e26525-3419-fd26-3d07-c98becf0987c term=2 tally=1 31:22.456 [INFO] TestAgent.server.raft: election won: tally=1 31:22.456 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30190 [Leader]" 31:22.458 [INFO] TestAgent.server: cluster leadership acquired 31:22.458 [INFO] TestAgent.server: New leader elected: payload=Node-76e26525-3419-fd26-3d07-c98becf0987c 31:22.488 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30190 31:22.488 [INFO] TestAgent: Synced node info 31:22.488 [DEBUG] TestAgent: Node info in sync 31:22.552 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.582 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.582 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.582 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.582 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.582 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.582 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-76e26525-3419-fd26-3d07-c98becf0987c 31:22.582 [INFO] TestAgent.server: member joined, marking health alive: member=Node-76e26525-3419-fd26-3d07-c98becf0987c 31:22.612 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.764 [DEBUG] TestAgent.dns: request served from client: name=primary.db.service.consul. type=SRV class=IN latency=377.611µs client=127.0.0.1:35909 client_network=udp 31:22.765 [DEBUG] TestAgent.dns: request served from client: name=pRIMARY.dB.service.consul. type=SRV class=IN latency=102.259µs client=127.0.0.1:59943 client_network=udp 31:22.765 [DEBUG] TestAgent.dns: request served from client: name=PRIMARY.dB.service.consul. type=SRV class=IN latency=93.548µs client=127.0.0.1:38254 client_network=udp 31:22.767 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=252.026µs client=127.0.0.1:34480 client_network=udp 31:22.767 [DEBUG] TestAgent.dns: request served from client: name=DB.service.consul. type=SRV class=IN latency=132.274µs client=127.0.0.1:46881 client_network=udp 31:22.767 [DEBUG] TestAgent.dns: request served from client: name=Db.service.consul. type=SRV class=IN latency=126.86µs client=127.0.0.1:32861 client_network=udp 31:22.768 [DEBUG] TestAgent.dns: request served from client: name=somequery.query.consul. type=SRV class=IN latency=156.502µs client=127.0.0.1:36774 client_network=udp 31:22.768 [DEBUG] TestAgent.dns: request served from client: name=SomeQuery.query.consul. type=SRV class=IN latency=141.884µs client=127.0.0.1:56637 client_network=udp 31:22.769 [DEBUG] TestAgent.dns: request served from client: name=SOMEQUERY.query.consul. type=SRV class=IN latency=110.789µs client=127.0.0.1:49908 client_network=udp 31:22.769 [INFO] TestAgent: Requesting shutdown 31:22.769 [INFO] TestAgent.server: shutting down server 31:22.769 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.769 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.769 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.769 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.769 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.769 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.769 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.769 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.769 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.769 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.776 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:22.781Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.781Z [INFO] agent.router.manager: shutting down 31:22.781 [INFO] TestAgent: consul server down 31:22.781 [INFO] TestAgent: shutdown complete 31:22.781 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30185 network=tcp 31:22.781 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30185 network=udp 31:22.781 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30186 network=tcp 31:23.282 [INFO] TestAgent: Waiting for endpoints to shut down 31:23.282 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_CaseInsensitiveServiceLookup (1.02s) === CONT TestDNS_ExternalServiceToConsulCNAMELookup [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_ServiceLookup_WanTranslation/service-addr-from-dc1 2021-10-05T16:31:22.647Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.669Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.724 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5bfea19e-cf45-5c33-c6df-d58c1a755eb9 Address:127.0.0.1:30208}]" 31:22.724 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30208 [Follower]" leader= 31:22.725 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5bfea19e-cf45-5c33-c6df-d58c1a755eb9.dc1 127.0.0.1 31:22.725 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5bfea19e-cf45-5c33-c6df-d58c1a755eb9 127.0.0.1 2021-10-05T16:31:22.725Z [INFO] agent.router: Initializing LAN area manager 31:22.725 [DEBUG] TestAgent.dns: recursor enabled 31:22.725 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30216 network=udp 31:22.732 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5bfea19e-cf45-5c33-c6df-d58c1a755eb9.dc1 area=wan 31:22.733 [INFO] TestAgent.server: Adding LAN server: server="Node-5bfea19e-cf45-5c33-c6df-d58c1a755eb9 (Addr: tcp/127.0.0.1:30208) (DC: dc1)" 31:22.735 [DEBUG] TestAgent.dns: recursor enabled 31:22.735 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30216 network=tcp 31:22.737 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30217 network=tcp 31:22.737 [INFO] TestAgent: started state syncer 31:22.737 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30209 network=tcp 31:22.790 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.790 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30208 [Candidate]" term=2 31:22.839 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.839 [DEBUG] TestAgent.server.raft: vote granted: from=5bfea19e-cf45-5c33-c6df-d58c1a755eb9 term=2 tally=1 31:22.839 [INFO] TestAgent.server.raft: election won: tally=1 31:22.839 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30208 [Leader]" 31:22.840 [INFO] TestAgent.server: cluster leadership acquired 31:22.840 [INFO] TestAgent.server: New leader elected: payload=Node-5bfea19e-cf45-5c33-c6df-d58c1a755eb9 31:22.848 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30208 31:22.888 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.924 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.924 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.924 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.924 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.924 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.924 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5bfea19e-cf45-5c33-c6df-d58c1a755eb9 31:22.924 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5bfea19e-cf45-5c33-c6df-d58c1a755eb9 31:22.951 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.989 [DEBUG] TestAgent.dns: cname recurse RTT for name: name=www.google.com. rtt=85.24µs 31:22.989 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=307.981µs client=127.0.0.1:39102 client_network=udp 31:22.989 [DEBUG] TestAgent.dns: cname recurse RTT for name: name=www.google.com. rtt=68.778µs 31:22.989 [DEBUG] TestAgent.dns: request served from client: name=2bf8e080-1071-1bf1-5861-1132016390a1.query.consul. type=SRV class=IN latency=252.352µs client=127.0.0.1:52474 client_network=udp 31:22.990 [INFO] TestAgent: Requesting shutdown 31:22.990 [INFO] TestAgent.server: shutting down server 31:22.990 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.990 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.990 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.990 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.990 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.990 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.990 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.990 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.990 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:22.990 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.990 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.000 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.008Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.008Z [INFO] agent.router.manager: shutting down 31:23.008 [INFO] TestAgent: consul server down 31:23.008 [INFO] TestAgent: shutdown complete 31:23.008 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30216 network=tcp 31:23.008 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30216 network=udp 31:23.008 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30217 network=tcp 31:23.516 [INFO] TestAgent: Waiting for endpoints to shut down 31:23.516 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_ServiceAddress_SRV (0.89s) === CONT TestDNS_InifiniteRecursion 2021-10-05T16:31:22.665Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.692Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.765 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:817cbd1e-1121-7220-88a1-e3e973c38014 Address:127.0.0.1:30229}]" 31:22.766 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-817cbd1e-1121-7220-88a1-e3e973c38014.dc1 127.0.0.1 31:22.767 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-817cbd1e-1121-7220-88a1-e3e973c38014 127.0.0.1 2021-10-05T16:31:22.767Z [INFO] agent.router: Initializing LAN area manager 31:22.767 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30210 network=udp 31:22.767 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30229 [Follower]" leader= 31:22.767 [INFO] TestAgent.server: Adding LAN server: server="Node-817cbd1e-1121-7220-88a1-e3e973c38014 (Addr: tcp/127.0.0.1:30229) (DC: dc1)" 31:22.767 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-817cbd1e-1121-7220-88a1-e3e973c38014.dc1 area=wan 31:22.768 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30210 network=tcp 31:22.772 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30211 network=tcp 31:22.772 [INFO] TestAgent: started state syncer 31:22.772 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30230 network=tcp 31:22.824 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.824 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30229 [Candidate]" term=2 31:22.852 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.852 [DEBUG] TestAgent.server.raft: vote granted: from=817cbd1e-1121-7220-88a1-e3e973c38014 term=2 tally=1 31:22.852 [INFO] TestAgent.server.raft: election won: tally=1 31:22.852 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30229 [Leader]" 31:22.853 [INFO] TestAgent.server: cluster leadership acquired 31:22.854 [INFO] TestAgent.server: New leader elected: payload=Node-817cbd1e-1121-7220-88a1-e3e973c38014 31:22.867 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30229 31:22.892 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.931 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.931 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.931 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.931 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.931 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.931 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-817cbd1e-1121-7220-88a1-e3e973c38014 31:22.931 [INFO] TestAgent.server: member joined, marking health alive: member=Node-817cbd1e-1121-7220-88a1-e3e973c38014 31:22.940 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.012 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=249.705µs client=127.0.0.1:56459 client_network=udp 31:23.017 [DEBUG] TestAgent.dns: request served from client: name=3e8c71a6-2469-b3cc-3fb9-4500e12ac47c.query.consul. type=SRV class=IN latency=297.373µs client=127.0.0.1:55437 client_network=udp 31:23.017 [INFO] TestAgent: Requesting shutdown 31:23.017 [INFO] TestAgent.server: shutting down server 31:23.017 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.017 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.017 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.017 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.017 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.017 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.017 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.017 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:23.017 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.018 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.018 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.024 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.033Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.033Z [INFO] agent.router.manager: shutting down 31:23.033 [INFO] TestAgent: consul server down 31:23.033 [INFO] TestAgent: shutdown complete 31:23.033 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30210 network=tcp 31:23.033 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30210 network=udp 31:23.033 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30211 network=tcp 31:23.533 [INFO] TestAgent: Waiting for endpoints to shut down 31:23.533 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_ServiceAddress_A (0.89s) === CONT TestDNS_ExternalServiceLookup 2021-10-05T16:31:22.612Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.629Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.704 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4dd6c9d2-5639-ea78-1886-39cc9f0429f3 Address:127.0.0.1:30197}]" 31:22.705 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4dd6c9d2-5639-ea78-1886-39cc9f0429f3.dc1 127.0.0.1 31:22.705 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4dd6c9d2-5639-ea78-1886-39cc9f0429f3 127.0.0.1 2021-10-05T16:31:22.705Z [INFO] agent.router: Initializing LAN area manager 31:22.705 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30192 network=udp 31:22.705 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30197 [Follower]" leader= 31:22.706 [INFO] TestAgent.server: Adding LAN server: server="Node-4dd6c9d2-5639-ea78-1886-39cc9f0429f3 (Addr: tcp/127.0.0.1:30197) (DC: dc1)" 31:22.706 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4dd6c9d2-5639-ea78-1886-39cc9f0429f3.dc1 area=wan 31:22.706 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30192 network=tcp 31:22.706 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30193 network=tcp 31:22.706 [INFO] TestAgent: started state syncer 31:22.707 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30214 network=tcp 31:22.743 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.743 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30197 [Candidate]" term=2 31:22.812 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.812 [DEBUG] TestAgent.server.raft: vote granted: from=4dd6c9d2-5639-ea78-1886-39cc9f0429f3 term=2 tally=1 31:22.812 [INFO] TestAgent.server.raft: election won: tally=1 31:22.812 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30197 [Leader]" 31:22.816 [INFO] TestAgent.server: cluster leadership acquired 31:22.816 [INFO] TestAgent.server: New leader elected: payload=Node-4dd6c9d2-5639-ea78-1886-39cc9f0429f3 31:22.852 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30197 31:22.896 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.950 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.950 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.950 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.950 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.950 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.950 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4dd6c9d2-5639-ea78-1886-39cc9f0429f3 31:22.950 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4dd6c9d2-5639-ea78-1886-39cc9f0429f3 31:22.963 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.032 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:23.036 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=231.585µs client=127.0.0.1:54461 client_network=udp 31:23.036 [DEBUG] TestAgent.dns: request served from client: name=5111c9bb-224f-a4dc-b41e-6f756795abee.query.consul. type=SRV class=IN latency=131.852µs client=127.0.0.1:42493 client_network=udp 31:23.036 [INFO] TestAgent: Requesting shutdown 31:23.036 [INFO] TestAgent.server: shutting down server 31:23.036 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.036 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.036 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.036 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.036 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.037 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.037 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.037 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.045 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 31:23.045 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.045 [INFO] TestAgent: Synced node info 31:23.045 [DEBUG] TestAgent: Node info in sync 31:23.048 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.055Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.055Z [INFO] agent.router.manager: shutting down 31:23.056 [INFO] TestAgent: consul server down 31:23.056 [INFO] TestAgent: shutdown complete 31:23.056 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30192 network=tcp 31:23.056 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30192 network=udp 31:23.056 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30193 network=tcp 31:23.556 [INFO] TestAgent: Waiting for endpoints to shut down 31:23.556 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_ServiceAddressIPV6 (0.96s) === CONT TestDNS_IngressServiceLookup [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:22.876Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.905Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.952 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5a3fd63a-2c9f-41bf-5e0e-525293b1b2c4 Address:127.0.0.1:30236}]" 31:22.953 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 31:22.954 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:31:22.954Z [INFO] agent.router: Initializing LAN area manager 31:22.954 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30224 network=udp 31:22.954 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30236 [Follower]" leader= 31:22.954 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30236) (DC: dc1)" 31:22.954 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 31:22.954 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30224 network=tcp 31:22.955 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30225 network=tcp 31:22.955 [INFO] TestAgent: started state syncer 31:22.955 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30237 network=tcp 31:22.990 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.990 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30236 [Candidate]" term=2 31:23.021 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.021 [DEBUG] TestAgent.server.raft: vote granted: from=5a3fd63a-2c9f-41bf-5e0e-525293b1b2c4 term=2 tally=1 31:23.021 [INFO] TestAgent.server.raft: election won: tally=1 31:23.021 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30236 [Leader]" 31:23.024 [INFO] TestAgent.server: cluster leadership acquired 31:23.024 [INFO] TestAgent.server: New leader elected: payload=test-node 31:23.035 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30236 31:23.057 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.114 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.114 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.114 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.114 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.114 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.114 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 31:23.114 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 31:23.150 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.331 [DEBUG] TestAgent.dns: request served from client: name=alias2.service.consul. type=SRV class=IN latency=211.975µs client=127.0.0.1:34196 client_network=udp 31:23.332 [INFO] TestAgent: Requesting shutdown 31:23.332 [INFO] TestAgent.server: shutting down server 31:23.332 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.332 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.332 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.332 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.332 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.332 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:23.332 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.332 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.332 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.343 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.352Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.352Z [INFO] agent.router.manager: shutting down 31:23.352 [INFO] TestAgent: consul server down 31:23.352 [INFO] TestAgent: shutdown complete 31:23.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30224 network=tcp 31:23.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30224 network=udp 31:23.352 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30225 network=tcp 31:23.852 [INFO] TestAgent: Waiting for endpoints to shut down 31:23.852 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ExternalServiceToConsulCNAMENestedLookup (1.01s) === CONT TestDNS_ConnectServiceLookup === RUN TestDNS_IngressServiceLookup/api.ingress.consul. === RUN TestDNS_IngressServiceLookup/api.ingress.dc1.consul. === RUN TestDNS_IngressServiceLookup/db.ingress.consul. === RUN TestDNS_IngressServiceLookup/db.ingress.dc1.consul. 2021-10-05T16:31:23.012Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:23.029Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:23.128 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0714833e-eff5-fdb5-c4ef-f75495bb3447 Address:[::1]:30243}]" 31:23.128 [INFO] TestAgent.server.raft: entering follower state: follower="Node at [::1]:30243 [Follower]" leader= 31:23.129 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: server1.dc1 ::1 31:23.129 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: server1 ::1 2021-10-05T16:31:23.129Z [INFO] agent.router: Initializing LAN area manager 31:23.130 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30238 network=udp 31:23.130 [INFO] TestAgent.server: Adding LAN server: server="server1 (Addr: tcp/[::1]:30243) (DC: dc1)" 31:23.130 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=server1.dc1 area=wan 31:23.130 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30238 network=tcp 31:23.130 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30239 network=tcp 31:23.130 [INFO] TestAgent: started state syncer 31:23.130 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30244 network=tcp 31:23.186 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:23.186 [INFO] TestAgent.server.raft: entering candidate state: node="Node at [::1]:30243 [Candidate]" term=2 31:23.224 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.224 [DEBUG] TestAgent.server.raft: vote granted: from=0714833e-eff5-fdb5-c4ef-f75495bb3447 term=2 tally=1 31:23.224 [INFO] TestAgent.server.raft: election won: tally=1 31:23.224 [INFO] TestAgent.server.raft: entering leader state: leader="Node at [::1]:30243 [Leader]" 31:23.224 [INFO] TestAgent.server: cluster leadership acquired 31:23.224 [INFO] TestAgent.server: New leader elected: payload=server1 31:23.255 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=[::1]:30243 31:23.312 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.371 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.371 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.371 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.371 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.371 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.371 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=server1 31:23.371 [INFO] TestAgent.server: member joined, marking health alive: member=server1 31:23.392 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.414 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:23.432 [INFO] TestAgent: Synced node info 31:23.536 [DEBUG] TestAgent.dns: request served from client: name=server1.node.dc1.consul. type=NS class=IN latency=202.927µs client=127.0.0.1:57368 client_network=udp 31:23.540 [INFO] TestAgent: Requesting shutdown 31:23.540 [INFO] TestAgent.server: shutting down server 31:23.540 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.540 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.540 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.540 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.540 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.540 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.540 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.540 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.540 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.540 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.547 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.554Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.554Z [INFO] agent.router.manager: shutting down 31:23.554 [INFO] TestAgent: consul server down 31:23.554 [INFO] TestAgent: shutdown complete 31:23.554 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30238 network=tcp 31:23.554 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30238 network=udp 31:23.554 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30239 network=tcp 31:24.054 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.054 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NSRecords_IPV6 (1.06s) === CONT TestDNS_ServiceLookupWithInternalServiceAddress [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:23.297Z [WARN] agent: Node name "test node" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:23.297Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:23.308Z [WARN] agent.auto_config: Node name "test node" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:23.308Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:23.373 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7a84bb7b-1c45-61b5-bc31-45bcdbb6a8aa Address:127.0.0.1:30257}]" 31:23.374 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test node.dc1 127.0.0.1 31:23.375 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test node 127.0.0.1 2021-10-05T16:31:23.375Z [INFO] agent.router: Initializing LAN area manager 31:23.375 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30252 network=udp 31:23.375 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30257 [Follower]" leader= 31:23.376 [INFO] TestAgent.server: Adding LAN server: server="test node (Addr: tcp/127.0.0.1:30257) (DC: dc1)" 31:23.376 [INFO] TestAgent.server: Handled event for server in area: event=member-join server="test node.dc1" area=wan 31:23.376 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30252 network=tcp 31:23.376 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30253 network=tcp 31:23.377 [INFO] TestAgent: started state syncer 31:23.377 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30258 network=tcp 31:23.432 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:23.432 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30257 [Candidate]" term=2 31:23.456 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.456 [DEBUG] TestAgent.server.raft: vote granted: from=7a84bb7b-1c45-61b5-bc31-45bcdbb6a8aa term=2 tally=1 31:23.456 [INFO] TestAgent.server.raft: election won: tally=1 31:23.456 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30257 [Leader]" 31:23.456 [INFO] TestAgent.server: cluster leadership acquired 31:23.456 [INFO] TestAgent.server: New leader elected: payload="test node" 31:23.464 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30257 31:23.479 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.542 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.542 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.542 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.542 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.542 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.542 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node="test node" 31:23.542 [INFO] TestAgent.server: member joined, marking health alive: member="test node" 31:23.563 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.648 [DEBUG] TestAgent.dns: request served from client: name=alias.service.consul. type=SRV class=IN latency=333.086µs client=127.0.0.1:49091 client_network=udp 31:23.652 [DEBUG] TestAgent.dns: request served from client: name=alias.service.CoNsUl. type=SRV class=IN latency=294.589µs client=127.0.0.1:40751 client_network=udp 31:23.654 [INFO] TestAgent: Requesting shutdown 31:23.654 [INFO] TestAgent.server: shutting down server 31:23.654 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.654 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.654 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.654 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.655 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.655 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.655 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.655 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:23.655 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.655 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.655 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.661 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.672Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.672Z [INFO] agent.router.manager: shutting down 31:23.672 [INFO] TestAgent: consul server down 31:23.672 [INFO] TestAgent: shutdown complete 31:23.672 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30252 network=tcp 31:23.672 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30252 network=udp 31:23.672 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30253 network=tcp 31:24.173 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.173 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ExternalServiceToConsulCNAMELookup (0.89s) === CONT TestDNS_ServiceLookup 2021-10-05T16:31:23.269Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:23.285Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:23.352 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:79aaf8ea-4c65-a43a-0dfb-a1ce715cb7a0 Address:127.0.0.1:30250}]" 31:23.352 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30250 [Follower]" leader= 31:23.353 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: server1.dc1 127.0.0.1 31:23.353 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: server1 127.0.0.1 2021-10-05T16:31:23.353Z [INFO] agent.router: Initializing LAN area manager 31:23.353 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30245 network=udp 31:23.354 [INFO] TestAgent.server: Adding LAN server: server="server1 (Addr: tcp/127.0.0.1:30250) (DC: dc1)" 31:23.354 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=server1.dc1 area=wan 31:23.354 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30245 network=tcp 31:23.354 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30246 network=tcp 31:23.354 [INFO] TestAgent: started state syncer 31:23.354 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30251 network=tcp 31:23.392 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:23.392 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30250 [Candidate]" term=2 31:23.435 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.435 [DEBUG] TestAgent.server.raft: vote granted: from=79aaf8ea-4c65-a43a-0dfb-a1ce715cb7a0 term=2 tally=1 31:23.435 [INFO] TestAgent.server.raft: election won: tally=1 31:23.435 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30250 [Leader]" 31:23.435 [INFO] TestAgent.server: cluster leadership acquired 31:23.435 [INFO] TestAgent.server: New leader elected: payload=server1 31:23.451 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30250 31:23.469 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.504 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.504 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.504 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.504 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.504 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.505 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=server1 31:23.505 [INFO] TestAgent.server: member joined, marking health alive: member=server1 31:23.544 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.600 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:23.616 [INFO] TestAgent: Synced node info 31:23.616 [DEBUG] TestAgent: Node info in sync 31:23.701 [DEBUG] TestAgent.dns: request served from client: name=something.node.consul. type=NS class=IN latency=129.875µs client=127.0.0.1:39006 client_network=udp 31:23.701 [INFO] TestAgent: Requesting shutdown 31:23.701 [INFO] TestAgent.server: shutting down server 31:23.701 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.701 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.701 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.702 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.702 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.702 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.702 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.702 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.702 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.702 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.707 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.716Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.716Z [INFO] agent.router.manager: shutting down 31:23.716 [INFO] TestAgent: consul server down 31:23.716 [INFO] TestAgent: shutdown complete 31:23.716 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30245 network=tcp 31:23.716 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30245 network=udp 31:23.716 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30246 network=tcp 31:24.217 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.217 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NSRecords (0.96s) === CONT TestDNS_ServiceLookupMultiAddrNoCNAME [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:22.781Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:22.781Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.834Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:22.834Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.928 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7ba53657-7940-454c-e904-03a54fb19b86 Address:127.0.0.1:30222}]" 31:22.929 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30222 [Follower]" leader= 31:22.929 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7ba53657-7940-454c-e904-03a54fb19b86.dc2 127.0.0.1 31:22.930 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7ba53657-7940-454c-e904-03a54fb19b86 127.0.0.1 2021-10-05T16:31:22.930Z [INFO] agent.router: Initializing LAN area manager 31:22.930 [INFO] TestAgent.server: Adding LAN server: server="Node-7ba53657-7940-454c-e904-03a54fb19b86 (Addr: tcp/127.0.0.1:30222) (DC: dc2)" 31:22.930 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7ba53657-7940-454c-e904-03a54fb19b86.dc2 area=wan 31:22.931 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30231 network=tcp 31:22.931 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30231 network=udp 31:22.932 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30232 network=tcp 31:22.932 [INFO] TestAgent: started state syncer 31:22.932 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30223 network=tcp 31:22.981 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:22.996 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.996 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30222 [Candidate]" term=2 31:23.023 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.023 [DEBUG] TestAgent.server.raft: vote granted: from=7ba53657-7940-454c-e904-03a54fb19b86 term=2 tally=1 31:23.023 [INFO] TestAgent.server.raft: election won: tally=1 31:23.023 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30222 [Leader]" 31:23.024 [INFO] TestAgent.server: cluster leadership acquired 31:23.024 [INFO] TestAgent.server: New leader elected: payload=Node-7ba53657-7940-454c-e904-03a54fb19b86 31:23.039 [INFO] TestAgent.server: initializing acls 31:23.045 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:23.064 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:23.064 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:23.064 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:23.064 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7ba53657-7940-454c-e904-03a54fb19b86 31:23.064 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7ba53657-7940-454c-e904-03a54fb19b86.dc2 31:23.064 [INFO] TestAgent.server: Updating LAN server: server="Node-7ba53657-7940-454c-e904-03a54fb19b86 (Addr: tcp/127.0.0.1:30222) (DC: dc2)" 31:23.065 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7ba53657-7940-454c-e904-03a54fb19b86.dc2 area=wan 31:23.099 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.115 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:30203] 31:23.115 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:30203 31:23.116 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 127.0.0.1 31:23.117 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:23.117 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 area=wan 31:23.164 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.164 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.164 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.164 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.164 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.164 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7ba53657-7940-454c-e904-03a54fb19b86 31:23.164 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7ba53657-7940-454c-e904-03a54fb19b86 31:23.192 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7ba53657-7940-454c-e904-03a54fb19b86 31:23.193 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=224.021µs client=127.0.0.1:43650 client_network=udp 31:23.193 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=117.297µs client=127.0.0.1:35011 client_network=udp 31:23.193 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=109.035µs client=127.0.0.1:46594 client_network=udp 31:23.193 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=92.006µs client=127.0.0.1:57019 client_network=udp 31:23.208 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.222 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=293.956µs client=127.0.0.1:40325 client_network=udp 31:23.222 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=158.203µs client=127.0.0.1:53033 client_network=udp 31:23.222 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=103.707µs client=127.0.0.1:39122 client_network=udp 31:23.222 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=98.116µs client=127.0.0.1:57059 client_network=udp 31:23.240 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=266.581µs client=127.0.0.1:55938 client_network=udp 31:23.241 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=239.159µs client=127.0.0.1:46299 client_network=udp 31:23.241 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=143.261µs client=127.0.0.1:37431 client_network=udp 31:23.242 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=131.068µs client=127.0.0.1:35898 client_network=udp 31:23.252 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:23.256 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=302.801µs client=127.0.0.1:41713 client_network=udp 31:23.257 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=162.531µs client=127.0.0.1:48536 client_network=udp 31:23.257 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=146.714µs client=127.0.0.1:37943 client_network=udp 31:23.257 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=126.878µs client=127.0.0.1:33948 client_network=udp 31:23.262 [INFO] TestAgent: Synced node info 31:23.338 [INFO] TestAgent: Requesting shutdown 31:23.338 [INFO] TestAgent.server: shutting down server 31:23.338 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.338 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.338 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.338 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.338 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:23.338 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:23.338 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.338 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.338 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.338 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.338 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.338 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.338 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:23.338 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:23.345 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.354Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.354Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.354Z [INFO] agent.router.manager: shutting down 31:23.354 [INFO] TestAgent: consul server down 31:23.354 [INFO] TestAgent: shutdown complete 31:23.354 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30231 network=tcp 31:23.354 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30231 network=udp 31:23.354 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30232 network=tcp 31:23.854 [INFO] TestAgent: Waiting for endpoints to shut down 31:23.854 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:22.454Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:22.454Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.483Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:22.483Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.508 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6c885042-4c7c-2d34-c11f-3ea0f3500f76 Address:127.0.0.1:30204}]" 31:22.508 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30204 [Follower]" leader= 31:22.509 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 127.0.0.1 31:22.509 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 127.0.0.1 2021-10-05T16:31:22.509Z [INFO] agent.router: Initializing LAN area manager 31:22.509 [INFO] TestAgent.server: Adding LAN server: server="Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 (Addr: tcp/127.0.0.1:30204) (DC: dc1)" 31:22.509 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30199 network=udp 31:22.510 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 area=wan 31:22.510 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30199 network=tcp 31:22.510 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30200 network=tcp 31:22.510 [INFO] TestAgent: started state syncer 31:22.510 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30191 network=tcp 31:22.560 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:22.576 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.576 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30204 [Candidate]" term=2 31:22.605 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.605 [DEBUG] TestAgent.server.raft: vote granted: from=6c885042-4c7c-2d34-c11f-3ea0f3500f76 term=2 tally=1 31:22.605 [INFO] TestAgent.server.raft: election won: tally=1 31:22.605 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30204 [Leader]" 31:22.608 [INFO] TestAgent.server: cluster leadership acquired 31:22.608 [INFO] TestAgent.server: New leader elected: payload=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 31:22.628 [INFO] TestAgent.server: initializing acls 31:22.644 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:22.660 [INFO] TestAgent.server: initializing acls 31:22.699 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:22.699 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:22.699 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:22.699 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:22.699 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 31:22.699 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 31:22.699 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 area=wan 31:22.699 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:22.699 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 31:22.699 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 31:22.700 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76.dc1 area=wan 31:22.700 [INFO] TestAgent.server: Updating LAN server: server="Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 (Addr: tcp/127.0.0.1:30204) (DC: dc1)" 31:22.700 [INFO] TestAgent.server: Updating LAN server: server="Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 (Addr: tcp/127.0.0.1:30204) (DC: dc1)" 31:22.724 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.814 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.814 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.814 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.814 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.814 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.814 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 31:22.814 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 31:22.847 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 31:22.847 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6c885042-4c7c-2d34-c11f-3ea0f3500f76 31:22.896 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.896 [INFO] TestAgent: Synced node info 31:22.896 [DEBUG] TestAgent: Node info in sync 31:23.116 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:59572 31:23.116 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7ba53657-7940-454c-e904-03a54fb19b86.dc2 127.0.0.1 31:23.116 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7ba53657-7940-454c-e904-03a54fb19b86.dc2 area=wan 31:23.145 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=984.116µs client=127.0.0.1:44051 client_network=udp 31:23.146 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=382.497µs client=127.0.0.1:40943 client_network=udp 31:23.146 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=279.808µs client=127.0.0.1:59985 client_network=udp 31:23.147 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=282.586µs client=127.0.0.1:56743 client_network=udp 31:23.272 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=8.139011ms client=127.0.0.1:33647 client_network=udp 31:23.273 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=604.713µs client=127.0.0.1:45732 client_network=udp 31:23.273 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=338.819µs client=127.0.0.1:47438 client_network=udp 31:23.274 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=374.338µs client=127.0.0.1:54075 client_network=udp 31:23.311 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=543.105µs client=127.0.0.1:51082 client_network=udp 31:23.311 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=296.697µs client=127.0.0.1:39115 client_network=udp 31:23.316 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=4.482479ms client=127.0.0.1:60675 client_network=udp 31:23.318 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=1.696601ms client=127.0.0.1:51581 client_network=udp 31:23.331 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=SRV class=IN latency=534.028µs client=127.0.0.1:42669 client_network=udp 31:23.332 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=SRV class=IN latency=435.667µs client=127.0.0.1:40690 client_network=udp 31:23.337 [DEBUG] TestAgent.dns: request served from client: name=db.service.dc2.consul. type=A class=IN latency=873.333µs client=127.0.0.1:40769 client_network=udp 31:23.337 [DEBUG] TestAgent.dns: request served from client: name=11a3f8fc-e904-5ae4-ff20-98020f6b975b.query.dc2.consul. type=A class=IN latency=466.411µs client=127.0.0.1:38280 client_network=udp 31:23.854 [INFO] TestAgent: Requesting shutdown 31:23.854 [INFO] TestAgent.server: shutting down server 31:23.854 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.854 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.854 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.854 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.854 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:23.854 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:23.854 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.854 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.854 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.855 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.855 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.855 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.855 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:23.855 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:23.860 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.872Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.872Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.872Z [INFO] agent.router.manager: shutting down 31:23.872 [INFO] TestAgent: consul server down 31:23.872 [INFO] TestAgent: shutdown complete 31:23.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30199 network=tcp 31:23.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30199 network=udp 31:23.872 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30200 network=tcp 31:24.375 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.375 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_WanTranslation (1.95s) --- PASS: TestDNS_ServiceLookup_WanTranslation/service-wan-from-dc1 (0.01s) --- PASS: TestDNS_ServiceLookup_WanTranslation/node-addr-from-dc2 (0.05s) --- PASS: TestDNS_ServiceLookup_WanTranslation/node-wan-from-dc2 (0.03s) --- PASS: TestDNS_ServiceLookup_WanTranslation/service-addr-from-dc2 (0.02s) --- PASS: TestDNS_ServiceLookup_WanTranslation/service-wan-from-dc2 (0.02s) --- PASS: TestDNS_ServiceLookup_WanTranslation/node-addr-from-dc1 (0.02s) --- PASS: TestDNS_ServiceLookup_WanTranslation/node-wan-from-dc1 (0.05s) --- PASS: TestDNS_ServiceLookup_WanTranslation/service-addr-from-dc1 (0.02s) === CONT TestDNS_ServiceLookupPreferNoCNAME 2021-10-05T16:31:23.560Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:23.630Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:23.684 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae Address:127.0.0.1:30271}]" 31:23.685 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae.dc1 127.0.0.1 31:23.685 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae 127.0.0.1 2021-10-05T16:31:23.685Z [INFO] agent.router: Initializing LAN area manager 31:23.686 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30266 network=udp 31:23.686 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30271 [Follower]" leader= 31:23.686 [INFO] TestAgent.server: Adding LAN server: server="Node-ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae (Addr: tcp/127.0.0.1:30271) (DC: dc1)" 31:23.686 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae.dc1 area=wan 31:23.686 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30266 network=tcp 31:23.686 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30267 network=tcp 31:23.686 [INFO] TestAgent: started state syncer 31:23.687 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30272 network=tcp 31:23.751 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:23.752 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30271 [Candidate]" term=2 31:23.768 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.768 [DEBUG] TestAgent.server.raft: vote granted: from=ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae term=2 tally=1 31:23.768 [INFO] TestAgent.server.raft: election won: tally=1 31:23.768 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30271 [Leader]" 31:23.771 [INFO] TestAgent.server: cluster leadership acquired 31:23.771 [INFO] TestAgent.server: New leader elected: payload=Node-ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae 31:23.777 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30271 31:23.828 [INFO] TestAgent: Synced node info 31:23.828 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.866 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.866 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.866 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.866 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.866 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.866 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae 31:23.866 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ed8c5c6c-ab05-6c56-ff3c-27c8d4768fae 31:23.894 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.924 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=246.473µs client=127.0.0.1:60824 client_network=udp 31:23.928 [INFO] TestAgent: Requesting shutdown 31:23.928 [INFO] TestAgent.server: shutting down server 31:23.928 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.928 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.928 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.928 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.928 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.928 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.928 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.940 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.948Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.948Z [INFO] agent.router.manager: shutting down 31:23.948 [INFO] TestAgent: consul server down 31:23.948 [INFO] TestAgent: shutdown complete 31:23.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30266 network=tcp 31:23.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30266 network=udp 31:23.948 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30267 network=tcp 31:24.448 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.448 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ExternalServiceLookup (0.91s) === CONT TestDNS_ServiceLookupNoMultiCNAME 2021-10-05T16:31:23.567Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:23.623Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:23.678 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fe2ad231-b565-cf48-43ca-a747496301e5 Address:127.0.0.1:30278}]" 31:23.678 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fe2ad231-b565-cf48-43ca-a747496301e5.dc1 127.0.0.1 31:23.679 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fe2ad231-b565-cf48-43ca-a747496301e5 127.0.0.1 2021-10-05T16:31:23.679Z [INFO] agent.router: Initializing LAN area manager 31:23.679 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30273 network=udp 31:23.679 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30278 [Follower]" leader= 31:23.679 [INFO] TestAgent.server: Adding LAN server: server="Node-fe2ad231-b565-cf48-43ca-a747496301e5 (Addr: tcp/127.0.0.1:30278) (DC: dc1)" 31:23.679 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fe2ad231-b565-cf48-43ca-a747496301e5.dc1 area=wan 31:23.679 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30273 network=tcp 31:23.680 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30274 network=tcp 31:23.680 [INFO] TestAgent: started state syncer 31:23.680 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30279 network=tcp 31:23.719 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:23.719 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30278 [Candidate]" term=2 31:23.735 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.735 [DEBUG] TestAgent.server.raft: vote granted: from=fe2ad231-b565-cf48-43ca-a747496301e5 term=2 tally=1 31:23.735 [INFO] TestAgent.server.raft: election won: tally=1 31:23.735 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30278 [Leader]" 31:23.735 [INFO] TestAgent.server: cluster leadership acquired 31:23.735 [INFO] TestAgent.server: New leader elected: payload=Node-fe2ad231-b565-cf48-43ca-a747496301e5 31:23.743 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30278 31:23.767 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.803 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.803 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.803 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.803 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.803 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.803 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fe2ad231-b565-cf48-43ca-a747496301e5 31:23.803 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fe2ad231-b565-cf48-43ca-a747496301e5 31:23.845 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.941 [DEBUG] TestAgent.dns: request served from client: name=api.ingress.consul. type=A class=IN latency=184.306µs client=127.0.0.1:41344 client_network=udp 31:23.942 [DEBUG] TestAgent.dns: request served from client: name=api.ingress.dc1.consul. type=A class=IN latency=98.43µs client=127.0.0.1:54722 client_network=udp 31:23.942 [DEBUG] TestAgent.dns: request served from client: name=db.ingress.consul. type=A class=IN latency=100.028µs client=127.0.0.1:44764 client_network=udp 31:23.942 [DEBUG] TestAgent.dns: request served from client: name=db.ingress.dc1.consul. type=A class=IN latency=100.189µs client=127.0.0.1:49379 client_network=udp 31:23.942 [INFO] TestAgent: Requesting shutdown 31:23.943 [INFO] TestAgent.server: shutting down server 31:23.943 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.943 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.943 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.943 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.943 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.943 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.943 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.943 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:23.943 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.943 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.943 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.947 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.961Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.961Z [INFO] agent.router.manager: shutting down 31:23.961 [INFO] TestAgent: consul server down 31:23.961 [INFO] TestAgent: shutdown complete 31:23.961 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30273 network=tcp 31:23.961 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30273 network=udp 31:23.961 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30274 network=tcp 31:24.464 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.464 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_IngressServiceLookup (0.91s) --- PASS: TestDNS_IngressServiceLookup/api.ingress.consul. (0.00s) --- PASS: TestDNS_IngressServiceLookup/api.ingress.dc1.consul. (0.00s) --- PASS: TestDNS_IngressServiceLookup/db.ingress.consul. (0.00s) --- PASS: TestDNS_IngressServiceLookup/db.ingress.dc1.consul. (0.00s) === CONT TestDNS_ServiceReverseLookupNodeAddress 2021-10-05T16:31:23.538Z [WARN] agent: Node name "test node" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:23.538Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:23.549Z [WARN] agent.auto_config: Node name "test node" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:23.549Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:23.630 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:634f03de-420b-804a-dd91-e71fada436c1 Address:127.0.0.1:30264}]" 31:23.631 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test node.dc1 127.0.0.1 31:23.633 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30264 [Follower]" leader= 31:23.637 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test node 127.0.0.1 2021-10-05T16:31:23.637Z [INFO] agent.router: Initializing LAN area manager 31:23.637 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30259 network=udp 31:23.637 [INFO] TestAgent.server: Adding LAN server: server="test node (Addr: tcp/127.0.0.1:30264) (DC: dc1)" 31:23.637 [INFO] TestAgent.server: Handled event for server in area: event=member-join server="test node.dc1" area=wan 31:23.637 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30259 network=tcp 31:23.638 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30260 network=tcp 31:23.638 [INFO] TestAgent: started state syncer 31:23.639 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30265 network=tcp 31:23.694 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:23.694 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30264 [Candidate]" term=2 31:23.707 [DEBUG] TestAgent.server.raft: votes: needed=1 31:23.707 [DEBUG] TestAgent.server.raft: vote granted: from=634f03de-420b-804a-dd91-e71fada436c1 term=2 tally=1 31:23.707 [INFO] TestAgent.server.raft: election won: tally=1 31:23.707 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30264 [Leader]" 31:23.708 [INFO] TestAgent.server: cluster leadership acquired 31:23.708 [INFO] TestAgent.server: New leader elected: payload="test node" 31:23.717 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30264 31:23.733 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:23.769 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:23.769 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:23.769 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:23.769 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:23.769 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:23.770 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node="test node" 31:23.770 [INFO] TestAgent.server: member joined, marking health alive: member="test node" 31:23.794 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.859 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:23.863 [INFO] TestAgent: Synced node info 31:23.863 [DEBUG] TestAgent: Node info in sync 31:23.984 [ERROR] TestAgent.dns: Infinite recursion detected for name, won't perform any CNAME resolution.: name=web.service.consul. 31:23.984 [DEBUG] TestAgent.dns: request served from client: name=web.service.consul. type=A class=IN latency=352.495µs client=127.0.0.1:45956 client_network=udp 31:23.984 [INFO] TestAgent: Requesting shutdown 31:23.984 [INFO] TestAgent.server: shutting down server 31:23.984 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:23.984 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:23.984 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:23.984 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:23.984 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:23.984 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:23.984 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:23.984 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:23.984 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:23.984 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:23.991 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:23.999Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:23.999Z [INFO] agent.router.manager: shutting down 31:23.999 [INFO] TestAgent: consul server down 31:23.999 [INFO] TestAgent: shutdown complete 31:23.999 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30259 network=tcp 31:24.000 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30259 network=udp 31:24.000 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30260 network=tcp 31:24.500 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.500 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_InifiniteRecursion (0.98s) === CONT TestDNS_SOA_Settings 2021-10-05T16:31:20.779Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.795Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.850 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1ffd3ecb-f9f7-865e-d980-2a05f7088b79 Address:127.0.0.1:30120}]" 31:20.851 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1ffd3ecb-f9f7-865e-d980-2a05f7088b79.dc1 127.0.0.1 31:20.851 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1ffd3ecb-f9f7-865e-d980-2a05f7088b79 127.0.0.1 2021-10-05T16:31:20.851Z [INFO] agent.router: Initializing LAN area manager 31:20.852 [DEBUG] TestAgent.dns: recursor enabled 31:20.852 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30115 network=udp 31:20.852 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30120 [Follower]" leader= 31:20.852 [DEBUG] TestAgent.dns: recursor enabled 31:20.852 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1ffd3ecb-f9f7-865e-d980-2a05f7088b79.dc1 area=wan 31:20.852 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30115 network=tcp 31:20.852 [INFO] TestAgent.server: Adding LAN server: server="Node-1ffd3ecb-f9f7-865e-d980-2a05f7088b79 (Addr: tcp/127.0.0.1:30120) (DC: dc1)" 31:20.853 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30116 network=tcp 31:20.853 [INFO] TestAgent: started state syncer 31:20.853 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30121 network=tcp 31:20.920 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.920 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30120 [Candidate]" term=2 31:20.942 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.942 [DEBUG] TestAgent.server.raft: vote granted: from=1ffd3ecb-f9f7-865e-d980-2a05f7088b79 term=2 tally=1 31:20.942 [INFO] TestAgent.server.raft: election won: tally=1 31:20.942 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30120 [Leader]" 31:20.942 [INFO] TestAgent.server: cluster leadership acquired 31:20.942 [INFO] TestAgent.server: New leader elected: payload=Node-1ffd3ecb-f9f7-865e-d980-2a05f7088b79 31:20.955 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30120 31:21.000 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:21.043 [INFO] TestAgent: Synced node info 31:21.043 [DEBUG] TestAgent: Node info in sync 31:21.077 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:21.077 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:21.077 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:21.077 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:21.077 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:21.077 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1ffd3ecb-f9f7-865e-d980-2a05f7088b79 31:21.077 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1ffd3ecb-f9f7-865e-d980-2a05f7088b79 31:21.091 [INFO] TestAgent.server: federation state anti-entropy synced 31:23.885 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:23.885 [DEBUG] TestAgent: Node info in sync 31:24.048 [ERROR] TestAgent.dns: recurse failed: error="read udp 127.0.0.1:32805->127.0.0.1:38000: i/o timeout" 31:24.048 [ERROR] TestAgent.dns: all resolvers failed for question from client: question="{apple.com. 255 1}" client=127.0.0.1:34403 client_network=udp 31:24.048 [DEBUG] TestAgent.dns: request served from client: question="{apple.com. 255 1}" network=udp latency=3.001684962s client=127.0.0.1:34403 client_network=udp 31:24.051 [INFO] TestAgent: Requesting shutdown 31:24.051 [INFO] TestAgent.server: shutting down server 31:24.051 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.051 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.051 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.051 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.051 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.052 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.052 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.052 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.052 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.052 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.060 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.064Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.064Z [INFO] agent.router.manager: shutting down 31:24.064 [INFO] TestAgent: consul server down 31:24.064 [INFO] TestAgent: shutdown complete 31:24.064 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30115 network=tcp 31:24.064 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30115 network=udp 31:24.064 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30116 network=tcp 31:24.568 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.568 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_RecursorTimeout (3.81s) === CONT TestDNS_ServiceReverseLookup_CustomDomain [WARN] freeport: 10 out of 52 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:23.868Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:23.882Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:23.956 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:72e1a2b0-d46f-12af-77d2-a34754c416ca Address:127.0.0.1:30285}]" 31:23.957 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-72e1a2b0-d46f-12af-77d2-a34754c416ca.dc1 127.0.0.1 31:23.957 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-72e1a2b0-d46f-12af-77d2-a34754c416ca 127.0.0.1 2021-10-05T16:31:23.957Z [INFO] agent.router: Initializing LAN area manager 31:23.957 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30280 network=udp 31:23.957 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30285 [Follower]" leader= 31:23.958 [INFO] TestAgent.server: Adding LAN server: server="Node-72e1a2b0-d46f-12af-77d2-a34754c416ca (Addr: tcp/127.0.0.1:30285) (DC: dc1)" 31:23.958 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-72e1a2b0-d46f-12af-77d2-a34754c416ca.dc1 area=wan 31:23.958 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30280 network=tcp 31:23.958 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30281 network=tcp 31:23.958 [INFO] TestAgent: started state syncer 31:23.959 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30286 network=tcp 31:24.020 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.020 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30285 [Candidate]" term=2 31:24.056 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.056 [DEBUG] TestAgent.server.raft: vote granted: from=72e1a2b0-d46f-12af-77d2-a34754c416ca term=2 tally=1 31:24.056 [INFO] TestAgent.server.raft: election won: tally=1 31:24.056 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30285 [Leader]" 31:24.056 [INFO] TestAgent.server: cluster leadership acquired 31:24.057 [INFO] TestAgent.server: New leader elected: payload=Node-72e1a2b0-d46f-12af-77d2-a34754c416ca 31:24.089 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30285 31:24.103 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.150 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.150 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.150 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.150 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.150 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.150 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-72e1a2b0-d46f-12af-77d2-a34754c416ca 31:24.150 [INFO] TestAgent.server: member joined, marking health alive: member=Node-72e1a2b0-d46f-12af-77d2-a34754c416ca 31:24.173 [INFO] TestAgent: Synced node info 31:24.197 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.197 [DEBUG] TestAgent.dns: request served from client: name=db.connect.consul. type=SRV class=IN latency=161.483µs client=127.0.0.1:37537 client_network=udp 31:24.198 [INFO] TestAgent: Requesting shutdown 31:24.198 [INFO] TestAgent.server: shutting down server 31:24.198 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.198 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.198 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.198 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.198 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.198 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.198 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.198 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.198 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.198 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.212 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.220Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.220Z [INFO] agent.router.manager: shutting down 31:24.220 [INFO] TestAgent: consul server down 31:24.220 [INFO] TestAgent: shutdown complete 31:24.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30280 network=tcp 31:24.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30280 network=udp 31:24.220 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30281 network=tcp 31:24.721 [INFO] TestAgent: Waiting for endpoints to shut down 31:24.721 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ConnectServiceLookup (0.87s) === CONT TestDNS_ServiceReverseLookup_IPV6 [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:24.071Z [WARN] agent: Node name "my.test-node" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:24.071Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.087Z [WARN] agent.auto_config: Node name "my.test-node" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:24.087Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.121 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8d5fce15-117b-f24d-c2ed-07a1e5da618a Address:127.0.0.1:30292}]" 31:24.122 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: my.test-node.dc1 127.0.0.1 31:24.122 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: my.test-node 127.0.0.1 2021-10-05T16:31:24.122Z [INFO] agent.router: Initializing LAN area manager 31:24.122 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30287 network=udp 31:24.122 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30292 [Follower]" leader= 31:24.123 [INFO] TestAgent.server: Adding LAN server: server="my.test-node (Addr: tcp/127.0.0.1:30292) (DC: dc1)" 31:24.123 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=my.test-node.dc1 area=wan 31:24.123 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30287 network=tcp 31:24.124 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30288 network=tcp 31:24.124 [INFO] TestAgent: started state syncer 31:24.124 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30293 network=tcp 31:24.184 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.184 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30292 [Candidate]" term=2 31:24.226 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.226 [DEBUG] TestAgent.server.raft: vote granted: from=8d5fce15-117b-f24d-c2ed-07a1e5da618a term=2 tally=1 31:24.226 [INFO] TestAgent.server.raft: election won: tally=1 31:24.226 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30292 [Leader]" 31:24.228 [INFO] TestAgent.server: cluster leadership acquired 31:24.228 [INFO] TestAgent.server: New leader elected: payload=my.test-node 31:24.244 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30292 31:24.285 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.317 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.318 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.318 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.318 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.318 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.318 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=my.test-node 31:24.318 [INFO] TestAgent.server: member joined, marking health alive: member=my.test-node 31:24.351 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.388 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:24.404 [INFO] TestAgent: Synced node info 31:24.515 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=137.71µs client=127.0.0.1:44101 client_network=udp 31:24.515 [INFO] TestAgent: Requesting shutdown 31:24.515 [INFO] TestAgent.server: shutting down server 31:24.515 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.515 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.515 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.515 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.515 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.515 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.515 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.515 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.515 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.515 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.521 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.548Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.548Z [INFO] agent.router.manager: shutting down 31:24.548 [INFO] TestAgent: consul server down 31:24.548 [INFO] TestAgent: shutdown complete 31:24.548 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30287 network=tcp 31:24.548 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30287 network=udp 31:24.548 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30288 network=tcp 31:25.049 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.049 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookupWithInternalServiceAddress (1.00s) === CONT TestDNS_ServiceReverseLookup [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:24.191Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.206Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.259 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cca9f60a-06e8-91a0-fd47-3889b3459c1a Address:127.0.0.1:30299}]" 31:24.260 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cca9f60a-06e8-91a0-fd47-3889b3459c1a.dc1 127.0.0.1 31:24.260 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30299 [Follower]" leader= 31:24.260 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cca9f60a-06e8-91a0-fd47-3889b3459c1a 127.0.0.1 2021-10-05T16:31:24.260Z [INFO] agent.router: Initializing LAN area manager 31:24.261 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30294 network=udp 31:24.261 [INFO] TestAgent.server: Adding LAN server: server="Node-cca9f60a-06e8-91a0-fd47-3889b3459c1a (Addr: tcp/127.0.0.1:30299) (DC: dc1)" 31:24.261 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cca9f60a-06e8-91a0-fd47-3889b3459c1a.dc1 area=wan 31:24.261 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30294 network=tcp 31:24.262 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30295 network=tcp 31:24.262 [INFO] TestAgent: started state syncer 31:24.262 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30300 network=tcp 31:24.300 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.300 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30299 [Candidate]" term=2 31:24.340 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.340 [DEBUG] TestAgent.server.raft: vote granted: from=cca9f60a-06e8-91a0-fd47-3889b3459c1a term=2 tally=1 31:24.340 [INFO] TestAgent.server.raft: election won: tally=1 31:24.340 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30299 [Leader]" 31:24.340 [INFO] TestAgent.server: cluster leadership acquired 31:24.340 [INFO] TestAgent.server: New leader elected: payload=Node-cca9f60a-06e8-91a0-fd47-3889b3459c1a 31:24.364 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30299 31:24.405 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.452 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.452 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.452 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.452 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.452 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.452 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cca9f60a-06e8-91a0-fd47-3889b3459c1a 31:24.452 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cca9f60a-06e8-91a0-fd47-3889b3459c1a 31:24.484 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.528 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=SRV class=IN latency=220.235µs client=127.0.0.1:46711 client_network=udp 31:24.532 [DEBUG] TestAgent.dns: request served from client: name=7288ef3a-eeaa-290f-cd5c-240e8299c5e2.query.consul. type=SRV class=IN latency=164.873µs client=127.0.0.1:60690 client_network=udp 31:24.532 [DEBUG] TestAgent.dns: request served from client: name=nodb.service.consul. type=SRV class=IN latency=86.126µs client=127.0.0.1:35438 client_network=udp 31:24.533 [DEBUG] TestAgent.dns: request served from client: name=nope.query.consul. type=SRV class=IN latency=53.992µs client=127.0.0.1:44481 client_network=udp 31:24.533 [INFO] TestAgent: Requesting shutdown 31:24.533 [INFO] TestAgent.server: shutting down server 31:24.533 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.533 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.533 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.533 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.533 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.544 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.544 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.544 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:24.544 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.544 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.544 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.568 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.578Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.578Z [INFO] agent.router.manager: shutting down 31:24.578 [INFO] TestAgent: consul server down 31:24.578 [INFO] TestAgent: shutdown complete 31:24.578 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30294 network=tcp 31:24.578 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30294 network=udp 31:24.578 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30295 network=tcp 31:25.078 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.078 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup (0.91s) === CONT TestDNS_ReverseLookup_IPV6 2021-10-05T16:31:24.234Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.247Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.284 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:88304ef4-3ddb-8816-d036-d4094ba9e323 Address:127.0.0.1:30306}]" 31:24.285 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-88304ef4-3ddb-8816-d036-d4094ba9e323.dc1 127.0.0.1 31:24.285 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-88304ef4-3ddb-8816-d036-d4094ba9e323 127.0.0.1 2021-10-05T16:31:24.285Z [INFO] agent.router: Initializing LAN area manager 31:24.286 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30301 network=udp 31:24.286 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30306 [Follower]" leader= 31:24.286 [INFO] TestAgent.server: Adding LAN server: server="Node-88304ef4-3ddb-8816-d036-d4094ba9e323 (Addr: tcp/127.0.0.1:30306) (DC: dc1)" 31:24.286 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-88304ef4-3ddb-8816-d036-d4094ba9e323.dc1 area=wan 31:24.286 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30301 network=tcp 31:24.287 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30302 network=tcp 31:24.287 [INFO] TestAgent: started state syncer 31:24.287 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30307 network=tcp 31:24.332 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.332 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30306 [Candidate]" term=2 31:24.382 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.382 [DEBUG] TestAgent.server.raft: vote granted: from=88304ef4-3ddb-8816-d036-d4094ba9e323 term=2 tally=1 31:24.382 [INFO] TestAgent.server.raft: election won: tally=1 31:24.382 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30306 [Leader]" 31:24.382 [INFO] TestAgent.server: cluster leadership acquired 31:24.383 [INFO] TestAgent.server: New leader elected: payload=Node-88304ef4-3ddb-8816-d036-d4094ba9e323 31:24.409 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30306 31:24.427 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.500 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.500 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.500 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.500 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.500 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.500 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-88304ef4-3ddb-8816-d036-d4094ba9e323 31:24.500 [INFO] TestAgent.server: member joined, marking health alive: member=Node-88304ef4-3ddb-8816-d036-d4094ba9e323 31:24.531 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.552 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:24.573 [INFO] TestAgent: Synced node info 31:24.658 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=ANY class=IN latency=336.458µs client=127.0.0.1:36584 client_network=udp 31:24.658 [INFO] TestAgent: Requesting shutdown 31:24.658 [INFO] TestAgent.server: shutting down server 31:24.658 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.658 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.658 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.658 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.659 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.659 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.659 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.659 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.659 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.659 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.668 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.684Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.684Z [INFO] agent.router.manager: shutting down 31:24.684 [INFO] TestAgent: consul server down 31:24.684 [INFO] TestAgent: shutdown complete 31:24.684 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30301 network=tcp 31:24.684 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30301 network=udp 31:24.685 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30302 network=tcp 31:25.185 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.185 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookupMultiAddrNoCNAME (0.97s) === CONT TestDNS_ReverseLookup_CustomDomain [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:24.395Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.428Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.508 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:06eec532-dee6-9916-81fa-346de96b2184 Address:127.0.0.1:30313}]" 31:24.509 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-06eec532-dee6-9916-81fa-346de96b2184.dc1 127.0.0.1 31:24.509 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-06eec532-dee6-9916-81fa-346de96b2184 127.0.0.1 2021-10-05T16:31:24.509Z [INFO] agent.router: Initializing LAN area manager 31:24.510 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30308 network=udp 31:24.510 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30313 [Follower]" leader= 31:24.510 [INFO] TestAgent.server: Adding LAN server: server="Node-06eec532-dee6-9916-81fa-346de96b2184 (Addr: tcp/127.0.0.1:30313) (DC: dc1)" 31:24.510 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-06eec532-dee6-9916-81fa-346de96b2184.dc1 area=wan 31:24.510 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30308 network=tcp 31:24.511 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30309 network=tcp 31:24.511 [INFO] TestAgent: started state syncer 31:24.511 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30314 network=tcp 31:24.578 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.578 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30313 [Candidate]" term=2 31:24.636 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.636 [DEBUG] TestAgent.server.raft: vote granted: from=06eec532-dee6-9916-81fa-346de96b2184 term=2 tally=1 31:24.636 [INFO] TestAgent.server.raft: election won: tally=1 31:24.636 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30313 [Leader]" 31:24.636 [INFO] TestAgent.server: cluster leadership acquired 31:24.636 [INFO] TestAgent.server: New leader elected: payload=Node-06eec532-dee6-9916-81fa-346de96b2184 31:24.668 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30313 31:24.691 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.739 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.739 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.739 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.739 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.739 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.739 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-06eec532-dee6-9916-81fa-346de96b2184 31:24.739 [INFO] TestAgent.server: member joined, marking health alive: member=Node-06eec532-dee6-9916-81fa-346de96b2184 31:24.777 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.805 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=ANY class=IN latency=219.871µs client=127.0.0.1:35537 client_network=udp 31:24.805 [INFO] TestAgent: Requesting shutdown 31:24.805 [INFO] TestAgent.server: shutting down server 31:24.805 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.805 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.805 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.805 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.805 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.805 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.805 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.805 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:24.805 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.805 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.805 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.814 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.827Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.827Z [INFO] agent.router.manager: shutting down 31:24.828 [INFO] TestAgent: consul server down 31:24.828 [INFO] TestAgent: shutdown complete 31:24.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30308 network=tcp 31:24.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30308 network=udp 31:24.828 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30309 network=tcp 31:25.328 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.328 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookupPreferNoCNAME (0.95s) === CONT TestDNS_ReverseLookup 2021-10-05T16:31:24.467Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.491Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.592 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6679e07a-f8d9-2af5-444b-f61e90fd397c Address:127.0.0.1:30320}]" 31:24.592 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30320 [Follower]" leader= 31:24.593 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6679e07a-f8d9-2af5-444b-f61e90fd397c.dc1 127.0.0.1 31:24.594 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6679e07a-f8d9-2af5-444b-f61e90fd397c 127.0.0.1 2021-10-05T16:31:24.594Z [INFO] agent.router: Initializing LAN area manager 31:24.594 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30315 network=udp 31:24.595 [INFO] TestAgent.server: Adding LAN server: server="Node-6679e07a-f8d9-2af5-444b-f61e90fd397c (Addr: tcp/127.0.0.1:30320) (DC: dc1)" 31:24.595 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6679e07a-f8d9-2af5-444b-f61e90fd397c.dc1 area=wan 31:24.595 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30315 network=tcp 31:24.596 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30316 network=tcp 31:24.596 [INFO] TestAgent: started state syncer 31:24.597 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30321 network=tcp 31:24.643 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.643 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30320 [Candidate]" term=2 31:24.688 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.688 [DEBUG] TestAgent.server.raft: vote granted: from=6679e07a-f8d9-2af5-444b-f61e90fd397c term=2 tally=1 31:24.688 [INFO] TestAgent.server.raft: election won: tally=1 31:24.688 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30320 [Leader]" 31:24.688 [INFO] TestAgent.server: cluster leadership acquired 31:24.689 [INFO] TestAgent.server: New leader elected: payload=Node-6679e07a-f8d9-2af5-444b-f61e90fd397c 31:24.699 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30320 31:24.733 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.776 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.776 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.776 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.776 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.776 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.776 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6679e07a-f8d9-2af5-444b-f61e90fd397c 31:24.776 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6679e07a-f8d9-2af5-444b-f61e90fd397c 31:24.809 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.834 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=ANY class=IN latency=207.731µs client=127.0.0.1:38448 client_network=udp 31:24.834 [INFO] TestAgent: Requesting shutdown 31:24.834 [INFO] TestAgent.server: shutting down server 31:24.834 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.834 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.834 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.834 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.834 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.834 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.834 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.834 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:24.834 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.834 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.834 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.841 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.846Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.846Z [INFO] agent.router.manager: shutting down 31:24.846 [INFO] TestAgent: consul server down 31:24.846 [INFO] TestAgent: shutdown complete 31:24.846 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30315 network=tcp 31:24.846 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30315 network=udp 31:24.846 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30316 network=tcp 31:25.349 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.349 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookupNoMultiCNAME (0.90s) === CONT TestDNS_EDNS0_ECS [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:24.493Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.547Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.640 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c32bd972-bf11-2175-7d2a-937f6b5dd235 Address:127.0.0.1:30327}]" 31:24.640 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30327 [Follower]" leader= 31:24.640 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c32bd972-bf11-2175-7d2a-937f6b5dd235.dc1 127.0.0.1 31:24.641 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c32bd972-bf11-2175-7d2a-937f6b5dd235 127.0.0.1 2021-10-05T16:31:24.641Z [INFO] agent.router: Initializing LAN area manager 31:24.641 [INFO] TestAgent.server: Adding LAN server: server="Node-c32bd972-bf11-2175-7d2a-937f6b5dd235 (Addr: tcp/127.0.0.1:30327) (DC: dc1)" 31:24.641 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c32bd972-bf11-2175-7d2a-937f6b5dd235.dc1 area=wan 31:24.641 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30322 network=udp 31:24.641 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30322 network=tcp 31:24.642 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30323 network=tcp 31:24.642 [INFO] TestAgent: started state syncer 31:24.642 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30328 network=tcp 31:24.688 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.688 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30327 [Candidate]" term=2 31:24.736 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.736 [DEBUG] TestAgent.server.raft: vote granted: from=c32bd972-bf11-2175-7d2a-937f6b5dd235 term=2 tally=1 31:24.736 [INFO] TestAgent.server.raft: election won: tally=1 31:24.736 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30327 [Leader]" 31:24.736 [INFO] TestAgent.server: cluster leadership acquired 31:24.736 [INFO] TestAgent.server: New leader elected: payload=Node-c32bd972-bf11-2175-7d2a-937f6b5dd235 31:24.771 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30327 31:24.813 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.861 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.861 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.861 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.861 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.861 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.861 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c32bd972-bf11-2175-7d2a-937f6b5dd235 31:24.861 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c32bd972-bf11-2175-7d2a-937f6b5dd235 31:24.872 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.932 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:24.938 [INFO] TestAgent: Synced node info 31:25.065 [DEBUG] TestAgent.dns: request served from client: question="{1.0.0.127.in-addr.arpa. 255 1}" latency=101.141µs client=127.0.0.1:36214 client_network=udp 31:25.065 [INFO] TestAgent: Requesting shutdown 31:25.065 [INFO] TestAgent.server: shutting down server 31:25.065 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.065 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.065 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.065 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.065 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.065 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.065 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.065 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.065 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.065 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.069 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.075Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.075Z [INFO] agent.router.manager: shutting down 31:25.075 [INFO] TestAgent: consul server down 31:25.075 [INFO] TestAgent: shutdown complete 31:25.075 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30322 network=tcp 31:25.075 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30322 network=udp 31:25.075 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30323 network=tcp 31:25.576 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.576 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceReverseLookupNodeAddress (1.11s) === CONT TestDNS_EDNS0 2021-10-05T16:31:24.736Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.749Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.851 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cd2ca64a-6028-d835-2e74-1324c49add1d Address:127.0.0.1:30348}]" 31:24.852 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cd2ca64a-6028-d835-2e74-1324c49add1d.dc1 127.0.0.1 31:24.852 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cd2ca64a-6028-d835-2e74-1324c49add1d 127.0.0.1 2021-10-05T16:31:24.852Z [INFO] agent.router: Initializing LAN area manager 31:24.853 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30343 network=udp 31:24.853 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30348 [Follower]" leader= 31:24.853 [INFO] TestAgent.server: Adding LAN server: server="Node-cd2ca64a-6028-d835-2e74-1324c49add1d (Addr: tcp/127.0.0.1:30348) (DC: dc1)" 31:24.853 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cd2ca64a-6028-d835-2e74-1324c49add1d.dc1 area=wan 31:24.853 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30343 network=tcp 31:24.854 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30344 network=tcp 31:24.854 [INFO] TestAgent: started state syncer 31:24.854 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30349 network=tcp 31:24.920 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.920 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30348 [Candidate]" term=2 31:24.944 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.944 [DEBUG] TestAgent.server.raft: vote granted: from=cd2ca64a-6028-d835-2e74-1324c49add1d term=2 tally=1 31:24.944 [INFO] TestAgent.server.raft: election won: tally=1 31:24.944 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30348 [Leader]" 31:24.944 [INFO] TestAgent.server: cluster leadership acquired 31:24.944 [INFO] TestAgent.server: New leader elected: payload=Node-cd2ca64a-6028-d835-2e74-1324c49add1d 31:24.954 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30348 31:24.972 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.020 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.020 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.020 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.020 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.020 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.020 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cd2ca64a-6028-d835-2e74-1324c49add1d 31:25.020 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cd2ca64a-6028-d835-2e74-1324c49add1d 31:25.036 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:25.045 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.062 [INFO] TestAgent: Synced node info 31:25.062 [DEBUG] TestAgent: Node info in sync 31:25.063 [DEBUG] TestAgent.dns: request served from client: question="{9.2.3.8.2.4.0.0.0.0.f.f.0.0.0.0.0.0.0.0.0.0.0.0.8.b.d.0.1.0.0.2.ip6.arpa. 255 1}" latency=94.074µs client=127.0.0.1:44972 client_network=udp 31:25.063 [INFO] TestAgent: Requesting shutdown 31:25.063 [INFO] TestAgent.server: shutting down server 31:25.063 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.063 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.063 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.063 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.063 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.063 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.069 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.074Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.074Z [INFO] agent.router.manager: shutting down 31:25.074 [INFO] TestAgent: consul server down 31:25.074 [INFO] TestAgent: shutdown complete 31:25.074 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30343 network=tcp 31:25.074 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30343 network=udp 31:25.074 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30344 network=tcp 31:25.576 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.576 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:24.623Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.655Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.713 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d8607efc-bb1a-ba65-66e5-fa557d7f528c Address:127.0.0.1:30341}]" 31:24.714 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d8607efc-bb1a-ba65-66e5-fa557d7f528c.dc1 127.0.0.1 31:24.715 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d8607efc-bb1a-ba65-66e5-fa557d7f528c 127.0.0.1 2021-10-05T16:31:24.715Z [INFO] agent.router: Initializing LAN area manager 31:24.715 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30341 [Follower]" leader= 31:24.715 [INFO] TestAgent.server: Adding LAN server: server="Node-d8607efc-bb1a-ba65-66e5-fa557d7f528c (Addr: tcp/127.0.0.1:30341) (DC: dc1)" 31:24.715 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d8607efc-bb1a-ba65-66e5-fa557d7f528c.dc1 area=wan 31:24.715 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30336 network=tcp 31:24.715 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30336 network=udp 31:24.716 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30337 network=tcp 31:24.716 [INFO] TestAgent: started state syncer 31:24.716 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30342 network=tcp 31:24.760 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.760 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30341 [Candidate]" term=2 31:24.812 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.812 [DEBUG] TestAgent.server.raft: vote granted: from=d8607efc-bb1a-ba65-66e5-fa557d7f528c term=2 tally=1 31:24.812 [INFO] TestAgent.server.raft: election won: tally=1 31:24.812 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30341 [Leader]" 31:24.813 [INFO] TestAgent.server: cluster leadership acquired 31:24.813 [INFO] TestAgent.server: New leader elected: payload=Node-d8607efc-bb1a-ba65-66e5-fa557d7f528c 31:24.840 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30341 31:24.874 [INFO] TestAgent: Synced node info 31:24.912 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.958 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.958 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.958 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.958 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.958 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.958 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d8607efc-bb1a-ba65-66e5-fa557d7f528c 31:24.958 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d8607efc-bb1a-ba65-66e5-fa557d7f528c 31:24.976 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.063 [DEBUG] TestAgent.dns: request served from client: question="{2.0.0.127.in-addr.arpa. 255 1}" latency=112.264µs client=127.0.0.1:35765 client_network=udp 31:25.064 [INFO] TestAgent: Requesting shutdown 31:25.064 [INFO] TestAgent.server: shutting down server 31:25.064 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.064 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.064 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.064 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.064 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.064 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.064 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.069 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.075Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.075Z [INFO] agent.router.manager: shutting down 31:25.075 [INFO] TestAgent: consul server down 31:25.075 [INFO] TestAgent: shutdown complete 31:25.075 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30336 network=tcp 31:25.075 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30336 network=udp 31:25.075 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30337 network=tcp 31:25.576 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.576 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceReverseLookup_CustomDomain (1.01s) === CONT TestDNS_NodeLookup_CNAME --- PASS: TestDNS_ServiceReverseLookup_IPV6 (0.86s) === CONT TestDNSCycleRecursorCheck === RUN TestDNS_EDNS0_ECS/global === RUN TestDNS_EDNS0_ECS/query === RUN TestDNS_EDNS0_ECS/query-subnet [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:25.071Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.085Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.156 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4f96b404-471d-22da-7803-d8633c803edd Address:127.0.0.1:30355}]" 31:25.157 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4f96b404-471d-22da-7803-d8633c803edd.dc1 127.0.0.1 31:25.158 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4f96b404-471d-22da-7803-d8633c803edd 127.0.0.1 2021-10-05T16:31:25.158Z [INFO] agent.router: Initializing LAN area manager 31:25.158 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30350 network=udp 31:25.158 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30355 [Follower]" leader= 31:25.158 [INFO] TestAgent.server: Adding LAN server: server="Node-4f96b404-471d-22da-7803-d8633c803edd (Addr: tcp/127.0.0.1:30355) (DC: dc1)" 31:25.158 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4f96b404-471d-22da-7803-d8633c803edd.dc1 area=wan 31:25.159 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30350 network=tcp 31:25.159 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30351 network=tcp 31:25.159 [INFO] TestAgent: started state syncer 31:25.159 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30356 network=tcp 31:25.224 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.224 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30355 [Candidate]" term=2 31:25.248 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.248 [DEBUG] TestAgent.server.raft: vote granted: from=4f96b404-471d-22da-7803-d8633c803edd term=2 tally=1 31:25.248 [INFO] TestAgent.server.raft: election won: tally=1 31:25.248 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30355 [Leader]" 31:25.248 [INFO] TestAgent.server: cluster leadership acquired 31:25.248 [INFO] TestAgent.server: New leader elected: payload=Node-4f96b404-471d-22da-7803-d8633c803edd 31:25.258 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30355 31:25.296 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.355 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.355 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.355 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.355 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.355 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.355 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4f96b404-471d-22da-7803-d8633c803edd 31:25.355 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4f96b404-471d-22da-7803-d8633c803edd 31:25.389 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.416 [DEBUG] TestAgent.dns: request served from client: question="{2.0.0.127.in-addr.arpa. 255 1}" latency=251.84µs client=127.0.0.1:59963 client_network=udp 31:25.416 [INFO] TestAgent: Requesting shutdown 31:25.416 [INFO] TestAgent.server: shutting down server 31:25.416 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.416 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.416 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.416 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.416 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.416 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.417 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.417 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:25.417 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.417 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.417 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.432 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.448Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.448Z [INFO] agent.router.manager: shutting down 31:25.449 [INFO] TestAgent: consul server down 31:25.449 [INFO] TestAgent: shutdown complete 31:25.449 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30350 network=tcp 31:25.449 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30350 network=udp 31:25.449 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30351 network=tcp 31:25.949 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.949 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceReverseLookup (0.90s) === CONT TestDNS_NodeLookup_AAAA 2021-10-05T16:31:25.090Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.107Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.163 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a Address:127.0.0.1:30362}]" 31:25.164 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30362 [Follower]" leader= 31:25.164 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a.dc1 127.0.0.1 31:25.165 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a 127.0.0.1 2021-10-05T16:31:25.165Z [INFO] agent.router: Initializing LAN area manager 31:25.165 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30357 network=udp 31:25.165 [INFO] TestAgent.server: Adding LAN server: server="Node-6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a (Addr: tcp/127.0.0.1:30362) (DC: dc1)" 31:25.165 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a.dc1 area=wan 31:25.165 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30357 network=tcp 31:25.166 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30358 network=tcp 31:25.166 [INFO] TestAgent: started state syncer 31:25.166 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30363 network=tcp 31:25.225 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.225 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30362 [Candidate]" term=2 31:25.245 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.245 [DEBUG] TestAgent.server.raft: vote granted: from=6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a term=2 tally=1 31:25.245 [INFO] TestAgent.server.raft: election won: tally=1 31:25.245 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30362 [Leader]" 31:25.248 [INFO] TestAgent.server: cluster leadership acquired 31:25.248 [INFO] TestAgent.server: New leader elected: payload=Node-6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a 31:25.259 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30362 31:25.277 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.309 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.309 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.309 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.309 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.309 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.309 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a 31:25.309 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6a993fcc-fd4e-2c58-2ab4-4fdd4fd7121a 31:25.330 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.344 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:25.356 [INFO] TestAgent: Synced node info 31:25.356 [DEBUG] TestAgent: Node info in sync 31:25.516 [DEBUG] TestAgent.dns: request served from client: question="{2.4.2.4.2.4.2.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.ip6.arpa. 255 1}" latency=197.746µs client=127.0.0.1:39747 client_network=udp 31:25.520 [INFO] TestAgent: Requesting shutdown 31:25.520 [INFO] TestAgent.server: shutting down server 31:25.520 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.520 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.520 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.520 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.520 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.520 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.520 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.520 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.520 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.520 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.532 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.544Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.544Z [INFO] agent.router.manager: shutting down 31:25.544 [INFO] TestAgent: consul server down 31:25.544 [INFO] TestAgent: shutdown complete 31:25.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30357 network=tcp 31:25.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30357 network=udp 31:25.544 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30358 network=tcp 31:26.044 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.044 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ReverseLookup_IPV6 (0.97s) === CONT TestDNS_NodeLookup_PeriodName [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:25.211Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.229Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.296 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fcb4bb21-bd2a-e2b6-3367-bc4e376e413c Address:127.0.0.1:30369}]" 31:25.296 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30369 [Follower]" leader= 31:25.297 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fcb4bb21-bd2a-e2b6-3367-bc4e376e413c.dc1 127.0.0.1 31:25.297 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fcb4bb21-bd2a-e2b6-3367-bc4e376e413c 127.0.0.1 2021-10-05T16:31:25.297Z [INFO] agent.router: Initializing LAN area manager 31:25.297 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30364 network=udp 31:25.298 [INFO] TestAgent.server: Adding LAN server: server="Node-fcb4bb21-bd2a-e2b6-3367-bc4e376e413c (Addr: tcp/127.0.0.1:30369) (DC: dc1)" 31:25.298 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fcb4bb21-bd2a-e2b6-3367-bc4e376e413c.dc1 area=wan 31:25.298 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30364 network=tcp 31:25.298 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30365 network=tcp 31:25.298 [INFO] TestAgent: started state syncer 31:25.298 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30370 network=tcp 31:25.353 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.353 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30369 [Candidate]" term=2 31:25.391 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.391 [DEBUG] TestAgent.server.raft: vote granted: from=fcb4bb21-bd2a-e2b6-3367-bc4e376e413c term=2 tally=1 31:25.391 [INFO] TestAgent.server.raft: election won: tally=1 31:25.391 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30369 [Leader]" 31:25.416 [INFO] TestAgent.server: cluster leadership acquired 31:25.417 [INFO] TestAgent.server: New leader elected: payload=Node-fcb4bb21-bd2a-e2b6-3367-bc4e376e413c 31:25.448 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30369 31:25.493 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.584 [INFO] TestAgent: Synced node info 31:25.584 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.584 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.584 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.584 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.584 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.584 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fcb4bb21-bd2a-e2b6-3367-bc4e376e413c 31:25.584 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fcb4bb21-bd2a-e2b6-3367-bc4e376e413c 31:25.636 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.640 [DEBUG] TestAgent.dns: request served from client: question="{2.0.0.127.in-addr.arpa. 255 1}" latency=120.415µs client=127.0.0.1:43904 client_network=udp 31:25.641 [INFO] TestAgent: Requesting shutdown 31:25.641 [INFO] TestAgent.server: shutting down server 31:25.641 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.641 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.641 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.641 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.641 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.641 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.641 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.641 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.641 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.641 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.652 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.660Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.660Z [INFO] agent.router.manager: shutting down 31:25.660 [INFO] TestAgent: consul server down 31:25.660 [INFO] TestAgent: shutdown complete 31:25.660 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30364 network=tcp 31:25.660 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30364 network=udp 31:25.660 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30365 network=tcp 31:26.163 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.163 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ReverseLookup_CustomDomain (0.98s) === CONT TestDNS_CaseInsensitiveNodeLookup 2021-10-05T16:31:25.349Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.373Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.483 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:34627bae-ad65-e2cc-0236-c961c5c78197 Address:127.0.0.1:30376}]" 31:25.484 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-34627bae-ad65-e2cc-0236-c961c5c78197.dc1 127.0.0.1 31:25.484 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30376 [Follower]" leader= 31:25.484 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-34627bae-ad65-e2cc-0236-c961c5c78197 127.0.0.1 2021-10-05T16:31:25.484Z [INFO] agent.router: Initializing LAN area manager 31:25.485 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30371 network=udp 31:25.485 [INFO] TestAgent.server: Adding LAN server: server="Node-34627bae-ad65-e2cc-0236-c961c5c78197 (Addr: tcp/127.0.0.1:30376) (DC: dc1)" 31:25.485 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-34627bae-ad65-e2cc-0236-c961c5c78197.dc1 area=wan 31:25.485 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30371 network=tcp 31:25.485 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30372 network=tcp 31:25.485 [INFO] TestAgent: started state syncer 31:25.486 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30377 network=tcp 31:25.546 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.546 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30376 [Candidate]" term=2 31:25.568 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.568 [DEBUG] TestAgent.server.raft: vote granted: from=34627bae-ad65-e2cc-0236-c961c5c78197 term=2 tally=1 31:25.568 [INFO] TestAgent.server.raft: election won: tally=1 31:25.568 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30376 [Leader]" 31:25.568 [INFO] TestAgent.server: cluster leadership acquired 31:25.569 [INFO] TestAgent.server: New leader elected: payload=Node-34627bae-ad65-e2cc-0236-c961c5c78197 31:25.594 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30376 31:25.642 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.680 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.680 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.680 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.680 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.680 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.680 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-34627bae-ad65-e2cc-0236-c961c5c78197 31:25.680 [INFO] TestAgent.server: member joined, marking health alive: member=Node-34627bae-ad65-e2cc-0236-c961c5c78197 31:25.708 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.734 [DEBUG] TestAgent.dns: request served from client: question="{2.0.0.127.in-addr.arpa. 255 1}" latency=79.94µs client=127.0.0.1:58228 client_network=udp 31:25.734 [INFO] TestAgent: Requesting shutdown 31:25.734 [INFO] TestAgent.server: shutting down server 31:25.734 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.734 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.734 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.734 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.734 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.734 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.734 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.734 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:25.734 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.734 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.734 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.748 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.760Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.760Z [INFO] agent.router.manager: shutting down 31:25.760 [INFO] TestAgent: consul server down 31:25.760 [INFO] TestAgent: shutdown complete 31:25.760 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30371 network=tcp 31:25.760 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30371 network=udp 31:25.760 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30372 network=tcp 31:26.264 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.264 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ReverseLookup (0.94s) === CONT TestDNS_NodeLookup 2021-10-05T16:31:25.375Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.390Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.470 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd Address:127.0.0.1:30383}]" 31:25.471 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd.dc1 127.0.0.1 31:25.471 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd 127.0.0.1 2021-10-05T16:31:25.471Z [INFO] agent.router: Initializing LAN area manager 31:25.472 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30378 network=udp 31:25.472 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30383 [Follower]" leader= 31:25.472 [INFO] TestAgent.server: Adding LAN server: server="Node-717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd (Addr: tcp/127.0.0.1:30383) (DC: dc1)" 31:25.472 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd.dc1 area=wan 31:25.473 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30378 network=tcp 31:25.474 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30379 network=tcp 31:25.474 [INFO] TestAgent: started state syncer 31:25.474 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30384 network=tcp 31:25.522 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.522 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30383 [Candidate]" term=2 31:25.545 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.545 [DEBUG] TestAgent.server.raft: vote granted: from=717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd term=2 tally=1 31:25.545 [INFO] TestAgent.server.raft: election won: tally=1 31:25.545 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30383 [Leader]" 31:25.545 [INFO] TestAgent.server: cluster leadership acquired 31:25.545 [INFO] TestAgent.server: New leader elected: payload=Node-717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd 31:25.563 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30383 31:25.608 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.668 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.668 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.668 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.668 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.668 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.668 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd 31:25.668 [INFO] TestAgent.server: member joined, marking health alive: member=Node-717d09ba-89d3-fcb7-cd32-fe0fcca4d1cd 31:25.692 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.716 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:25.744 [INFO] TestAgent: Synced node info 31:25.744 [DEBUG] TestAgent: Node info in sync 31:25.748 [DEBUG] TestAgent.dns: request served from client: name=db.service.consul. type=A class=IN latency=201.064µs client=127.0.0.1:40709 client_network=udp 31:25.752 [DEBUG] TestAgent.dns: request served from client: name=test.query.consul. type=A class=IN latency=180.585µs client=127.0.0.1:42903 client_network=udp 31:25.753 [DEBUG] TestAgent.dns: request served from client: name=test.query.consul. type=A class=IN latency=89.75µs client=127.0.0.1:35333 client_network=udp 31:25.753 [INFO] TestAgent: Requesting shutdown 31:25.753 [INFO] TestAgent.server: shutting down server 31:25.753 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.753 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.753 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.753 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.753 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.753 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.753 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.753 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.753 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.753 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.759 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.770Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.770Z [INFO] agent.router.manager: shutting down 31:25.770 [INFO] TestAgent: consul server down 31:25.770 [INFO] TestAgent: shutdown complete 31:25.770 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30378 network=tcp 31:25.770 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30378 network=udp 31:25.770 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30379 network=tcp 31:26.272 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.272 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_EDNS0_ECS (0.92s) --- PASS: TestDNS_EDNS0_ECS/global (0.01s) --- PASS: TestDNS_EDNS0_ECS/query (0.00s) --- PASS: TestDNS_EDNS0_ECS/query-subnet (0.00s) === CONT TestDNS_EmptyAltDomain [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:25.621Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.651Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.741 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d Address:127.0.0.1:30404}]" 31:25.741 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d.dc1 127.0.0.1 31:25.742 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d 127.0.0.1 2021-10-05T16:31:25.742Z [INFO] agent.router: Initializing LAN area manager 31:25.742 [DEBUG] TestAgent.dns: recursor enabled 31:25.742 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30399 network=udp 31:25.742 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30404 [Follower]" leader= 31:25.743 [INFO] TestAgent.server: Adding LAN server: server="Node-8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d (Addr: tcp/127.0.0.1:30404) (DC: dc1)" 31:25.743 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d.dc1 area=wan 31:25.743 [DEBUG] TestAgent.dns: recursor enabled 31:25.743 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30399 network=tcp 31:25.745 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30400 network=tcp 31:25.745 [INFO] TestAgent: started state syncer 31:25.745 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30405 network=tcp 31:25.808 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.808 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30404 [Candidate]" term=2 31:25.826 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.826 [DEBUG] TestAgent.server.raft: vote granted: from=8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d term=2 tally=1 31:25.826 [INFO] TestAgent.server.raft: election won: tally=1 31:25.826 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30404 [Leader]" 31:25.826 [INFO] TestAgent.server: cluster leadership acquired 31:25.826 [INFO] TestAgent.server: New leader elected: payload=Node-8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d 31:25.835 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30404 31:25.866 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.925 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.925 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.925 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.925 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.925 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.925 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d 31:25.925 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8a93f5ba-15a1-dcc3-a1b3-a56d18fe9f6d 31:25.949 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.968 [DEBUG] TestAgent.dns: cname recurse RTT for name: name=www.google.com. rtt=199.373µs 31:25.968 [DEBUG] TestAgent.dns: request served from client: name=google.node.consul. type=ANY class=IN latency=421.311µs client=127.0.0.1:58167 client_network=udp 31:25.968 [INFO] TestAgent: Requesting shutdown 31:25.968 [INFO] TestAgent.server: shutting down server 31:25.968 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.968 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.968 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.968 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.968 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.968 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.968 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.969 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:25.969 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.969 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.969 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.984 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.992Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.992Z [INFO] agent.router.manager: shutting down 31:25.992 [INFO] TestAgent: consul server down 31:25.992 [INFO] TestAgent: shutdown complete 31:25.992 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30399 network=tcp 31:25.992 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30399 network=udp 31:25.992 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30400 network=tcp 31:26.493 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.493 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_CNAME (0.91s) === CONT TestDNS_Over_TCP 2021-10-05T16:31:25.595Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.612Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.672 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1b577f89-087f-36f0-bc31-f012ecfb407c Address:127.0.0.1:30397}]" 31:25.672 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30397 [Follower]" leader= 31:25.673 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1b577f89-087f-36f0-bc31-f012ecfb407c.dc1 127.0.0.1 31:25.674 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1b577f89-087f-36f0-bc31-f012ecfb407c 127.0.0.1 2021-10-05T16:31:25.674Z [INFO] agent.router: Initializing LAN area manager 31:25.674 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30392 network=udp 31:25.674 [INFO] TestAgent.server: Adding LAN server: server="Node-1b577f89-087f-36f0-bc31-f012ecfb407c (Addr: tcp/127.0.0.1:30397) (DC: dc1)" 31:25.674 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1b577f89-087f-36f0-bc31-f012ecfb407c.dc1 area=wan 31:25.674 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30392 network=tcp 31:25.675 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30393 network=tcp 31:25.675 [INFO] TestAgent: started state syncer 31:25.675 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30398 network=tcp 31:25.730 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.730 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30397 [Candidate]" term=2 31:25.758 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.758 [DEBUG] TestAgent.server.raft: vote granted: from=1b577f89-087f-36f0-bc31-f012ecfb407c term=2 tally=1 31:25.758 [INFO] TestAgent.server.raft: election won: tally=1 31:25.758 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30397 [Leader]" 31:25.760 [INFO] TestAgent.server: cluster leadership acquired 31:25.760 [INFO] TestAgent.server: New leader elected: payload=Node-1b577f89-087f-36f0-bc31-f012ecfb407c 31:25.770 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30397 31:25.791 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.844 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.844 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.844 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.844 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.844 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.844 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1b577f89-087f-36f0-bc31-f012ecfb407c 31:25.844 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1b577f89-087f-36f0-bc31-f012ecfb407c 31:25.884 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.937 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:25.952 [INFO] TestAgent: Synced node info 31:26.004 [DEBUG] TestAgent.dns: request served from client: name=foo.node.dc1.consul. type=ANY class=IN latency=152.114µs client=127.0.0.1:60407 client_network=udp 31:26.008 [INFO] TestAgent: Requesting shutdown 31:26.008 [INFO] TestAgent.server: shutting down server 31:26.008 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.008 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.008 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.008 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.008 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.008 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:26.008 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.008 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.008 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.008 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.016 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.024Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.024Z [INFO] agent.router.manager: shutting down 31:26.024 [INFO] TestAgent: consul server down 31:26.024 [INFO] TestAgent: shutdown complete 31:26.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30392 network=tcp 31:26.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30392 network=udp 31:26.024 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30393 network=tcp 31:26.524 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.524 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_EDNS0 (0.95s) === CONT TestRecursorAddr --- PASS: TestRecursorAddr (0.00s) === CONT TestDiscoveryChainRead 2021-10-05T16:31:25.628Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.647Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.732 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4364acbf-60dd-adbc-f993-f591ddf6c750 Address:127.0.0.1:30411}]" 31:25.732 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4364acbf-60dd-adbc-f993-f591ddf6c750.dc1 127.0.0.1 31:25.733 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30411 [Follower]" leader= 31:25.733 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4364acbf-60dd-adbc-f993-f591ddf6c750 127.0.0.1 2021-10-05T16:31:25.733Z [INFO] agent.router: Initializing LAN area manager 31:25.733 [DEBUG] TestAgent.dns: recursor enabled 31:25.733 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30406 network=udp 31:25.733 [INFO] TestAgent.server: Adding LAN server: server="Node-4364acbf-60dd-adbc-f993-f591ddf6c750 (Addr: tcp/127.0.0.1:30411) (DC: dc1)" 31:25.733 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4364acbf-60dd-adbc-f993-f591ddf6c750.dc1 area=wan 31:25.734 [DEBUG] TestAgent.dns: recursor enabled 31:25.734 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30406 network=tcp 31:25.734 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30407 network=tcp 31:25.734 [INFO] TestAgent: started state syncer 31:25.734 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30412 network=tcp 31:25.798 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.798 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30411 [Candidate]" term=2 31:25.821 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.821 [DEBUG] TestAgent.server.raft: vote granted: from=4364acbf-60dd-adbc-f993-f591ddf6c750 term=2 tally=1 31:25.822 [INFO] TestAgent.server.raft: election won: tally=1 31:25.822 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30411 [Leader]" 31:25.822 [INFO] TestAgent.server: cluster leadership acquired 31:25.822 [INFO] TestAgent.server: New leader elected: payload=Node-4364acbf-60dd-adbc-f993-f591ddf6c750 31:25.833 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30411 31:25.862 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.925 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.925 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.925 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.925 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.925 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.925 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4364acbf-60dd-adbc-f993-f591ddf6c750 31:25.925 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4364acbf-60dd-adbc-f993-f591ddf6c750 31:25.948 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:25.949 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.967 [INFO] TestAgent: Synced node info 31:25.967 [DEBUG] TestAgent: Node info in sync 31:26.032 [DEBUG] TestAgent.dns: recurse failed for question: question="{google.com. 1 1}" rtt=89.162µs recursor=127.0.0.1:46173 rcode=SERVFAIL 31:26.032 [DEBUG] TestAgent.dns: recurse succeeded for question: question="{google.com. 1 1}" rtt=84.275µs recursor=127.0.0.1:43360 31:26.033 [DEBUG] TestAgent.dns: request served from client: question="{google.com. 1 1}" network=udp latency=356.99µs client=127.0.0.1:35198 client_network=udp 31:26.033 [INFO] TestAgent: Requesting shutdown 31:26.033 [INFO] TestAgent.server: shutting down server 31:26.033 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.033 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.033 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.033 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.033 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.033 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:26.033 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.033 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.033 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.033 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.043 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.048Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.048Z [INFO] agent.router.manager: shutting down 31:26.048 [INFO] TestAgent: consul server down 31:26.048 [INFO] TestAgent: shutdown complete 31:26.048 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30406 network=tcp 31:26.048 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30406 network=udp 31:26.048 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30407 network=tcp 31:26.548 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.548 [INFO] TestAgent: Endpoints down --- PASS: TestDNSCycleRecursorCheck (0.97s) === CONT TestDenylist === RUN TestDenylist/nothing_blocked_root === RUN TestDenylist/nothing_blocked_path === RUN TestDenylist/exact_match_1 === RUN TestDenylist/exact_match_2 === RUN TestDenylist/subpath === RUN TestDenylist/longer_prefix === RUN TestDenylist/longer_subpath === RUN TestDenylist/partial_prefix === RUN TestDenylist/no_match --- PASS: TestDenylist (0.00s) --- PASS: TestDenylist/nothing_blocked_root (0.00s) --- PASS: TestDenylist/nothing_blocked_path (0.00s) --- PASS: TestDenylist/exact_match_1 (0.00s) --- PASS: TestDenylist/exact_match_2 (0.00s) --- PASS: TestDenylist/subpath (0.00s) --- PASS: TestDenylist/longer_prefix (0.00s) --- PASS: TestDenylist/longer_subpath (0.00s) --- PASS: TestDenylist/partial_prefix (0.00s) --- PASS: TestDenylist/no_match (0.00s) === CONT TestCoordinate_Datacenters [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDiscoveryChainRead/GET:_error_on_no_service_name === RUN TestDiscoveryChainRead/GET:_read_default_chain === RUN TestDiscoveryChainRead/GET:_read_default_chain;_evaluate_in_dc2 === RUN TestDiscoveryChainRead/GET:_read_default_chain_with_cache === RUN TestDiscoveryChainRead/POST:_error_on_no_service_name === RUN TestDiscoveryChainRead/POST:_read_default_chain === RUN TestDiscoveryChainRead/POST:_read_default_chain;_evaluate_in_dc2 === RUN TestDiscoveryChainRead/POST:_read_default_chain_with_cache === RUN TestDiscoveryChainRead/GET:_read_modified_chain === RUN TestDiscoveryChainRead/POST:_read_modified_chain_with_overrides_(camel_case) === RUN TestDiscoveryChainRead/POST:_read_modified_chain_with_overrides_(snake_case) 2021-10-05T16:31:26.061Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.101Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.188 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:015245b4-1863-8473-d268-fd692495da0e Address:127.0.0.1:29405}]" 31:26.189 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-015245b4-1863-8473-d268-fd692495da0e.dc1 127.0.0.1 31:26.189 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-015245b4-1863-8473-d268-fd692495da0e 127.0.0.1 2021-10-05T16:31:26.189Z [INFO] agent.router: Initializing LAN area manager 31:26.189 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=udp 31:26.189 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29405 [Follower]" leader= 31:26.190 [INFO] TestAgent.server: Adding LAN server: server="Node-015245b4-1863-8473-d268-fd692495da0e (Addr: tcp/127.0.0.1:29405) (DC: dc1)" 31:26.190 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-015245b4-1863-8473-d268-fd692495da0e.dc1 area=wan 31:26.190 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=tcp 31:26.190 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29401 network=tcp 31:26.190 [INFO] TestAgent: started state syncer 31:26.191 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29406 network=tcp 31:26.244 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.244 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29405 [Candidate]" term=2 31:26.289 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.289 [DEBUG] TestAgent.server.raft: vote granted: from=015245b4-1863-8473-d268-fd692495da0e term=2 tally=1 31:26.289 [INFO] TestAgent.server.raft: election won: tally=1 31:26.289 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29405 [Leader]" 31:26.292 [INFO] TestAgent.server: cluster leadership acquired 31:26.292 [INFO] TestAgent.server: New leader elected: payload=Node-015245b4-1863-8473-d268-fd692495da0e 31:26.336 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29405 31:26.384 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.456 [INFO] TestAgent: Synced node info 31:26.456 [DEBUG] TestAgent: Node info in sync 31:26.477 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.477 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.477 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.477 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.477 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.477 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-015245b4-1863-8473-d268-fd692495da0e 31:26.477 [INFO] TestAgent.server: member joined, marking health alive: member=Node-015245b4-1863-8473-d268-fd692495da0e 31:26.520 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.520 [DEBUG] TestAgent.dns: request served from client: name=foo.bar.node.consul. type=ANY class=IN latency=78.847µs client=127.0.0.1:46519 client_network=udp 31:26.520 [INFO] TestAgent: Requesting shutdown 31:26.520 [INFO] TestAgent.server: shutting down server 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.520 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.520 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.528 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.533Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.533Z [INFO] agent.router.manager: shutting down 31:26.533 [INFO] TestAgent: consul server down 31:26.533 [INFO] TestAgent: shutdown complete 31:26.533 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=tcp 31:26.533 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=udp 31:26.533 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29401 network=tcp 31:27.036 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.036 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_PeriodName (0.99s) === CONT TestCoordinate_Update_ACLDeny 2021-10-05T16:31:25.975Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.994Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.076 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7951a49c-b685-fe8c-eb1b-59e199362228 Address:127.0.0.1:30418}]" 31:26.077 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7951a49c-b685-fe8c-eb1b-59e199362228.dc1 127.0.0.1 31:26.077 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7951a49c-b685-fe8c-eb1b-59e199362228 127.0.0.1 2021-10-05T16:31:26.077Z [INFO] agent.router: Initializing LAN area manager 31:26.077 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30413 network=udp 31:26.077 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30418 [Follower]" leader= 31:26.078 [INFO] TestAgent.server: Adding LAN server: server="Node-7951a49c-b685-fe8c-eb1b-59e199362228 (Addr: tcp/127.0.0.1:30418) (DC: dc1)" 31:26.078 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7951a49c-b685-fe8c-eb1b-59e199362228.dc1 area=wan 31:26.078 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30413 network=tcp 31:26.078 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30414 network=tcp 31:26.079 [INFO] TestAgent: started state syncer 31:26.079 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30419 network=tcp 31:26.143 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.143 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30418 [Candidate]" term=2 31:26.155 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.155 [DEBUG] TestAgent.server.raft: vote granted: from=7951a49c-b685-fe8c-eb1b-59e199362228 term=2 tally=1 31:26.155 [INFO] TestAgent.server.raft: election won: tally=1 31:26.155 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30418 [Leader]" 31:26.156 [INFO] TestAgent.server: cluster leadership acquired 31:26.156 [INFO] TestAgent.server: New leader elected: payload=Node-7951a49c-b685-fe8c-eb1b-59e199362228 31:26.168 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30418 31:26.224 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.312 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.312 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.312 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.312 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.312 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.312 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7951a49c-b685-fe8c-eb1b-59e199362228 31:26.312 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7951a49c-b685-fe8c-eb1b-59e199362228 31:26.353 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.428 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:26.438 [INFO] TestAgent: Synced node info 31:26.438 [DEBUG] TestAgent: Node info in sync 31:26.516 [DEBUG] TestAgent.dns: request served from client: name=bar.node.consul. type=AAAA class=IN latency=124.203µs client=127.0.0.1:37440 client_network=udp 31:26.520 [INFO] TestAgent: Requesting shutdown 31:26.520 [INFO] TestAgent.server: shutting down server 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.520 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.520 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.520 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:26.520 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.532 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.544Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.544Z [INFO] agent.router.manager: shutting down 31:26.544 [INFO] TestAgent: consul server down 31:26.544 [INFO] TestAgent: shutdown complete 31:26.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30413 network=tcp 31:26.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30413 network=udp 31:26.544 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30414 network=tcp 31:27.044 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.044 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup_AAAA (1.09s) === CONT TestCoordinate_Update [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:26.316Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.363Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.412 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:67f1f7ff-0659-6224-52fa-90a1bed50a54 Address:127.0.0.1:29447}]" 31:26.413 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-67f1f7ff-0659-6224-52fa-90a1bed50a54.dc1 127.0.0.1 31:26.413 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-67f1f7ff-0659-6224-52fa-90a1bed50a54 127.0.0.1 2021-10-05T16:31:26.413Z [INFO] agent.router: Initializing LAN area manager 31:26.414 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29477 network=udp 31:26.414 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29447 [Follower]" leader= 31:26.414 [INFO] TestAgent.server: Adding LAN server: server="Node-67f1f7ff-0659-6224-52fa-90a1bed50a54 (Addr: tcp/127.0.0.1:29447) (DC: dc1)" 31:26.414 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-67f1f7ff-0659-6224-52fa-90a1bed50a54.dc1 area=wan 31:26.414 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29477 network=tcp 31:26.415 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29478 network=tcp 31:26.415 [INFO] TestAgent: started state syncer 31:26.415 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29448 network=tcp 31:26.472 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.472 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29447 [Candidate]" term=2 31:26.490 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.490 [DEBUG] TestAgent.server.raft: vote granted: from=67f1f7ff-0659-6224-52fa-90a1bed50a54 term=2 tally=1 31:26.490 [INFO] TestAgent.server.raft: election won: tally=1 31:26.490 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29447 [Leader]" 31:26.490 [INFO] TestAgent.server: cluster leadership acquired 31:26.491 [INFO] TestAgent.server: New leader elected: payload=Node-67f1f7ff-0659-6224-52fa-90a1bed50a54 31:26.501 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29447 31:26.532 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.590 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.590 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.590 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.590 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.590 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.590 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-67f1f7ff-0659-6224-52fa-90a1bed50a54 31:26.590 [INFO] TestAgent.server: member joined, marking health alive: member=Node-67f1f7ff-0659-6224-52fa-90a1bed50a54 31:26.624 [INFO] TestAgent: Synced node info 31:26.631 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.641 [INFO] TestAgent: Requesting shutdown 31:26.641 [INFO] TestAgent.server: shutting down server 31:26.641 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.641 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.641 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.641 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.641 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.641 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:26.641 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.641 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.641 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.641 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.651 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.656Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.656Z [INFO] agent.router.manager: shutting down 31:26.656 [INFO] TestAgent: consul server down 31:26.656 [INFO] TestAgent: shutdown complete 31:26.656 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29477 network=tcp 31:26.656 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29477 network=udp 31:26.656 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29478 network=tcp 31:27.157 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.157 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_EmptyAltDomain (0.89s) === CONT TestCoordinate_Node 2021-10-05T16:31:26.191Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.245Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.322 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:63653eb7-67ac-e1d7-4c56-5de0aa5f98dc Address:127.0.0.1:29412}]" 31:26.322 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29412 [Follower]" leader= 31:26.322 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-63653eb7-67ac-e1d7-4c56-5de0aa5f98dc.dc1 127.0.0.1 31:26.336 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-63653eb7-67ac-e1d7-4c56-5de0aa5f98dc 127.0.0.1 2021-10-05T16:31:26.336Z [INFO] agent.router: Initializing LAN area manager 31:26.336 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=udp 31:26.341 [INFO] TestAgent.server: Adding LAN server: server="Node-63653eb7-67ac-e1d7-4c56-5de0aa5f98dc (Addr: tcp/127.0.0.1:29412) (DC: dc1)" 31:26.341 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-63653eb7-67ac-e1d7-4c56-5de0aa5f98dc.dc1 area=wan 31:26.342 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=tcp 31:26.342 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29408 network=tcp 31:26.342 [INFO] TestAgent: started state syncer 31:26.342 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29413 network=tcp 31:26.382 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.382 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29412 [Candidate]" term=2 31:26.428 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.428 [DEBUG] TestAgent.server.raft: vote granted: from=63653eb7-67ac-e1d7-4c56-5de0aa5f98dc term=2 tally=1 31:26.428 [INFO] TestAgent.server.raft: election won: tally=1 31:26.428 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29412 [Leader]" 31:26.429 [INFO] TestAgent.server: cluster leadership acquired 31:26.429 [INFO] TestAgent.server: New leader elected: payload=Node-63653eb7-67ac-e1d7-4c56-5de0aa5f98dc 31:26.444 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29412 31:26.468 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.497 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.497 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.497 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.497 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.497 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.497 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-63653eb7-67ac-e1d7-4c56-5de0aa5f98dc 31:26.497 [INFO] TestAgent.server: member joined, marking health alive: member=Node-63653eb7-67ac-e1d7-4c56-5de0aa5f98dc 31:26.515 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.608 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:26.615 [INFO] TestAgent: Synced node info 31:26.653 [DEBUG] TestAgent.dns: request served from client: name=fOO.node.dc1.consul. type=ANY class=IN latency=86.45µs client=127.0.0.1:58996 client_network=udp 31:26.653 [INFO] TestAgent: Requesting shutdown 31:26.653 [INFO] TestAgent.server: shutting down server 31:26.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.653 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.653 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.653 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.653 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:26.653 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.653 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.653 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.653 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.660 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.668Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.668Z [INFO] agent.router.manager: shutting down 31:26.668 [INFO] TestAgent: consul server down 31:26.668 [INFO] TestAgent: shutdown complete 31:26.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=tcp 31:26.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=udp 31:26.668 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29408 network=tcp 31:27.171 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.171 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_CaseInsensitiveNodeLookup (1.01s) === CONT TestCoordinate_Nodes 2021-10-05T16:31:26.311Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.363Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.461 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8b45440f-e301-8a9f-ff67-985514004c2d Address:127.0.0.1:29489}]" 31:26.462 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29489 [Follower]" leader= 31:26.462 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8b45440f-e301-8a9f-ff67-985514004c2d.dc1 127.0.0.1 31:26.463 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8b45440f-e301-8a9f-ff67-985514004c2d 127.0.0.1 2021-10-05T16:31:26.463Z [INFO] agent.router: Initializing LAN area manager 31:26.463 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29414 network=udp 31:26.463 [INFO] TestAgent.server: Adding LAN server: server="Node-8b45440f-e301-8a9f-ff67-985514004c2d (Addr: tcp/127.0.0.1:29489) (DC: dc1)" 31:26.463 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8b45440f-e301-8a9f-ff67-985514004c2d.dc1 area=wan 31:26.464 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29414 network=tcp 31:26.464 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29415 network=tcp 31:26.464 [INFO] TestAgent: started state syncer 31:26.464 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29490 network=tcp 31:26.500 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.500 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29489 [Candidate]" term=2 31:26.524 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.524 [DEBUG] TestAgent.server.raft: vote granted: from=8b45440f-e301-8a9f-ff67-985514004c2d term=2 tally=1 31:26.524 [INFO] TestAgent.server.raft: election won: tally=1 31:26.524 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29489 [Leader]" 31:26.532 [INFO] TestAgent.server: cluster leadership acquired 31:26.532 [INFO] TestAgent.server: New leader elected: payload=Node-8b45440f-e301-8a9f-ff67-985514004c2d 31:26.568 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29489 31:26.620 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.696 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.696 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.696 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.696 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.696 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.696 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8b45440f-e301-8a9f-ff67-985514004c2d 31:26.696 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8b45440f-e301-8a9f-ff67-985514004c2d 31:26.728 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=ANY class=IN latency=120.594µs client=127.0.0.1:52902 client_network=udp 31:26.729 [DEBUG] TestAgent.dns: request served from client: name=foo.node.consul. type=A class=IN latency=78.313µs client=127.0.0.1:39791 client_network=udp 31:26.729 [DEBUG] TestAgent.dns: request served from client: name=foo.node.dc1.consul. type=ANY class=IN latency=76.775µs client=127.0.0.1:41711 client_network=udp 31:26.729 [DEBUG] TestAgent.dns: request served from client: name=nofoo.node.dc1.consul. type=ANY class=IN latency=117.496µs client=127.0.0.1:50785 client_network=udp 31:26.729 [INFO] TestAgent: Requesting shutdown 31:26.729 [INFO] TestAgent.server: shutting down server 31:26.729 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.729 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.729 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.729 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.729 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.729 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 31:26.729 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.729 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:26.730 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.730 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.730 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.748 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.756Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.756Z [INFO] agent.router.manager: shutting down 31:26.756 [INFO] TestAgent: consul server down 31:26.756 [INFO] TestAgent: shutdown complete 31:26.756 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29414 network=tcp 31:26.756 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29414 network=udp 31:26.756 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29415 network=tcp 31:27.262 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.262 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_NodeLookup (0.99s) === CONT TestCoordinate_Disabled_Response [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:26.577Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.609Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.704 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cf536da1-c806-ed6c-6514-e4c701de3263 Address:127.0.0.1:29454}]" 31:26.704 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29454 [Follower]" leader= 31:26.705 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cf536da1-c806-ed6c-6514-e4c701de3263.dc1 127.0.0.1 31:26.706 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cf536da1-c806-ed6c-6514-e4c701de3263 127.0.0.1 2021-10-05T16:31:26.706Z [INFO] agent.router: Initializing LAN area manager 31:26.706 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29435 network=udp 31:26.706 [INFO] TestAgent.server: Adding LAN server: server="Node-cf536da1-c806-ed6c-6514-e4c701de3263 (Addr: tcp/127.0.0.1:29454) (DC: dc1)" 31:26.706 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cf536da1-c806-ed6c-6514-e4c701de3263.dc1 area=wan 31:26.707 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29435 network=tcp 31:26.707 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29436 network=tcp 31:26.707 [INFO] TestAgent: started state syncer 31:26.707 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29455 network=tcp 31:26.764 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.764 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29454 [Candidate]" term=2 31:26.803 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.803 [DEBUG] TestAgent.server.raft: vote granted: from=cf536da1-c806-ed6c-6514-e4c701de3263 term=2 tally=1 31:26.803 [INFO] TestAgent.server.raft: election won: tally=1 31:26.803 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29454 [Leader]" 31:26.803 [INFO] TestAgent.server: cluster leadership acquired 31:26.803 [INFO] TestAgent.server: New leader elected: payload=Node-cf536da1-c806-ed6c-6514-e4c701de3263 31:26.832 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29454 31:26.875 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.926 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.926 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.926 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.926 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.926 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.926 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cf536da1-c806-ed6c-6514-e4c701de3263 31:26.926 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cf536da1-c806-ed6c-6514-e4c701de3263 31:26.964 [INFO] TestAgent: Synced node info 31:26.964 [DEBUG] TestAgent: Node info in sync 31:26.976 [INFO] TestAgent: Requesting shutdown 31:26.976 [INFO] TestAgent.server: shutting down server 31:26.976 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.976 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.976 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.976 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.976 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.976 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.976 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.976 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.980 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.980 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.984 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.992Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.992Z [INFO] agent.router.manager: shutting down 31:26.992 [INFO] TestAgent: consul server down 31:26.992 [INFO] TestAgent: shutdown complete 31:26.992 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29435 network=tcp 31:26.992 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29435 network=udp 31:26.992 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29436 network=tcp 31:27.492 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.492 [INFO] TestAgent: Endpoints down --- PASS: TestCoordinate_Datacenters (0.94s) === CONT TestConnectCAConfig === RUN TestConnectCAConfig/basic 2021-10-05T16:31:26.583Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.613Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.648 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6 Address:127.0.0.1:29426}]" 31:26.649 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6.dc1 127.0.0.1 31:26.650 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6 127.0.0.1 2021-10-05T16:31:26.650Z [INFO] agent.router: Initializing LAN area manager 31:26.650 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29470 network=udp 31:26.650 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29426 [Follower]" leader= 31:26.651 [INFO] TestAgent.server: Adding LAN server: server="Node-c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6 (Addr: tcp/127.0.0.1:29426) (DC: dc1)" 31:26.651 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6.dc1 area=wan 31:26.651 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29470 network=tcp 31:26.651 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29471 network=tcp 31:26.651 [INFO] TestAgent: started state syncer 31:26.652 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29427 network=tcp 31:26.713 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.713 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29426 [Candidate]" term=2 31:26.748 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.748 [DEBUG] TestAgent.server.raft: vote granted: from=c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6 term=2 tally=1 31:26.748 [INFO] TestAgent.server.raft: election won: tally=1 31:26.748 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29426 [Leader]" 31:26.748 [INFO] TestAgent.server: cluster leadership acquired 31:26.748 [INFO] TestAgent.server: New leader elected: payload=Node-c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6 31:26.766 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29426 31:26.792 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.848 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.848 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.848 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.848 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.848 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.848 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6 31:26.848 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c2a8c3dd-1396-847c-dd0e-70f1fb8a80c6 31:26.880 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.924 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:26.936 [INFO] TestAgent: Synced node info 31:27.025 [INFO] TestAgent: Requesting shutdown 31:27.025 [INFO] TestAgent.server: shutting down server 31:27.025 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.025 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.025 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.025 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.025 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.025 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.025 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.025 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.025 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.025 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.036 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.044Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.044Z [INFO] agent.router.manager: shutting down 31:27.044 [INFO] TestAgent: consul server down 31:27.044 [INFO] TestAgent: shutdown complete 31:27.044 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29470 network=tcp 31:27.044 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29470 network=udp 31:27.044 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29471 network=tcp 31:27.545 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.545 [INFO] TestAgent: Endpoints down --- PASS: TestDiscoveryChainRead (1.02s) --- PASS: TestDiscoveryChainRead/GET:_error_on_no_service_name (0.00s) --- PASS: TestDiscoveryChainRead/GET:_read_default_chain (0.00s) --- PASS: TestDiscoveryChainRead/GET:_read_default_chain;_evaluate_in_dc2 (0.00s) --- PASS: TestDiscoveryChainRead/GET:_read_default_chain_with_cache (0.00s) --- PASS: TestDiscoveryChainRead/POST:_error_on_no_service_name (0.00s) --- PASS: TestDiscoveryChainRead/POST:_read_default_chain (0.00s) --- PASS: TestDiscoveryChainRead/POST:_read_default_chain;_evaluate_in_dc2 (0.00s) --- PASS: TestDiscoveryChainRead/POST:_read_default_chain_with_cache (0.00s) --- PASS: TestDiscoveryChainRead/GET:_read_modified_chain (0.03s) --- PASS: TestDiscoveryChainRead/POST:_read_modified_chain_with_overrides_(camel_case) (0.00s) --- PASS: TestDiscoveryChainRead/POST:_read_modified_chain_with_overrides_(snake_case) (0.00s) === CONT TestConnectCARoots_list [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestCoordinate_Update_ACLDeny/no_token === RUN TestCoordinate_Update_ACLDeny/valid_token 2021-10-05T16:31:26.517Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.577Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.672 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0 Address:127.0.0.1:29468}]" 31:26.672 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29468 [Follower]" leader= 31:26.673 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0.dc1 127.0.0.1 31:26.673 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0 127.0.0.1 2021-10-05T16:31:26.673Z [INFO] agent.router: Initializing LAN area manager 31:26.673 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29484 network=udp 31:26.674 [INFO] TestAgent.server: Adding LAN server: server="Node-fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0 (Addr: tcp/127.0.0.1:29468) (DC: dc1)" 31:26.674 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0.dc1 area=wan 31:26.674 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29484 network=tcp 31:26.675 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29485 network=tcp 31:26.675 [INFO] TestAgent: started state syncer 31:26.675 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29469 network=tcp 31:26.733 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.733 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29468 [Candidate]" term=2 31:26.765 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.765 [DEBUG] TestAgent.server.raft: vote granted: from=fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0 term=2 tally=1 31:26.765 [INFO] TestAgent.server.raft: election won: tally=1 31:26.765 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29468 [Leader]" 31:26.765 [INFO] TestAgent.server: cluster leadership acquired 31:26.766 [INFO] TestAgent.server: New leader elected: payload=Node-fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0 31:26.781 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29468 31:26.793 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.825 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.825 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.825 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.825 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.825 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.825 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0 31:26.825 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fbacdd0f-ca3b-0c5c-9144-141bc9cc77b0 31:26.852 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.876 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:26.888 [INFO] TestAgent: Synced node info 31:26.888 [DEBUG] TestAgent: Node info in sync 31:27.116 [DEBUG] TestAgent.dns: request served from client: name=foo.node.dc1.consul. type=ANY class=IN latency=163.732µs client=127.0.0.1:38910 client_network=tcp 31:27.116 [INFO] TestAgent: Requesting shutdown 31:27.116 [INFO] TestAgent.server: shutting down server 31:27.116 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.116 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.116 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.116 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.116 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.116 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.116 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.116 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.116 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.116 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.128 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.134Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.134Z [INFO] agent.router.manager: shutting down 31:27.134 [INFO] TestAgent: consul server down 31:27.134 [INFO] TestAgent: shutdown complete 31:27.134 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29484 network=tcp 31:27.134 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29484 network=udp 31:27.134 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29485 network=tcp 31:27.635 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.635 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_Over_TCP (1.14s) === CONT TestConnectCARoots_empty === RUN TestCoordinate_Disabled_Response/0 === RUN TestCoordinate_Disabled_Response/1 === RUN TestCoordinate_Disabled_Response/2 === RUN TestCoordinate_Disabled_Response/3 [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:27.281Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.295Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.356 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:27a3a10f-608c-bd86-ca3f-46e1e9d61764 Address:127.0.0.1:29517}]" 31:27.356 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29517 [Follower]" leader= 31:27.357 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-27a3a10f-608c-bd86-ca3f-46e1e9d61764.dc1 127.0.0.1 31:27.357 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-27a3a10f-608c-bd86-ca3f-46e1e9d61764 127.0.0.1 2021-10-05T16:31:27.357Z [INFO] agent.router: Initializing LAN area manager 31:27.357 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29463 network=udp 31:27.357 [INFO] TestAgent.server: Adding LAN server: server="Node-27a3a10f-608c-bd86-ca3f-46e1e9d61764 (Addr: tcp/127.0.0.1:29517) (DC: dc1)" 31:27.357 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-27a3a10f-608c-bd86-ca3f-46e1e9d61764.dc1 area=wan 31:27.357 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29463 network=tcp 31:27.358 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29464 network=tcp 31:27.358 [INFO] TestAgent: started state syncer 31:27.358 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29518 network=tcp 31:27.410 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.410 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29517 [Candidate]" term=2 31:27.435 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.435 [DEBUG] TestAgent.server.raft: vote granted: from=27a3a10f-608c-bd86-ca3f-46e1e9d61764 term=2 tally=1 31:27.435 [INFO] TestAgent.server.raft: election won: tally=1 31:27.435 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29517 [Leader]" 31:27.435 [INFO] TestAgent.server: cluster leadership acquired 31:27.435 [INFO] TestAgent.server: New leader elected: payload=Node-27a3a10f-608c-bd86-ca3f-46e1e9d61764 31:27.461 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29517 31:27.492 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.537 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.537 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.537 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.537 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.537 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.537 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-27a3a10f-608c-bd86-ca3f-46e1e9d61764 31:27.537 [INFO] TestAgent.server: member joined, marking health alive: member=Node-27a3a10f-608c-bd86-ca3f-46e1e9d61764 31:27.560 [DEBUG] TestAgent.dns: request served from client: name=nofoo.node.dc1.consul. type=ANY class=IN latency=221.223µs client=127.0.0.1:47852 client_network=udp 31:27.560 [INFO] TestAgent: Requesting shutdown 31:27.561 [INFO] TestAgent.server: shutting down server 31:27.561 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.561 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.561 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.561 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.561 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.561 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:27.561 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.561 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.561 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.568 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.568 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.572 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.580Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.580Z [INFO] agent.router.manager: shutting down 31:27.580 [INFO] TestAgent: consul server down 31:27.580 [INFO] TestAgent: shutdown complete 31:27.580 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29463 network=tcp 31:27.580 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29463 network=udp 31:27.580 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29464 network=tcp 31:28.080 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.080 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:26.402Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:26.431Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:26.488 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0ec32489-0c8e-f61b-d32d-937db639e379 Address:127.0.0.1:29475}]" 31:26.488 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29475 [Follower]" leader= 31:26.488 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0ec32489-0c8e-f61b-d32d-937db639e379.dc1 127.0.0.1 31:26.489 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0ec32489-0c8e-f61b-d32d-937db639e379 127.0.0.1 2021-10-05T16:31:26.489Z [INFO] agent.router: Initializing LAN area manager 31:26.489 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29449 network=udp 31:26.489 [INFO] TestAgent.server: Adding LAN server: server="Node-0ec32489-0c8e-f61b-d32d-937db639e379 (Addr: tcp/127.0.0.1:29475) (DC: dc1)" 31:26.489 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0ec32489-0c8e-f61b-d32d-937db639e379.dc1 area=wan 31:26.490 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29449 network=tcp 31:26.490 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29450 network=tcp 31:26.490 [INFO] TestAgent: started state syncer 31:26.490 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29476 network=tcp 31:26.528 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:26.528 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29475 [Candidate]" term=2 31:26.576 [DEBUG] TestAgent.server.raft: votes: needed=1 31:26.576 [DEBUG] TestAgent.server.raft: vote granted: from=0ec32489-0c8e-f61b-d32d-937db639e379 term=2 tally=1 31:26.576 [INFO] TestAgent.server.raft: election won: tally=1 31:26.576 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29475 [Leader]" 31:26.580 [INFO] TestAgent.server: cluster leadership acquired 31:26.580 [INFO] TestAgent.server: New leader elected: payload=Node-0ec32489-0c8e-f61b-d32d-937db639e379 31:26.608 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29475 31:26.652 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:26.679 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:26.679 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:26.679 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:26.679 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:26.679 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:26.679 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0ec32489-0c8e-f61b-d32d-937db639e379 31:26.679 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0ec32489-0c8e-f61b-d32d-937db639e379 31:26.701 [INFO] TestAgent.server: federation state anti-entropy synced 31:26.706 [DEBUG] TestAgent.dns: request served from client: name=nofoo.node.dc1.consul. type=ANY class=IN latency=130.572µs client=127.0.0.1:60278 client_network=udp 31:26.706 [INFO] TestAgent: Requesting shutdown 31:26.706 [INFO] TestAgent.server: shutting down server 31:26.706 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:26.706 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:26.706 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:26.706 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:26.706 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:26.707 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:26.707 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:26.707 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:26.707 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:26.707 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:26.707 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:26.711 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:26.714Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:26.714Z [INFO] agent.router.manager: shutting down 31:26.714 [INFO] TestAgent: consul server down 31:26.714 [INFO] TestAgent: shutdown complete 31:26.714 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29449 network=tcp 31:26.714 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29449 network=udp 31:26.714 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29450 network=tcp 31:27.215 [INFO] TestAgent: Waiting for endpoints to shut down 31:27.215 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:25.497Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:25.532Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:25.636 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ac83cc04-04ed-ebeb-bd3c-d62c0f94326d Address:127.0.0.1:30390}]" 31:25.636 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30390 [Follower]" leader= 31:25.637 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ac83cc04-04ed-ebeb-bd3c-d62c0f94326d.dc1 127.0.0.1 31:25.637 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ac83cc04-04ed-ebeb-bd3c-d62c0f94326d 127.0.0.1 2021-10-05T16:31:25.637Z [INFO] agent.router: Initializing LAN area manager 31:25.637 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30385 network=udp 31:25.638 [INFO] TestAgent.server: Adding LAN server: server="Node-ac83cc04-04ed-ebeb-bd3c-d62c0f94326d (Addr: tcp/127.0.0.1:30390) (DC: dc1)" 31:25.638 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ac83cc04-04ed-ebeb-bd3c-d62c0f94326d.dc1 area=wan 31:25.638 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30385 network=tcp 31:25.638 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30386 network=tcp 31:25.638 [INFO] TestAgent: started state syncer 31:25.638 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30391 network=tcp 31:25.691 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:25.691 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30390 [Candidate]" term=2 31:25.706 [DEBUG] TestAgent.server.raft: votes: needed=1 31:25.706 [DEBUG] TestAgent.server.raft: vote granted: from=ac83cc04-04ed-ebeb-bd3c-d62c0f94326d term=2 tally=1 31:25.706 [INFO] TestAgent.server.raft: election won: tally=1 31:25.706 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30390 [Leader]" 31:25.706 [INFO] TestAgent.server: cluster leadership acquired 31:25.706 [INFO] TestAgent.server: New leader elected: payload=Node-ac83cc04-04ed-ebeb-bd3c-d62c0f94326d 31:25.720 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30390 31:25.755 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:25.801 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:25.801 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:25.801 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:25.801 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:25.801 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:25.801 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ac83cc04-04ed-ebeb-bd3c-d62c0f94326d 31:25.801 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ac83cc04-04ed-ebeb-bd3c-d62c0f94326d 31:25.825 [INFO] TestAgent.server: federation state anti-entropy synced 31:25.842 [DEBUG] TestAgent.dns: request served from client: name=nofoo.node.dc1.consul. type=ANY class=IN latency=322.601µs client=127.0.0.1:34974 client_network=udp 31:25.842 [INFO] TestAgent: Requesting shutdown 31:25.842 [INFO] TestAgent.server: shutting down server 31:25.842 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:25.842 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:25.842 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:25.842 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:25.842 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:25.842 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:25.842 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:25.842 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:25.842 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:25.842 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:25.842 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:25.847 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:25.859Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:25.859Z [INFO] agent.router.manager: shutting down 31:25.859 [INFO] TestAgent: consul server down 31:25.859 [INFO] TestAgent: shutdown complete 31:25.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30385 network=tcp 31:25.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30385 network=udp 31:25.859 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30386 network=tcp 31:26.360 [INFO] TestAgent: Waiting for endpoints to shut down 31:26.360 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:24.574Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:24.608Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:24.645 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b40a57a6-40ce-ccb7-ef2a-78951f7f8488 Address:127.0.0.1:30334}]" 31:24.646 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b40a57a6-40ce-ccb7-ef2a-78951f7f8488.dc1 127.0.0.1 31:24.647 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b40a57a6-40ce-ccb7-ef2a-78951f7f8488 127.0.0.1 2021-10-05T16:31:24.647Z [INFO] agent.router: Initializing LAN area manager 31:24.647 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30329 network=udp 31:24.647 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30334 [Follower]" leader= 31:24.647 [INFO] TestAgent.server: Adding LAN server: server="Node-b40a57a6-40ce-ccb7-ef2a-78951f7f8488 (Addr: tcp/127.0.0.1:30334) (DC: dc1)" 31:24.647 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b40a57a6-40ce-ccb7-ef2a-78951f7f8488.dc1 area=wan 31:24.647 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30329 network=tcp 31:24.648 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30330 network=tcp 31:24.648 [INFO] TestAgent: started state syncer 31:24.649 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30335 network=tcp 31:24.705 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:24.705 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30334 [Candidate]" term=2 31:24.724 [DEBUG] TestAgent.server.raft: votes: needed=1 31:24.724 [DEBUG] TestAgent.server.raft: vote granted: from=b40a57a6-40ce-ccb7-ef2a-78951f7f8488 term=2 tally=1 31:24.724 [INFO] TestAgent.server.raft: election won: tally=1 31:24.724 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30334 [Leader]" 31:24.726 [INFO] TestAgent.server: cluster leadership acquired 31:24.727 [INFO] TestAgent.server: New leader elected: payload=Node-b40a57a6-40ce-ccb7-ef2a-78951f7f8488 31:24.740 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30334 31:24.770 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:24.824 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:24.824 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:24.824 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:24.824 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:24.824 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:24.824 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b40a57a6-40ce-ccb7-ef2a-78951f7f8488 31:24.824 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b40a57a6-40ce-ccb7-ef2a-78951f7f8488 31:24.859 [INFO] TestAgent.server: federation state anti-entropy synced 31:24.937 [DEBUG] TestAgent.dns: request served from client: name=nofoo.node.dc1.consul. type=ANY class=IN latency=222.989µs client=127.0.0.1:58458 client_network=udp 31:24.938 [INFO] TestAgent: Requesting shutdown 31:24.938 [INFO] TestAgent.server: shutting down server 31:24.938 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:24.938 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:24.938 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:24.938 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:24.938 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:24.938 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:24.938 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:24.938 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:24.938 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:24.938 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:24.938 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:24.945 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:24.951Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:24.951Z [INFO] agent.router.manager: shutting down 31:24.951 [INFO] TestAgent: consul server down 31:24.951 [INFO] TestAgent: shutdown complete 31:24.951 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30329 network=tcp 31:24.951 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30329 network=udp 31:24.951 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30330 network=tcp 31:25.452 [INFO] TestAgent: Waiting for endpoints to shut down 31:25.452 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_SOA_Settings (3.58s) === CONT TestConfig_Apply_ProxyDefaultsExpose 2021-10-05T16:31:27.067Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:27.067Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.093Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:27.093Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.184 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:91e2d166-42ae-13fb-48ff-af942bc382f2 Address:127.0.0.1:29440}]" 31:27.186 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-91e2d166-42ae-13fb-48ff-af942bc382f2.dc1 127.0.0.1 31:27.187 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-91e2d166-42ae-13fb-48ff-af942bc382f2 127.0.0.1 2021-10-05T16:31:27.187Z [INFO] agent.router: Initializing LAN area manager 31:27.196 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29440 [Follower]" leader= 31:27.200 [INFO] TestAgent.server: Adding LAN server: server="Node-91e2d166-42ae-13fb-48ff-af942bc382f2 (Addr: tcp/127.0.0.1:29440) (DC: dc1)" 31:27.202 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-91e2d166-42ae-13fb-48ff-af942bc382f2.dc1 area=wan 31:27.204 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29456 network=udp 31:27.204 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29456 network=tcp 31:27.211 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29457 network=tcp 31:27.215 [INFO] TestAgent: started state syncer 31:27.215 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29441 network=tcp 31:27.238 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.238 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29440 [Candidate]" term=2 31:27.262 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:27.267 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.267 [DEBUG] TestAgent.server.raft: vote granted: from=91e2d166-42ae-13fb-48ff-af942bc382f2 term=2 tally=1 31:27.267 [INFO] TestAgent.server.raft: election won: tally=1 31:27.267 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29440 [Leader]" 31:27.268 [INFO] TestAgent.server: cluster leadership acquired 31:27.268 [INFO] TestAgent.server: New leader elected: payload=Node-91e2d166-42ae-13fb-48ff-af942bc382f2 31:27.297 [INFO] TestAgent.server: initializing acls 31:27.303 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:27.303 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:27.319 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:27.343 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:27.343 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:27.343 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:27.343 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-91e2d166-42ae-13fb-48ff-af942bc382f2 31:27.344 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-91e2d166-42ae-13fb-48ff-af942bc382f2.dc1 31:27.344 [INFO] TestAgent.server: Updating LAN server: server="Node-91e2d166-42ae-13fb-48ff-af942bc382f2 (Addr: tcp/127.0.0.1:29440) (DC: dc1)" 31:27.344 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-91e2d166-42ae-13fb-48ff-af942bc382f2.dc1 area=wan 31:27.363 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.394 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.394 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.394 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.394 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.394 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.395 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-91e2d166-42ae-13fb-48ff-af942bc382f2 31:27.395 [INFO] TestAgent.server: member joined, marking health alive: member=Node-91e2d166-42ae-13fb-48ff-af942bc382f2 31:27.403 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-91e2d166-42ae-13fb-48ff-af942bc382f2 31:27.410 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.475 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:27.491 [INFO] TestAgent: Synced node info 31:27.591 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-91e2d166-42ae-13fb-48ff-af942bc382f2 31:27.591 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-91e2d166-42ae-13fb-48ff-af942bc382f2 31:27.591 [INFO] TestAgent: Requesting shutdown 31:27.591 [INFO] TestAgent.server: shutting down server 31:27.591 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:27.591 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:27.591 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.591 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.591 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.591 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.591 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.591 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.591 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.591 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:27.591 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:27.591 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.591 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.591 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.598 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.606Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.606Z [INFO] agent.router.manager: shutting down 31:27.606 [INFO] TestAgent: consul server down 31:27.606 [INFO] TestAgent: shutdown complete 31:27.606 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29456 network=tcp 31:27.606 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29456 network=udp 31:27.606 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29457 network=tcp 31:28.107 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.107 [INFO] TestAgent: Endpoints down --- PASS: TestCoordinate_Update_ACLDeny (1.07s) --- PASS: TestCoordinate_Update_ACLDeny/no_token (0.00s) --- PASS: TestCoordinate_Update_ACLDeny/valid_token (0.00s) === CONT TestConfig_Apply_Decoding 2021-10-05T16:31:27.071Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.104Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.188 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:83a1fed0-1628-a358-b0f3-e751db2099c0 Address:127.0.0.1:29433}]" 31:27.189 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-83a1fed0-1628-a358-b0f3-e751db2099c0.dc1 127.0.0.1 31:27.190 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-83a1fed0-1628-a358-b0f3-e751db2099c0 127.0.0.1 2021-10-05T16:31:27.190Z [INFO] agent.router: Initializing LAN area manager 31:27.190 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29442 network=udp 31:27.190 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29433 [Follower]" leader= 31:27.203 [INFO] TestAgent.server: Adding LAN server: server="Node-83a1fed0-1628-a358-b0f3-e751db2099c0 (Addr: tcp/127.0.0.1:29433) (DC: dc1)" 31:27.203 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-83a1fed0-1628-a358-b0f3-e751db2099c0.dc1 area=wan 31:27.204 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29442 network=tcp 31:27.209 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29443 network=tcp 31:27.209 [INFO] TestAgent: started state syncer 31:27.209 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29434 network=tcp 31:27.240 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.241 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29433 [Candidate]" term=2 31:27.272 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.272 [DEBUG] TestAgent.server.raft: vote granted: from=83a1fed0-1628-a358-b0f3-e751db2099c0 term=2 tally=1 31:27.272 [INFO] TestAgent.server.raft: election won: tally=1 31:27.272 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29433 [Leader]" 31:27.273 [INFO] TestAgent.server: cluster leadership acquired 31:27.273 [INFO] TestAgent.server: New leader elected: payload=Node-83a1fed0-1628-a358-b0f3-e751db2099c0 31:27.298 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29433 31:27.324 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.377 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.377 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.377 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.377 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.377 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.377 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-83a1fed0-1628-a358-b0f3-e751db2099c0 31:27.377 [INFO] TestAgent.server: member joined, marking health alive: member=Node-83a1fed0-1628-a358-b0f3-e751db2099c0 31:27.399 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.552 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:27.572 [INFO] TestAgent: Synced node info 31:27.572 [DEBUG] TestAgent: Node info in sync 31:27.736 [INFO] TestAgent: Requesting shutdown 31:27.736 [INFO] TestAgent.server: shutting down server 31:27.736 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.736 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.736 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.736 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.736 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.736 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.736 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.736 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.736 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.736 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.756 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.760Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.760Z [INFO] agent.router.manager: shutting down 31:27.760 [INFO] TestAgent: consul server down 31:27.760 [INFO] TestAgent: shutdown complete 31:27.760 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29442 network=tcp 31:27.760 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29442 network=udp 31:27.760 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29443 network=tcp 31:28.270 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.270 [INFO] TestAgent: Endpoints down --- PASS: TestCoordinate_Update (1.23s) === CONT TestConfig_Apply_CAS 2021-10-05T16:31:27.276Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.293Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.354 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42 Address:127.0.0.1:29503}]" 31:27.354 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29503 [Follower]" leader= 31:27.354 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42.dc1 127.0.0.1 31:27.355 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42 127.0.0.1 2021-10-05T16:31:27.355Z [INFO] agent.router: Initializing LAN area manager 31:27.355 [INFO] TestAgent.server: Adding LAN server: server="Node-45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42 (Addr: tcp/127.0.0.1:29503) (DC: dc1)" 31:27.355 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42.dc1 area=wan 31:27.355 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29505 network=udp 31:27.356 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29505 network=tcp 31:27.357 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29506 network=tcp 31:27.357 [INFO] TestAgent: started state syncer 31:27.357 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29504 network=tcp 31:27.390 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.390 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29503 [Candidate]" term=2 31:27.404 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.404 [DEBUG] TestAgent.server.raft: vote granted: from=45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42 term=2 tally=1 31:27.404 [INFO] TestAgent.server.raft: election won: tally=1 31:27.404 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29503 [Leader]" 31:27.404 [INFO] TestAgent.server: cluster leadership acquired 31:27.404 [INFO] TestAgent.server: New leader elected: payload=Node-45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42 31:27.425 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29503 31:27.463 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.488 [INFO] TestAgent: Synced node info 31:27.512 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.512 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.512 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.512 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.512 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.513 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42 31:27.513 [INFO] TestAgent.server: member joined, marking health alive: member=Node-45a5ddab-a5b8-d9ae-a512-cd3bf73ecc42 31:27.534 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.769 [INFO] TestAgent: Requesting shutdown 31:27.770 [INFO] TestAgent.server: shutting down server 31:27.770 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.770 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.770 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.770 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.770 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.770 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.770 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.770 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.770 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.770 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.779 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.780Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.780Z [INFO] agent.router.manager: shutting down 31:27.786 [INFO] TestAgent: consul server down 31:27.786 [INFO] TestAgent: shutdown complete 31:27.786 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29505 network=tcp 31:27.786 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29505 network=udp 31:27.786 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29506 network=tcp 31:28.287 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.287 [INFO] TestAgent: Endpoints down --- PASS: TestCoordinate_Disabled_Response (1.03s) --- PASS: TestCoordinate_Disabled_Response/0 (0.00s) --- PASS: TestCoordinate_Disabled_Response/1 (0.00s) --- PASS: TestCoordinate_Disabled_Response/2 (0.00s) --- PASS: TestCoordinate_Disabled_Response/3 (0.00s) === CONT TestConfig_Apply_ProxyDefaultsMeshGateway [WARN] freeport: 10 out of 59 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:27.513Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.528Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.588 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d60964ec-3e1d-e291-6570-575215f52198 Address:127.0.0.1:29482}]" 31:27.589 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d60964ec-3e1d-e291-6570-575215f52198.dc1 127.0.0.1 31:27.589 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d60964ec-3e1d-e291-6570-575215f52198 127.0.0.1 2021-10-05T16:31:27.589Z [INFO] agent.router: Initializing LAN area manager 31:27.589 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29491 network=udp 31:27.589 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29482 [Follower]" leader= 31:27.590 [INFO] TestAgent.server: Adding LAN server: server="Node-d60964ec-3e1d-e291-6570-575215f52198 (Addr: tcp/127.0.0.1:29482) (DC: dc1)" 31:27.590 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d60964ec-3e1d-e291-6570-575215f52198.dc1 area=wan 31:27.590 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29491 network=tcp 31:27.591 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29492 network=tcp 31:27.591 [INFO] TestAgent: started state syncer 31:27.591 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29483 network=tcp 31:27.652 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.652 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29482 [Candidate]" term=2 31:27.705 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.705 [DEBUG] TestAgent.server.raft: vote granted: from=d60964ec-3e1d-e291-6570-575215f52198 term=2 tally=1 31:27.705 [INFO] TestAgent.server.raft: election won: tally=1 31:27.705 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29482 [Leader]" 31:27.705 [INFO] TestAgent.server: cluster leadership acquired 31:27.705 [INFO] TestAgent.server: New leader elected: payload=Node-d60964ec-3e1d-e291-6570-575215f52198 31:27.736 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29482 31:27.797 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.846 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.846 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.846 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.846 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.846 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.846 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d60964ec-3e1d-e291-6570-575215f52198 31:27.846 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d60964ec-3e1d-e291-6570-575215f52198 31:27.865 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.904 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:27.928 [INFO] TestAgent: Synced node info 31:27.928 [INFO] TestAgent.server.connect: CA provider config updated 31:27.928 [INFO] TestAgent: Requesting shutdown 31:27.928 [INFO] TestAgent.server: shutting down server 31:27.928 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.928 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.928 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.928 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.928 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.928 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.928 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.928 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.936 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.939Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.939Z [INFO] agent.router.manager: shutting down 31:27.939 [INFO] TestAgent: consul server down 31:27.939 [INFO] TestAgent: shutdown complete 31:27.939 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29491 network=tcp 31:27.939 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29491 network=udp 31:27.939 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29492 network=tcp 31:28.440 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.440 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:27.228Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.303Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.358 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fd38bd65-2c08-8d80-e67b-a5d60860e663 Address:127.0.0.1:29461}]" 31:27.359 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fd38bd65-2c08-8d80-e67b-a5d60860e663.dc1 127.0.0.1 31:27.359 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fd38bd65-2c08-8d80-e67b-a5d60860e663 127.0.0.1 2021-10-05T16:31:27.359Z [INFO] agent.router: Initializing LAN area manager 31:27.360 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29428 network=udp 31:27.360 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29461 [Follower]" leader= 31:27.360 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fd38bd65-2c08-8d80-e67b-a5d60860e663.dc1 area=wan 31:27.360 [INFO] TestAgent.server: Adding LAN server: server="Node-fd38bd65-2c08-8d80-e67b-a5d60860e663 (Addr: tcp/127.0.0.1:29461) (DC: dc1)" 31:27.360 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29428 network=tcp 31:27.361 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29429 network=tcp 31:27.361 [INFO] TestAgent: started state syncer 31:27.361 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29462 network=tcp 31:27.430 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.430 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29461 [Candidate]" term=2 31:27.468 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.468 [DEBUG] TestAgent.server.raft: vote granted: from=fd38bd65-2c08-8d80-e67b-a5d60860e663 term=2 tally=1 31:27.468 [INFO] TestAgent.server.raft: election won: tally=1 31:27.468 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29461 [Leader]" 31:27.468 [INFO] TestAgent.server: cluster leadership acquired 31:27.468 [INFO] TestAgent.server: New leader elected: payload=Node-fd38bd65-2c08-8d80-e67b-a5d60860e663 31:27.488 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29461 31:27.509 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.553 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.553 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.553 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.553 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.553 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.553 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fd38bd65-2c08-8d80-e67b-a5d60860e663 31:27.553 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fd38bd65-2c08-8d80-e67b-a5d60860e663 31:27.584 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.765 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:27.784 [INFO] TestAgent: Synced node info 31:27.784 [DEBUG] TestAgent: Node info in sync 31:27.932 [INFO] TestAgent: Requesting shutdown 31:27.932 [INFO] TestAgent.server: shutting down server 31:27.932 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.932 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.932 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.932 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.932 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.932 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.932 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.932 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.932 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.932 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.939 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.940Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.940Z [INFO] agent.router.manager: shutting down 31:27.940 [INFO] TestAgent: consul server down 31:27.940 [INFO] TestAgent: shutdown complete 31:27.940 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29428 network=tcp 31:27.940 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29428 network=udp 31:27.940 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29429 network=tcp 31:28.440 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.440 [INFO] TestAgent: Endpoints down === RUN TestConnectCAConfig/basic_with_IntermediateCertTTL --- PASS: TestCoordinate_Nodes (1.27s) === CONT TestAgent_RegisterCheck 2021-10-05T16:31:27.563Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.581Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.621 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:006a8702-f059-b424-d29b-5e0d8ad6e1a4 Address:127.0.0.1:29538}]" 31:27.622 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-006a8702-f059-b424-d29b-5e0d8ad6e1a4.dc1 127.0.0.1 31:27.622 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-006a8702-f059-b424-d29b-5e0d8ad6e1a4 127.0.0.1 2021-10-05T16:31:27.622Z [INFO] agent.router: Initializing LAN area manager 31:27.623 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29498 network=udp 31:27.623 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29538 [Follower]" leader= 31:27.623 [INFO] TestAgent.server: Adding LAN server: server="Node-006a8702-f059-b424-d29b-5e0d8ad6e1a4 (Addr: tcp/127.0.0.1:29538) (DC: dc1)" 31:27.623 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-006a8702-f059-b424-d29b-5e0d8ad6e1a4.dc1 area=wan 31:27.623 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29498 network=tcp 31:27.624 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29499 network=tcp 31:27.624 [INFO] TestAgent: started state syncer 31:27.624 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29539 network=tcp 31:27.664 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.664 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29538 [Candidate]" term=2 31:27.725 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.725 [DEBUG] TestAgent.server.raft: vote granted: from=006a8702-f059-b424-d29b-5e0d8ad6e1a4 term=2 tally=1 31:27.725 [INFO] TestAgent.server.raft: election won: tally=1 31:27.725 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29538 [Leader]" 31:27.725 [INFO] TestAgent.server: cluster leadership acquired 31:27.725 [INFO] TestAgent.server: New leader elected: payload=Node-006a8702-f059-b424-d29b-5e0d8ad6e1a4 31:27.745 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29538 31:27.799 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.851 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.851 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.851 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.851 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.851 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.851 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-006a8702-f059-b424-d29b-5e0d8ad6e1a4 31:27.851 [INFO] TestAgent.server: member joined, marking health alive: member=Node-006a8702-f059-b424-d29b-5e0d8ad6e1a4 31:27.865 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.891 [DEBUG] connect.ca.consul: consul CA provider configured: id=27:7c:55:cf:7a:2f:48:78:c2:11:86:09:77:47:54:e1:7d:e9:6d:21:08:86:23:c9:9f:dd:f8:20:88:11:79:9a is_primary=true 31:27.950 [INFO] TestAgent.server.connect: CA rotated to new root under provider: provider=consul 31:27.950 [INFO] TestAgent: Requesting shutdown 31:27.950 [INFO] TestAgent.server: shutting down server 31:27.950 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.950 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.950 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.950 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.950 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.950 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.950 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:27.950 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:27.950 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.950 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.950 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.960 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:27.961Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:27.961Z [INFO] agent.router.manager: shutting down 31:27.961 [INFO] TestAgent: consul server down 31:27.961 [INFO] TestAgent: shutdown complete 31:27.961 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29498 network=tcp 31:27.961 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29498 network=udp 31:27.961 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29499 network=tcp 31:28.461 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.461 [INFO] TestAgent: Endpoints down --- PASS: TestConnectCARoots_list (0.92s) === CONT TestRemoteExecWrites_ACLDeny === RUN TestConfig_Apply_Decoding/No_Kind === RUN TestConfig_Apply_Decoding/Kind_Not_String === RUN TestConfig_Apply_Decoding/Lowercase_kind 2021-10-05T16:31:27.227Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.266Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.320 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d9149e0b-776e-c077-c289-b78949b5e1ae Address:127.0.0.1:29419}]" 31:27.321 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29419 [Follower]" leader= 31:27.321 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d9149e0b-776e-c077-c289-b78949b5e1ae.dc1 127.0.0.1 31:27.321 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d9149e0b-776e-c077-c289-b78949b5e1ae 127.0.0.1 2021-10-05T16:31:27.322Z [INFO] agent.router: Initializing LAN area manager 31:27.322 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29421 network=udp 31:27.322 [INFO] TestAgent.server: Adding LAN server: server="Node-d9149e0b-776e-c077-c289-b78949b5e1ae (Addr: tcp/127.0.0.1:29419) (DC: dc1)" 31:27.322 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d9149e0b-776e-c077-c289-b78949b5e1ae.dc1 area=wan 31:27.322 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29421 network=tcp 31:27.323 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29422 network=tcp 31:27.323 [INFO] TestAgent: started state syncer 31:27.323 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29420 network=tcp 31:27.366 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.366 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29419 [Candidate]" term=2 31:27.400 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.400 [DEBUG] TestAgent.server.raft: vote granted: from=d9149e0b-776e-c077-c289-b78949b5e1ae term=2 tally=1 31:27.400 [INFO] TestAgent.server.raft: election won: tally=1 31:27.400 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29419 [Leader]" 31:27.401 [INFO] TestAgent.server: cluster leadership acquired 31:27.401 [INFO] TestAgent.server: New leader elected: payload=Node-d9149e0b-776e-c077-c289-b78949b5e1ae 31:27.412 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29419 31:27.440 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:27.492 [INFO] TestAgent: Synced node info 31:27.492 [DEBUG] TestAgent: Node info in sync 31:27.492 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:27.492 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.492 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.492 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:27.492 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:27.492 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d9149e0b-776e-c077-c289-b78949b5e1ae 31:27.492 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d9149e0b-776e-c077-c289-b78949b5e1ae 31:27.518 [INFO] TestAgent.server: federation state anti-entropy synced 31:27.992 [INFO] TestAgent: Requesting shutdown 31:27.992 [INFO] TestAgent.server: shutting down server 31:27.992 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:27.992 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:27.992 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:27.992 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:27.992 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:27.992 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:27.992 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:27.992 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:27.992 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:27.992 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.000 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:28.004Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:28.004Z [INFO] agent.router.manager: shutting down 31:28.004 [INFO] TestAgent: consul server down 31:28.004 [INFO] TestAgent: shutdown complete 31:28.004 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29421 network=tcp 31:28.004 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29421 network=udp 31:28.004 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29422 network=tcp 31:28.504 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.504 [INFO] TestAgent: Endpoints down --- PASS: TestCoordinate_Node (1.35s) === CONT TestSessionGet === RUN TestSessionGet/#00 [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:27.661Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:27.732Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:27.833 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:76a5b9aa-73b0-67e4-1725-a63d719acc88 Address:127.0.0.1:29496}]" 31:27.834 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-76a5b9aa-73b0-67e4-1725-a63d719acc88.dc1 127.0.0.1 31:27.835 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-76a5b9aa-73b0-67e4-1725-a63d719acc88 127.0.0.1 2021-10-05T16:31:27.835Z [INFO] agent.router: Initializing LAN area manager 31:27.835 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29540 network=udp 31:27.835 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29496 [Follower]" leader= 31:27.835 [INFO] TestAgent.server: Adding LAN server: server="Node-76a5b9aa-73b0-67e4-1725-a63d719acc88 (Addr: tcp/127.0.0.1:29496) (DC: dc1)" 31:27.836 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-76a5b9aa-73b0-67e4-1725-a63d719acc88.dc1 area=wan 31:27.836 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29540 network=tcp 31:27.836 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29541 network=tcp 31:27.836 [INFO] TestAgent: started state syncer 31:27.837 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29497 network=tcp 31:27.880 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:27.880 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29496 [Candidate]" term=2 31:27.904 [DEBUG] TestAgent.server.raft: votes: needed=1 31:27.904 [DEBUG] TestAgent.server.raft: vote granted: from=76a5b9aa-73b0-67e4-1725-a63d719acc88 term=2 tally=1 31:27.904 [INFO] TestAgent.server.raft: election won: tally=1 31:27.904 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29496 [Leader]" 31:27.904 [INFO] TestAgent.server: cluster leadership acquired 31:27.904 [INFO] TestAgent.server: New leader elected: payload=Node-76a5b9aa-73b0-67e4-1725-a63d719acc88 31:27.924 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29496 31:27.928 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:27.928 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:27.928 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-76a5b9aa-73b0-67e4-1725-a63d719acc88 31:27.928 [INFO] TestAgent.server: member joined, marking health alive: member=Node-76a5b9aa-73b0-67e4-1725-a63d719acc88 31:27.949 [INFO] TestAgent.server: federation state anti-entropy synced 31:28.112 [INFO] TestAgent: Requesting shutdown 31:28.112 [INFO] TestAgent.server: shutting down server 31:28.112 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:28.112 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:28.112 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:28.112 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:28.112 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.112 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:28.112 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:28.120 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:28.120Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:28.120Z [INFO] agent.router.manager: shutting down 31:28.120 [INFO] TestAgent: consul server down 31:28.120 [INFO] TestAgent: shutdown complete 31:28.120 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29540 network=tcp 31:28.120 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29540 network=udp 31:28.120 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29541 network=tcp 31:28.621 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.621 [INFO] TestAgent: Endpoints down --- PASS: TestConnectCARoots_empty (1.00s) === CONT TestSessionCustomTTL [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:28.152Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.187Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.222 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:19d8aa04-86f3-0633-d79a-b52b4ff78ed7 Address:127.0.0.1:29531}]" 31:28.223 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-19d8aa04-86f3-0633-d79a-b52b4ff78ed7.dc1 127.0.0.1 31:28.224 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-19d8aa04-86f3-0633-d79a-b52b4ff78ed7 127.0.0.1 2021-10-05T16:31:28.224Z [INFO] agent.router: Initializing LAN area manager 31:28.224 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29512 network=udp 31:28.224 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29531 [Follower]" leader= 31:28.224 [INFO] TestAgent.server: Adding LAN server: server="Node-19d8aa04-86f3-0633-d79a-b52b4ff78ed7 (Addr: tcp/127.0.0.1:29531) (DC: dc1)" 31:28.224 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-19d8aa04-86f3-0633-d79a-b52b4ff78ed7.dc1 area=wan 31:28.224 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29512 network=tcp 31:28.225 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29513 network=tcp 31:28.225 [INFO] TestAgent: started state syncer 31:28.225 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29532 network=tcp 31:28.268 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.268 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29531 [Candidate]" term=2 31:28.300 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.300 [DEBUG] TestAgent.server.raft: vote granted: from=19d8aa04-86f3-0633-d79a-b52b4ff78ed7 term=2 tally=1 31:28.300 [INFO] TestAgent.server.raft: election won: tally=1 31:28.300 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29531 [Leader]" 31:28.300 [INFO] TestAgent.server: cluster leadership acquired 31:28.300 [INFO] TestAgent.server: New leader elected: payload=Node-19d8aa04-86f3-0633-d79a-b52b4ff78ed7 31:28.327 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29531 31:28.349 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:28.381 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:28.381 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:28.381 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:28.381 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:28.381 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:28.381 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-19d8aa04-86f3-0633-d79a-b52b4ff78ed7 31:28.381 [INFO] TestAgent.server: member joined, marking health alive: member=Node-19d8aa04-86f3-0633-d79a-b52b4ff78ed7 31:28.424 [INFO] TestAgent.server: federation state anti-entropy synced 31:28.453 [INFO] TestAgent: Requesting shutdown 31:28.453 [INFO] TestAgent.server: shutting down server 31:28.453 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:28.453 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:28.453 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:28.453 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:28.454 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:28.454 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:28.454 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.454 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:28.454 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:28.454 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:28.454 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:28.457 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:28.457Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:28.457Z [INFO] agent.router.manager: shutting down 31:28.457 [INFO] TestAgent: consul server down 31:28.457 [INFO] TestAgent: shutdown complete 31:28.457 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29512 network=tcp 31:28.457 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29512 network=udp 31:28.457 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29513 network=tcp 31:28.960 [INFO] TestAgent: Waiting for endpoints to shut down 31:28.960 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Apply_ProxyDefaultsExpose (0.88s) === CONT TestSessionDestroy 2021-10-05T16:31:28.170Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.184Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.223 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ab054159-2ad5-d838-7c04-0b4ac75cb4bd Address:127.0.0.1:29524}]" 31:28.224 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ab054159-2ad5-d838-7c04-0b4ac75cb4bd.dc1 127.0.0.1 31:28.224 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ab054159-2ad5-d838-7c04-0b4ac75cb4bd 127.0.0.1 2021-10-05T16:31:28.224Z [INFO] agent.router: Initializing LAN area manager 31:28.225 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29533 network=udp 31:28.225 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29524 [Follower]" leader= 31:28.225 [INFO] TestAgent.server: Adding LAN server: server="Node-ab054159-2ad5-d838-7c04-0b4ac75cb4bd (Addr: tcp/127.0.0.1:29524) (DC: dc1)" 31:28.225 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ab054159-2ad5-d838-7c04-0b4ac75cb4bd.dc1 area=wan 31:28.225 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29533 network=tcp 31:28.226 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29534 network=tcp 31:28.226 [INFO] TestAgent: started state syncer 31:28.226 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29525 network=tcp 31:28.283 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.283 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29524 [Candidate]" term=2 31:28.316 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.316 [DEBUG] TestAgent.server.raft: vote granted: from=ab054159-2ad5-d838-7c04-0b4ac75cb4bd term=2 tally=1 31:28.316 [INFO] TestAgent.server.raft: election won: tally=1 31:28.316 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29524 [Leader]" 31:28.320 [INFO] TestAgent.server: cluster leadership acquired 31:28.320 [INFO] TestAgent.server: New leader elected: payload=Node-ab054159-2ad5-d838-7c04-0b4ac75cb4bd 31:28.333 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29524 31:28.371 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:28.451 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:28.451 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:28.451 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:28.451 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:28.451 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:28.451 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ab054159-2ad5-d838-7c04-0b4ac75cb4bd 31:28.451 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ab054159-2ad5-d838-7c04-0b4ac75cb4bd 31:28.492 [INFO] TestAgent.server: federation state anti-entropy synced 31:28.504 [INFO] TestAgent: Requesting shutdown 31:28.505 [INFO] TestAgent.server: shutting down server 31:28.505 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:28.505 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:28.505 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:28.505 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:28.505 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:28.505 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:28.505 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.505 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:28.505 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:28.505 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:28.505 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:28.516 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:28.516Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:28.516Z [INFO] agent.router.manager: shutting down 31:28.516 [INFO] TestAgent: consul server down 31:28.516 [INFO] TestAgent: shutdown complete 31:28.516 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29533 network=tcp 31:28.516 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29533 network=udp 31:28.517 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29534 network=tcp 31:29.019 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.019 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Apply_Decoding (0.91s) --- PASS: TestConfig_Apply_Decoding/No_Kind (0.00s) --- PASS: TestConfig_Apply_Decoding/Kind_Not_String (0.00s) --- PASS: TestConfig_Apply_Decoding/Lowercase_kind (0.02s) === CONT TestSessionCreate_NoCheck [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:28.294Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.327Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.421 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0e704649-e321-4198-2713-15902349192a Address:127.0.0.1:29545}]" 31:28.422 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0e704649-e321-4198-2713-15902349192a.dc1 127.0.0.1 31:28.422 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0e704649-e321-4198-2713-15902349192a 127.0.0.1 2021-10-05T16:31:28.422Z [INFO] agent.router: Initializing LAN area manager 31:28.422 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29526 network=udp 31:28.422 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29545 [Follower]" leader= 31:28.423 [INFO] TestAgent.server: Adding LAN server: server="Node-0e704649-e321-4198-2713-15902349192a (Addr: tcp/127.0.0.1:29545) (DC: dc1)" 31:28.423 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0e704649-e321-4198-2713-15902349192a.dc1 area=wan 31:28.423 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29526 network=tcp 31:28.423 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29527 network=tcp 31:28.423 [INFO] TestAgent: started state syncer 31:28.424 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29546 network=tcp 31:28.467 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.467 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29545 [Candidate]" term=2 31:28.520 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.520 [DEBUG] TestAgent.server.raft: vote granted: from=0e704649-e321-4198-2713-15902349192a term=2 tally=1 31:28.520 [INFO] TestAgent.server.raft: election won: tally=1 31:28.520 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29545 [Leader]" 31:28.524 [INFO] TestAgent.server: cluster leadership acquired 31:28.524 [INFO] TestAgent.server: New leader elected: payload=Node-0e704649-e321-4198-2713-15902349192a 31:28.552 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29545 31:28.652 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:28.792 [INFO] TestAgent: Synced node info 31:28.792 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:28.792 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:28.792 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:28.792 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:28.792 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:28.793 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0e704649-e321-4198-2713-15902349192a 31:28.793 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0e704649-e321-4198-2713-15902349192a 31:28.822 [INFO] TestAgent.server: federation state anti-entropy synced 31:28.858 [INFO] TestAgent: Requesting shutdown 31:28.858 [INFO] TestAgent.server: shutting down server 31:28.858 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:28.858 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:28.858 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:28.858 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:28.858 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:28.858 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:28.858 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.858 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:28.858 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:28.858 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:28.872 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:28.876Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:28.876Z [INFO] agent.router.manager: shutting down 31:28.876 [INFO] TestAgent: consul server down 31:28.876 [INFO] TestAgent: shutdown complete 31:28.876 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29526 network=tcp 31:28.876 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29526 network=udp 31:28.876 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29527 network=tcp 31:29.377 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.377 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Apply_CAS (1.10s) === CONT TestSessionCreate_DefaultCheck 2021-10-05T16:31:28.303Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.319Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.417 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:910fc166-34b7-82fb-e43f-f8c58de8a5c8 Address:127.0.0.1:29552}]" 31:28.417 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-910fc166-34b7-82fb-e43f-f8c58de8a5c8.dc1 127.0.0.1 31:28.418 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-910fc166-34b7-82fb-e43f-f8c58de8a5c8 127.0.0.1 2021-10-05T16:31:28.418Z [INFO] agent.router: Initializing LAN area manager 31:28.418 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29547 network=udp 31:28.418 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29552 [Follower]" leader= 31:28.419 [INFO] TestAgent.server: Adding LAN server: server="Node-910fc166-34b7-82fb-e43f-f8c58de8a5c8 (Addr: tcp/127.0.0.1:29552) (DC: dc1)" 31:28.419 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-910fc166-34b7-82fb-e43f-f8c58de8a5c8.dc1 area=wan 31:28.419 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29547 network=tcp 31:28.419 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29548 network=tcp 31:28.420 [INFO] TestAgent: started state syncer 31:28.420 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29553 network=tcp 31:28.468 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.472 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29552 [Candidate]" term=2 31:28.516 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.516 [DEBUG] TestAgent.server.raft: vote granted: from=910fc166-34b7-82fb-e43f-f8c58de8a5c8 term=2 tally=1 31:28.516 [INFO] TestAgent.server.raft: election won: tally=1 31:28.516 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29552 [Leader]" 31:28.517 [INFO] TestAgent.server: cluster leadership acquired 31:28.517 [INFO] TestAgent.server: New leader elected: payload=Node-910fc166-34b7-82fb-e43f-f8c58de8a5c8 31:28.544 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29552 31:28.649 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:28.769 [INFO] TestAgent: Synced node info 31:28.796 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:28.796 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:28.796 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:28.796 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:28.796 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:28.796 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-910fc166-34b7-82fb-e43f-f8c58de8a5c8 31:28.796 [INFO] TestAgent.server: member joined, marking health alive: member=Node-910fc166-34b7-82fb-e43f-f8c58de8a5c8 31:28.853 [INFO] TestAgent.server: federation state anti-entropy synced 31:28.866 [INFO] TestAgent: Requesting shutdown 31:28.866 [INFO] TestAgent.server: shutting down server 31:28.866 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:28.866 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:28.866 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:28.866 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:28.866 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:28.866 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:28.866 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.866 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:28.866 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:28.866 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:28.877 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:28.881Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:28.881Z [INFO] agent.router.manager: shutting down 31:28.881 [INFO] TestAgent: consul server down 31:28.881 [INFO] TestAgent: shutdown complete 31:28.881 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29547 network=tcp 31:28.881 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29547 network=udp 31:28.881 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29548 network=tcp 31:29.382 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.382 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Apply_ProxyDefaultsMeshGateway (1.09s) === CONT TestSessionCreate_Delete === RUN TestSessionCreate_NoCheck/no_check_fields_should_yield_default_serfHealth === RUN TestSessionCreate_NoCheck/overwrite_nodechecks_to_associate_with_no_checks === RUN TestSessionCreate_NoCheck/overwrite_checks_to_associate_with_no_checks 2021-10-05T16:31:28.472Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.498Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.676 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1536c9e2-319f-522b-59ce-3f363989a2b3 Address:127.0.0.1:29566}]" 31:28.677 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1536c9e2-319f-522b-59ce-3f363989a2b3.dc1 127.0.0.1 31:28.678 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1536c9e2-319f-522b-59ce-3f363989a2b3 127.0.0.1 31:28.680 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29566 [Follower]" leader= 2021-10-05T16:31:28.684Z [INFO] agent.router: Initializing LAN area manager 31:28.684 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29554 network=udp 31:28.684 [INFO] TestAgent.server: Adding LAN server: server="Node-1536c9e2-319f-522b-59ce-3f363989a2b3 (Addr: tcp/127.0.0.1:29566) (DC: dc1)" 31:28.684 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1536c9e2-319f-522b-59ce-3f363989a2b3.dc1 area=wan 31:28.684 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29554 network=tcp 31:28.685 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29555 network=tcp 31:28.685 [INFO] TestAgent: started state syncer 31:28.685 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29567 network=tcp 31:28.748 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.748 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29566 [Candidate]" term=2 31:28.797 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.797 [DEBUG] TestAgent.server.raft: vote granted: from=1536c9e2-319f-522b-59ce-3f363989a2b3 term=2 tally=1 31:28.797 [INFO] TestAgent.server.raft: election won: tally=1 31:28.797 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29566 [Leader]" 31:28.799 [INFO] TestAgent.server: cluster leadership acquired 31:28.799 [INFO] TestAgent.server: New leader elected: payload=Node-1536c9e2-319f-522b-59ce-3f363989a2b3 31:28.819 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29566 31:28.855 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:28.937 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:28.937 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:28.937 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:28.937 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:28.937 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:28.937 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1536c9e2-319f-522b-59ce-3f363989a2b3 31:28.937 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1536c9e2-319f-522b-59ce-3f363989a2b3 31:28.973 [INFO] TestAgent: Synced node info 31:28.973 [DEBUG] TestAgent: Node info in sync 31:28.989 [INFO] TestAgent.server: federation state anti-entropy synced 31:28.994 [INFO] TestAgent.server.connect: CA provider config updated 31:28.994 [INFO] TestAgent: Requesting shutdown 31:28.994 [INFO] TestAgent.server: shutting down server 31:28.994 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:28.994 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:28.994 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:28.994 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:28.994 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:28.994 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:28.994 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.994 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:28.994 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:28.994 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.005 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.006Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.006Z [INFO] agent.router.manager: shutting down 31:29.006 [INFO] TestAgent: consul server down 31:29.006 [INFO] TestAgent: shutdown complete 31:29.006 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29554 network=tcp 31:29.006 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29554 network=udp 31:29.006 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29555 network=tcp 31:29.507 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.507 [INFO] TestAgent: Endpoints down === RUN TestConnectCAConfig/force_without_cross_sign_CamelCase 2021-10-05T16:31:28.462Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.485Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.639 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:59e400d4-d321-576c-0976-b5d65a71af36 Address:127.0.0.1:29559}]" 31:28.640 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29559 [Follower]" leader= 31:28.640 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-59e400d4-d321-576c-0976-b5d65a71af36.dc1 127.0.0.1 31:28.647 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-59e400d4-d321-576c-0976-b5d65a71af36 127.0.0.1 2021-10-05T16:31:28.647Z [INFO] agent.router: Initializing LAN area manager 31:28.647 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29568 network=udp 31:28.648 [INFO] TestAgent.server: Adding LAN server: server="Node-59e400d4-d321-576c-0976-b5d65a71af36 (Addr: tcp/127.0.0.1:29559) (DC: dc1)" 31:28.648 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-59e400d4-d321-576c-0976-b5d65a71af36.dc1 area=wan 31:28.648 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29568 network=tcp 31:28.648 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29569 network=tcp 31:28.648 [INFO] TestAgent: started state syncer 31:28.648 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29560 network=tcp 31:28.692 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.692 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29559 [Candidate]" term=2 31:28.765 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.765 [DEBUG] TestAgent.server.raft: vote granted: from=59e400d4-d321-576c-0976-b5d65a71af36 term=2 tally=1 31:28.765 [INFO] TestAgent.server.raft: election won: tally=1 31:28.765 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29559 [Leader]" 31:28.765 [INFO] TestAgent.server: cluster leadership acquired 31:28.766 [INFO] TestAgent.server: New leader elected: payload=Node-59e400d4-d321-576c-0976-b5d65a71af36 31:28.800 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29559 31:28.854 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:28.940 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:28.940 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:28.940 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:28.940 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:28.940 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:28.940 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-59e400d4-d321-576c-0976-b5d65a71af36 31:28.940 [INFO] TestAgent.server: member joined, marking health alive: member=Node-59e400d4-d321-576c-0976-b5d65a71af36 31:28.944 [INFO] TestAgent: Synced node info 31:28.944 [DEBUG] TestAgent: Node info in sync 31:28.977 [INFO] TestAgent.server: federation state anti-entropy synced 31:28.993 [DEBUG] TestAgent: Node info in sync 31:28.999 [INFO] TestAgent: Synced check: check=test 31:28.999 [INFO] TestAgent: Requesting shutdown 31:28.999 [INFO] TestAgent.server: shutting down server 31:28.999 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:28.999 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:28.999 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:28.999 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:28.999 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:28.999 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:28.999 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:28.999 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:28.999 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:28.999 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.009 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.010Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.010Z [INFO] agent.router.manager: shutting down 31:29.011 [INFO] TestAgent: consul server down 31:29.011 [INFO] TestAgent: shutdown complete 31:29.011 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29568 network=tcp 31:29.011 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29568 network=udp 31:29.011 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29569 network=tcp 31:29.512 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.512 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterCheck (1.07s) === CONT TestSessionCreate_NodeChecks [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:28.542Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.592Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.752 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9d913b32-22ca-8236-3b9a-1ac88caa90d8 Address:127.0.0.1:29573}]" 31:28.753 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9d913b32-22ca-8236-3b9a-1ac88caa90d8.dc1 127.0.0.1 31:28.754 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9d913b32-22ca-8236-3b9a-1ac88caa90d8 127.0.0.1 2021-10-05T16:31:28.754Z [INFO] agent.router: Initializing LAN area manager 31:28.754 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29589 network=udp 31:28.754 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29573 [Follower]" leader= 31:28.755 [INFO] TestAgent.server: Adding LAN server: server="Node-9d913b32-22ca-8236-3b9a-1ac88caa90d8 (Addr: tcp/127.0.0.1:29573) (DC: dc1)" 31:28.755 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9d913b32-22ca-8236-3b9a-1ac88caa90d8.dc1 area=wan 31:28.755 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29589 network=tcp 31:28.757 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29590 network=tcp 31:28.757 [INFO] TestAgent: started state syncer 31:28.757 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29574 network=tcp 31:28.815 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.815 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29573 [Candidate]" term=2 31:28.864 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.864 [DEBUG] TestAgent.server.raft: vote granted: from=9d913b32-22ca-8236-3b9a-1ac88caa90d8 term=2 tally=1 31:28.864 [INFO] TestAgent.server.raft: election won: tally=1 31:28.864 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29573 [Leader]" 31:28.864 [INFO] TestAgent.server: cluster leadership acquired 31:28.864 [INFO] TestAgent.server: New leader elected: payload=Node-9d913b32-22ca-8236-3b9a-1ac88caa90d8 31:28.908 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29573 31:28.965 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.025 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.025 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.025 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.025 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.025 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.025 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9d913b32-22ca-8236-3b9a-1ac88caa90d8 31:29.025 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9d913b32-22ca-8236-3b9a-1ac88caa90d8 31:29.061 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.080 [INFO] TestAgent: Requesting shutdown 31:29.080 [INFO] TestAgent.server: shutting down server 31:29.080 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.080 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.080 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.080 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.080 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.080 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.080 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.080 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:29.080 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.080 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.080 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.087 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.089Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.089Z [INFO] agent.router.manager: shutting down 31:29.089 [INFO] TestAgent: consul server down 31:29.089 [INFO] TestAgent: shutdown complete 31:29.089 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29589 network=tcp 31:29.089 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29589 network=udp 31:29.089 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29590 network=tcp 31:29.590 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.590 [INFO] TestAgent: Endpoints down === RUN TestSessionGet/#01 2021-10-05T16:31:28.479Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:28.479Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.509Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:28.509Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.695 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f9213833-408b-286a-d5d0-3fc7ad25b2ba Address:127.0.0.1:29587}]" 31:28.695 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29587 [Follower]" leader= 31:28.710 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba.dc1 127.0.0.1 31:28.710 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 127.0.0.1 2021-10-05T16:31:28.710Z [INFO] agent.router: Initializing LAN area manager 31:28.710 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29561 network=udp 31:28.711 [INFO] TestAgent.server: Adding LAN server: server="Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba (Addr: tcp/127.0.0.1:29587) (DC: dc1)" 31:28.711 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba.dc1 area=wan 31:28.711 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29561 network=tcp 31:28.711 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29562 network=tcp 31:28.711 [INFO] TestAgent: started state syncer 31:28.712 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29588 network=tcp 31:28.736 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.736 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29587 [Candidate]" term=2 31:28.764 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:28.792 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.792 [DEBUG] TestAgent.server.raft: vote granted: from=f9213833-408b-286a-d5d0-3fc7ad25b2ba term=2 tally=1 31:28.792 [INFO] TestAgent.server.raft: election won: tally=1 31:28.792 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29587 [Leader]" 31:28.792 [INFO] TestAgent.server: cluster leadership acquired 31:28.793 [INFO] TestAgent.server: New leader elected: payload=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:28.802 [INFO] TestAgent.server: initializing acls 31:28.815 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:28.815 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:28.832 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:28.864 [INFO] TestAgent.server: initializing acls 31:28.864 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:28.892 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:28.892 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:28.892 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:28.892 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:28.892 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:28.892 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba.dc1 31:28.892 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba.dc1 area=wan 31:28.892 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:28.892 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:28.893 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba.dc1 31:28.894 [INFO] TestAgent.server: Updating LAN server: server="Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba (Addr: tcp/127.0.0.1:29587) (DC: dc1)" 31:28.894 [INFO] TestAgent.server: Updating LAN server: server="Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba (Addr: tcp/127.0.0.1:29587) (DC: dc1)" 31:28.894 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba.dc1 area=wan 31:28.916 [WARN] TestAgent: Node info update blocked by ACLs: node=f9213833-408b-286a-d5d0-3fc7ad25b2ba accessorID=00000000-0000-0000-0000-000000000002 31:28.920 [WARN] TestAgent: Node info update blocked by ACLs: node=f9213833-408b-286a-d5d0-3fc7ad25b2ba accessorID=00000000-0000-0000-0000-000000000002 31:28.920 [DEBUG] TestAgent: Node info in sync 31:28.944 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.020 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.020 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.020 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.020 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.020 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.020 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:29.020 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:29.037 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:29.037 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:29.053 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.142 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:29.142 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-f9213833-408b-286a-d5d0-3fc7ad25b2ba 31:29.145 [ERROR] TestAgent: failed to ack remote exec job: error="Permission denied" 31:29.146 [ERROR] TestAgent: failed to write output for remote exec job: error="Permission denied" 31:29.146 [ERROR] TestAgent: failed to write output for remote exec job: error="Permission denied" 31:29.164 [INFO] TestAgent: Requesting shutdown 31:29.164 [INFO] TestAgent.server: shutting down server 31:29.164 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:29.164 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:29.164 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.164 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.164 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.164 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.164 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.164 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.164 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.164 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:29.164 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:29.164 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.164 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.164 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.176 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.180Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.180Z [INFO] agent.router.manager: shutting down 31:29.180 [INFO] TestAgent: consul server down 31:29.180 [INFO] TestAgent: shutdown complete 31:29.180 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29561 network=tcp 31:29.180 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29561 network=udp 31:29.180 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29562 network=tcp 31:29.682 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.682 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecWrites_ACLDeny (1.22s) === CONT TestSessionCreate [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:28.986Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.026Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.107 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1ca75bd2-08b4-876c-babe-cd4efab115eb Address:127.0.0.1:29510}]" 31:29.108 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29510 [Follower]" leader= 31:29.108 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1ca75bd2-08b4-876c-babe-cd4efab115eb.dc1 127.0.0.1 31:29.109 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1ca75bd2-08b4-876c-babe-cd4efab115eb 127.0.0.1 2021-10-05T16:31:29.109Z [INFO] agent.router: Initializing LAN area manager 31:29.109 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29582 network=udp 31:29.109 [INFO] TestAgent.server: Adding LAN server: server="Node-1ca75bd2-08b4-876c-babe-cd4efab115eb (Addr: tcp/127.0.0.1:29510) (DC: dc1)" 31:29.110 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1ca75bd2-08b4-876c-babe-cd4efab115eb.dc1 area=wan 31:29.110 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29582 network=tcp 31:29.110 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29583 network=tcp 31:29.110 [INFO] TestAgent: started state syncer 31:29.110 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29511 network=tcp 31:29.169 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.169 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29510 [Candidate]" term=2 31:29.193 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.193 [DEBUG] TestAgent.server.raft: vote granted: from=1ca75bd2-08b4-876c-babe-cd4efab115eb term=2 tally=1 31:29.193 [INFO] TestAgent.server.raft: election won: tally=1 31:29.193 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29510 [Leader]" 31:29.193 [INFO] TestAgent.server: cluster leadership acquired 31:29.193 [INFO] TestAgent.server: New leader elected: payload=Node-1ca75bd2-08b4-876c-babe-cd4efab115eb 31:29.210 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29510 31:29.236 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.276 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.276 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.276 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.276 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.276 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.276 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1ca75bd2-08b4-876c-babe-cd4efab115eb 31:29.276 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1ca75bd2-08b4-876c-babe-cd4efab115eb 31:29.332 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.332 [INFO] TestAgent: Synced node info 31:29.332 [DEBUG] TestAgent: Node info in sync 31:29.355 [INFO] TestAgent: Requesting shutdown 31:29.355 [INFO] TestAgent.server: shutting down server 31:29.355 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.355 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.355 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.355 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.355 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.355 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.355 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.355 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.355 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.355 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.359 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.359Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.359Z [INFO] agent.router.manager: shutting down 31:29.359 [INFO] TestAgent: consul server down 31:29.359 [INFO] TestAgent: shutdown complete 31:29.359 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29582 network=tcp 31:29.359 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29582 network=udp 31:29.359 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29583 network=tcp 31:29.859 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.859 [INFO] TestAgent: Endpoints down --- PASS: TestSessionDestroy (0.90s) === CONT TestServiceManager_PersistService_ConfigFiles 2021-10-05T16:31:29.043Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.059Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.093 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:504a2983-7b88-c7da-87bc-8da3d52c0bb2 Address:127.0.0.1:29608}]" 31:29.094 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-504a2983-7b88-c7da-87bc-8da3d52c0bb2.dc1 127.0.0.1 31:29.095 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-504a2983-7b88-c7da-87bc-8da3d52c0bb2 127.0.0.1 2021-10-05T16:31:29.095Z [INFO] agent.router: Initializing LAN area manager 31:29.095 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29519 network=udp 31:29.095 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29608 [Follower]" leader= 31:29.095 [INFO] TestAgent.server: Adding LAN server: server="Node-504a2983-7b88-c7da-87bc-8da3d52c0bb2 (Addr: tcp/127.0.0.1:29608) (DC: dc1)" 31:29.095 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-504a2983-7b88-c7da-87bc-8da3d52c0bb2.dc1 area=wan 31:29.095 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29519 network=tcp 31:29.096 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29520 network=tcp 31:29.096 [INFO] TestAgent: started state syncer 31:29.096 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29609 network=tcp 31:29.142 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.142 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29608 [Candidate]" term=2 31:29.153 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.153 [DEBUG] TestAgent.server.raft: vote granted: from=504a2983-7b88-c7da-87bc-8da3d52c0bb2 term=2 tally=1 31:29.153 [INFO] TestAgent.server.raft: election won: tally=1 31:29.153 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29608 [Leader]" 31:29.153 [INFO] TestAgent.server: cluster leadership acquired 31:29.153 [INFO] TestAgent.server: New leader elected: payload=Node-504a2983-7b88-c7da-87bc-8da3d52c0bb2 31:29.164 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29608 31:29.187 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.234 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.234 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.234 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.234 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.234 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.234 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-504a2983-7b88-c7da-87bc-8da3d52c0bb2 31:29.234 [INFO] TestAgent.server: member joined, marking health alive: member=Node-504a2983-7b88-c7da-87bc-8da3d52c0bb2 31:29.258 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.463 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:29.471 [INFO] TestAgent: Synced node info 31:29.471 [DEBUG] TestAgent: Node info in sync 31:29.478 [INFO] TestAgent: Requesting shutdown 31:29.479 [INFO] TestAgent.server: shutting down server 31:29.479 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.479 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.479 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.479 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.479 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.479 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.479 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.479 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.479 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.479 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.486 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.488Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.488Z [INFO] agent.router.manager: shutting down 31:29.488 [INFO] TestAgent: consul server down 31:29.488 [INFO] TestAgent: shutdown complete 31:29.488 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29519 network=tcp 31:29.488 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29519 network=udp 31:29.488 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29520 network=tcp 31:29.988 [INFO] TestAgent: Waiting for endpoints to shut down 31:29.988 [INFO] TestAgent: Endpoints down --- PASS: TestSessionCreate_NoCheck (0.97s) --- PASS: TestSessionCreate_NoCheck/no_check_fields_should_yield_default_serfHealth (0.01s) --- PASS: TestSessionCreate_NoCheck/overwrite_nodechecks_to_associate_with_no_checks (0.01s) --- PASS: TestSessionCreate_NoCheck/overwrite_checks_to_associate_with_no_checks (0.01s) === CONT TestHandleRemoteExecFailed [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:29.399Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.422Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.454 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:951b5bb9-2ecb-adf2-01ed-481e83f9766e Address:127.0.0.1:29615}]" 31:29.455 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-951b5bb9-2ecb-adf2-01ed-481e83f9766e.dc1 127.0.0.1 31:29.455 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-951b5bb9-2ecb-adf2-01ed-481e83f9766e 127.0.0.1 2021-10-05T16:31:29.455Z [INFO] agent.router: Initializing LAN area manager 31:29.456 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29610 network=udp 31:29.456 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29615 [Follower]" leader= 31:29.456 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-951b5bb9-2ecb-adf2-01ed-481e83f9766e.dc1 area=wan 31:29.456 [INFO] TestAgent.server: Adding LAN server: server="Node-951b5bb9-2ecb-adf2-01ed-481e83f9766e (Addr: tcp/127.0.0.1:29615) (DC: dc1)" 31:29.456 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29610 network=tcp 31:29.457 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29611 network=tcp 31:29.457 [INFO] TestAgent: started state syncer 31:29.457 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29616 network=tcp 31:29.502 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.502 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29615 [Candidate]" term=2 31:29.532 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.532 [DEBUG] TestAgent.server.raft: vote granted: from=951b5bb9-2ecb-adf2-01ed-481e83f9766e term=2 tally=1 31:29.532 [INFO] TestAgent.server.raft: election won: tally=1 31:29.532 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29615 [Leader]" 31:29.532 [INFO] TestAgent.server: cluster leadership acquired 31:29.532 [INFO] TestAgent.server: New leader elected: payload=Node-951b5bb9-2ecb-adf2-01ed-481e83f9766e 31:29.562 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29615 31:29.604 [INFO] TestAgent: Synced node info 31:29.604 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.628 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.628 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.628 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.628 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.628 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.628 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-951b5bb9-2ecb-adf2-01ed-481e83f9766e 31:29.628 [INFO] TestAgent.server: member joined, marking health alive: member=Node-951b5bb9-2ecb-adf2-01ed-481e83f9766e 31:29.668 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.688 [INFO] TestAgent: Requesting shutdown 31:29.688 [INFO] TestAgent.server: shutting down server 31:29.688 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.688 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.688 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.689 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.689 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.689 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.689 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.689 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.689 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.689 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.697 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.706Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.706Z [INFO] agent.router.manager: shutting down 31:29.706 [INFO] TestAgent: consul server down 31:29.706 [INFO] TestAgent: shutdown complete 31:29.706 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29610 network=tcp 31:29.706 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29610 network=udp 31:29.706 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29611 network=tcp 31:30.207 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.207 [INFO] TestAgent: Endpoints down --- PASS: TestSessionCreate_DefaultCheck (0.83s) === CONT TestHandleRemoteExec [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:29.533Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.548Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.589 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:24cb4837-a49b-4262-331a-6e5a3a4ca269 Address:127.0.0.1:29629}]" 31:29.589 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-24cb4837-a49b-4262-331a-6e5a3a4ca269.dc1 127.0.0.1 31:29.590 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-24cb4837-a49b-4262-331a-6e5a3a4ca269 127.0.0.1 2021-10-05T16:31:29.590Z [INFO] agent.router: Initializing LAN area manager 31:29.592 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29629 [Follower]" leader= 31:29.592 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-24cb4837-a49b-4262-331a-6e5a3a4ca269.dc1 area=wan 31:29.592 [INFO] TestAgent.server: Adding LAN server: server="Node-24cb4837-a49b-4262-331a-6e5a3a4ca269 (Addr: tcp/127.0.0.1:29629) (DC: dc1)" 31:29.592 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29624 network=tcp 31:29.592 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29624 network=udp 31:29.593 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29625 network=tcp 31:29.593 [INFO] TestAgent: started state syncer 31:29.593 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29630 network=tcp 31:29.644 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.644 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29629 [Candidate]" term=2 31:29.684 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.684 [DEBUG] TestAgent.server.raft: vote granted: from=24cb4837-a49b-4262-331a-6e5a3a4ca269 term=2 tally=1 31:29.684 [INFO] TestAgent.server.raft: election won: tally=1 31:29.684 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29629 [Leader]" 31:29.688 [INFO] TestAgent.server: cluster leadership acquired 31:29.688 [INFO] TestAgent.server: New leader elected: payload=Node-24cb4837-a49b-4262-331a-6e5a3a4ca269 31:29.712 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29629 31:29.749 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.795 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.795 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.795 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.795 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.795 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.795 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-24cb4837-a49b-4262-331a-6e5a3a4ca269 31:29.795 [INFO] TestAgent.server: member joined, marking health alive: member=Node-24cb4837-a49b-4262-331a-6e5a3a4ca269 31:29.819 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.918 [INFO] TestAgent: Requesting shutdown 31:29.918 [INFO] TestAgent.server: shutting down server 31:29.918 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.918 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.918 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.918 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.918 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.918 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.918 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.918 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:29.918 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.918 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.918 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.926 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.941Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.941Z [INFO] agent.router.manager: shutting down 31:29.941 [INFO] TestAgent: consul server down 31:29.941 [INFO] TestAgent: shutdown complete 31:29.941 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29624 network=tcp 31:29.941 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29624 network=udp 31:29.941 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29625 network=tcp 31:30.444 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.444 [INFO] TestAgent: Endpoints down --- PASS: TestSessionCreate_NodeChecks (0.93s) === CONT TestUiIndex 2021-10-05T16:31:29.405Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.440Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.532 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:04ab51e7-3354-77e8-b49d-6a4fa120ff51 Address:127.0.0.1:29601}]" 31:29.532 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29601 [Follower]" leader= 31:29.532 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-04ab51e7-3354-77e8-b49d-6a4fa120ff51.dc1 127.0.0.1 31:29.533 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-04ab51e7-3354-77e8-b49d-6a4fa120ff51 127.0.0.1 2021-10-05T16:31:29.533Z [INFO] agent.router: Initializing LAN area manager 31:29.533 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29617 network=udp 31:29.533 [INFO] TestAgent.server: Adding LAN server: server="Node-04ab51e7-3354-77e8-b49d-6a4fa120ff51 (Addr: tcp/127.0.0.1:29601) (DC: dc1)" 31:29.533 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-04ab51e7-3354-77e8-b49d-6a4fa120ff51.dc1 area=wan 31:29.534 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29617 network=tcp 31:29.534 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29618 network=tcp 31:29.534 [INFO] TestAgent: started state syncer 31:29.534 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29602 network=tcp 31:29.585 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.585 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29601 [Candidate]" term=2 31:29.605 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.606 [DEBUG] TestAgent.server.raft: vote granted: from=04ab51e7-3354-77e8-b49d-6a4fa120ff51 term=2 tally=1 31:29.606 [INFO] TestAgent.server.raft: election won: tally=1 31:29.606 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29601 [Leader]" 31:29.606 [INFO] TestAgent.server: cluster leadership acquired 31:29.606 [INFO] TestAgent.server: New leader elected: payload=Node-04ab51e7-3354-77e8-b49d-6a4fa120ff51 31:29.615 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29601 31:29.622 [INFO] TestAgent: Synced node info 31:29.676 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.723 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.723 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.723 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.723 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.723 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.723 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04ab51e7-3354-77e8-b49d-6a4fa120ff51 31:29.723 [INFO] TestAgent.server: member joined, marking health alive: member=Node-04ab51e7-3354-77e8-b49d-6a4fa120ff51 31:29.763 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.960 [INFO] TestAgent: Requesting shutdown 31:29.960 [INFO] TestAgent.server: shutting down server 31:29.960 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.960 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.960 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.960 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.960 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.960 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.960 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.960 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.960 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.960 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.970 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:29.974Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:29.974Z [INFO] agent.router.manager: shutting down 31:29.975 [INFO] TestAgent: consul server down 31:29.975 [INFO] TestAgent: shutdown complete 31:29.975 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29617 network=tcp 31:29.975 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29617 network=udp 31:29.975 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29618 network=tcp 31:30.475 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.475 [INFO] TestAgent: Endpoints down --- PASS: TestSessionCreate_Delete (1.09s) === CONT TestFireReceiveEvent 2021-10-05T16:31:28.662Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:28.706Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:28.831 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e3030616-3392-fad3-afb6-4a4f9b854ec5 Address:127.0.0.1:29580}]" 31:28.831 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e3030616-3392-fad3-afb6-4a4f9b854ec5.dc1 127.0.0.1 31:28.832 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29580 [Follower]" leader= 31:28.832 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e3030616-3392-fad3-afb6-4a4f9b854ec5 127.0.0.1 2021-10-05T16:31:28.832Z [INFO] agent.router: Initializing LAN area manager 31:28.833 [INFO] TestAgent.server: Adding LAN server: server="Node-e3030616-3392-fad3-afb6-4a4f9b854ec5 (Addr: tcp/127.0.0.1:29580) (DC: dc1)" 31:28.833 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e3030616-3392-fad3-afb6-4a4f9b854ec5.dc1 area=wan 31:28.833 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29575 network=udp 31:28.833 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29575 network=tcp 31:28.834 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29576 network=tcp 31:28.834 [INFO] TestAgent: started state syncer 31:28.834 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29581 network=tcp 31:28.878 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:28.878 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29580 [Candidate]" term=2 31:28.892 [DEBUG] TestAgent.server.raft: votes: needed=1 31:28.892 [DEBUG] TestAgent.server.raft: vote granted: from=e3030616-3392-fad3-afb6-4a4f9b854ec5 term=2 tally=1 31:28.892 [INFO] TestAgent.server.raft: election won: tally=1 31:28.892 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29580 [Leader]" 31:28.894 [INFO] TestAgent.server: cluster leadership acquired 31:28.895 [INFO] TestAgent.server: New leader elected: payload=Node-e3030616-3392-fad3-afb6-4a4f9b854ec5 31:28.936 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29580 31:28.991 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.059 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.059 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.059 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.059 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.059 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.059 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3030616-3392-fad3-afb6-4a4f9b854ec5 31:29.059 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e3030616-3392-fad3-afb6-4a4f9b854ec5 31:29.060 [INFO] TestAgent: Synced node info 31:29.092 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.756 [DEBUG] TestAgent.server: Session TTL expired: session=ecf9e049-5567-8800-4350-45fa1c02ed42 31:29.818 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:29.818 [DEBUG] TestAgent: Node info in sync 31:29.818 [DEBUG] TestAgent: Node info in sync 31:29.986 [INFO] TestAgent: Requesting shutdown 31:29.986 [INFO] TestAgent.server: shutting down server 31:29.986 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.986 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.986 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.986 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.986 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.986 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.986 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.986 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.986 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:29.986 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.993 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.000Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.000Z [INFO] agent.router.manager: shutting down 31:30.000 [INFO] TestAgent: consul server down 31:30.000 [INFO] TestAgent: shutdown complete 31:30.000 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29575 network=tcp 31:30.000 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29575 network=udp 31:30.000 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29576 network=tcp 31:30.500 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.500 [INFO] TestAgent: Endpoints down --- PASS: TestSessionCustomTTL (1.86s) === CONT TestIngestUserEvent 2021-10-05T16:31:29.647Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.691Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.760 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:295d6698-6c70-5971-c0fb-31867b981ecd Address:127.0.0.1:29636}]" 31:29.761 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-295d6698-6c70-5971-c0fb-31867b981ecd.dc1 127.0.0.1 31:29.761 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-295d6698-6c70-5971-c0fb-31867b981ecd 127.0.0.1 2021-10-05T16:31:29.761Z [INFO] agent.router: Initializing LAN area manager 31:29.761 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29638 network=udp 31:29.761 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29636 [Follower]" leader= 31:29.762 [INFO] TestAgent.server: Adding LAN server: server="Node-295d6698-6c70-5971-c0fb-31867b981ecd (Addr: tcp/127.0.0.1:29636) (DC: dc1)" 31:29.762 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-295d6698-6c70-5971-c0fb-31867b981ecd.dc1 area=wan 31:29.762 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29638 network=tcp 31:29.762 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29639 network=tcp 31:29.762 [INFO] TestAgent: started state syncer 31:29.762 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29637 network=tcp 31:29.815 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.815 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29636 [Candidate]" term=2 31:29.845 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.845 [DEBUG] TestAgent.server.raft: vote granted: from=295d6698-6c70-5971-c0fb-31867b981ecd term=2 tally=1 31:29.845 [INFO] TestAgent.server.raft: election won: tally=1 31:29.845 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29636 [Leader]" 31:29.845 [INFO] TestAgent.server: cluster leadership acquired 31:29.845 [INFO] TestAgent.server: New leader elected: payload=Node-295d6698-6c70-5971-c0fb-31867b981ecd 31:29.854 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29636 31:29.873 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.948 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.948 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.948 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.948 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.948 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.948 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-295d6698-6c70-5971-c0fb-31867b981ecd 31:29.948 [INFO] TestAgent.server: member joined, marking health alive: member=Node-295d6698-6c70-5971-c0fb-31867b981ecd 31:29.962 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.972 [INFO] TestAgent: Synced node info 31:29.994 [INFO] TestAgent: Requesting shutdown 31:29.994 [INFO] TestAgent.server: shutting down server 31:29.994 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:29.994 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:29.994 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:29.994 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:29.994 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:29.994 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:29.994 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:29.994 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:29.994 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:29.994 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.007 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.020Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.020Z [INFO] agent.router.manager: shutting down 31:30.020 [INFO] TestAgent: consul server down 31:30.020 [INFO] TestAgent: shutdown complete 31:30.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29638 network=tcp 31:30.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29638 network=udp 31:30.020 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29639 network=tcp 31:30.528 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.528 [INFO] TestAgent: Endpoints down --- PASS: TestSessionGet (2.02s) --- PASS: TestSessionGet/#00 (1.08s) --- PASS: TestSessionGet/#01 (0.94s) === CONT TestShouldProcessUserEvent [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:29.547Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.615Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.745 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:59451b31-7502-1022-9693-4b7a3f52eaba Address:127.0.0.1:29622}]" 31:29.745 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29622 [Follower]" leader= 31:29.746 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-59451b31-7502-1022-9693-4b7a3f52eaba.dc1 127.0.0.1 31:29.746 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-59451b31-7502-1022-9693-4b7a3f52eaba 127.0.0.1 2021-10-05T16:31:29.746Z [INFO] agent.router: Initializing LAN area manager 31:29.746 [INFO] TestAgent.server: Adding LAN server: server="Node-59451b31-7502-1022-9693-4b7a3f52eaba (Addr: tcp/127.0.0.1:29622) (DC: dc1)" 31:29.746 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-59451b31-7502-1022-9693-4b7a3f52eaba.dc1 area=wan 31:29.746 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29603 network=udp 31:29.746 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29603 network=tcp 31:29.747 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29604 network=tcp 31:29.747 [INFO] TestAgent: started state syncer 31:29.747 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29623 network=tcp 31:29.788 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.788 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29622 [Candidate]" term=2 31:29.804 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.804 [DEBUG] TestAgent.server.raft: vote granted: from=59451b31-7502-1022-9693-4b7a3f52eaba term=2 tally=1 31:29.804 [INFO] TestAgent.server.raft: election won: tally=1 31:29.804 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29622 [Leader]" 31:29.805 [INFO] TestAgent.server: cluster leadership acquired 31:29.805 [INFO] TestAgent.server: New leader elected: payload=Node-59451b31-7502-1022-9693-4b7a3f52eaba 31:29.818 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29622 31:29.844 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.870 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.870 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.870 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.870 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.870 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.870 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-59451b31-7502-1022-9693-4b7a3f52eaba 31:29.870 [INFO] TestAgent.server: member joined, marking health alive: member=Node-59451b31-7502-1022-9693-4b7a3f52eaba 31:29.901 [INFO] TestAgent.server: federation state anti-entropy synced 31:29.981 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:29.988 [INFO] TestAgent: Synced node info 31:30.088 [INFO] TestAgent.server.connect: CA provider config updated 31:30.088 [INFO] TestAgent: Requesting shutdown 31:30.088 [INFO] TestAgent.server: shutting down server 31:30.088 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.088 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.088 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.088 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.088 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.088 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:30.088 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.088 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.088 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.088 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.095 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.105Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.105Z [INFO] agent.router.manager: shutting down 31:30.105 [INFO] TestAgent: consul server down 31:30.105 [INFO] TestAgent: shutdown complete 31:30.105 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29603 network=tcp 31:30.105 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29603 network=udp 31:30.105 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29604 network=tcp 31:30.605 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.605 [INFO] TestAgent: Endpoints down === RUN TestConnectCAConfig/force_without_cross_sign_snake_case 2021-10-05T16:31:29.730Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.765Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.813 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:858301dc-c2ba-b456-0901-0acf6e74d32d Address:127.0.0.1:29657}]" 31:29.814 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-858301dc-c2ba-b456-0901-0acf6e74d32d.dc1 127.0.0.1 31:29.814 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-858301dc-c2ba-b456-0901-0acf6e74d32d 127.0.0.1 2021-10-05T16:31:29.814Z [INFO] agent.router: Initializing LAN area manager 31:29.815 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29645 network=udp 31:29.815 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29657 [Follower]" leader= 31:29.815 [INFO] TestAgent.server: Adding LAN server: server="Node-858301dc-c2ba-b456-0901-0acf6e74d32d (Addr: tcp/127.0.0.1:29657) (DC: dc1)" 31:29.815 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-858301dc-c2ba-b456-0901-0acf6e74d32d.dc1 area=wan 31:29.815 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29645 network=tcp 31:29.816 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29646 network=tcp 31:29.816 [INFO] TestAgent: started state syncer 31:29.816 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29658 network=tcp 31:29.880 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:29.880 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29657 [Candidate]" term=2 31:29.911 [DEBUG] TestAgent.server.raft: votes: needed=1 31:29.911 [DEBUG] TestAgent.server.raft: vote granted: from=858301dc-c2ba-b456-0901-0acf6e74d32d term=2 tally=1 31:29.911 [INFO] TestAgent.server.raft: election won: tally=1 31:29.911 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29657 [Leader]" 31:29.911 [INFO] TestAgent.server: cluster leadership acquired 31:29.911 [INFO] TestAgent.server: New leader elected: payload=Node-858301dc-c2ba-b456-0901-0acf6e74d32d 31:29.927 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29657 31:29.946 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:29.993 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:29.993 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:29.993 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:29.993 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:29.993 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:29.993 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-858301dc-c2ba-b456-0901-0acf6e74d32d 31:29.993 [INFO] TestAgent.server: member joined, marking health alive: member=Node-858301dc-c2ba-b456-0901-0acf6e74d32d 31:30.035 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.165 [INFO] TestAgent: Requesting shutdown 31:30.165 [INFO] TestAgent.server: shutting down server 31:30.165 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.165 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.165 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.165 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.165 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.166 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:30.166 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.166 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:30.166 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.166 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.166 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.175 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.183Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.183Z [INFO] agent.router.manager: shutting down 31:30.183 [INFO] TestAgent: consul server down 31:30.183 [INFO] TestAgent: shutdown complete 31:30.183 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29645 network=tcp 31:30.183 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29645 network=udp 31:30.183 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29646 network=tcp 31:30.683 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.683 [INFO] TestAgent: Endpoints down --- PASS: TestSessionCreate (1.00s) === CONT TestValidateUserEventParams --- PASS: TestValidateUserEventParams (0.00s) === CONT TestUIGatewayServiceNodes_Ingress [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:30.008Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.021Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.073 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7470fa14-7c35-3dad-db17-46c109f65cee Address:127.0.0.1:29678}]" 31:30.074 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7470fa14-7c35-3dad-db17-46c109f65cee.dc1 127.0.0.1 31:30.074 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7470fa14-7c35-3dad-db17-46c109f65cee 127.0.0.1 2021-10-05T16:31:30.074Z [INFO] agent.router: Initializing LAN area manager 31:30.075 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29652 network=udp 31:30.075 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29678 [Follower]" leader= 31:30.075 [INFO] TestAgent.server: Adding LAN server: server="Node-7470fa14-7c35-3dad-db17-46c109f65cee (Addr: tcp/127.0.0.1:29678) (DC: dc1)" 31:30.075 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7470fa14-7c35-3dad-db17-46c109f65cee.dc1 area=wan 31:30.075 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29652 network=tcp 31:30.076 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29653 network=tcp 31:30.076 [INFO] TestAgent: started state syncer 31:30.076 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29679 network=tcp 31:30.118 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.118 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29678 [Candidate]" term=2 31:30.138 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.138 [DEBUG] TestAgent.server.raft: vote granted: from=7470fa14-7c35-3dad-db17-46c109f65cee term=2 tally=1 31:30.138 [INFO] TestAgent.server.raft: election won: tally=1 31:30.138 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29678 [Leader]" 31:30.139 [INFO] TestAgent.server: cluster leadership acquired 31:30.139 [INFO] TestAgent.server: New leader elected: payload=Node-7470fa14-7c35-3dad-db17-46c109f65cee 31:30.165 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29678 31:30.188 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.248 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.248 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.248 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.248 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.248 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.248 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7470fa14-7c35-3dad-db17-46c109f65cee 31:30.248 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7470fa14-7c35-3dad-db17-46c109f65cee 31:30.271 [INFO] TestAgent: Synced node info 31:30.271 [DEBUG] TestAgent: Node info in sync 31:30.278 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.299 [DEBUG] TestAgent: received remote exec event: id=c72a2f13-d3f7-26a8-3385-a0d2585a0734 31:30.304 [INFO] TestAgent: remote exec script: script="echo failing;exit 2" 31:30.349 [INFO] TestAgent: Requesting shutdown 31:30.350 [INFO] TestAgent.server: shutting down server 31:30.350 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.350 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.350 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.350 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.350 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.350 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:30.350 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.350 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.350 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.350 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.353 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.357Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.357Z [INFO] agent.router.manager: shutting down 31:30.357 [INFO] TestAgent: consul server down 31:30.357 [INFO] TestAgent: shutdown complete 31:30.357 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29652 network=tcp 31:30.357 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29652 network=udp 31:30.357 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29653 network=tcp 31:30.858 [INFO] TestAgent: Waiting for endpoints to shut down 31:30.858 [INFO] TestAgent: Endpoints down --- PASS: TestHandleRemoteExecFailed (0.87s) === CONT TestUIGatewayServiceNodes_Terminating [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:30.491Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.505Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.580 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7726e4ef-6c2d-10e5-b91c-85c8be7b9e0d Address:127.0.0.1:29594}]" 31:30.580 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29594 [Follower]" leader= 31:30.581 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7726e4ef-6c2d-10e5-b91c-85c8be7b9e0d.dc1 127.0.0.1 31:30.581 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7726e4ef-6c2d-10e5-b91c-85c8be7b9e0d 127.0.0.1 2021-10-05T16:31:30.581Z [INFO] agent.router: Initializing LAN area manager 31:30.582 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29631 network=udp 31:30.582 [INFO] TestAgent.server: Adding LAN server: server="Node-7726e4ef-6c2d-10e5-b91c-85c8be7b9e0d (Addr: tcp/127.0.0.1:29594) (DC: dc1)" 31:30.582 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7726e4ef-6c2d-10e5-b91c-85c8be7b9e0d.dc1 area=wan 31:30.582 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29631 network=tcp 31:30.582 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29632 network=tcp 31:30.582 [INFO] TestAgent: started state syncer 31:30.583 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29595 network=tcp 31:30.624 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.624 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29594 [Candidate]" term=2 31:30.646 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.646 [DEBUG] TestAgent.server.raft: vote granted: from=7726e4ef-6c2d-10e5-b91c-85c8be7b9e0d term=2 tally=1 31:30.646 [INFO] TestAgent.server.raft: election won: tally=1 31:30.646 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29594 [Leader]" 31:30.646 [INFO] TestAgent.server: cluster leadership acquired 31:30.647 [INFO] TestAgent.server: New leader elected: payload=Node-7726e4ef-6c2d-10e5-b91c-85c8be7b9e0d 31:30.661 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29594 31:30.669 [DEBUG] TestAgent.server: User event: event=deploy 31:30.669 [DEBUG] TestAgent.server: User event: event=deploy 31:30.669 [DEBUG] TestAgent: new event: event_name=deploy event_id=2b09e82c-3e09-c11e-6f61-f68dad26e66b 31:30.688 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.696 [INFO] TestAgent: Requesting shutdown 31:30.698 [INFO] TestAgent.server: shutting down server 31:30.698 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.700 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:30.716 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.726Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.726Z [INFO] agent.router.manager: shutting down 31:30.736 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 31:30.736 [INFO] TestAgent: consul server down 31:30.736 [INFO] TestAgent: shutdown complete 31:30.736 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29631 network=tcp 31:30.736 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29631 network=udp 31:30.736 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29632 network=tcp 31:31.237 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.237 [INFO] TestAgent: Endpoints down --- PASS: TestFireReceiveEvent (0.76s) === CONT TestUiServices 2021-10-05T16:31:30.247Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.269Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.314 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9a1b5141-a22f-1206-545e-49332761d0d1 Address:127.0.0.1:29664}]" 31:30.314 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29664 [Follower]" leader= 31:30.315 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9a1b5141-a22f-1206-545e-49332761d0d1.dc1 127.0.0.1 31:30.316 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9a1b5141-a22f-1206-545e-49332761d0d1 127.0.0.1 2021-10-05T16:31:30.316Z [INFO] agent.router: Initializing LAN area manager 31:30.317 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29680 network=udp 31:30.317 [INFO] TestAgent.server: Adding LAN server: server="Node-9a1b5141-a22f-1206-545e-49332761d0d1 (Addr: tcp/127.0.0.1:29664) (DC: dc1)" 31:30.317 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9a1b5141-a22f-1206-545e-49332761d0d1.dc1 area=wan 31:30.318 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29680 network=tcp 31:30.319 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29681 network=tcp 31:30.319 [INFO] TestAgent: started state syncer 31:30.319 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29665 network=tcp 31:30.361 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.361 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29664 [Candidate]" term=2 31:30.376 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.376 [DEBUG] TestAgent.server.raft: vote granted: from=9a1b5141-a22f-1206-545e-49332761d0d1 term=2 tally=1 31:30.376 [INFO] TestAgent.server.raft: election won: tally=1 31:30.376 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29664 [Leader]" 31:30.377 [INFO] TestAgent.server: cluster leadership acquired 31:30.377 [INFO] TestAgent.server: New leader elected: payload=Node-9a1b5141-a22f-1206-545e-49332761d0d1 31:30.388 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29664 31:30.416 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.459 [INFO] TestAgent: Synced node info 31:30.482 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.482 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.483 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.483 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.483 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.483 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9a1b5141-a22f-1206-545e-49332761d0d1 31:30.483 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9a1b5141-a22f-1206-545e-49332761d0d1 31:30.504 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.676 [DEBUG] TestAgent: received remote exec event: id=249a0b56-1b99-0b2c-8136-88bb0937af4b 31:30.690 [INFO] TestAgent: remote exec script: script=uptime 31:30.749 [INFO] TestAgent: Requesting shutdown 31:30.749 [INFO] TestAgent.server: shutting down server 31:30.749 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.749 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.749 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.749 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.749 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.750 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:30.750 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.750 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.750 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.750 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.756 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.767Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.768Z [INFO] agent.router.manager: shutting down 31:30.768 [INFO] TestAgent: consul server down 31:30.768 [INFO] TestAgent: shutdown complete 31:30.768 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29680 network=tcp 31:30.768 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29680 network=udp 31:30.768 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29681 network=tcp 31:31.269 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.269 [INFO] TestAgent: Endpoints down --- PASS: TestHandleRemoteExec (1.06s) === CONT TestUiNodeInfo [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:30.468Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.489Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.570 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1e421480-0abe-f5eb-7a5b-4df3f4d68ad9 Address:127.0.0.1:29643}]" 31:30.571 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1e421480-0abe-f5eb-7a5b-4df3f4d68ad9.dc1 127.0.0.1 31:30.572 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1e421480-0abe-f5eb-7a5b-4df3f4d68ad9 127.0.0.1 2021-10-05T16:31:30.572Z [INFO] agent.router: Initializing LAN area manager 31:30.572 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29643 [Follower]" leader= 31:30.572 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29687 network=udp 31:30.572 [INFO] TestAgent.server: Adding LAN server: server="Node-1e421480-0abe-f5eb-7a5b-4df3f4d68ad9 (Addr: tcp/127.0.0.1:29643) (DC: dc1)" 31:30.572 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1e421480-0abe-f5eb-7a5b-4df3f4d68ad9.dc1 area=wan 31:30.572 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29687 network=tcp 31:30.573 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29688 network=tcp 31:30.573 [INFO] TestAgent: started state syncer 31:30.573 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29644 network=tcp 31:30.636 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.636 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29643 [Candidate]" term=2 31:30.668 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.668 [DEBUG] TestAgent.server.raft: vote granted: from=1e421480-0abe-f5eb-7a5b-4df3f4d68ad9 term=2 tally=1 31:30.668 [INFO] TestAgent.server.raft: election won: tally=1 31:30.668 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29643 [Leader]" 31:30.668 [INFO] TestAgent.server: cluster leadership acquired 31:30.668 [INFO] TestAgent.server: New leader elected: payload=Node-1e421480-0abe-f5eb-7a5b-4df3f4d68ad9 31:30.676 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29643 31:30.735 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.782 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.782 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.782 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.782 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.782 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.782 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1e421480-0abe-f5eb-7a5b-4df3f4d68ad9 31:30.782 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1e421480-0abe-f5eb-7a5b-4df3f4d68ad9 31:30.800 [INFO] TestAgent: Requesting shutdown 31:30.800 [INFO] TestAgent.server: shutting down server 31:30.800 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.800 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.800 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.800 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.800 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.800 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:30.800 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.800 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.800 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.805 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.805 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.814 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.824Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.824Z [INFO] agent.router.manager: shutting down 31:30.824 [INFO] TestAgent: consul server down 31:30.824 [INFO] TestAgent: shutdown complete 31:30.824 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29687 network=tcp 31:30.824 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29687 network=udp 31:30.824 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29688 network=tcp 31:31.327 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.327 [INFO] TestAgent: Endpoints down --- PASS: TestUiIndex (0.89s) === CONT TestUiNodes_Filter 2021-10-05T16:31:30.574Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.590Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.660 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0af92b7e-fbe6-0364-e7c2-8235d8d90ff4 Address:127.0.0.1:29699}]" 31:30.660 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29699 [Follower]" leader= 31:30.660 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0af92b7e-fbe6-0364-e7c2-8235d8d90ff4.dc1 127.0.0.1 31:30.661 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0af92b7e-fbe6-0364-e7c2-8235d8d90ff4 127.0.0.1 2021-10-05T16:31:30.661Z [INFO] agent.router: Initializing LAN area manager 31:30.661 [INFO] TestAgent.server: Adding LAN server: server="Node-0af92b7e-fbe6-0364-e7c2-8235d8d90ff4 (Addr: tcp/127.0.0.1:29699) (DC: dc1)" 31:30.661 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0af92b7e-fbe6-0364-e7c2-8235d8d90ff4.dc1 area=wan 31:30.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29694 network=udp 31:30.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29694 network=tcp 31:30.663 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29695 network=tcp 31:30.663 [INFO] TestAgent: started state syncer 31:30.663 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29700 network=tcp 31:30.730 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.730 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29699 [Candidate]" term=2 31:30.756 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.756 [DEBUG] TestAgent.server.raft: vote granted: from=0af92b7e-fbe6-0364-e7c2-8235d8d90ff4 term=2 tally=1 31:30.756 [INFO] TestAgent.server.raft: election won: tally=1 31:30.756 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29699 [Leader]" 31:30.756 [INFO] TestAgent.server: cluster leadership acquired 31:30.756 [INFO] TestAgent.server: New leader elected: payload=Node-0af92b7e-fbe6-0364-e7c2-8235d8d90ff4 31:30.777 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29699 31:30.800 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.837 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.837 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.837 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.837 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.837 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.837 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0af92b7e-fbe6-0364-e7c2-8235d8d90ff4 31:30.837 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0af92b7e-fbe6-0364-e7c2-8235d8d90ff4 31:30.850 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.871 [INFO] TestAgent: Requesting shutdown 31:30.871 [INFO] TestAgent.server: shutting down server 31:30.871 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.871 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.871 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.871 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.871 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.871 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:30.871 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.871 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:30.871 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.871 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.871 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.883 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.892Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.892Z [INFO] agent.router.manager: shutting down 31:30.892 [INFO] TestAgent: consul server down 31:30.892 [INFO] TestAgent: shutdown complete 31:30.892 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29694 network=tcp 31:30.892 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29694 network=udp 31:30.892 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29695 network=tcp 31:31.395 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.395 [INFO] TestAgent: Endpoints down --- PASS: TestShouldProcessUserEvent (0.87s) === CONT TestUiNodes 2021-10-05T16:31:30.622Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.637Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.680 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d Address:127.0.0.1:29727}]" 31:30.680 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29727 [Follower]" leader= 31:30.681 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d.dc1 127.0.0.1 31:30.682 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d 127.0.0.1 2021-10-05T16:31:30.682Z [INFO] agent.router: Initializing LAN area manager 31:30.682 [INFO] TestAgent.server: Adding LAN server: server="Node-b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d (Addr: tcp/127.0.0.1:29727) (DC: dc1)" 31:30.682 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d.dc1 area=wan 31:30.682 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29701 network=udp 31:30.682 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29701 network=tcp 31:30.683 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29702 network=tcp 31:30.683 [INFO] TestAgent: started state syncer 31:30.683 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29728 network=tcp 31:30.724 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.724 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29727 [Candidate]" term=2 31:30.749 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.749 [DEBUG] TestAgent.server.raft: vote granted: from=b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d term=2 tally=1 31:30.749 [INFO] TestAgent.server.raft: election won: tally=1 31:30.749 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29727 [Leader]" 31:30.750 [INFO] TestAgent.server: cluster leadership acquired 31:30.750 [INFO] TestAgent.server: New leader elected: payload=Node-b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d 31:30.764 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29727 31:30.780 [INFO] TestAgent: Synced node info 31:30.814 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.872 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.872 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.872 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.872 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.872 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.872 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d 31:30.872 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b0e64e9f-c0fb-f4e5-e4a6-c1a054e2c48d 31:30.912 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.923 [INFO] TestAgent.server.connect: CA provider config updated 31:30.923 [INFO] TestAgent: Requesting shutdown 31:30.923 [INFO] TestAgent.server: shutting down server 31:30.923 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.923 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.923 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.923 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.923 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.923 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:30.923 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.923 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.923 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.923 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.929 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:30.936Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:30.936Z [INFO] agent.router.manager: shutting down 31:30.936 [INFO] TestAgent: consul server down 31:30.936 [INFO] TestAgent: shutdown complete 31:30.936 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29701 network=tcp 31:30.936 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29701 network=udp 31:30.936 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29702 network=tcp 31:31.437 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.437 [INFO] TestAgent: Endpoints down === RUN TestConnectCAConfig/setting_state_fails 2021-10-05T16:31:30.552Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.584Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.648 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:28a1cbd3-adb2-a0d3-d105-279502aab738 Address:127.0.0.1:29692}]" 31:30.648 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29692 [Follower]" leader= 31:30.649 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-28a1cbd3-adb2-a0d3-d105-279502aab738.dc1 127.0.0.1 31:30.650 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-28a1cbd3-adb2-a0d3-d105-279502aab738 127.0.0.1 2021-10-05T16:31:30.650Z [INFO] agent.router: Initializing LAN area manager 31:30.650 [INFO] TestAgent.server: Adding LAN server: server="Node-28a1cbd3-adb2-a0d3-d105-279502aab738 (Addr: tcp/127.0.0.1:29692) (DC: dc1)" 31:30.650 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-28a1cbd3-adb2-a0d3-d105-279502aab738.dc1 area=wan 31:30.650 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29596 network=udp 31:30.650 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29596 network=tcp 31:30.651 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29597 network=tcp 31:30.651 [INFO] TestAgent: started state syncer 31:30.651 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29693 network=tcp 31:30.684 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.684 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29692 [Candidate]" term=2 31:30.713 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.713 [DEBUG] TestAgent.server.raft: vote granted: from=28a1cbd3-adb2-a0d3-d105-279502aab738 term=2 tally=1 31:30.713 [INFO] TestAgent.server.raft: election won: tally=1 31:30.713 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29692 [Leader]" 31:30.716 [INFO] TestAgent.server: cluster leadership acquired 31:30.716 [INFO] TestAgent.server: New leader elected: payload=Node-28a1cbd3-adb2-a0d3-d105-279502aab738 31:30.723 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29692 31:30.766 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.819 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.819 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.819 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.819 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.819 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.819 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-28a1cbd3-adb2-a0d3-d105-279502aab738 31:30.819 [INFO] TestAgent.server: member joined, marking health alive: member=Node-28a1cbd3-adb2-a0d3-d105-279502aab738 31:30.833 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.896 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:30.912 [INFO] TestAgent: Synced node info 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.970 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.971 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.972 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.973 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [DEBUG] TestAgent: new event: event_name=test event_id= 31:30.974 [INFO] TestAgent: Requesting shutdown 31:30.975 [INFO] TestAgent.server: shutting down server 31:30.975 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:30.975 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:30.975 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:30.975 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:30.975 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:30.975 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:30.975 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:30.975 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:30.975 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:30.975 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:30.983 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.000Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.000Z [INFO] agent.router.manager: shutting down 31:31.000 [INFO] TestAgent: consul server down 31:31.000 [INFO] TestAgent: shutdown complete 31:31.000 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29596 network=tcp 31:31.000 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29596 network=udp 31:31.000 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29597 network=tcp 31:31.500 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.500 [INFO] TestAgent: Endpoints down --- PASS: TestIngestUserEvent (1.00s) === CONT TestTxnEndpoint_Bad_JSON [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestUiServices/No_Filter === PAUSE TestUiServices/No_Filter === RUN TestUiServices/Filtered 2021-10-05T16:31:30.723Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.751Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:30.820 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6e1de79c-81c4-fbbf-6876-af8f08ef6916 Address:127.0.0.1:29713}]" 31:30.821 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29713 [Follower]" leader= 31:30.821 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6e1de79c-81c4-fbbf-6876-af8f08ef6916.dc1 127.0.0.1 31:30.822 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6e1de79c-81c4-fbbf-6876-af8f08ef6916 127.0.0.1 2021-10-05T16:31:30.822Z [INFO] agent.router: Initializing LAN area manager 31:30.822 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29736 network=udp 31:30.823 [INFO] TestAgent.server: Adding LAN server: server="Node-6e1de79c-81c4-fbbf-6876-af8f08ef6916 (Addr: tcp/127.0.0.1:29713) (DC: dc1)" 31:30.823 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6e1de79c-81c4-fbbf-6876-af8f08ef6916.dc1 area=wan 31:30.823 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29736 network=tcp 31:30.824 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29737 network=tcp 31:30.824 [INFO] TestAgent: started state syncer 31:30.824 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29714 network=tcp 31:30.864 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.864 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29713 [Candidate]" term=2 31:30.893 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.893 [DEBUG] TestAgent.server.raft: vote granted: from=6e1de79c-81c4-fbbf-6876-af8f08ef6916 term=2 tally=1 31:30.893 [INFO] TestAgent.server.raft: election won: tally=1 31:30.893 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29713 [Leader]" 31:30.896 [INFO] TestAgent.server: cluster leadership acquired 31:30.896 [INFO] TestAgent.server: New leader elected: payload=Node-6e1de79c-81c4-fbbf-6876-af8f08ef6916 31:30.914 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29713 31:30.935 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.967 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.967 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.967 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.967 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.967 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.967 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6e1de79c-81c4-fbbf-6876-af8f08ef6916 31:30.967 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6e1de79c-81c4-fbbf-6876-af8f08ef6916 31:31.000 [INFO] TestAgent.server: federation state anti-entropy synced 31:31.017 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:31.032 [INFO] TestAgent: Synced node info 31:31.160 [INFO] TestAgent: Requesting shutdown 31:31.160 [INFO] TestAgent.server: shutting down server 31:31.160 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.160 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.160 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.160 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.160 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.160 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.160 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.160 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.160 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.184 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.188Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.188Z [INFO] agent.router.manager: shutting down 31:31.188 [INFO] TestAgent: consul server down 31:31.188 [INFO] TestAgent: shutdown complete 31:31.188 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29736 network=tcp 31:31.188 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29736 network=udp 31:31.188 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29737 network=tcp 31:31.688 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.688 [INFO] TestAgent: Endpoints down --- PASS: TestUIGatewayServiceNodes_Ingress (1.00s) === CONT TestTxnEndpoint_UpdateCheck 2021-10-05T16:31:30.898Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:30.918Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.004 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:22c4e7c2-e089-4cb6-fb1a-b8eef4a16238 Address:127.0.0.1:29720}]" 31:31.005 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-22c4e7c2-e089-4cb6-fb1a-b8eef4a16238.dc1 127.0.0.1 31:31.006 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-22c4e7c2-e089-4cb6-fb1a-b8eef4a16238 127.0.0.1 2021-10-05T16:31:31.006Z [INFO] agent.router: Initializing LAN area manager 31:31.006 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29715 network=udp 31:31.006 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29720 [Follower]" leader= 31:31.007 [INFO] TestAgent.server: Adding LAN server: server="Node-22c4e7c2-e089-4cb6-fb1a-b8eef4a16238 (Addr: tcp/127.0.0.1:29720) (DC: dc1)" 31:31.007 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-22c4e7c2-e089-4cb6-fb1a-b8eef4a16238.dc1 area=wan 31:31.007 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29715 network=tcp 31:31.008 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29716 network=tcp 31:31.008 [INFO] TestAgent: started state syncer 31:31.008 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29721 network=tcp 31:31.073 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.073 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29720 [Candidate]" term=2 31:31.082 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.082 [DEBUG] TestAgent.server.raft: vote granted: from=22c4e7c2-e089-4cb6-fb1a-b8eef4a16238 term=2 tally=1 31:31.082 [INFO] TestAgent.server.raft: election won: tally=1 31:31.082 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29720 [Leader]" 31:31.084 [INFO] TestAgent.server: cluster leadership acquired 31:31.084 [INFO] TestAgent.server: New leader elected: payload=Node-22c4e7c2-e089-4cb6-fb1a-b8eef4a16238 31:31.094 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29720 31:31.110 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.220 [INFO] TestAgent: Synced node info 31:31.220 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.220 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.220 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.220 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.220 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.220 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-22c4e7c2-e089-4cb6-fb1a-b8eef4a16238 31:31.220 [INFO] TestAgent.server: member joined, marking health alive: member=Node-22c4e7c2-e089-4cb6-fb1a-b8eef4a16238 31:31.247 [INFO] TestAgent.server: federation state anti-entropy synced 31:31.259 [INFO] TestAgent: Requesting shutdown 31:31.259 [INFO] TestAgent.server: shutting down server 31:31.259 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.259 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.259 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.259 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.259 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.259 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:31.259 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.259 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.259 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.259 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.276 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.279Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.279Z [INFO] agent.router.manager: shutting down 31:31.280 [INFO] TestAgent: consul server down 31:31.280 [INFO] TestAgent: shutdown complete 31:31.280 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29715 network=tcp 31:31.280 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29715 network=udp 31:31.280 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29716 network=tcp 31:31.780 [INFO] TestAgent: Waiting for endpoints to shut down 31:31.780 [INFO] TestAgent: Endpoints down --- PASS: TestUIGatewayServiceNodes_Terminating (0.93s) === CONT TestTxnEndpoint_KV_Actions === RUN TestTxnEndpoint_KV_Actions/#00 [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === CONT TestTxnEndpoint_Bad_Size_Ops 2021-10-05T16:31:31.313Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.379Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.461 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a3f10913-abab-26f9-4b9d-6ee3bfd90130 Address:127.0.0.1:29755}]" 31:31.462 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a3f10913-abab-26f9-4b9d-6ee3bfd90130.dc1 127.0.0.1 31:31.463 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a3f10913-abab-26f9-4b9d-6ee3bfd90130 127.0.0.1 2021-10-05T16:31:31.463Z [INFO] agent.router: Initializing LAN area manager 31:31.463 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29743 network=udp 31:31.463 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29755 [Follower]" leader= 31:31.463 [INFO] TestAgent.server: Adding LAN server: server="Node-a3f10913-abab-26f9-4b9d-6ee3bfd90130 (Addr: tcp/127.0.0.1:29755) (DC: dc1)" 31:31.464 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a3f10913-abab-26f9-4b9d-6ee3bfd90130.dc1 area=wan 31:31.464 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29743 network=tcp 31:31.465 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29744 network=tcp 31:31.465 [INFO] TestAgent: started state syncer 31:31.465 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29756 network=tcp 31:31.518 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.518 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29755 [Candidate]" term=2 31:31.562 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.562 [DEBUG] TestAgent.server.raft: vote granted: from=a3f10913-abab-26f9-4b9d-6ee3bfd90130 term=2 tally=1 31:31.562 [INFO] TestAgent.server.raft: election won: tally=1 31:31.562 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29755 [Leader]" 31:31.564 [INFO] TestAgent.server: cluster leadership acquired 31:31.564 [INFO] TestAgent.server: New leader elected: payload=Node-a3f10913-abab-26f9-4b9d-6ee3bfd90130 31:31.592 [INFO] TestAgent: Synced node info 31:31.592 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29755 31:31.637 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.683 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.683 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.683 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.683 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.683 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.684 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a3f10913-abab-26f9-4b9d-6ee3bfd90130 31:31.684 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a3f10913-abab-26f9-4b9d-6ee3bfd90130 31:31.724 [INFO] TestAgent.server: federation state anti-entropy synced 31:31.737 [INFO] TestAgent: Requesting shutdown 31:31.737 [INFO] TestAgent.server: shutting down server 31:31.737 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.737 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.737 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.737 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.737 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.737 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:31.737 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.737 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.737 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.737 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.749 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.750Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.750Z [INFO] agent.router.manager: shutting down 31:31.750 [INFO] TestAgent: consul server down 31:31.750 [INFO] TestAgent: shutdown complete 31:31.750 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29743 network=tcp 31:31.750 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29743 network=udp 31:31.750 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29744 network=tcp 31:32.252 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.252 [INFO] TestAgent: Endpoints down --- PASS: TestUiNodeInfo (0.98s) === CONT TestTxnEndpoint_Bad_Size_Net === RUN TestTxnEndpoint_Bad_Size_Net/exceeds_default_limits 2021-10-05T16:31:31.521Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.539Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.587 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:08262107-cbbd-7877-428d-5857bbca6995 Address:127.0.0.1:29748}]" 31:31.587 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-08262107-cbbd-7877-428d-5857bbca6995.dc1 127.0.0.1 31:31.588 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29748 [Follower]" leader= 31:31.588 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-08262107-cbbd-7877-428d-5857bbca6995 127.0.0.1 2021-10-05T16:31:31.588Z [INFO] agent.router: Initializing LAN area manager 31:31.588 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-08262107-cbbd-7877-428d-5857bbca6995.dc1 area=wan 31:31.588 [INFO] TestAgent.server: Adding LAN server: server="Node-08262107-cbbd-7877-428d-5857bbca6995 (Addr: tcp/127.0.0.1:29748) (DC: dc1)" 31:31.589 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29729 network=udp 31:31.589 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29729 network=tcp 31:31.589 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29730 network=tcp 31:31.589 [INFO] TestAgent: started state syncer 31:31.589 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29749 network=tcp 31:31.644 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.644 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29748 [Candidate]" term=2 31:31.676 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.676 [DEBUG] TestAgent.server.raft: vote granted: from=08262107-cbbd-7877-428d-5857bbca6995 term=2 tally=1 31:31.676 [INFO] TestAgent.server.raft: election won: tally=1 31:31.676 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29748 [Leader]" 31:31.676 [INFO] TestAgent.server: cluster leadership acquired 31:31.676 [INFO] TestAgent.server: New leader elected: payload=Node-08262107-cbbd-7877-428d-5857bbca6995 31:31.686 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29748 31:31.707 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.763 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.763 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.763 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.763 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.763 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.763 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-08262107-cbbd-7877-428d-5857bbca6995 31:31.763 [INFO] TestAgent.server: member joined, marking health alive: member=Node-08262107-cbbd-7877-428d-5857bbca6995 31:31.772 [INFO] TestAgent: Requesting shutdown 31:31.772 [INFO] TestAgent.server: shutting down server 31:31.772 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.772 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.772 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.772 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.772 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.772 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:31.772 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.772 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.774 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.784 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:31.784 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.789 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.791Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.791Z [INFO] agent.router.manager: shutting down 31:31.791 [INFO] TestAgent: consul server down 31:31.791 [INFO] TestAgent: shutdown complete 31:31.791 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29729 network=tcp 31:31.791 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29729 network=udp 31:31.791 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29730 network=tcp 31:32.291 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.291 [INFO] TestAgent: Endpoints down --- PASS: TestTxnEndpoint_Bad_JSON (0.79s) === CONT TestTxnEndpoint_Bad_Size_Item === RUN TestTxnEndpoint_Bad_Size_Item/exceeds_default_limits [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:31.383Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.427Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.524 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ffdf23bc-4305-cf95-1e3a-1e67800fa56a Address:127.0.0.1:29706}]" 31:31.524 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ffdf23bc-4305-cf95-1e3a-1e67800fa56a.dc1 127.0.0.1 31:31.525 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ffdf23bc-4305-cf95-1e3a-1e67800fa56a 127.0.0.1 2021-10-05T16:31:31.525Z [INFO] agent.router: Initializing LAN area manager 31:31.525 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29757 network=udp 31:31.525 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29706 [Follower]" leader= 31:31.526 [INFO] TestAgent.server: Adding LAN server: server="Node-ffdf23bc-4305-cf95-1e3a-1e67800fa56a (Addr: tcp/127.0.0.1:29706) (DC: dc1)" 31:31.526 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ffdf23bc-4305-cf95-1e3a-1e67800fa56a.dc1 area=wan 31:31.526 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29757 network=tcp 31:31.526 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29758 network=tcp 31:31.526 [INFO] TestAgent: started state syncer 31:31.526 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29707 network=tcp 31:31.567 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.567 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29706 [Candidate]" term=2 31:31.593 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.593 [DEBUG] TestAgent.server.raft: vote granted: from=ffdf23bc-4305-cf95-1e3a-1e67800fa56a term=2 tally=1 31:31.593 [INFO] TestAgent.server.raft: election won: tally=1 31:31.593 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29706 [Leader]" 31:31.593 [INFO] TestAgent.server: cluster leadership acquired 31:31.593 [INFO] TestAgent.server: New leader elected: payload=Node-ffdf23bc-4305-cf95-1e3a-1e67800fa56a 31:31.605 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29706 31:31.652 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.734 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.734 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.734 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.734 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.734 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.734 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ffdf23bc-4305-cf95-1e3a-1e67800fa56a 31:31.734 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ffdf23bc-4305-cf95-1e3a-1e67800fa56a 31:31.771 [INFO] TestAgent: Synced node info 31:31.777 [INFO] TestAgent.server: federation state anti-entropy synced 31:31.821 [INFO] TestAgent: Requesting shutdown 31:31.821 [INFO] TestAgent.server: shutting down server 31:31.821 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.821 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.821 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.821 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.821 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.821 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:31.821 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.821 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.821 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.821 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.827 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.828Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.828Z [INFO] agent.router.manager: shutting down 31:31.828 [INFO] TestAgent: consul server down 31:31.828 [INFO] TestAgent: shutdown complete 31:31.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29757 network=tcp 31:31.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29757 network=udp 31:31.828 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29758 network=tcp 31:32.329 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.329 [INFO] TestAgent: Endpoints down --- PASS: TestUiNodes_Filter (0.99s) === CONT TestAgentConnectAuthorize_badBody 2021-10-05T16:31:31.457Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.480Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.568 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:93ef7d96-366d-e3a8-be83-a3a4b53e8698 Address:127.0.0.1:29741}]" 31:31.568 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-93ef7d96-366d-e3a8-be83-a3a4b53e8698.dc1 127.0.0.1 31:31.569 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29741 [Follower]" leader= 31:31.569 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-93ef7d96-366d-e3a8-be83-a3a4b53e8698 127.0.0.1 2021-10-05T16:31:31.569Z [INFO] agent.router: Initializing LAN area manager 31:31.569 [INFO] TestAgent.server: Adding LAN server: server="Node-93ef7d96-366d-e3a8-be83-a3a4b53e8698 (Addr: tcp/127.0.0.1:29741) (DC: dc1)" 31:31.569 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29673 network=udp 31:31.569 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-93ef7d96-366d-e3a8-be83-a3a4b53e8698.dc1 area=wan 31:31.569 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29673 network=tcp 31:31.570 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29674 network=tcp 31:31.570 [INFO] TestAgent: started state syncer 31:31.570 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29742 network=tcp 31:31.606 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.607 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29741 [Candidate]" term=2 31:31.620 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.620 [DEBUG] TestAgent.server.raft: vote granted: from=93ef7d96-366d-e3a8-be83-a3a4b53e8698 term=2 tally=1 31:31.620 [INFO] TestAgent.server.raft: election won: tally=1 31:31.620 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29741 [Leader]" 31:31.620 [INFO] TestAgent.server: cluster leadership acquired 31:31.620 [INFO] TestAgent.server: New leader elected: payload=Node-93ef7d96-366d-e3a8-be83-a3a4b53e8698 31:31.632 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29741 31:31.678 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.713 [INFO] TestAgent: Synced node info 31:31.713 [DEBUG] TestAgent: Node info in sync 31:31.763 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.763 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.763 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.763 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.763 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.764 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-93ef7d96-366d-e3a8-be83-a3a4b53e8698 31:31.764 [INFO] TestAgent.server: member joined, marking health alive: member=Node-93ef7d96-366d-e3a8-be83-a3a4b53e8698 31:31.795 [INFO] TestAgent.server: federation state anti-entropy synced 31:31.860 [INFO] TestAgent: Requesting shutdown 31:31.860 [INFO] TestAgent.server: shutting down server 31:31.860 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.860 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.860 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.860 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.860 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.860 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:31.860 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.860 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.860 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.860 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.866 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.868Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.868Z [INFO] agent.router.manager: shutting down 31:31.868 [INFO] TestAgent: consul server down 31:31.868 [INFO] TestAgent: shutdown complete 31:31.868 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29673 network=tcp 31:31.868 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29673 network=udp 31:31.868 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29674 network=tcp 31:32.368 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.368 [INFO] TestAgent: Endpoints down === RUN TestConnectCAConfig/updating_config_with_same_state 2021-10-05T16:31:31.432Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.466Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.560 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2332e38c-8ec8-3d04-aed1-c3d049fbdf21 Address:127.0.0.1:29671}]" 31:31.560 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29671 [Follower]" leader= 31:31.561 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2332e38c-8ec8-3d04-aed1-c3d049fbdf21.dc1 127.0.0.1 31:31.563 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2332e38c-8ec8-3d04-aed1-c3d049fbdf21 127.0.0.1 2021-10-05T16:31:31.563Z [INFO] agent.router: Initializing LAN area manager 31:31.563 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29708 network=udp 31:31.563 [INFO] TestAgent.server: Adding LAN server: server="Node-2332e38c-8ec8-3d04-aed1-c3d049fbdf21 (Addr: tcp/127.0.0.1:29671) (DC: dc1)" 31:31.563 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2332e38c-8ec8-3d04-aed1-c3d049fbdf21.dc1 area=wan 31:31.564 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29708 network=tcp 31:31.565 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29709 network=tcp 31:31.566 [INFO] TestAgent: started state syncer 31:31.566 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29672 network=tcp 31:31.628 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.628 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29671 [Candidate]" term=2 31:31.671 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.671 [DEBUG] TestAgent.server.raft: vote granted: from=2332e38c-8ec8-3d04-aed1-c3d049fbdf21 term=2 tally=1 31:31.671 [INFO] TestAgent.server.raft: election won: tally=1 31:31.671 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29671 [Leader]" 31:31.671 [INFO] TestAgent.server: cluster leadership acquired 31:31.671 [INFO] TestAgent.server: New leader elected: payload=Node-2332e38c-8ec8-3d04-aed1-c3d049fbdf21 31:31.688 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29671 31:31.711 [INFO] TestAgent: Synced node info 31:31.740 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.771 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.771 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.771 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.771 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.771 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.771 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2332e38c-8ec8-3d04-aed1-c3d049fbdf21 31:31.771 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2332e38c-8ec8-3d04-aed1-c3d049fbdf21 31:31.797 [INFO] TestAgent.server: federation state anti-entropy synced 31:31.972 [INFO] TestAgent: Requesting shutdown 31:31.972 [INFO] TestAgent.server: shutting down server 31:31.972 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.972 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.972 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.972 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.972 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.972 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:31.972 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.972 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.972 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.972 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.983 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.984Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.984Z [INFO] agent.router.manager: shutting down 31:31.984 [INFO] TestAgent: consul server down 31:31.984 [INFO] TestAgent: shutdown complete 31:31.984 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29708 network=tcp 31:31.984 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29708 network=udp 31:31.984 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29709 network=tcp 31:32.484 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.484 [INFO] TestAgent: Endpoints down --- PASS: TestUiNodes (1.09s) === CONT TestConfig_Apply_TerminatingGateway [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:31.804Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.817Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.900 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fae6279e-d2fc-99ce-9d42-b88392ced73c Address:127.0.0.1:29783}]" 31:31.900 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29783 [Follower]" leader= 31:31.901 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fae6279e-d2fc-99ce-9d42-b88392ced73c.dc1 127.0.0.1 31:31.901 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fae6279e-d2fc-99ce-9d42-b88392ced73c 127.0.0.1 2021-10-05T16:31:31.901Z [INFO] agent.router: Initializing LAN area manager 31:31.902 [INFO] TestAgent.server: Adding LAN server: server="Node-fae6279e-d2fc-99ce-9d42-b88392ced73c (Addr: tcp/127.0.0.1:29783) (DC: dc1)" 31:31.902 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29764 network=udp 31:31.902 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fae6279e-d2fc-99ce-9d42-b88392ced73c.dc1 area=wan 31:31.902 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29764 network=tcp 31:31.902 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29765 network=tcp 31:31.902 [INFO] TestAgent: started state syncer 31:31.902 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29784 network=tcp 31:31.972 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.972 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29783 [Candidate]" term=2 31:32.005 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.005 [DEBUG] TestAgent.server.raft: vote granted: from=fae6279e-d2fc-99ce-9d42-b88392ced73c term=2 tally=1 31:32.005 [INFO] TestAgent.server.raft: election won: tally=1 31:32.005 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29783 [Leader]" 31:32.006 [INFO] TestAgent.server: cluster leadership acquired 31:32.006 [INFO] TestAgent.server: New leader elected: payload=Node-fae6279e-d2fc-99ce-9d42-b88392ced73c 31:32.036 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29783 31:32.054 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.087 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.087 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.087 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.087 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.087 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.087 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fae6279e-d2fc-99ce-9d42-b88392ced73c 31:32.087 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fae6279e-d2fc-99ce-9d42-b88392ced73c 31:32.111 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.139 [INFO] TestAgent: Requesting shutdown 31:32.140 [INFO] TestAgent.server: shutting down server 31:32.140 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.140 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.140 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.140 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.140 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.140 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.140 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.140 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:32.140 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.140 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.140 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.147 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.168Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.169Z [INFO] agent.router.manager: shutting down 31:32.169 [INFO] TestAgent: consul server down 31:32.169 [INFO] TestAgent: shutdown complete 31:32.169 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29764 network=tcp 31:32.169 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29764 network=udp 31:32.169 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29765 network=tcp 31:32.669 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.669 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_KV_Actions/#01 2021-10-05T16:31:31.706Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.728Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.789 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a7fdb0c3-f73b-db5c-c600-caa04626f65d Address:127.0.0.1:29762}]" 31:31.790 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a7fdb0c3-f73b-db5c-c600-caa04626f65d.dc1 127.0.0.1 31:31.790 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a7fdb0c3-f73b-db5c-c600-caa04626f65d 127.0.0.1 2021-10-05T16:31:31.790Z [INFO] agent.router: Initializing LAN area manager 31:31.791 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29762 [Follower]" leader= 31:31.792 [INFO] TestAgent.server: Adding LAN server: server="Node-a7fdb0c3-f73b-db5c-c600-caa04626f65d (Addr: tcp/127.0.0.1:29762) (DC: dc1)" 31:31.792 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a7fdb0c3-f73b-db5c-c600-caa04626f65d.dc1 area=wan 31:31.792 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29750 network=tcp 31:31.792 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29750 network=udp 31:31.793 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29751 network=tcp 31:31.793 [INFO] TestAgent: started state syncer 31:31.793 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29763 network=tcp 31:31.852 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.852 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29762 [Candidate]" term=2 31:31.869 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.869 [DEBUG] TestAgent.server.raft: vote granted: from=a7fdb0c3-f73b-db5c-c600-caa04626f65d term=2 tally=1 31:31.869 [INFO] TestAgent.server.raft: election won: tally=1 31:31.869 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29762 [Leader]" 31:31.869 [INFO] TestAgent.server: cluster leadership acquired 31:31.869 [INFO] TestAgent.server: New leader elected: payload=Node-a7fdb0c3-f73b-db5c-c600-caa04626f65d 31:31.878 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29762 31:31.895 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.923 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.923 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.923 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.923 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.923 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.923 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a7fdb0c3-f73b-db5c-c600-caa04626f65d 31:31.923 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a7fdb0c3-f73b-db5c-c600-caa04626f65d 31:31.939 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.076 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:32.081 [INFO] TestAgent: Synced node info 31:32.081 [DEBUG] TestAgent: Node info in sync 31:32.169 [INFO] TestAgent: Requesting shutdown 31:32.169 [INFO] TestAgent.server: shutting down server 31:32.169 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.169 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.169 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.169 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.170 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.170 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.170 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.170 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.170 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.170 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.180 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.180Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.180Z [INFO] agent.router.manager: shutting down 31:32.180 [INFO] TestAgent: consul server down 31:32.180 [INFO] TestAgent: shutdown complete 31:32.180 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29750 network=tcp 31:32.180 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29750 network=udp 31:32.180 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29751 network=tcp 31:32.680 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.680 [INFO] TestAgent: Endpoints down --- PASS: TestTxnEndpoint_UpdateCheck (0.99s) === CONT TestConfig_Apply [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:32.254Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.271Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.353 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bcd50b92-8150-9194-9fda-2577dbbd2ba7 Address:127.0.0.1:29790}]" 31:32.354 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bcd50b92-8150-9194-9fda-2577dbbd2ba7.dc1 127.0.0.1 31:32.354 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bcd50b92-8150-9194-9fda-2577dbbd2ba7 127.0.0.1 2021-10-05T16:31:32.354Z [INFO] agent.router: Initializing LAN area manager 31:32.354 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29785 network=udp 31:32.354 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29790 [Follower]" leader= 31:32.355 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bcd50b92-8150-9194-9fda-2577dbbd2ba7.dc1 area=wan 31:32.355 [INFO] TestAgent.server: Adding LAN server: server="Node-bcd50b92-8150-9194-9fda-2577dbbd2ba7 (Addr: tcp/127.0.0.1:29790) (DC: dc1)" 31:32.355 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29785 network=tcp 31:32.356 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29786 network=tcp 31:32.356 [INFO] TestAgent: started state syncer 31:32.356 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29791 network=tcp 31:32.393 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.393 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29790 [Candidate]" term=2 31:32.419 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.419 [DEBUG] TestAgent.server.raft: vote granted: from=bcd50b92-8150-9194-9fda-2577dbbd2ba7 term=2 tally=1 31:32.419 [INFO] TestAgent.server.raft: election won: tally=1 31:32.419 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29790 [Leader]" 31:32.420 [INFO] TestAgent.server: cluster leadership acquired 31:32.420 [INFO] TestAgent.server: New leader elected: payload=Node-bcd50b92-8150-9194-9fda-2577dbbd2ba7 31:32.430 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29790 31:32.457 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.491 [INFO] TestAgent: Synced node info 31:32.528 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.528 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.528 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.528 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.528 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.528 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bcd50b92-8150-9194-9fda-2577dbbd2ba7 31:32.528 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bcd50b92-8150-9194-9fda-2577dbbd2ba7 31:32.604 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.604 [INFO] TestAgent: Requesting shutdown 31:32.604 [INFO] TestAgent.server: shutting down server 31:32.604 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.604 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.604 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.604 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.604 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.605 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.605 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.605 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.605 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.605 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.618 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.632Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.632Z [INFO] agent.router.manager: shutting down 31:32.632 [INFO] TestAgent: consul server down 31:32.632 [INFO] TestAgent: shutdown complete 31:32.632 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29785 network=tcp 31:32.632 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29785 network=udp 31:32.632 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29786 network=tcp 31:33.133 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.133 [INFO] TestAgent: Endpoints down --- PASS: TestTxnEndpoint_Bad_Size_Ops (0.94s) === CONT TestConfig_Delete 2021-10-05T16:31:32.307Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.321Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.377 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:929efaa5-76a0-8ec8-dbaf-cc92983231c3 Address:127.0.0.1:29839}]" 31:32.378 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-929efaa5-76a0-8ec8-dbaf-cc92983231c3.dc1 127.0.0.1 31:32.379 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-929efaa5-76a0-8ec8-dbaf-cc92983231c3 127.0.0.1 2021-10-05T16:31:32.379Z [INFO] agent.router: Initializing LAN area manager 31:32.379 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29778 network=udp 31:32.379 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29839 [Follower]" leader= 31:32.380 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-929efaa5-76a0-8ec8-dbaf-cc92983231c3.dc1 area=wan 31:32.380 [INFO] TestAgent.server: Adding LAN server: server="Node-929efaa5-76a0-8ec8-dbaf-cc92983231c3 (Addr: tcp/127.0.0.1:29839) (DC: dc1)" 31:32.380 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29778 network=tcp 31:32.381 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29779 network=tcp 31:32.381 [INFO] TestAgent: started state syncer 31:32.381 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29840 network=tcp 31:32.435 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.435 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29839 [Candidate]" term=2 31:32.457 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.457 [DEBUG] TestAgent.server.raft: vote granted: from=929efaa5-76a0-8ec8-dbaf-cc92983231c3 term=2 tally=1 31:32.457 [INFO] TestAgent.server.raft: election won: tally=1 31:32.457 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29839 [Leader]" 31:32.460 [INFO] TestAgent.server: cluster leadership acquired 31:32.460 [INFO] TestAgent.server: New leader elected: payload=Node-929efaa5-76a0-8ec8-dbaf-cc92983231c3 31:32.486 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29839 31:32.518 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.608 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.608 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.608 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.608 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.608 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.609 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-929efaa5-76a0-8ec8-dbaf-cc92983231c3 31:32.609 [INFO] TestAgent.server: member joined, marking health alive: member=Node-929efaa5-76a0-8ec8-dbaf-cc92983231c3 31:32.640 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.683 [INFO] TestAgent: Requesting shutdown 31:32.683 [INFO] TestAgent.server: shutting down server 31:32.683 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.683 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.683 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.683 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.683 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.683 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.683 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.683 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:32.683 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.683 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.683 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.695 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.703Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.703Z [INFO] agent.router.manager: shutting down 31:32.703 [INFO] TestAgent: consul server down 31:32.703 [INFO] TestAgent: shutdown complete 31:32.703 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29778 network=tcp 31:32.703 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29778 network=udp 31:32.704 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29779 network=tcp 31:33.204 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.204 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_Bad_Size_Item/exceeds_configured_max_txn_len 2021-10-05T16:31:32.341Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.352Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.436 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7517cedb-4028-489e-d5cd-15dcbc434503 Address:127.0.0.1:29825}]" 31:32.436 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7517cedb-4028-489e-d5cd-15dcbc434503.dc1 127.0.0.1 31:32.437 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7517cedb-4028-489e-d5cd-15dcbc434503 127.0.0.1 2021-10-05T16:31:32.437Z [INFO] agent.router: Initializing LAN area manager 31:32.437 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29820 network=udp 31:32.437 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29825 [Follower]" leader= 31:32.437 [INFO] TestAgent.server: Adding LAN server: server="Node-7517cedb-4028-489e-d5cd-15dcbc434503 (Addr: tcp/127.0.0.1:29825) (DC: dc1)" 31:32.437 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7517cedb-4028-489e-d5cd-15dcbc434503.dc1 area=wan 31:32.437 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29820 network=tcp 31:32.438 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29821 network=tcp 31:32.438 [INFO] TestAgent: started state syncer 31:32.438 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29826 network=tcp 31:32.488 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.488 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29825 [Candidate]" term=2 31:32.522 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.522 [DEBUG] TestAgent.server.raft: vote granted: from=7517cedb-4028-489e-d5cd-15dcbc434503 term=2 tally=1 31:32.522 [INFO] TestAgent.server.raft: election won: tally=1 31:32.522 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29825 [Leader]" 31:32.529 [INFO] TestAgent.server: cluster leadership acquired 31:32.529 [INFO] TestAgent.server: New leader elected: payload=Node-7517cedb-4028-489e-d5cd-15dcbc434503 31:32.554 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29825 31:32.638 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.672 [INFO] TestAgent: Synced node info 31:32.672 [DEBUG] TestAgent: Node info in sync 31:32.689 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.689 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.689 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.689 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.689 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.689 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7517cedb-4028-489e-d5cd-15dcbc434503 31:32.689 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7517cedb-4028-489e-d5cd-15dcbc434503 31:32.695 [DEBUG] TestAgent: Node info in sync 31:32.707 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.741 [INFO] TestAgent: Requesting shutdown 31:32.741 [INFO] TestAgent.server: shutting down server 31:32.741 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.741 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.741 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.741 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.741 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.741 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.741 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.741 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.741 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.741 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.751 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.762Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.762Z [INFO] agent.router.manager: shutting down 31:32.762 [INFO] TestAgent: consul server down 31:32.762 [INFO] TestAgent: shutdown complete 31:32.762 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29820 network=tcp 31:32.762 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29820 network=udp 31:32.762 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29821 network=tcp 31:33.263 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.263 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_badBody (0.93s) === CONT TestConfig_Get 2021-10-05T16:31:32.381Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.394Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.432 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c7c879a0-352c-91a8-622b-4fdfbf14cbaa Address:127.0.0.1:29818}]" 31:32.432 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29818 [Follower]" leader= 31:32.433 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c7c879a0-352c-91a8-622b-4fdfbf14cbaa.dc1 127.0.0.1 31:32.433 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c7c879a0-352c-91a8-622b-4fdfbf14cbaa 127.0.0.1 2021-10-05T16:31:32.433Z [INFO] agent.router: Initializing LAN area manager 31:32.433 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29813 network=udp 31:32.434 [INFO] TestAgent.server: Adding LAN server: server="Node-c7c879a0-352c-91a8-622b-4fdfbf14cbaa (Addr: tcp/127.0.0.1:29818) (DC: dc1)" 31:32.434 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c7c879a0-352c-91a8-622b-4fdfbf14cbaa.dc1 area=wan 31:32.434 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29813 network=tcp 31:32.434 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29814 network=tcp 31:32.434 [INFO] TestAgent: started state syncer 31:32.434 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29819 network=tcp 31:32.476 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.476 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29818 [Candidate]" term=2 31:32.528 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.528 [DEBUG] TestAgent.server.raft: vote granted: from=c7c879a0-352c-91a8-622b-4fdfbf14cbaa term=2 tally=1 31:32.528 [INFO] TestAgent.server.raft: election won: tally=1 31:32.528 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29818 [Leader]" 31:32.532 [INFO] TestAgent.server: cluster leadership acquired 31:32.532 [INFO] TestAgent.server: New leader elected: payload=Node-c7c879a0-352c-91a8-622b-4fdfbf14cbaa 31:32.559 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29818 31:32.627 [INFO] TestAgent: Synced node info 31:32.666 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.702 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.702 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.702 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.702 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.702 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.702 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c7c879a0-352c-91a8-622b-4fdfbf14cbaa 31:32.702 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c7c879a0-352c-91a8-622b-4fdfbf14cbaa 31:32.720 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.743 [INFO] TestAgent.server.connect: CA provider config updated 31:32.743 [INFO] TestAgent: Requesting shutdown 31:32.743 [INFO] TestAgent.server: shutting down server 31:32.743 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.743 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.743 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.743 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.743 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.743 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.743 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.744 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.744 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.744 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.757 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.769Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.769Z [INFO] agent.router.manager: shutting down 31:32.770 [INFO] TestAgent: consul server down 31:32.770 [INFO] TestAgent: shutdown complete 31:32.770 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29813 network=tcp 31:32.770 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29813 network=udp 31:32.770 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29814 network=tcp 31:33.272 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.272 [INFO] TestAgent: Endpoints down --- PASS: TestConnectCAConfig (5.78s) --- PASS: TestConnectCAConfig/basic (0.95s) --- PASS: TestConnectCAConfig/basic_with_IntermediateCertTTL (1.07s) --- PASS: TestConnectCAConfig/force_without_cross_sign_CamelCase (1.10s) --- PASS: TestConnectCAConfig/force_without_cross_sign_snake_case (0.84s) --- PASS: TestConnectCAConfig/setting_state_fails (0.93s) --- PASS: TestConnectCAConfig/updating_config_with_same_state (0.90s) === CONT TestCatalog_GatewayServices_Ingress [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:32.542Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.606Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.700 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6f212a8f-5533-12d4-e989-e481ead2b056 Address:127.0.0.1:29797}]" 31:32.700 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29797 [Follower]" leader= 31:32.701 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6f212a8f-5533-12d4-e989-e481ead2b056.dc1 127.0.0.1 31:32.701 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6f212a8f-5533-12d4-e989-e481ead2b056 127.0.0.1 2021-10-05T16:31:32.701Z [INFO] agent.router: Initializing LAN area manager 31:32.702 [INFO] TestAgent.server: Adding LAN server: server="Node-6f212a8f-5533-12d4-e989-e481ead2b056 (Addr: tcp/127.0.0.1:29797) (DC: dc1)" 31:32.702 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29827 network=udp 31:32.702 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6f212a8f-5533-12d4-e989-e481ead2b056.dc1 area=wan 31:32.702 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29827 network=tcp 31:32.702 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29828 network=tcp 31:32.702 [INFO] TestAgent: started state syncer 31:32.703 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29798 network=tcp 31:32.745 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.745 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29797 [Candidate]" term=2 31:32.769 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.769 [DEBUG] TestAgent.server.raft: vote granted: from=6f212a8f-5533-12d4-e989-e481ead2b056 term=2 tally=1 31:32.769 [INFO] TestAgent.server.raft: election won: tally=1 31:32.769 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29797 [Leader]" 31:32.770 [INFO] TestAgent.server: cluster leadership acquired 31:32.770 [INFO] TestAgent.server: New leader elected: payload=Node-6f212a8f-5533-12d4-e989-e481ead2b056 31:32.786 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29797 31:32.807 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.848 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.848 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.848 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.848 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.848 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.848 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6f212a8f-5533-12d4-e989-e481ead2b056 31:32.848 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6f212a8f-5533-12d4-e989-e481ead2b056 31:32.901 [INFO] TestAgent: Requesting shutdown 31:32.902 [INFO] TestAgent.server: shutting down server 31:32.902 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.902 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.902 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.902 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.902 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.902 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.902 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.902 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:32.902 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.902 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.902 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.916 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.925Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.925Z [INFO] agent.router.manager: shutting down 31:32.925 [INFO] TestAgent: consul server down 31:32.925 [INFO] TestAgent: shutdown complete 31:32.925 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29827 network=tcp 31:32.925 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29827 network=udp 31:32.925 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29828 network=tcp 31:33.427 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.427 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Apply_TerminatingGateway (0.94s) === CONT TestCatalog_GatewayServices_Terminating 2021-10-05T16:31:32.281Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.302Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.384 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2412d7f2-cb2d-ab52-4bec-d28745791105 Address:127.0.0.1:29769}]" 31:32.384 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29769 [Follower]" leader= 31:32.384 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2412d7f2-cb2d-ab52-4bec-d28745791105.dc1 127.0.0.1 31:32.385 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2412d7f2-cb2d-ab52-4bec-d28745791105 127.0.0.1 2021-10-05T16:31:32.385Z [INFO] agent.router: Initializing LAN area manager 31:32.385 [INFO] TestAgent.server: Adding LAN server: server="Node-2412d7f2-cb2d-ab52-4bec-d28745791105 (Addr: tcp/127.0.0.1:29769) (DC: dc1)" 31:32.385 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29834 network=udp 31:32.385 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2412d7f2-cb2d-ab52-4bec-d28745791105.dc1 area=wan 31:32.385 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29834 network=tcp 31:32.386 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29835 network=tcp 31:32.386 [INFO] TestAgent: started state syncer 31:32.387 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29770 network=tcp 31:32.429 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.429 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29769 [Candidate]" term=2 31:32.447 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.447 [DEBUG] TestAgent.server.raft: vote granted: from=2412d7f2-cb2d-ab52-4bec-d28745791105 term=2 tally=1 31:32.448 [INFO] TestAgent.server.raft: election won: tally=1 31:32.448 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29769 [Leader]" 31:32.448 [INFO] TestAgent.server: cluster leadership acquired 31:32.448 [INFO] TestAgent.server: New leader elected: payload=Node-2412d7f2-cb2d-ab52-4bec-d28745791105 31:32.484 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29769 31:32.524 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.626 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.626 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.626 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.626 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.626 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.626 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2412d7f2-cb2d-ab52-4bec-d28745791105 31:32.626 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2412d7f2-cb2d-ab52-4bec-d28745791105 31:32.661 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.679 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:32.692 [INFO] TestAgent: Synced node info 31:32.692 [DEBUG] TestAgent: Node info in sync 31:33.034 [INFO] TestAgent: Requesting shutdown 31:33.034 [INFO] TestAgent.server: shutting down server 31:33.034 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.034 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.034 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.034 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.034 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.034 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.034 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.034 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.034 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.034 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.044 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.056Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.056Z [INFO] agent.router.manager: shutting down 31:33.056 [INFO] TestAgent: consul server down 31:33.056 [INFO] TestAgent: shutdown complete 31:33.056 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29834 network=tcp 31:33.056 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29834 network=udp 31:33.056 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29835 network=tcp 31:33.559 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.559 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_Bad_Size_Net/exceeds_configured_max_txn_len 2021-10-05T16:31:32.687Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.725Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.792 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c2b54acd-16cb-d111-ab1c-b0a2a3ccd492 Address:127.0.0.1:29832}]" 31:32.792 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29832 [Follower]" leader= 31:32.793 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c2b54acd-16cb-d111-ab1c-b0a2a3ccd492.dc1 127.0.0.1 31:32.793 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c2b54acd-16cb-d111-ab1c-b0a2a3ccd492 127.0.0.1 2021-10-05T16:31:32.793Z [INFO] agent.router: Initializing LAN area manager 31:32.793 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29799 network=udp 31:32.793 [INFO] TestAgent.server: Adding LAN server: server="Node-c2b54acd-16cb-d111-ab1c-b0a2a3ccd492 (Addr: tcp/127.0.0.1:29832) (DC: dc1)" 31:32.793 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c2b54acd-16cb-d111-ab1c-b0a2a3ccd492.dc1 area=wan 31:32.794 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29799 network=tcp 31:32.794 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29800 network=tcp 31:32.794 [INFO] TestAgent: started state syncer 31:32.794 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29833 network=tcp 31:32.844 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.844 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29832 [Candidate]" term=2 31:32.872 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.872 [DEBUG] TestAgent.server.raft: vote granted: from=c2b54acd-16cb-d111-ab1c-b0a2a3ccd492 term=2 tally=1 31:32.872 [INFO] TestAgent.server.raft: election won: tally=1 31:32.872 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29832 [Leader]" 31:32.873 [INFO] TestAgent.server: cluster leadership acquired 31:32.873 [INFO] TestAgent.server: New leader elected: payload=Node-c2b54acd-16cb-d111-ab1c-b0a2a3ccd492 31:32.908 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29832 31:32.955 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.994 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.994 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.994 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.994 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.994 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.994 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c2b54acd-16cb-d111-ab1c-b0a2a3ccd492 31:32.994 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c2b54acd-16cb-d111-ab1c-b0a2a3ccd492 31:33.013 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.051 [INFO] TestAgent: Requesting shutdown 31:33.051 [INFO] TestAgent.server: shutting down server 31:33.051 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.051 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.051 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.051 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.051 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.051 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.051 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.051 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:33.051 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.051 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.051 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.059 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.064Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.064Z [INFO] agent.router.manager: shutting down 31:33.064 [INFO] TestAgent: consul server down 31:33.064 [INFO] TestAgent: shutdown complete 31:33.064 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29799 network=tcp 31:33.064 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29799 network=udp 31:33.064 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29800 network=tcp 31:33.568 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.568 [INFO] TestAgent: Endpoints down --- PASS: TestTxnEndpoint_KV_Actions (1.78s) --- PASS: TestTxnEndpoint_KV_Actions/#00 (0.88s) --- PASS: TestTxnEndpoint_KV_Actions/#01 (0.90s) === CONT TestCatalogNodeServices_WanTranslation [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestConfig_Get/get_a_single_service_entry === RUN TestConfig_Get/list_both_service_entries === RUN TestConfig_Get/get_global_proxy_config === RUN TestConfig_Get/error_on_no_arguments 2021-10-05T16:31:32.709Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.752Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.856 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4beaadf6-7268-14e4-880f-29e905271b64 Address:127.0.0.1:29804}]" 31:32.857 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4beaadf6-7268-14e4-880f-29e905271b64.dc1 127.0.0.1 31:32.857 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4beaadf6-7268-14e4-880f-29e905271b64 127.0.0.1 2021-10-05T16:31:32.857Z [INFO] agent.router: Initializing LAN area manager 31:32.857 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29792 network=udp 31:32.857 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29804 [Follower]" leader= 31:32.858 [INFO] TestAgent.server: Adding LAN server: server="Node-4beaadf6-7268-14e4-880f-29e905271b64 (Addr: tcp/127.0.0.1:29804) (DC: dc1)" 31:32.858 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4beaadf6-7268-14e4-880f-29e905271b64.dc1 area=wan 31:32.858 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29792 network=tcp 31:32.859 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29793 network=tcp 31:32.859 [INFO] TestAgent: started state syncer 31:32.859 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29805 network=tcp 31:32.899 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.899 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29804 [Candidate]" term=2 31:32.939 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.939 [DEBUG] TestAgent.server.raft: vote granted: from=4beaadf6-7268-14e4-880f-29e905271b64 term=2 tally=1 31:32.939 [INFO] TestAgent.server.raft: election won: tally=1 31:32.939 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29804 [Leader]" 31:32.944 [INFO] TestAgent.server: cluster leadership acquired 31:32.944 [INFO] TestAgent.server: New leader elected: payload=Node-4beaadf6-7268-14e4-880f-29e905271b64 31:32.958 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29804 31:33.000 [INFO] TestAgent: Synced node info 31:33.000 [DEBUG] TestAgent: Node info in sync 31:33.017 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.039 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.039 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.039 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.039 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.039 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.039 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4beaadf6-7268-14e4-880f-29e905271b64 31:33.039 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4beaadf6-7268-14e4-880f-29e905271b64 31:33.060 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.229 [INFO] TestAgent: Requesting shutdown 31:33.229 [INFO] TestAgent.server: shutting down server 31:33.229 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.229 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.229 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.229 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.229 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.230 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.230 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.230 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.230 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.230 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.237 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.244Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.244Z [INFO] agent.router.manager: shutting down 31:33.244 [INFO] TestAgent: consul server down 31:33.244 [INFO] TestAgent: shutdown complete 31:33.244 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29792 network=tcp 31:33.244 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29792 network=udp 31:33.244 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29793 network=tcp 31:33.745 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.745 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Apply (1.06s) === CONT TestCatalogNodeServices_ConnectProxy [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:33.145Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.156Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.186 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:55aa24cc-9854-d153-17ee-0fcfb7da8b3f Address:127.0.0.1:29811}]" 31:33.187 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-55aa24cc-9854-d153-17ee-0fcfb7da8b3f.dc1 127.0.0.1 31:33.187 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-55aa24cc-9854-d153-17ee-0fcfb7da8b3f 127.0.0.1 2021-10-05T16:31:33.187Z [INFO] agent.router: Initializing LAN area manager 31:33.188 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29811 [Follower]" leader= 31:33.188 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29806 network=udp 31:33.188 [INFO] TestAgent.server: Adding LAN server: server="Node-55aa24cc-9854-d153-17ee-0fcfb7da8b3f (Addr: tcp/127.0.0.1:29811) (DC: dc1)" 31:33.188 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29806 network=tcp 31:33.188 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-55aa24cc-9854-d153-17ee-0fcfb7da8b3f.dc1 area=wan 31:33.188 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29807 network=tcp 31:33.188 [INFO] TestAgent: started state syncer 31:33.189 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29812 network=tcp 31:33.232 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.232 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29811 [Candidate]" term=2 31:33.253 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.253 [DEBUG] TestAgent.server.raft: vote granted: from=55aa24cc-9854-d153-17ee-0fcfb7da8b3f term=2 tally=1 31:33.253 [INFO] TestAgent.server.raft: election won: tally=1 31:33.253 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29811 [Leader]" 31:33.253 [INFO] TestAgent.server: cluster leadership acquired 31:33.253 [INFO] TestAgent.server: New leader elected: payload=Node-55aa24cc-9854-d153-17ee-0fcfb7da8b3f 31:33.262 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29811 31:33.284 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.325 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.325 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.325 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.325 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.325 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.325 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-55aa24cc-9854-d153-17ee-0fcfb7da8b3f 31:33.325 [INFO] TestAgent.server: member joined, marking health alive: member=Node-55aa24cc-9854-d153-17ee-0fcfb7da8b3f 31:33.355 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.377 [INFO] TestAgent: Requesting shutdown 31:33.377 [INFO] TestAgent.server: shutting down server 31:33.377 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.377 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.377 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.377 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.377 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.377 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.377 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.377 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:33.377 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.377 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.377 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.386 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.390Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.390Z [INFO] agent.router.manager: shutting down 31:33.390 [INFO] TestAgent: consul server down 31:33.390 [INFO] TestAgent: shutdown complete 31:33.390 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29806 network=tcp 31:33.390 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29806 network=udp 31:33.390 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29807 network=tcp 31:33.893 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.893 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Delete (0.76s) === CONT TestCatalogNodeServices_Filter [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:33.285Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.296Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.346 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:773f834a-d7e6-3ad2-72dc-64aee180fc13 Address:127.0.0.1:29776}]" 31:33.346 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-773f834a-d7e6-3ad2-72dc-64aee180fc13.dc1 127.0.0.1 31:33.347 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-773f834a-d7e6-3ad2-72dc-64aee180fc13 127.0.0.1 2021-10-05T16:31:33.347Z [INFO] agent.router: Initializing LAN area manager 31:33.348 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29776 [Follower]" leader= 31:33.348 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29855 network=udp 31:33.348 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29855 network=tcp 31:33.348 [INFO] TestAgent.server: Adding LAN server: server="Node-773f834a-d7e6-3ad2-72dc-64aee180fc13 (Addr: tcp/127.0.0.1:29776) (DC: dc1)" 31:33.348 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-773f834a-d7e6-3ad2-72dc-64aee180fc13.dc1 area=wan 31:33.349 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29856 network=tcp 31:33.349 [INFO] TestAgent: started state syncer 31:33.349 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29777 network=tcp 31:33.389 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.389 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29776 [Candidate]" term=2 31:33.416 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.416 [DEBUG] TestAgent.server.raft: vote granted: from=773f834a-d7e6-3ad2-72dc-64aee180fc13 term=2 tally=1 31:33.416 [INFO] TestAgent.server.raft: election won: tally=1 31:33.416 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29776 [Leader]" 31:33.416 [INFO] TestAgent.server: cluster leadership acquired 31:33.416 [INFO] TestAgent.server: New leader elected: payload=Node-773f834a-d7e6-3ad2-72dc-64aee180fc13 31:33.433 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29776 31:33.464 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.537 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.538 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.538 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.538 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.538 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.538 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-773f834a-d7e6-3ad2-72dc-64aee180fc13 31:33.538 [INFO] TestAgent.server: member joined, marking health alive: member=Node-773f834a-d7e6-3ad2-72dc-64aee180fc13 31:33.557 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.588 [INFO] TestAgent: Requesting shutdown 31:33.588 [INFO] TestAgent.server: shutting down server 31:33.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.589 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.589 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.589 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.589 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.589 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.589 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:33.589 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.589 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.589 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.596 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.605Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.605Z [INFO] agent.router.manager: shutting down 31:33.605 [INFO] TestAgent: consul server down 31:33.605 [INFO] TestAgent: shutdown complete 31:33.605 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29855 network=tcp 31:33.605 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29855 network=udp 31:33.605 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29856 network=tcp 31:34.107 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.107 [INFO] TestAgent: Endpoints down --- PASS: TestConfig_Get (0.84s) --- PASS: TestConfig_Get/get_a_single_service_entry (0.00s) --- PASS: TestConfig_Get/list_both_service_entries (0.00s) --- PASS: TestConfig_Get/get_global_proxy_config (0.00s) --- PASS: TestConfig_Get/error_on_no_arguments (0.00s) === CONT TestCatalogNodeServiceList 2021-10-05T16:31:33.226Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.239Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.274 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0bf544df-bfb0-6f29-17bd-eb92143c1714 Address:127.0.0.1:29853}]" 31:33.275 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0bf544df-bfb0-6f29-17bd-eb92143c1714.dc1 127.0.0.1 31:33.276 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0bf544df-bfb0-6f29-17bd-eb92143c1714 127.0.0.1 2021-10-05T16:31:33.276Z [INFO] agent.router: Initializing LAN area manager 31:33.276 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29853 [Follower]" leader= 31:33.276 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29771 network=udp 31:33.276 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0bf544df-bfb0-6f29-17bd-eb92143c1714.dc1 area=wan 31:33.276 [INFO] TestAgent.server: Adding LAN server: server="Node-0bf544df-bfb0-6f29-17bd-eb92143c1714 (Addr: tcp/127.0.0.1:29853) (DC: dc1)" 31:33.276 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29771 network=tcp 31:33.277 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29772 network=tcp 31:33.277 [INFO] TestAgent: started state syncer 31:33.277 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29854 network=tcp 31:33.324 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.324 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29853 [Candidate]" term=2 31:33.358 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.358 [DEBUG] TestAgent.server.raft: vote granted: from=0bf544df-bfb0-6f29-17bd-eb92143c1714 term=2 tally=1 31:33.358 [INFO] TestAgent.server.raft: election won: tally=1 31:33.358 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29853 [Leader]" 31:33.358 [INFO] TestAgent.server: cluster leadership acquired 31:33.359 [INFO] TestAgent.server: New leader elected: payload=Node-0bf544df-bfb0-6f29-17bd-eb92143c1714 31:33.367 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29853 31:33.388 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.427 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.427 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.427 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.427 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.427 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.428 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0bf544df-bfb0-6f29-17bd-eb92143c1714 31:33.428 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0bf544df-bfb0-6f29-17bd-eb92143c1714 31:33.472 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.573 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:33.583 [INFO] TestAgent: Synced node info 31:33.583 [DEBUG] TestAgent: Node info in sync 31:33.615 [INFO] TestAgent: Requesting shutdown 31:33.615 [INFO] TestAgent.server: shutting down server 31:33.615 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.615 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.615 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.615 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.615 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.615 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.615 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.615 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.615 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.615 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.633 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.640Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.640Z [INFO] agent.router.manager: shutting down 31:33.640 [INFO] TestAgent: consul server down 31:33.640 [INFO] TestAgent: shutdown complete 31:33.640 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29771 network=tcp 31:33.640 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29771 network=udp 31:33.640 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29772 network=tcp 31:34.141 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.141 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_Bad_Size_Item/exceeds_default_max_kv_value_size 31:33.656 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-3bdd4432-80ea-b5eb-ae1d-f843ab756d8c 127.0.0.1 2021-10-05T16:31:33.656Z [INFO] agent.router: Initializing LAN area manager 31:33.656 [INFO] TestAgent.client.serf.lan: serf: Attempting re-join to previously known node: Node-0865308a-0797-fd61-f89f-7f1d17c865fe: 127.0.0.1:29648 31:33.657 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 31:33.657 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Failed to join 127.0.0.1: dial tcp 127.0.0.1:29648: connect: connection refused 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [INFO] TestAgent.client.serf.lan: serf: Attempting re-join to previously known node: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239: 127.0.0.1:29683 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Failed to join 127.0.0.1: dial tcp 127.0.0.1:29683: connect: connection refused 31:33.657 [WARN] TestAgent.client.serf.lan: serf: Failed to re-join any previously known node 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29883 network=udp 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29883 network=tcp 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 31:33.657 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29884 network=tcp 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 31:33.657 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:33.657 [INFO] TestAgent: started state syncer 31:33.657 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=discovery-chain:redis error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 2021-10-05T16:31:33.657Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29889 network=tcp 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=discovery-chain:redis error="error filling agent cache: No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=discovery-chain:redis error="error filling agent cache: No known Consul servers" 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [DEBUG] TestAgent: removed service: service=web-sidecar-proxy 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [INFO] TestAgent: Requesting shutdown 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [INFO] TestAgent.client: shutting down client 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.658 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:33.658 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:33.658Z [WARN] agent.router.manager: No servers available 31:33.677 [INFO] TestAgent: consul client down 31:33.677 [INFO] TestAgent: shutdown complete 31:33.677 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29883 network=tcp 31:33.678 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29883 network=udp 31:33.678 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29884 network=tcp 31:34.178 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.178 [INFO] TestAgent: Endpoints down 31:30.375 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 127.0.0.1 2021-10-05T16:31:30.375Z [INFO] agent.router: Initializing LAN area manager 31:30.375 [DEBUG] TestAgent: added local registration for service: service=web-sidecar-proxy 31:30.375 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29666 network=udp 2021-10-05T16:31:30.375Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.375Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.375Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.375Z [WARN] agent.router.manager: No servers available 31:30.375 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29666 network=tcp 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 31:30.376 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:30.376 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 31:30.376 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 31:30.376 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.376Z [WARN] agent.router.manager: No servers available 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 31:30.377 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=service-http-checks:web error="error filling agent cache: Internal cache failure: service 'web' not in agent state" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.377Z [WARN] agent.router.manager: No servers available 31:30.377 [ERROR] TestAgent: error handling service update: error="error watching service config: No known Consul servers" 31:30.377 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 31:30.380 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=discovery-chain:redis error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 31:30.380 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29667 network=tcp 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 31:30.380 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=discovery-chain:redis error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 31:30.380 [INFO] TestAgent: started state syncer 31:30.380 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=discovery-chain:redis error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 31:30.380 [ERROR] TestAgent.proxycfg: watch error: service_id=web-sidecar-proxy id=discovery-chain:redis error="error filling agent cache: No known Consul servers" 31:30.380 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29686 network=tcp 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:30.380Z [WARN] agent.router.manager: No servers available 31:30.380 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:30.381 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:29648] 31:30.381 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:29648 31:30.384 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-0865308a-0797-fd61-f89f-7f1d17c865fe 127.0.0.1 31:30.384 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 31:30.384 [DEBUG] TestAgent: systemd notify failed: error="No socket" 2021-10-05T16:31:30.384Z [WARN] agent.router.manager: No servers available 31:30.384 [INFO] TestAgent.client: adding server: server="Node-0865308a-0797-fd61-f89f-7f1d17c865fe (Addr: tcp/127.0.0.1:29650) (DC: dc1)" 31:30.581 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 31:30.581 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:30.780 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 31:30.780 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:30.981 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 31:30.981 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:30.981 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 31:30.981 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:32.597 [INFO] TestAgent: Requesting shutdown 31:32.604 [INFO] TestAgent.client: shutting down client 31:32.604 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:32.616 [INFO] TestAgent: consul client down 31:32.616 [INFO] TestAgent: shutdown complete 31:32.616 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29666 network=tcp 31:32.616 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29666 network=udp 31:32.616 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29667 network=tcp 31:32.616 [ERROR] TestAgent.client: RPC failed to server: method=ConnectCA.Roots server=127.0.0.1:29650 error="rpc error making call: EOF" 31:32.616 [ERROR] TestAgent.client: RPC failed to server: method=ConfigEntry.ResolveServiceConfig server=127.0.0.1:29650 error="rpc error making call: EOF" 31:33.120 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.120 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:29.883Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:29.899Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:29.978 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0865308a-0797-fd61-f89f-7f1d17c865fe Address:127.0.0.1:29650}]" 31:29.978 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0865308a-0797-fd61-f89f-7f1d17c865fe.dc1 127.0.0.1 31:29.979 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0865308a-0797-fd61-f89f-7f1d17c865fe 127.0.0.1 2021-10-05T16:31:29.979Z [INFO] agent.router: Initializing LAN area manager 31:29.979 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29659 network=udp 31:29.979 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29650 [Follower]" leader= 31:29.979 [INFO] TestAgent.server: Adding LAN server: server="Node-0865308a-0797-fd61-f89f-7f1d17c865fe (Addr: tcp/127.0.0.1:29650) (DC: dc1)" 31:29.979 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0865308a-0797-fd61-f89f-7f1d17c865fe.dc1 area=wan 31:29.980 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29659 network=tcp 31:29.980 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29660 network=tcp 31:29.980 [INFO] TestAgent: started state syncer 31:29.980 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29651 network=tcp 31:30.039 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:30.039 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29650 [Candidate]" term=2 31:30.057 [DEBUG] TestAgent.server.raft: votes: needed=1 31:30.057 [DEBUG] TestAgent.server.raft: vote granted: from=0865308a-0797-fd61-f89f-7f1d17c865fe term=2 tally=1 31:30.057 [INFO] TestAgent.server.raft: election won: tally=1 31:30.057 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29650 [Leader]" 31:30.060 [INFO] TestAgent.server: cluster leadership acquired 31:30.060 [INFO] TestAgent.server: New leader elected: payload=Node-0865308a-0797-fd61-f89f-7f1d17c865fe 31:30.073 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29650 31:30.106 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:30.137 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:30.137 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:30.137 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:30.137 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:30.137 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:30.137 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0865308a-0797-fd61-f89f-7f1d17c865fe 31:30.137 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0865308a-0797-fd61-f89f-7f1d17c865fe 31:30.177 [INFO] TestAgent.server: federation state anti-entropy synced 31:30.357 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:30.362 [INFO] TestAgent: Synced node info 31:30.362 [DEBUG] TestAgent: Node info in sync 31:30.382 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:55700 31:30.382 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 127.0.0.1 31:30.382 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:30.576 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:30.775 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:30.976 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:30.982 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 31:31.490 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:31.490 [DEBUG] TestAgent: Node info in sync 31:33.120 [INFO] TestAgent: Requesting shutdown 31:33.120 [INFO] TestAgent.server: shutting down server 31:33.120 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.120 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.120 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.120 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.120 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.120 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.120 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.120 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.120 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.120 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.124 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.128Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.128Z [INFO] agent.router.manager: shutting down 31:33.128 [INFO] TestAgent: consul server down 31:33.128 [INFO] TestAgent: shutdown complete 31:33.128 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29659 network=tcp 31:33.128 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29659 network=udp 31:33.128 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29660 network=tcp 31:33.493 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 (timeout reached) 31:33.629 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.629 [INFO] TestAgent: Endpoints down 31:33.980 [INFO] TestAgent.server.memberlist.lan: memberlist: Suspect Node-2b0dda7f-32d4-6db2-3361-47c9e426c239 has failed, no acks received --- PASS: TestServiceManager_PersistService_ConfigFiles (4.32s) === CONT TestCatalogNodeServices [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:33.310Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.337Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.403 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:08d18ef2-ef16-71ff-26a8-eda800df430e Address:127.0.0.1:29846}]" 31:33.404 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29846 [Follower]" leader= 31:33.404 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-08d18ef2-ef16-71ff-26a8-eda800df430e.dc1 127.0.0.1 31:33.404 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-08d18ef2-ef16-71ff-26a8-eda800df430e 127.0.0.1 2021-10-05T16:31:33.405Z [INFO] agent.router: Initializing LAN area manager 31:33.405 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29841 network=udp 31:33.405 [INFO] TestAgent.server: Adding LAN server: server="Node-08d18ef2-ef16-71ff-26a8-eda800df430e (Addr: tcp/127.0.0.1:29846) (DC: dc1)" 31:33.405 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-08d18ef2-ef16-71ff-26a8-eda800df430e.dc1 area=wan 31:33.405 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29841 network=tcp 31:33.406 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29842 network=tcp 31:33.406 [INFO] TestAgent: started state syncer 31:33.406 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29847 network=tcp 31:33.472 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.472 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29846 [Candidate]" term=2 31:33.532 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.532 [DEBUG] TestAgent.server.raft: vote granted: from=08d18ef2-ef16-71ff-26a8-eda800df430e term=2 tally=1 31:33.532 [INFO] TestAgent.server.raft: election won: tally=1 31:33.532 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29846 [Leader]" 31:33.533 [INFO] TestAgent.server: cluster leadership acquired 31:33.533 [INFO] TestAgent.server: New leader elected: payload=Node-08d18ef2-ef16-71ff-26a8-eda800df430e 31:33.565 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29846 31:33.599 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.644 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.644 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.644 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.644 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.644 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.645 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-08d18ef2-ef16-71ff-26a8-eda800df430e 31:33.645 [INFO] TestAgent.server: member joined, marking health alive: member=Node-08d18ef2-ef16-71ff-26a8-eda800df430e 31:33.682 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.787 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:33.799 [INFO] TestAgent: Synced node info 31:33.799 [DEBUG] TestAgent: Node info in sync 31:33.832 [INFO] TestAgent: Requesting shutdown 31:33.833 [INFO] TestAgent.server: shutting down server 31:33.833 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.833 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.833 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.833 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.833 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.833 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.833 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.833 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.833 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.833 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.848 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.855Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.855Z [INFO] agent.router.manager: shutting down 31:33.855 [INFO] TestAgent: consul server down 31:33.855 [INFO] TestAgent: shutdown complete 31:33.855 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29841 network=tcp 31:33.855 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29841 network=udp 31:33.855 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29842 network=tcp 31:34.356 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.356 [INFO] TestAgent: Endpoints down --- PASS: TestCatalog_GatewayServices_Ingress (1.08s) === CONT TestCatalogConnectServiceNodes_good 2021-10-05T16:31:33.447Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.538Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.606 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:04341cef-9df5-d94f-20cc-cf32f08050df Address:127.0.0.1:29874}]" 31:33.606 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-04341cef-9df5-d94f-20cc-cf32f08050df.dc1 127.0.0.1 31:33.607 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29874 [Follower]" leader= 31:33.607 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-04341cef-9df5-d94f-20cc-cf32f08050df 127.0.0.1 2021-10-05T16:31:33.607Z [INFO] agent.router: Initializing LAN area manager 31:33.607 [INFO] TestAgent.server: Adding LAN server: server="Node-04341cef-9df5-d94f-20cc-cf32f08050df (Addr: tcp/127.0.0.1:29874) (DC: dc1)" 31:33.607 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-04341cef-9df5-d94f-20cc-cf32f08050df.dc1 area=wan 31:33.607 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29848 network=udp 31:33.607 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29848 network=tcp 31:33.608 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29849 network=tcp 31:33.608 [INFO] TestAgent: started state syncer 31:33.608 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29875 network=tcp 31:33.674 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.675 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29874 [Candidate]" term=2 31:33.716 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.716 [DEBUG] TestAgent.server.raft: vote granted: from=04341cef-9df5-d94f-20cc-cf32f08050df term=2 tally=1 31:33.716 [INFO] TestAgent.server.raft: election won: tally=1 31:33.716 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29874 [Leader]" 31:33.716 [INFO] TestAgent.server: cluster leadership acquired 31:33.716 [INFO] TestAgent.server: New leader elected: payload=Node-04341cef-9df5-d94f-20cc-cf32f08050df 31:33.739 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29874 31:33.800 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.800 [INFO] TestAgent: Synced node info 31:33.835 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.835 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.835 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.835 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.835 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.835 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04341cef-9df5-d94f-20cc-cf32f08050df 31:33.835 [INFO] TestAgent.server: member joined, marking health alive: member=Node-04341cef-9df5-d94f-20cc-cf32f08050df 31:33.863 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.964 [INFO] TestAgent: Requesting shutdown 31:33.964 [INFO] TestAgent.server: shutting down server 31:33.964 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.964 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.964 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.964 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.964 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.964 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.964 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.965 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.965 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.965 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.975 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.988Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.988Z [INFO] agent.router.manager: shutting down 31:33.988 [INFO] TestAgent: consul server down 31:33.988 [INFO] TestAgent: shutdown complete 31:33.988 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29848 network=tcp 31:33.988 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29848 network=udp 31:33.988 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29849 network=tcp 31:34.492 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.492 [INFO] TestAgent: Endpoints down --- PASS: TestCatalog_GatewayServices_Terminating (1.06s) === CONT TestCatalogServiceNodes_ConnectProxy [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:33.765Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.785Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.852 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fe11598e-031b-a157-4f29-f40d66db152c Address:127.0.0.1:29908}]" 31:33.852 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29908 [Follower]" leader= 31:33.853 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fe11598e-031b-a157-4f29-f40d66db152c.dc1 127.0.0.1 31:33.853 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fe11598e-031b-a157-4f29-f40d66db152c 127.0.0.1 2021-10-05T16:31:33.853Z [INFO] agent.router: Initializing LAN area manager 31:33.853 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29876 network=udp 31:33.854 [INFO] TestAgent.server: Adding LAN server: server="Node-fe11598e-031b-a157-4f29-f40d66db152c (Addr: tcp/127.0.0.1:29908) (DC: dc1)" 31:33.854 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fe11598e-031b-a157-4f29-f40d66db152c.dc1 area=wan 31:33.854 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29876 network=tcp 31:33.854 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29877 network=tcp 31:33.854 [INFO] TestAgent: started state syncer 31:33.854 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29909 network=tcp 31:33.912 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.912 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29908 [Candidate]" term=2 31:33.968 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.968 [DEBUG] TestAgent.server.raft: vote granted: from=fe11598e-031b-a157-4f29-f40d66db152c term=2 tally=1 31:33.968 [INFO] TestAgent.server.raft: election won: tally=1 31:33.968 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29908 [Leader]" 31:33.968 [INFO] TestAgent.server: cluster leadership acquired 31:33.968 [INFO] TestAgent.server: New leader elected: payload=Node-fe11598e-031b-a157-4f29-f40d66db152c 31:34.004 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29908 31:34.027 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.067 [INFO] TestAgent: Synced node info 31:34.085 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.085 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.085 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.085 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.085 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.085 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fe11598e-031b-a157-4f29-f40d66db152c 31:34.085 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fe11598e-031b-a157-4f29-f40d66db152c 31:34.108 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.108 [INFO] TestAgent: Requesting shutdown 31:34.108 [INFO] TestAgent.server: shutting down server 31:34.108 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.108 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.108 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.108 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.108 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.108 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.108 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.108 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.108 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.108 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.120 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.130Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.130Z [INFO] agent.router.manager: shutting down 31:34.130 [INFO] TestAgent: consul server down 31:34.130 [INFO] TestAgent: shutdown complete 31:34.130 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29876 network=tcp 31:34.130 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29876 network=udp 31:34.130 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29877 network=tcp 31:34.632 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.632 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodeServices_ConnectProxy (0.89s) === CONT TestCatalogServiceNodes_DistanceSort [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:33.572Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.599Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.683 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f9d08421-26b7-024a-9d10-581a9adfdaef Address:127.0.0.1:29860}]" 31:33.683 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29860 [Follower]" leader= 31:33.684 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f9d08421-26b7-024a-9d10-581a9adfdaef.dc1 127.0.0.1 31:33.692 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f9d08421-26b7-024a-9d10-581a9adfdaef 127.0.0.1 2021-10-05T16:31:33.692Z [INFO] agent.router: Initializing LAN area manager 31:33.692 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29862 network=udp 31:33.692 [INFO] TestAgent.server: Adding LAN server: server="Node-f9d08421-26b7-024a-9d10-581a9adfdaef (Addr: tcp/127.0.0.1:29860) (DC: dc1)" 31:33.692 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f9d08421-26b7-024a-9d10-581a9adfdaef.dc1 area=wan 31:33.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29862 network=tcp 31:33.693 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29863 network=tcp 31:33.693 [INFO] TestAgent: started state syncer 31:33.693 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29861 network=tcp 31:33.736 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.736 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29860 [Candidate]" term=2 31:33.751 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.751 [DEBUG] TestAgent.server.raft: vote granted: from=f9d08421-26b7-024a-9d10-581a9adfdaef term=2 tally=1 31:33.751 [INFO] TestAgent.server.raft: election won: tally=1 31:33.751 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29860 [Leader]" 31:33.751 [INFO] TestAgent.server: cluster leadership acquired 31:33.751 [INFO] TestAgent.server: New leader elected: payload=Node-f9d08421-26b7-024a-9d10-581a9adfdaef 31:33.775 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29860 31:33.826 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.908 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.908 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.908 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.908 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.908 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.909 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f9d08421-26b7-024a-9d10-581a9adfdaef 31:33.909 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f9d08421-26b7-024a-9d10-581a9adfdaef 31:33.930 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.028 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:34.044 [INFO] TestAgent: Synced node info 31:34.044 [DEBUG] TestAgent: Node info in sync 31:34.232 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:34.232 [DEBUG] TestAgent: Node info in sync 31:34.322 [INFO] TestAgent: Requesting shutdown 31:34.322 [INFO] TestAgent.server: shutting down server 31:34.322 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.322 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.322 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.322 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.322 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.322 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.322 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.322 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.322 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.322 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.328 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.332Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.332Z [INFO] agent.router.manager: shutting down 31:34.332 [INFO] TestAgent: consul server down 31:34.332 [INFO] TestAgent: shutdown complete 31:34.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29862 network=tcp 31:34.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29862 network=udp 31:34.332 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29863 network=tcp 31:34.833 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.833 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_Bad_Size_Net/exceeds_default_max_kv_value_size 2021-10-05T16:31:33.947Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.998Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.035 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6a375cd2-7f4f-5903-969d-8e43871df074 Address:127.0.0.1:29922}]" 31:34.036 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29922 [Follower]" leader= 31:34.036 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6a375cd2-7f4f-5903-969d-8e43871df074.dc1 127.0.0.1 31:34.037 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6a375cd2-7f4f-5903-969d-8e43871df074 127.0.0.1 2021-10-05T16:31:34.037Z [INFO] agent.router: Initializing LAN area manager 31:34.037 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29910 network=udp 31:34.037 [INFO] TestAgent.server: Adding LAN server: server="Node-6a375cd2-7f4f-5903-969d-8e43871df074 (Addr: tcp/127.0.0.1:29922) (DC: dc1)" 31:34.037 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6a375cd2-7f4f-5903-969d-8e43871df074.dc1 area=wan 31:34.037 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29910 network=tcp 31:34.038 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29897 network=tcp 31:34.038 [INFO] TestAgent: started state syncer 31:34.038 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29923 network=tcp 31:34.097 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.097 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29922 [Candidate]" term=2 31:34.125 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.125 [DEBUG] TestAgent.server.raft: vote granted: from=6a375cd2-7f4f-5903-969d-8e43871df074 term=2 tally=1 31:34.125 [INFO] TestAgent.server.raft: election won: tally=1 31:34.125 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29922 [Leader]" 31:34.126 [INFO] TestAgent.server: cluster leadership acquired 31:34.126 [INFO] TestAgent.server: New leader elected: payload=Node-6a375cd2-7f4f-5903-969d-8e43871df074 31:34.137 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29922 31:34.187 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.253 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.253 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.253 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.253 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.253 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.253 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6a375cd2-7f4f-5903-969d-8e43871df074 31:34.253 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6a375cd2-7f4f-5903-969d-8e43871df074 31:34.320 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.344 [INFO] TestAgent: Requesting shutdown 31:34.344 [INFO] TestAgent.server: shutting down server 31:34.344 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.344 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.344 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.344 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.344 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.344 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.344 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.344 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:34.344 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.344 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.344 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.349 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.355Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.355Z [INFO] agent.router.manager: shutting down 31:34.355 [INFO] TestAgent: consul server down 31:34.355 [INFO] TestAgent: shutdown complete 31:34.355 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29910 network=tcp 31:34.355 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29910 network=udp 31:34.355 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29897 network=tcp 31:34.856 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.856 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodeServices_Filter (0.96s) === CONT TestCatalogServiceNodes_WanTranslation 2021-10-05T16:31:34.134Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.150Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.212 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9656f8c8-bdcc-6d25-7636-df8cf1823825 Address:127.0.0.1:29929}]" 31:34.212 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29929 [Follower]" leader= 31:34.213 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9656f8c8-bdcc-6d25-7636-df8cf1823825.dc1 127.0.0.1 31:34.213 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9656f8c8-bdcc-6d25-7636-df8cf1823825 127.0.0.1 2021-10-05T16:31:34.213Z [INFO] agent.router: Initializing LAN area manager 31:34.214 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29892 network=udp 31:34.214 [INFO] TestAgent.server: Adding LAN server: server="Node-9656f8c8-bdcc-6d25-7636-df8cf1823825 (Addr: tcp/127.0.0.1:29929) (DC: dc1)" 31:34.214 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9656f8c8-bdcc-6d25-7636-df8cf1823825.dc1 area=wan 31:34.214 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29892 network=tcp 31:34.214 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29904 network=tcp 31:34.214 [INFO] TestAgent: started state syncer 31:34.215 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29930 network=tcp 31:34.252 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.252 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29929 [Candidate]" term=2 31:34.277 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.277 [DEBUG] TestAgent.server.raft: vote granted: from=9656f8c8-bdcc-6d25-7636-df8cf1823825 term=2 tally=1 31:34.277 [INFO] TestAgent.server.raft: election won: tally=1 31:34.277 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29929 [Leader]" 31:34.280 [INFO] TestAgent.server: cluster leadership acquired 31:34.282 [INFO] TestAgent.server: New leader elected: payload=Node-9656f8c8-bdcc-6d25-7636-df8cf1823825 31:34.321 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29929 31:34.356 [INFO] TestAgent: Synced node info 31:34.356 [DEBUG] TestAgent: Node info in sync 31:34.385 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.417 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.417 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.417 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.417 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.417 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.417 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9656f8c8-bdcc-6d25-7636-df8cf1823825 31:34.417 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9656f8c8-bdcc-6d25-7636-df8cf1823825 31:34.435 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.480 [INFO] TestAgent: Requesting shutdown 31:34.480 [INFO] TestAgent.server: shutting down server 31:34.480 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.480 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.480 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.480 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.480 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.480 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.480 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.480 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.480 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 31:34.480 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.492 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.508Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.508Z [INFO] agent.router.manager: shutting down 31:34.508 [INFO] TestAgent: consul server down 31:34.508 [INFO] TestAgent: shutdown complete 31:34.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29892 network=tcp 31:34.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29892 network=udp 31:34.508 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29904 network=tcp 31:35.012 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.012 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodeServiceList (0.90s) === CONT TestCatalogServiceNodes_Filter [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:34.204Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.218Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.300 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:07d09523-14db-7de8-3cf6-a4ee9e24a9a5 Address:127.0.0.1:29901}]" 31:34.320 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29901 [Follower]" leader= 31:34.321 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-07d09523-14db-7de8-3cf6-a4ee9e24a9a5.dc1 127.0.0.1 31:34.322 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-07d09523-14db-7de8-3cf6-a4ee9e24a9a5 127.0.0.1 2021-10-05T16:31:34.322Z [INFO] agent.router: Initializing LAN area manager 31:34.322 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29917 network=udp 31:34.322 [INFO] TestAgent.server: Adding LAN server: server="Node-07d09523-14db-7de8-3cf6-a4ee9e24a9a5 (Addr: tcp/127.0.0.1:29901) (DC: dc1)" 31:34.322 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-07d09523-14db-7de8-3cf6-a4ee9e24a9a5.dc1 area=wan 31:34.322 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29917 network=tcp 31:34.323 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29918 network=tcp 31:34.323 [INFO] TestAgent: started state syncer 31:34.323 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29902 network=tcp 31:34.389 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.389 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29901 [Candidate]" term=2 31:34.417 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.417 [DEBUG] TestAgent.server.raft: vote granted: from=07d09523-14db-7de8-3cf6-a4ee9e24a9a5 term=2 tally=1 31:34.417 [INFO] TestAgent.server.raft: election won: tally=1 31:34.417 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29901 [Leader]" 31:34.420 [INFO] TestAgent.server: cluster leadership acquired 31:34.420 [INFO] TestAgent.server: New leader elected: payload=Node-07d09523-14db-7de8-3cf6-a4ee9e24a9a5 31:34.427 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29901 31:34.469 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.521 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.521 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.521 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.521 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.521 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.521 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-07d09523-14db-7de8-3cf6-a4ee9e24a9a5 31:34.521 [INFO] TestAgent.server: member joined, marking health alive: member=Node-07d09523-14db-7de8-3cf6-a4ee9e24a9a5 31:34.543 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.567 [INFO] TestAgent: Requesting shutdown 31:34.567 [INFO] TestAgent.server: shutting down server 31:34.567 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.567 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.567 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.567 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.567 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.567 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.567 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.567 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:34.567 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.567 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.567 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.580 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.592Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.592Z [INFO] agent.router.manager: shutting down 31:34.592 [INFO] TestAgent: consul server down 31:34.592 [INFO] TestAgent: shutdown complete 31:34.592 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29917 network=tcp 31:34.592 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29917 network=udp 31:34.592 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29918 network=tcp 31:35.092 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.092 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodeServices (0.91s) === CONT TestCatalogServiceNodes_NodeMetaFilter 2021-10-05T16:31:34.154Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.165Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.254 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:90b641d9-8057-44ab-34b5-9be6af6a8195 Address:127.0.0.1:29915}]" 31:34.256 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29915 [Follower]" leader= 31:34.261 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-90b641d9-8057-44ab-34b5-9be6af6a8195.dc1 127.0.0.1 31:34.262 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-90b641d9-8057-44ab-34b5-9be6af6a8195 127.0.0.1 2021-10-05T16:31:34.262Z [INFO] agent.router: Initializing LAN area manager 31:34.262 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29931 network=udp 31:34.262 [INFO] TestAgent.server: Adding LAN server: server="Node-90b641d9-8057-44ab-34b5-9be6af6a8195 (Addr: tcp/127.0.0.1:29915) (DC: dc1)" 31:34.262 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-90b641d9-8057-44ab-34b5-9be6af6a8195.dc1 area=wan 31:34.264 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29931 network=tcp 31:34.265 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29932 network=tcp 31:34.265 [INFO] TestAgent: started state syncer 31:34.266 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29916 network=tcp 31:34.302 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.302 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29915 [Candidate]" term=2 31:34.320 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.320 [DEBUG] TestAgent.server.raft: vote granted: from=90b641d9-8057-44ab-34b5-9be6af6a8195 term=2 tally=1 31:34.320 [INFO] TestAgent.server.raft: election won: tally=1 31:34.320 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29915 [Leader]" 31:34.322 [INFO] TestAgent.server: cluster leadership acquired 31:34.322 [INFO] TestAgent.server: New leader elected: payload=Node-90b641d9-8057-44ab-34b5-9be6af6a8195 31:34.360 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29915 31:34.402 [INFO] TestAgent: Synced node info 31:34.414 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.440 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.440 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.440 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.440 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.440 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.440 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-90b641d9-8057-44ab-34b5-9be6af6a8195 31:34.440 [INFO] TestAgent.server: member joined, marking health alive: member=Node-90b641d9-8057-44ab-34b5-9be6af6a8195 31:34.460 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.677 [INFO] TestAgent: Requesting shutdown 31:34.677 [INFO] TestAgent.server: shutting down server 31:34.677 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.677 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.677 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.677 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.677 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.678 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.678 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.678 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.678 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.678 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.691 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.695Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.695Z [INFO] agent.router.manager: shutting down 31:34.696 [INFO] TestAgent: consul server down 31:34.696 [INFO] TestAgent: shutdown complete 31:34.696 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29931 network=tcp 31:34.696 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29931 network=udp 31:34.696 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29932 network=tcp 31:35.198 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.198 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_Bad_Size_Item/allowed 2021-10-05T16:31:34.392Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.409Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.469 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6 Address:127.0.0.1:29936}]" 31:34.469 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29936 [Follower]" leader= 31:34.470 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6.dc1 127.0.0.1 31:34.470 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6 127.0.0.1 2021-10-05T16:31:34.470Z [INFO] agent.router: Initializing LAN area manager 31:34.471 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29903 network=udp 31:34.471 [INFO] TestAgent.server: Adding LAN server: server="Node-f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6 (Addr: tcp/127.0.0.1:29936) (DC: dc1)" 31:34.471 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6.dc1 area=wan 31:34.471 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29903 network=tcp 31:34.472 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29911 network=tcp 31:34.472 [INFO] TestAgent: started state syncer 31:34.472 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29937 network=tcp 31:34.528 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.528 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29936 [Candidate]" term=2 31:34.562 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.563 [DEBUG] TestAgent.server.raft: vote granted: from=f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6 term=2 tally=1 31:34.563 [INFO] TestAgent.server.raft: election won: tally=1 31:34.563 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29936 [Leader]" 31:34.563 [INFO] TestAgent.server: cluster leadership acquired 31:34.563 [INFO] TestAgent.server: New leader elected: payload=Node-f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6 31:34.571 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29936 31:34.597 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.664 [INFO] TestAgent: Synced node info 31:34.664 [DEBUG] TestAgent: Node info in sync 31:34.664 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.664 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.664 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.664 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.664 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.664 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6 31:34.665 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f5410bbc-0bc6-95c8-312a-b7e7db8ec4e6 31:34.732 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.732 [INFO] TestAgent: Requesting shutdown 31:34.733 [INFO] TestAgent.server: shutting down server 31:34.733 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.733 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.733 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.733 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.733 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.733 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.733 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.733 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.733 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.733 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.740 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.752Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.752Z [INFO] agent.router.manager: shutting down 31:34.752 [INFO] TestAgent: consul server down 31:34.752 [INFO] TestAgent: shutdown complete 31:34.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29903 network=tcp 31:34.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29903 network=udp 31:34.752 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29911 network=tcp 31:35.252 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.252 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogConnectServiceNodes_good (0.90s) === CONT TestCatalogServiceNodes [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:33.992Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:33.992Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.011Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:34.011Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.056 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4d75d19b-f91b-db38-b2de-0810ef71dda5 Address:127.0.0.1:29881}]" 31:34.057 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4d75d19b-f91b-db38-b2de-0810ef71dda5.dc2 127.0.0.1 31:34.057 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 127.0.0.1 2021-10-05T16:31:34.057Z [INFO] agent.router: Initializing LAN area manager 31:34.058 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29924 network=udp 31:34.058 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29881 [Follower]" leader= 31:34.058 [INFO] TestAgent.server: Adding LAN server: server="Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 (Addr: tcp/127.0.0.1:29881) (DC: dc2)" 31:34.058 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4d75d19b-f91b-db38-b2de-0810ef71dda5.dc2 area=wan 31:34.058 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29924 network=tcp 31:34.059 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29925 network=tcp 31:34.059 [INFO] TestAgent: started state syncer 31:34.059 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29882 network=tcp 31:34.104 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.104 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29881 [Candidate]" term=2 31:34.109 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:34.134 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.134 [DEBUG] TestAgent.server.raft: vote granted: from=4d75d19b-f91b-db38-b2de-0810ef71dda5 term=2 tally=1 31:34.134 [INFO] TestAgent.server.raft: election won: tally=1 31:34.134 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29881 [Leader]" 31:34.135 [INFO] TestAgent.server: cluster leadership acquired 31:34.135 [INFO] TestAgent.server: New leader elected: payload=Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 31:34.148 [INFO] TestAgent.server: initializing acls 31:34.156 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:34.156 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:34.165 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:34.165 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:34.165 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:34.165 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 31:34.165 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-4d75d19b-f91b-db38-b2de-0810ef71dda5.dc2 31:34.166 [INFO] TestAgent.server: Updating LAN server: server="Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 (Addr: tcp/127.0.0.1:29881) (DC: dc2)" 31:34.166 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-4d75d19b-f91b-db38-b2de-0810ef71dda5.dc2 area=wan 31:34.206 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.264 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.264 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.264 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.264 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.264 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.264 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 31:34.264 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 31:34.276 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4d75d19b-f91b-db38-b2de-0810ef71dda5 31:34.288 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.320 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:29866] 31:34.321 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29866 31:34.322 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3e6f7546-d43c-b410-1efb-00a4db5a6927.dc1 127.0.0.1 31:34.322 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:34.322 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3e6f7546-d43c-b410-1efb-00a4db5a6927.dc1 area=wan 31:34.337 [INFO] TestAgent: Requesting shutdown 31:34.337 [INFO] TestAgent.server: shutting down server 31:34.337 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:34.337 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:34.337 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.337 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.337 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.337 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.337 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.337 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.337 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.337 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:34.337 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:34.337 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.337 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.337 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.345 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.349Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.349Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.349Z [INFO] agent.router.manager: shutting down 31:34.349 [INFO] TestAgent: consul server down 31:34.349 [INFO] TestAgent: shutdown complete 31:34.349 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29924 network=tcp 31:34.349 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29924 network=udp 31:34.349 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29925 network=tcp 31:34.849 [INFO] TestAgent: Waiting for endpoints to shut down 31:34.849 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:33.607Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:33.607Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:33.637Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:33.637Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:33.712 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3e6f7546-d43c-b410-1efb-00a4db5a6927 Address:127.0.0.1:29867}]" 31:33.713 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3e6f7546-d43c-b410-1efb-00a4db5a6927.dc1 127.0.0.1 31:33.713 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 127.0.0.1 2021-10-05T16:31:33.713Z [INFO] agent.router: Initializing LAN area manager 31:33.713 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29867 [Follower]" leader= 31:33.714 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29869 network=udp 31:33.714 [INFO] TestAgent.server: Adding LAN server: server="Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 (Addr: tcp/127.0.0.1:29867) (DC: dc1)" 31:33.714 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3e6f7546-d43c-b410-1efb-00a4db5a6927.dc1 area=wan 31:33.714 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29869 network=tcp 31:33.715 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29870 network=tcp 31:33.715 [INFO] TestAgent: started state syncer 31:33.715 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29868 network=tcp 31:33.757 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:33.758 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29867 [Candidate]" term=2 31:33.764 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:33.786 [DEBUG] TestAgent.server.raft: votes: needed=1 31:33.786 [DEBUG] TestAgent.server.raft: vote granted: from=3e6f7546-d43c-b410-1efb-00a4db5a6927 term=2 tally=1 31:33.786 [INFO] TestAgent.server.raft: election won: tally=1 31:33.786 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29867 [Leader]" 31:33.786 [INFO] TestAgent.server: cluster leadership acquired 31:33.786 [INFO] TestAgent.server: New leader elected: payload=Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 31:33.801 [INFO] TestAgent.server: initializing acls 31:33.813 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:33.830 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:33.830 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:33.830 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:33.830 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 31:33.830 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-3e6f7546-d43c-b410-1efb-00a4db5a6927.dc1 31:33.831 [INFO] TestAgent.server: Updating LAN server: server="Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 (Addr: tcp/127.0.0.1:29867) (DC: dc1)" 31:33.831 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-3e6f7546-d43c-b410-1efb-00a4db5a6927.dc1 area=wan 31:33.848 [INFO] TestAgent: Synced node info 31:33.848 [DEBUG] TestAgent: Node info in sync 31:33.881 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:33.929 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:33.929 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:33.929 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:33.929 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:33.929 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:33.929 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 31:33.929 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 31:33.961 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3e6f7546-d43c-b410-1efb-00a4db5a6927 31:33.972 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.321 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:44286 31:34.321 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4d75d19b-f91b-db38-b2de-0810ef71dda5.dc2 127.0.0.1 31:34.322 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4d75d19b-f91b-db38-b2de-0810ef71dda5.dc2 area=wan 31:34.849 [INFO] TestAgent: Requesting shutdown 31:34.850 [INFO] TestAgent.server: shutting down server 31:34.850 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:34.850 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.850 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.850 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.850 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.850 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:34.850 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.850 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.850 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.850 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:34.850 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.850 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.850 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.850 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:34.857 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.871Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.871Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.871Z [INFO] agent.router.manager: shutting down 31:34.872 [INFO] TestAgent: consul server down 31:34.872 [INFO] TestAgent: shutdown complete 31:34.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29869 network=tcp 31:34.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29869 network=udp 31:34.872 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29870 network=tcp 31:35.388 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.388 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodeServices_WanTranslation (1.82s) === CONT TestCatalogRegister_checkRegistration 2021-10-05T16:31:34.518Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.556Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.635 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:04b09b2b-4c5f-d493-72af-8a34a72af29e Address:127.0.0.1:29943}]" 31:34.636 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29943 [Follower]" leader= 31:34.636 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-04b09b2b-4c5f-d493-72af-8a34a72af29e.dc1 127.0.0.1 31:34.637 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-04b09b2b-4c5f-d493-72af-8a34a72af29e 127.0.0.1 2021-10-05T16:31:34.637Z [INFO] agent.router: Initializing LAN area manager 31:34.637 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29938 network=udp 31:34.637 [INFO] TestAgent.server: Adding LAN server: server="Node-04b09b2b-4c5f-d493-72af-8a34a72af29e (Addr: tcp/127.0.0.1:29943) (DC: dc1)" 31:34.637 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-04b09b2b-4c5f-d493-72af-8a34a72af29e.dc1 area=wan 31:34.638 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29938 network=tcp 31:34.639 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29939 network=tcp 31:34.639 [INFO] TestAgent: started state syncer 31:34.646 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29944 network=tcp 31:34.696 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.696 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29943 [Candidate]" term=2 31:34.748 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.748 [DEBUG] TestAgent.server.raft: vote granted: from=04b09b2b-4c5f-d493-72af-8a34a72af29e term=2 tally=1 31:34.748 [INFO] TestAgent.server.raft: election won: tally=1 31:34.748 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29943 [Leader]" 31:34.748 [INFO] TestAgent.server: cluster leadership acquired 31:34.748 [INFO] TestAgent.server: New leader elected: payload=Node-04b09b2b-4c5f-d493-72af-8a34a72af29e 31:34.767 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29943 31:34.791 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.829 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.829 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.829 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.829 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.829 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.829 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04b09b2b-4c5f-d493-72af-8a34a72af29e 31:34.829 [INFO] TestAgent.server: member joined, marking health alive: member=Node-04b09b2b-4c5f-d493-72af-8a34a72af29e 31:34.852 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.892 [INFO] TestAgent: Requesting shutdown 31:34.893 [INFO] TestAgent.server: shutting down server 31:34.893 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.893 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.893 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.893 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.893 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.893 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 31:34.893 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.893 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.893 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.893 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.893 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:34.898 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.903Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.903Z [INFO] agent.router.manager: shutting down 31:34.904 [INFO] TestAgent: consul server down 31:34.904 [INFO] TestAgent: shutdown complete 31:34.904 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29938 network=tcp 31:34.904 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29938 network=udp 31:34.904 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29939 network=tcp 31:35.404 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.404 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServiceNodes_ConnectProxy (0.91s) === CONT TestCatalogServices_NodeMetaFilter [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:34.665Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.690Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.731 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7455e268-89b0-5a7b-3dc4-3495da0cd0ca Address:127.0.0.1:29950}]" 31:34.732 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29950 [Follower]" leader= 31:34.732 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7455e268-89b0-5a7b-3dc4-3495da0cd0ca.dc1 127.0.0.1 31:34.732 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7455e268-89b0-5a7b-3dc4-3495da0cd0ca 127.0.0.1 2021-10-05T16:31:34.732Z [INFO] agent.router: Initializing LAN area manager 31:34.733 [INFO] TestAgent.server: Adding LAN server: server="Node-7455e268-89b0-5a7b-3dc4-3495da0cd0ca (Addr: tcp/127.0.0.1:29950) (DC: dc1)" 31:34.733 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29945 network=udp 31:34.733 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29945 network=tcp 31:34.733 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7455e268-89b0-5a7b-3dc4-3495da0cd0ca.dc1 area=wan 31:34.733 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29946 network=tcp 31:34.733 [INFO] TestAgent: started state syncer 31:34.734 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29951 network=tcp 31:34.790 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.790 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29950 [Candidate]" term=2 31:34.807 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.807 [DEBUG] TestAgent.server.raft: vote granted: from=7455e268-89b0-5a7b-3dc4-3495da0cd0ca term=2 tally=1 31:34.807 [INFO] TestAgent.server.raft: election won: tally=1 31:34.807 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29950 [Leader]" 31:34.808 [INFO] TestAgent.server: cluster leadership acquired 31:34.808 [INFO] TestAgent.server: New leader elected: payload=Node-7455e268-89b0-5a7b-3dc4-3495da0cd0ca 31:34.817 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29950 31:34.836 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.905 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.905 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.905 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.905 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.905 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.906 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7455e268-89b0-5a7b-3dc4-3495da0cd0ca 31:34.906 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7455e268-89b0-5a7b-3dc4-3495da0cd0ca 31:34.923 [INFO] TestAgent.server: federation state anti-entropy synced 31:35.121 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:35.153 [INFO] TestAgent: Synced node info 31:35.153 [DEBUG] TestAgent: Node info in sync 31:35.205 [INFO] TestAgent: Requesting shutdown 31:35.205 [INFO] TestAgent.server: shutting down server 31:35.205 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.205 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.205 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.205 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.205 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.205 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:35.205 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:35.205 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.205 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.205 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.214 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.220Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.220Z [INFO] agent.router.manager: shutting down 31:35.220 [INFO] TestAgent: consul server down 31:35.220 [INFO] TestAgent: shutdown complete 31:35.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29945 network=tcp 31:35.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29945 network=udp 31:35.220 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29946 network=tcp 31:35.720 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.720 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServiceNodes_DistanceSort (1.09s) === CONT TestCatalogServices [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:35.108Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.122Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.184 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:eea08ab8-7458-9819-488a-e1f8e320fbfd Address:127.0.0.1:29992}]" 31:35.184 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29992 [Follower]" leader= 31:35.184 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-eea08ab8-7458-9819-488a-e1f8e320fbfd.dc1 127.0.0.1 31:35.185 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-eea08ab8-7458-9819-488a-e1f8e320fbfd 127.0.0.1 2021-10-05T16:31:35.185Z [INFO] agent.router: Initializing LAN area manager 31:35.185 [INFO] TestAgent.server: Adding LAN server: server="Node-eea08ab8-7458-9819-488a-e1f8e320fbfd (Addr: tcp/127.0.0.1:29992) (DC: dc1)" 31:35.185 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-eea08ab8-7458-9819-488a-e1f8e320fbfd.dc1 area=wan 31:35.185 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30001 network=udp 31:35.185 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30001 network=tcp 31:35.186 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29988 network=tcp 31:35.186 [INFO] TestAgent: started state syncer 31:35.186 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29993 network=tcp 31:35.224 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.224 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29992 [Candidate]" term=2 31:35.239 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.239 [DEBUG] TestAgent.server.raft: vote granted: from=eea08ab8-7458-9819-488a-e1f8e320fbfd term=2 tally=1 31:35.239 [INFO] TestAgent.server.raft: election won: tally=1 31:35.239 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29992 [Leader]" 31:35.239 [INFO] TestAgent.server: cluster leadership acquired 31:35.239 [INFO] TestAgent.server: New leader elected: payload=Node-eea08ab8-7458-9819-488a-e1f8e320fbfd 31:35.252 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29992 31:35.320 [INFO] TestAgent: Requesting shutdown 31:35.320 [INFO] TestAgent.server: shutting down server 31:35.320 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.321 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:35.332 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.340 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.347Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.347Z [INFO] agent.router.manager: shutting down 31:35.356 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:35.356 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:35.356 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:35.356 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 31:35.356 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 31:35.356 [INFO] TestAgent: consul server down 31:35.356 [INFO] TestAgent: shutdown complete 31:35.356 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30001 network=tcp 31:35.356 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30001 network=udp 31:35.356 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29988 network=tcp 31:35.857 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.857 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServiceNodes_NodeMetaFilter (0.79s) === CONT TestCatalogNodes_DistanceSort 2021-10-05T16:31:35.033Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.070Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.160 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b38a1ccd-dca6-95bb-0d1a-3704c3ac5571 Address:127.0.0.1:29999}]" 31:35.160 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29999 [Follower]" leader= 31:35.161 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b38a1ccd-dca6-95bb-0d1a-3704c3ac5571.dc1 127.0.0.1 31:35.161 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b38a1ccd-dca6-95bb-0d1a-3704c3ac5571 127.0.0.1 2021-10-05T16:31:35.161Z [INFO] agent.router: Initializing LAN area manager 31:35.162 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b38a1ccd-dca6-95bb-0d1a-3704c3ac5571.dc1 area=wan 31:35.162 [INFO] TestAgent.server: Adding LAN server: server="Node-b38a1ccd-dca6-95bb-0d1a-3704c3ac5571 (Addr: tcp/127.0.0.1:29999) (DC: dc1)" 31:35.162 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29973 network=udp 31:35.162 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29973 network=tcp 31:35.163 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29974 network=tcp 31:35.163 [INFO] TestAgent: started state syncer 31:35.164 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30000 network=tcp 31:35.215 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.215 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29999 [Candidate]" term=2 31:35.234 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.234 [DEBUG] TestAgent.server.raft: vote granted: from=b38a1ccd-dca6-95bb-0d1a-3704c3ac5571 term=2 tally=1 31:35.234 [INFO] TestAgent.server.raft: election won: tally=1 31:35.234 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29999 [Leader]" 31:35.234 [INFO] TestAgent.server: cluster leadership acquired 31:35.235 [INFO] TestAgent.server: New leader elected: payload=Node-b38a1ccd-dca6-95bb-0d1a-3704c3ac5571 31:35.246 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29999 31:35.293 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.356 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.356 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.356 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.356 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.356 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.356 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b38a1ccd-dca6-95bb-0d1a-3704c3ac5571 31:35.356 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b38a1ccd-dca6-95bb-0d1a-3704c3ac5571 31:35.416 [INFO] TestAgent.server: federation state anti-entropy synced 31:35.442 [INFO] TestAgent: Requesting shutdown 31:35.442 [INFO] TestAgent.server: shutting down server 31:35.442 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.442 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.442 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.442 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.442 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.442 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:35.442 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:35.442 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:35.442 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.442 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.442 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.447 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.453Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.453Z [INFO] agent.router.manager: shutting down 31:35.453 [INFO] TestAgent: consul server down 31:35.453 [INFO] TestAgent: shutdown complete 31:35.453 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29973 network=tcp 31:35.453 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29973 network=udp 31:35.453 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29974 network=tcp 31:35.954 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.954 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServiceNodes_Filter (0.94s) === CONT TestCatalogNodes_Blocking [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:35.308Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.342Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.426 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7773224f-46a5-0fd0-224c-037ee419ab59 Address:127.0.0.1:30020}]" 31:35.427 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7773224f-46a5-0fd0-224c-037ee419ab59.dc1 127.0.0.1 31:35.427 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7773224f-46a5-0fd0-224c-037ee419ab59 127.0.0.1 2021-10-05T16:31:35.427Z [INFO] agent.router: Initializing LAN area manager 31:35.427 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29980 network=udp 31:35.427 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30020 [Follower]" leader= 31:35.428 [INFO] TestAgent.server: Adding LAN server: server="Node-7773224f-46a5-0fd0-224c-037ee419ab59 (Addr: tcp/127.0.0.1:30020) (DC: dc1)" 31:35.428 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7773224f-46a5-0fd0-224c-037ee419ab59.dc1 area=wan 31:35.428 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29980 network=tcp 31:35.428 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29995 network=tcp 31:35.429 [INFO] TestAgent: started state syncer 31:35.429 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30021 network=tcp 31:35.471 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.471 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30020 [Candidate]" term=2 31:35.486 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.486 [DEBUG] TestAgent.server.raft: vote granted: from=7773224f-46a5-0fd0-224c-037ee419ab59 term=2 tally=1 31:35.486 [INFO] TestAgent.server.raft: election won: tally=1 31:35.486 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30020 [Leader]" 31:35.491 [INFO] TestAgent.server: cluster leadership acquired 31:35.492 [INFO] TestAgent.server: New leader elected: payload=Node-7773224f-46a5-0fd0-224c-037ee419ab59 31:35.513 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30020 31:35.515 [INFO] TestAgent: Synced node info 31:35.515 [DEBUG] TestAgent: Node info in sync 31:35.571 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.619 [INFO] TestAgent: Requesting shutdown 31:35.619 [INFO] TestAgent.server: shutting down server 31:35.619 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.631 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:35.640 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.640 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.640 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.640 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.640 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.640 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7773224f-46a5-0fd0-224c-037ee419ab59 31:35.640 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7773224f-46a5-0fd0-224c-037ee419ab59 2021-10-05T16:31:35.641Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.641Z [INFO] agent.router.manager: shutting down 31:35.664 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-7773224f-46a5-0fd0-224c-037ee419ab59 127.0.0.1 30018 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:7773224f-46a5-0fd0-224c-037ee419ab59 port:30020 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:30019] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:35.664 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.664 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.664 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.664 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.664 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.664 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.664 [INFO] TestAgent: consul server down 31:35.664 [INFO] TestAgent: shutdown complete 31:35.664 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29980 network=tcp 31:35.664 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.664 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29980 network=udp 31:35.664 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29995 network=tcp 31:36.164 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.164 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServiceNodes (0.91s) === CONT TestCatalogNodes_WanTranslation [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:35.423Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.437Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.482 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ed6153ae-8529-f842-774f-34d16cb7e9ff Address:127.0.0.1:29957}]" 31:35.482 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29957 [Follower]" leader= 31:35.484 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ed6153ae-8529-f842-774f-34d16cb7e9ff.dc1 127.0.0.1 31:35.486 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ed6153ae-8529-f842-774f-34d16cb7e9ff 127.0.0.1 2021-10-05T16:31:35.486Z [INFO] agent.router: Initializing LAN area manager 31:35.486 [INFO] TestAgent.server: Adding LAN server: server="Node-ed6153ae-8529-f842-774f-34d16cb7e9ff (Addr: tcp/127.0.0.1:29957) (DC: dc1)" 31:35.487 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29987 network=udp 31:35.487 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ed6153ae-8529-f842-774f-34d16cb7e9ff.dc1 area=wan 31:35.495 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29987 network=tcp 31:35.501 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30016 network=tcp 31:35.501 [INFO] TestAgent: started state syncer 31:35.501 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29958 network=tcp 31:35.553 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.553 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29957 [Candidate]" term=2 31:35.564 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.564 [DEBUG] TestAgent.server.raft: vote granted: from=ed6153ae-8529-f842-774f-34d16cb7e9ff term=2 tally=1 31:35.564 [INFO] TestAgent.server.raft: election won: tally=1 31:35.564 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29957 [Leader]" 31:35.565 [INFO] TestAgent.server: cluster leadership acquired 31:35.565 [INFO] TestAgent.server: New leader elected: payload=Node-ed6153ae-8529-f842-774f-34d16cb7e9ff 31:35.588 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29957 31:35.628 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.700 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.700 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.700 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.700 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.700 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.700 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ed6153ae-8529-f842-774f-34d16cb7e9ff 31:35.700 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ed6153ae-8529-f842-774f-34d16cb7e9ff 31:35.748 [INFO] TestAgent: Synced node info 31:35.748 [INFO] TestAgent.server: federation state anti-entropy synced 31:35.856 [INFO] TestAgent: Requesting shutdown 31:35.856 [INFO] TestAgent.server: shutting down server 31:35.856 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.856 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.856 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.856 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.856 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.857 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:35.857 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:35.857 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.857 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.857 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.868 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.880Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.880Z [INFO] agent.router.manager: shutting down 31:35.881 [INFO] TestAgent: consul server down 31:35.881 [INFO] TestAgent: shutdown complete 31:35.881 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29987 network=tcp 31:35.881 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29987 network=udp 31:35.881 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30016 network=tcp 31:36.381 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.381 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:35.417Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.441Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.533 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:67998661-84b2-8f04-2935-cf2627cce119 Address:127.0.0.1:29985}]" 31:35.534 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29985 [Follower]" leader= 31:35.535 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-67998661-84b2-8f04-2935-cf2627cce119.dc1 127.0.0.1 31:35.537 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-67998661-84b2-8f04-2935-cf2627cce119 127.0.0.1 2021-10-05T16:31:35.537Z [INFO] agent.router: Initializing LAN area manager 31:35.537 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30008 network=udp 31:35.537 [INFO] TestAgent.server: Adding LAN server: server="Node-67998661-84b2-8f04-2935-cf2627cce119 (Addr: tcp/127.0.0.1:29985) (DC: dc1)" 31:35.537 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-67998661-84b2-8f04-2935-cf2627cce119.dc1 area=wan 31:35.538 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30008 network=tcp 31:35.538 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29981 network=tcp 31:35.539 [INFO] TestAgent: started state syncer 31:35.539 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29986 network=tcp 31:35.585 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.585 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29985 [Candidate]" term=2 31:35.594 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.595 [DEBUG] TestAgent.server.raft: vote granted: from=67998661-84b2-8f04-2935-cf2627cce119 term=2 tally=1 31:35.595 [INFO] TestAgent.server.raft: election won: tally=1 31:35.595 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29985 [Leader]" 31:35.595 [INFO] TestAgent.server: cluster leadership acquired 31:35.595 [INFO] TestAgent.server: New leader elected: payload=Node-67998661-84b2-8f04-2935-cf2627cce119 31:35.617 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29985 31:35.660 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.728 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.728 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.728 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.728 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.728 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.728 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-67998661-84b2-8f04-2935-cf2627cce119 31:35.728 [INFO] TestAgent.server: member joined, marking health alive: member=Node-67998661-84b2-8f04-2935-cf2627cce119 31:35.750 [INFO] TestAgent.server: federation state anti-entropy synced 31:35.858 [INFO] TestAgent: Requesting shutdown 31:35.858 [INFO] TestAgent.server: shutting down server 31:35.858 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.858 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.858 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.858 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.858 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.859 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:35.859 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:35.859 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:35.859 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.859 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.859 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.868 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.881Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.881Z [INFO] agent.router.manager: shutting down 31:35.881 [INFO] TestAgent: consul server down 31:35.881 [INFO] TestAgent: shutdown complete 31:35.881 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30008 network=tcp 31:35.881 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30008 network=udp 31:35.881 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29981 network=tcp 31:36.381 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.381 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServices_NodeMetaFilter (0.98s) === CONT TestCatalogNodes_Filter --- PASS: TestCatalogRegister_checkRegistration (0.99s) === CONT TestCatalogNodes_MetaFilter 2021-10-05T16:31:34.853Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.874Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.927 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:46e55962-7338-9397-85cf-a9a0102ed226 Address:127.0.0.1:29964}]" 31:34.927 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29964 [Follower]" leader= 31:34.928 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-46e55962-7338-9397-85cf-a9a0102ed226.dc1 127.0.0.1 31:34.929 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-46e55962-7338-9397-85cf-a9a0102ed226 127.0.0.1 2021-10-05T16:31:34.929Z [INFO] agent.router: Initializing LAN area manager 31:34.929 [INFO] TestAgent.server: Adding LAN server: server="Node-46e55962-7338-9397-85cf-a9a0102ed226 (Addr: tcp/127.0.0.1:29964) (DC: dc1)" 31:34.929 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-46e55962-7338-9397-85cf-a9a0102ed226.dc1 area=wan 31:34.929 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29952 network=udp 31:34.929 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29952 network=tcp 31:34.930 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29960 network=tcp 31:34.930 [INFO] TestAgent: started state syncer 31:34.930 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29965 network=tcp 31:34.980 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.980 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29964 [Candidate]" term=2 31:34.996 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.996 [DEBUG] TestAgent.server.raft: vote granted: from=46e55962-7338-9397-85cf-a9a0102ed226 term=2 tally=1 31:34.996 [INFO] TestAgent.server.raft: election won: tally=1 31:34.996 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29964 [Leader]" 31:34.996 [INFO] TestAgent.server: cluster leadership acquired 31:34.996 [INFO] TestAgent.server: New leader elected: payload=Node-46e55962-7338-9397-85cf-a9a0102ed226 31:35.004 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29964 31:35.031 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.081 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.081 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.081 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.081 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.081 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.081 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-46e55962-7338-9397-85cf-a9a0102ed226 31:35.081 [INFO] TestAgent.server: member joined, marking health alive: member=Node-46e55962-7338-9397-85cf-a9a0102ed226 31:35.103 [INFO] TestAgent.server: federation state anti-entropy synced 31:35.390 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:35.405 [INFO] TestAgent: Synced node info 31:35.900 [INFO] TestAgent: Requesting shutdown 31:35.900 [INFO] TestAgent.server: shutting down server 31:35.900 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.900 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.900 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.900 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.900 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.900 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:35.900 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:35.900 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.900 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.900 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.904 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.914Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.914Z [INFO] agent.router.manager: shutting down 31:35.914 [INFO] TestAgent: consul server down 31:35.914 [INFO] TestAgent: shutdown complete 31:35.914 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29952 network=tcp 31:35.914 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29952 network=udp 31:35.914 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29960 network=tcp 31:36.415 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.415 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_Bad_Size_Net/allowed 2021-10-05T16:31:35.210Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.221Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.294 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7e2c87e5-3239-613a-d02f-06e2c8524679 Address:127.0.0.1:29978}]" 31:35.295 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7e2c87e5-3239-613a-d02f-06e2c8524679.dc1 127.0.0.1 31:35.296 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29978 [Follower]" leader= 31:35.296 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7e2c87e5-3239-613a-d02f-06e2c8524679 127.0.0.1 2021-10-05T16:31:35.296Z [INFO] agent.router: Initializing LAN area manager 31:35.297 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29994 network=udp 31:35.297 [INFO] TestAgent.server: Adding LAN server: server="Node-7e2c87e5-3239-613a-d02f-06e2c8524679 (Addr: tcp/127.0.0.1:29978) (DC: dc1)" 31:35.297 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7e2c87e5-3239-613a-d02f-06e2c8524679.dc1 area=wan 31:35.297 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29994 network=tcp 31:35.300 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30002 network=tcp 31:35.300 [INFO] TestAgent: started state syncer 31:35.300 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29979 network=tcp 31:35.334 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.334 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29978 [Candidate]" term=2 31:35.392 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.392 [DEBUG] TestAgent.server.raft: vote granted: from=7e2c87e5-3239-613a-d02f-06e2c8524679 term=2 tally=1 31:35.392 [INFO] TestAgent.server.raft: election won: tally=1 31:35.392 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29978 [Leader]" 31:35.396 [INFO] TestAgent.server: cluster leadership acquired 31:35.396 [INFO] TestAgent.server: New leader elected: payload=Node-7e2c87e5-3239-613a-d02f-06e2c8524679 31:35.408 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29978 31:35.432 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.467 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.467 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.467 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.467 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.467 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.467 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7e2c87e5-3239-613a-d02f-06e2c8524679 31:35.467 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7e2c87e5-3239-613a-d02f-06e2c8524679 31:35.482 [INFO] TestAgent.server: federation state anti-entropy synced 31:35.677 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:35.687 [INFO] TestAgent: Synced node info 31:35.687 [DEBUG] TestAgent: Node info in sync 31:35.930 [WARN] TestAgent.server.rpc: Attempting to apply large raft entry: size_in_bytes=1573029 31:35.952 [INFO] TestAgent: Requesting shutdown 31:35.952 [INFO] TestAgent.server: shutting down server 31:35.952 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.952 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.952 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.952 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.952 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.952 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:35.952 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:35.952 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.952 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.952 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.957 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.963Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.963Z [INFO] agent.router.manager: shutting down 31:35.963 [INFO] TestAgent: consul server down 31:35.963 [INFO] TestAgent: shutdown complete 31:35.963 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29994 network=tcp 31:35.963 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29994 network=udp 31:35.964 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30002 network=tcp 31:36.465 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.465 [INFO] TestAgent: Endpoints down --- PASS: TestTxnEndpoint_Bad_Size_Item (4.17s) --- PASS: TestTxnEndpoint_Bad_Size_Item/exceeds_default_limits (0.91s) --- PASS: TestTxnEndpoint_Bad_Size_Item/exceeds_configured_max_txn_len (0.94s) --- PASS: TestTxnEndpoint_Bad_Size_Item/exceeds_default_max_kv_value_size (1.06s) --- PASS: TestTxnEndpoint_Bad_Size_Item/allowed (1.27s) === CONT TestCatalogNodes 2021-10-05T16:31:35.743Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.759Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.805 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dd28c398-360c-2130-85f9-baf4679aff67 Address:127.0.0.1:30027}]" 31:35.805 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30027 [Follower]" leader= 31:35.807 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dd28c398-360c-2130-85f9-baf4679aff67.dc1 127.0.0.1 31:35.807 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dd28c398-360c-2130-85f9-baf4679aff67 127.0.0.1 2021-10-05T16:31:35.807Z [INFO] agent.router: Initializing LAN area manager 31:35.807 [INFO] TestAgent.server: Adding LAN server: server="Node-dd28c398-360c-2130-85f9-baf4679aff67 (Addr: tcp/127.0.0.1:30027) (DC: dc1)" 31:35.808 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dd28c398-360c-2130-85f9-baf4679aff67.dc1 area=wan 31:35.808 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29959 network=tcp 31:35.808 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29959 network=udp 31:35.808 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29967 network=tcp 31:35.808 [INFO] TestAgent: started state syncer 31:35.808 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30028 network=tcp 31:35.852 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.852 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30027 [Candidate]" term=2 31:35.880 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.880 [DEBUG] TestAgent.server.raft: vote granted: from=dd28c398-360c-2130-85f9-baf4679aff67 term=2 tally=1 31:35.880 [INFO] TestAgent.server.raft: election won: tally=1 31:35.880 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30027 [Leader]" 31:35.880 [INFO] TestAgent.server: cluster leadership acquired 31:35.880 [INFO] TestAgent.server: New leader elected: payload=Node-dd28c398-360c-2130-85f9-baf4679aff67 31:35.891 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30027 31:35.912 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.950 [INFO] TestAgent: Synced node info 31:35.969 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.969 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.969 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.969 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.969 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.969 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dd28c398-360c-2130-85f9-baf4679aff67 31:35.969 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dd28c398-360c-2130-85f9-baf4679aff67 31:36.006 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.010 [INFO] TestAgent: Requesting shutdown 31:36.011 [INFO] TestAgent.server: shutting down server 31:36.011 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.011 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.011 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.011 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.011 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.011 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.011 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.011 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.011 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.011 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.016 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.024Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.024Z [INFO] agent.router.manager: shutting down 31:36.024 [INFO] TestAgent: consul server down 31:36.024 [INFO] TestAgent: shutdown complete 31:36.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29959 network=tcp 31:36.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29959 network=udp 31:36.024 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29967 network=tcp 31:36.524 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.524 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServices (0.80s) === CONT TestCatalogDatacenters [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:35.326Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:35.326Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.414Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:35.414Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.450 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:137ab113-4e0a-bec8-0b63-96709d67cddc Address:127.0.0.1:30006}]" 31:35.451 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-137ab113-4e0a-bec8-0b63-96709d67cddc.dc2 127.0.0.1 31:35.451 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-137ab113-4e0a-bec8-0b63-96709d67cddc 127.0.0.1 2021-10-05T16:31:35.451Z [INFO] agent.router: Initializing LAN area manager 31:35.452 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30006 [Follower]" leader= 31:35.452 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30022 network=udp 31:35.452 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-137ab113-4e0a-bec8-0b63-96709d67cddc.dc2 area=wan 31:35.452 [INFO] TestAgent.server: Adding LAN server: server="Node-137ab113-4e0a-bec8-0b63-96709d67cddc (Addr: tcp/127.0.0.1:30006) (DC: dc2)" 31:35.452 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30022 network=tcp 31:35.453 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30009 network=tcp 31:35.453 [INFO] TestAgent: started state syncer 31:35.453 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30007 network=tcp 31:35.504 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:35.515 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.515 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30006 [Candidate]" term=2 31:35.524 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.524 [DEBUG] TestAgent.server.raft: vote granted: from=137ab113-4e0a-bec8-0b63-96709d67cddc term=2 tally=1 31:35.524 [INFO] TestAgent.server.raft: election won: tally=1 31:35.524 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30006 [Leader]" 31:35.524 [INFO] TestAgent.server: cluster leadership acquired 31:35.524 [INFO] TestAgent.server: New leader elected: payload=Node-137ab113-4e0a-bec8-0b63-96709d67cddc 31:35.536 [INFO] TestAgent.server: initializing acls 31:35.540 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:35.553 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:35.553 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:35.553 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:35.553 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-137ab113-4e0a-bec8-0b63-96709d67cddc 31:35.554 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-137ab113-4e0a-bec8-0b63-96709d67cddc.dc2 31:35.555 [INFO] TestAgent.server: Updating LAN server: server="Node-137ab113-4e0a-bec8-0b63-96709d67cddc (Addr: tcp/127.0.0.1:30006) (DC: dc2)" 31:35.555 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-137ab113-4e0a-bec8-0b63-96709d67cddc.dc2 area=wan 31:35.556 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:29970] 31:35.572 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29970 31:35.584 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c620d067-0af0-c618-e96e-a20c31ee0858.dc1 127.0.0.1 31:35.584 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:35.585 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c620d067-0af0-c618-e96e-a20c31ee0858.dc1 area=wan 31:35.601 [INFO] TestAgent: Requesting shutdown 31:35.601 [INFO] TestAgent.server: shutting down server 31:35.601 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:35.601 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:35.601 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.601 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:35.601 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:35.601 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:35.612 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:35.616 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 2021-10-05T16:31:35.625Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.625Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.625Z [INFO] agent.router.manager: shutting down 31:35.636 [INFO] TestAgent: consul server down 31:35.636 [INFO] TestAgent: shutdown complete 31:35.636 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30022 network=tcp 31:35.636 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30022 network=udp 31:35.636 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30009 network=tcp 31:35.636 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:35.636 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:36.136 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.136 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:34.894Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:34.894Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.918Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:34.918Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.970 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c620d067-0af0-c618-e96e-a20c31ee0858 Address:127.0.0.1:29971}]" 31:34.971 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c620d067-0af0-c618-e96e-a20c31ee0858.dc1 127.0.0.1 31:34.971 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c620d067-0af0-c618-e96e-a20c31ee0858 127.0.0.1 2021-10-05T16:31:34.971Z [INFO] agent.router: Initializing LAN area manager 31:34.972 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29971 [Follower]" leader= 31:34.972 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29966 network=udp 31:34.972 [INFO] TestAgent.server: Adding LAN server: server="Node-c620d067-0af0-c618-e96e-a20c31ee0858 (Addr: tcp/127.0.0.1:29971) (DC: dc1)" 31:34.972 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29966 network=tcp 31:34.972 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c620d067-0af0-c618-e96e-a20c31ee0858.dc1 area=wan 31:34.972 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29953 network=tcp 31:34.973 [INFO] TestAgent: started state syncer 31:34.973 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29972 network=tcp 31:35.009 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:35.009 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29971 [Candidate]" term=2 31:35.022 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:35.040 [DEBUG] TestAgent.server.raft: votes: needed=1 31:35.040 [DEBUG] TestAgent.server.raft: vote granted: from=c620d067-0af0-c618-e96e-a20c31ee0858 term=2 tally=1 31:35.040 [INFO] TestAgent.server.raft: election won: tally=1 31:35.040 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29971 [Leader]" 31:35.041 [INFO] TestAgent.server: cluster leadership acquired 31:35.041 [INFO] TestAgent.server: New leader elected: payload=Node-c620d067-0af0-c618-e96e-a20c31ee0858 31:35.056 [INFO] TestAgent.server: initializing acls 31:35.066 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:35.077 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:35.077 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:35.077 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:35.077 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c620d067-0af0-c618-e96e-a20c31ee0858 31:35.077 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c620d067-0af0-c618-e96e-a20c31ee0858.dc1 31:35.078 [INFO] TestAgent.server: Updating LAN server: server="Node-c620d067-0af0-c618-e96e-a20c31ee0858 (Addr: tcp/127.0.0.1:29971) (DC: dc1)" 31:35.078 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c620d067-0af0-c618-e96e-a20c31ee0858.dc1 area=wan 31:35.113 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:35.149 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:35.149 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:35.149 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:35.149 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:35.149 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:35.149 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c620d067-0af0-c618-e96e-a20c31ee0858 31:35.149 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c620d067-0af0-c618-e96e-a20c31ee0858 31:35.169 [INFO] TestAgent: Synced node info 31:35.169 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c620d067-0af0-c618-e96e-a20c31ee0858 31:35.177 [INFO] TestAgent.server: federation state anti-entropy synced 31:35.321 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:35.334 [INFO] TestAgent: Synced node info 31:35.334 [DEBUG] TestAgent: Node info in sync 31:35.568 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:48878 31:35.584 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-137ab113-4e0a-bec8-0b63-96709d67cddc.dc2 127.0.0.1 31:35.584 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-137ab113-4e0a-bec8-0b63-96709d67cddc.dc2 area=wan 31:36.136 [INFO] TestAgent: Requesting shutdown 31:36.136 [INFO] TestAgent.server: shutting down server 31:36.136 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.136 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.136 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:36.136 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:36.136 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.136 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.136 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.137 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.137 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.137 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.137 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.137 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:36.137 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:36.137 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.141 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.154Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.154Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.154Z [INFO] agent.router.manager: shutting down 31:36.154 [INFO] TestAgent: consul server down 31:36.154 [INFO] TestAgent: shutdown complete 31:36.154 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29966 network=tcp 31:36.154 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29966 network=udp 31:36.154 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29953 network=tcp 31:36.654 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.654 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogServiceNodes_WanTranslation (1.80s) === CONT TestCatalogDeregister [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:35.919Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.931Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:35.992 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:99b8be02-856c-830e-aabf-4a8438f5a23b Address:127.0.0.1:30055}]" 31:35.993 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-99b8be02-856c-830e-aabf-4a8438f5a23b.dc1 127.0.0.1 31:35.993 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30055 [Follower]" leader= 31:35.996 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-99b8be02-856c-830e-aabf-4a8438f5a23b 127.0.0.1 2021-10-05T16:31:35.996Z [INFO] agent.router: Initializing LAN area manager 31:35.997 [INFO] TestAgent.server: Adding LAN server: server="Node-99b8be02-856c-830e-aabf-4a8438f5a23b (Addr: tcp/127.0.0.1:30055) (DC: dc1)" 31:35.997 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-99b8be02-856c-830e-aabf-4a8438f5a23b.dc1 area=wan 31:35.997 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30029 network=tcp 31:35.997 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30029 network=udp 31:35.998 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30051 network=tcp 31:35.998 [INFO] TestAgent: started state syncer 31:35.998 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30056 network=tcp 31:36.042 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.042 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30055 [Candidate]" term=2 31:36.054 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.054 [DEBUG] TestAgent.server.raft: vote granted: from=99b8be02-856c-830e-aabf-4a8438f5a23b term=2 tally=1 31:36.054 [INFO] TestAgent.server.raft: election won: tally=1 31:36.054 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30055 [Leader]" 31:36.058 [INFO] TestAgent.server: cluster leadership acquired 31:36.060 [INFO] TestAgent.server: New leader elected: payload=Node-99b8be02-856c-830e-aabf-4a8438f5a23b 31:36.063 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30055 31:36.082 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.117 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.117 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.117 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.117 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.117 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.117 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-99b8be02-856c-830e-aabf-4a8438f5a23b 31:36.117 [INFO] TestAgent.server: member joined, marking health alive: member=Node-99b8be02-856c-830e-aabf-4a8438f5a23b 31:36.129 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.172 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:36.185 [INFO] TestAgent: Synced node info 31:36.185 [DEBUG] TestAgent: Node info in sync 31:36.512 [INFO] TestAgent: Requesting shutdown 31:36.512 [INFO] TestAgent.server: shutting down server 31:36.512 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.512 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.512 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.512 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.512 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.512 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.512 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.512 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.524 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.532Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.532Z [INFO] agent.router.manager: shutting down 31:36.532 [INFO] TestAgent: consul server down 31:36.532 [INFO] TestAgent: shutdown complete 31:36.532 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30029 network=tcp 31:36.532 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30029 network=udp 31:36.532 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30051 network=tcp 31:37.035 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.035 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodes_DistanceSort (1.16s) === CONT TestCatalogRegister_Service_InvalidAddress [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:35.968Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:35.982Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.021 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:431c8c1f-f169-9ff5-ea2a-0b15a3c1e748 Address:127.0.0.1:30041}]" 31:36.021 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30041 [Follower]" leader= 31:36.022 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-431c8c1f-f169-9ff5-ea2a-0b15a3c1e748.dc1 127.0.0.1 31:36.022 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-431c8c1f-f169-9ff5-ea2a-0b15a3c1e748 127.0.0.1 2021-10-05T16:31:36.022Z [INFO] agent.router: Initializing LAN area manager 31:36.023 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30057 network=udp 31:36.023 [INFO] TestAgent.server: Adding LAN server: server="Node-431c8c1f-f169-9ff5-ea2a-0b15a3c1e748 (Addr: tcp/127.0.0.1:30041) (DC: dc1)" 31:36.023 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30057 network=tcp 31:36.023 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-431c8c1f-f169-9ff5-ea2a-0b15a3c1e748.dc1 area=wan 31:36.023 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30037 network=tcp 31:36.023 [INFO] TestAgent: started state syncer 31:36.023 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30042 network=tcp 31:36.068 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.068 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30041 [Candidate]" term=2 31:36.120 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.120 [DEBUG] TestAgent.server.raft: vote granted: from=431c8c1f-f169-9ff5-ea2a-0b15a3c1e748 term=2 tally=1 31:36.120 [INFO] TestAgent.server.raft: election won: tally=1 31:36.120 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30041 [Leader]" 31:36.120 [INFO] TestAgent.server: cluster leadership acquired 31:36.120 [INFO] TestAgent.server: New leader elected: payload=Node-431c8c1f-f169-9ff5-ea2a-0b15a3c1e748 31:36.152 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30041 31:36.200 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.240 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.240 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.240 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.240 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.240 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.240 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-431c8c1f-f169-9ff5-ea2a-0b15a3c1e748 31:36.240 [INFO] TestAgent.server: member joined, marking health alive: member=Node-431c8c1f-f169-9ff5-ea2a-0b15a3c1e748 31:36.250 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.439 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:36.456 [INFO] TestAgent: Synced node info 31:36.590 [INFO] TestAgent: Requesting shutdown 31:36.590 [INFO] TestAgent.server: shutting down server 31:36.590 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.590 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.590 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.590 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.590 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.590 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.590 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.590 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.590 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.590 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.604 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.611Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.611Z [INFO] agent.router.manager: shutting down 31:36.611 [INFO] TestAgent: consul server down 31:36.611 [INFO] TestAgent: shutdown complete 31:36.611 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30057 network=tcp 31:36.611 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30057 network=udp 31:36.611 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30037 network=tcp 31:37.112 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.112 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodes_Blocking (1.16s) === CONT TestAgent_JoinWAN_viaMeshGateway === RUN TestCatalogRegister_Service_InvalidAddress/addr_0.0.0.0 === RUN TestCatalogRegister_Service_InvalidAddress/addr_:: === RUN TestCatalogRegister_Service_InvalidAddress/addr_[::] 2021-10-05T16:31:36.394Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.407Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.512 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b6336e9e-429d-d683-6644-92f7e41aeaeb Address:127.0.0.1:30048}]" 31:36.512 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30048 [Follower]" leader= 31:36.513 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b6336e9e-429d-d683-6644-92f7e41aeaeb.dc1 127.0.0.1 31:36.513 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b6336e9e-429d-d683-6644-92f7e41aeaeb 127.0.0.1 2021-10-05T16:31:36.513Z [INFO] agent.router: Initializing LAN area manager 31:36.514 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30064 network=udp 31:36.514 [INFO] TestAgent.server: Adding LAN server: server="Node-b6336e9e-429d-d683-6644-92f7e41aeaeb (Addr: tcp/127.0.0.1:30048) (DC: dc1)" 31:36.514 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b6336e9e-429d-d683-6644-92f7e41aeaeb.dc1 area=wan 31:36.514 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30064 network=tcp 31:36.514 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30044 network=tcp 31:36.514 [INFO] TestAgent: started state syncer 31:36.515 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30049 network=tcp 31:36.564 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.564 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30048 [Candidate]" term=2 31:36.590 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.590 [DEBUG] TestAgent.server.raft: vote granted: from=b6336e9e-429d-d683-6644-92f7e41aeaeb term=2 tally=1 31:36.590 [INFO] TestAgent.server.raft: election won: tally=1 31:36.590 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30048 [Leader]" 31:36.590 [INFO] TestAgent.server: cluster leadership acquired 31:36.590 [INFO] TestAgent.server: New leader elected: payload=Node-b6336e9e-429d-d683-6644-92f7e41aeaeb 31:36.610 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30048 31:36.658 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.693 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.693 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.693 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.693 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.693 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.693 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b6336e9e-429d-d683-6644-92f7e41aeaeb 31:36.693 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b6336e9e-429d-d683-6644-92f7e41aeaeb 31:36.720 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.734 [INFO] TestAgent: Requesting shutdown 31:36.734 [INFO] TestAgent.server: shutting down server 31:36.734 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.734 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.734 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.734 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.734 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.734 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.734 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.734 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:36.734 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.734 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.734 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.740 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.744Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.744Z [INFO] agent.router.manager: shutting down 31:36.744 [INFO] TestAgent: consul server down 31:36.744 [INFO] TestAgent: shutdown complete 31:36.744 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30064 network=tcp 31:36.744 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30064 network=udp 31:36.744 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30044 network=tcp 31:37.248 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.248 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodes_MetaFilter (0.87s) === CONT TestAgent_RerouteNewHTTPChecks 2021-10-05T16:31:36.542Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.556Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.611 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6fb11786-6934-caf2-f1ca-0e55e7d7644e Address:127.0.0.1:30111}]" 31:36.611 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30111 [Follower]" leader= 31:36.613 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6fb11786-6934-caf2-f1ca-0e55e7d7644e.dc1 127.0.0.1 31:36.614 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6fb11786-6934-caf2-f1ca-0e55e7d7644e 127.0.0.1 2021-10-05T16:31:36.614Z [INFO] agent.router: Initializing LAN area manager 31:36.614 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30015 network=udp 31:36.614 [INFO] TestAgent.server: Adding LAN server: server="Node-6fb11786-6934-caf2-f1ca-0e55e7d7644e (Addr: tcp/127.0.0.1:30111) (DC: dc1)" 31:36.614 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6fb11786-6934-caf2-f1ca-0e55e7d7644e.dc1 area=wan 31:36.614 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30015 network=tcp 31:36.615 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30030 network=tcp 31:36.615 [INFO] TestAgent: started state syncer 31:36.615 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30112 network=tcp 31:36.679 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.679 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30111 [Candidate]" term=2 31:36.698 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.698 [DEBUG] TestAgent.server.raft: vote granted: from=6fb11786-6934-caf2-f1ca-0e55e7d7644e term=2 tally=1 31:36.698 [INFO] TestAgent.server.raft: election won: tally=1 31:36.698 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30111 [Leader]" 31:36.698 [INFO] TestAgent.server: cluster leadership acquired 31:36.699 [INFO] TestAgent.server: New leader elected: payload=Node-6fb11786-6934-caf2-f1ca-0e55e7d7644e 31:36.709 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30111 31:36.746 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.773 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.773 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.773 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.773 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.773 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.773 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6fb11786-6934-caf2-f1ca-0e55e7d7644e 31:36.773 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6fb11786-6934-caf2-f1ca-0e55e7d7644e 31:36.788 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.796 [INFO] TestAgent: Requesting shutdown 31:36.796 [INFO] TestAgent.server: shutting down server 31:36.796 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.796 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.796 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.796 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.796 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.796 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.796 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.796 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:36.796 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.796 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.796 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.804 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.817Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.817Z [INFO] agent.router.manager: shutting down 31:36.817 [INFO] TestAgent: consul server down 31:36.817 [INFO] TestAgent: shutdown complete 31:36.817 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30015 network=tcp 31:36.817 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30015 network=udp 31:36.817 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30030 network=tcp 31:37.319 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.319 [INFO] TestAgent: Endpoints down [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! --- PASS: TestCatalogDatacenters (0.81s) === CONT TestAgent_RerouteExistingHTTPChecks 2021-10-05T16:31:36.399Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.413Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.451 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67 Address:127.0.0.1:30062}]" 31:36.451 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30062 [Follower]" leader= 31:36.452 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67.dc1 127.0.0.1 31:36.454 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67 127.0.0.1 2021-10-05T16:31:36.454Z [INFO] agent.router: Initializing LAN area manager 31:36.454 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30036 network=udp 31:36.454 [INFO] TestAgent.server: Adding LAN server: server="Node-3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67 (Addr: tcp/127.0.0.1:30062) (DC: dc1)" 31:36.454 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67.dc1 area=wan 31:36.454 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30036 network=tcp 31:36.455 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30023 network=tcp 31:36.455 [INFO] TestAgent: started state syncer 31:36.455 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30063 network=tcp 31:36.519 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.519 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30062 [Candidate]" term=2 31:36.543 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.543 [DEBUG] TestAgent.server.raft: vote granted: from=3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67 term=2 tally=1 31:36.543 [INFO] TestAgent.server.raft: election won: tally=1 31:36.543 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30062 [Leader]" 31:36.544 [INFO] TestAgent.server: cluster leadership acquired 31:36.544 [INFO] TestAgent.server: New leader elected: payload=Node-3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67 31:36.563 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30062 31:36.598 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.643 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.643 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.643 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.643 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.643 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.643 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67 31:36.643 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3e4ddb12-f2b8-9a7e-6cca-7d7f27894a67 31:36.660 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.665 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:36.672 [INFO] TestAgent: Synced node info 31:36.859 [INFO] TestAgent: Requesting shutdown 31:36.859 [INFO] TestAgent.server: shutting down server 31:36.859 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.859 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.859 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.859 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.859 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.859 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.859 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.859 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.859 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.859 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.864 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.876Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.876Z [INFO] agent.router.manager: shutting down 31:36.876 [INFO] TestAgent: consul server down 31:36.876 [INFO] TestAgent: shutdown complete 31:36.876 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30036 network=tcp 31:36.876 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30036 network=udp 31:36.876 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30023 network=tcp 31:37.376 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.376 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodes_Filter (1.00s) === CONT TestAgent_consulConfig_RaftTrailingLogs 2021-10-05T16:31:36.492Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.515Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.593 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7636d4cb-5a0e-2052-3fc8-20acb6214378 Address:127.0.0.1:30069}]" 31:36.594 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7636d4cb-5a0e-2052-3fc8-20acb6214378.dc1 127.0.0.1 31:36.595 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7636d4cb-5a0e-2052-3fc8-20acb6214378 127.0.0.1 2021-10-05T16:31:36.595Z [INFO] agent.router: Initializing LAN area manager 31:36.595 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30069 [Follower]" leader= 31:36.595 [INFO] TestAgent.server: Adding LAN server: server="Node-7636d4cb-5a0e-2052-3fc8-20acb6214378 (Addr: tcp/127.0.0.1:30069) (DC: dc1)" 31:36.596 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7636d4cb-5a0e-2052-3fc8-20acb6214378.dc1 area=wan 31:36.596 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30106 network=udp 31:36.596 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30106 network=tcp 31:36.596 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30093 network=tcp 31:36.597 [INFO] TestAgent: started state syncer 31:36.597 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30070 network=tcp 31:36.659 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.659 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30069 [Candidate]" term=2 31:36.675 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.675 [DEBUG] TestAgent.server.raft: vote granted: from=7636d4cb-5a0e-2052-3fc8-20acb6214378 term=2 tally=1 31:36.675 [INFO] TestAgent.server.raft: election won: tally=1 31:36.675 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30069 [Leader]" 31:36.675 [INFO] TestAgent.server: cluster leadership acquired 31:36.675 [INFO] TestAgent.server: New leader elected: payload=Node-7636d4cb-5a0e-2052-3fc8-20acb6214378 31:36.682 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30069 31:36.714 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.739 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.739 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.739 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.739 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.739 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.739 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7636d4cb-5a0e-2052-3fc8-20acb6214378 31:36.739 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7636d4cb-5a0e-2052-3fc8-20acb6214378 31:36.763 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.886 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:36.903 [INFO] TestAgent: Synced node info 31:36.903 [DEBUG] TestAgent: Node info in sync 31:36.927 [INFO] TestAgent: Requesting shutdown 31:36.927 [INFO] TestAgent.server: shutting down server 31:36.927 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.928 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.928 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.928 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.928 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.928 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.928 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.928 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.928 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.933 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:36.940Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.940Z [INFO] agent.router.manager: shutting down 31:36.941 [INFO] TestAgent: consul server down 31:36.941 [INFO] TestAgent: shutdown complete 31:36.941 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30106 network=tcp 31:36.941 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30106 network=udp 31:36.941 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30093 network=tcp 31:37.442 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.442 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodes (0.98s) === CONT TestAgent_consulConfig_AutoEncryptAllowTLS [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:36.672Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.686Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.735 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f9dee954-19b2-aeae-d6ec-854464a3f9ff Address:127.0.0.1:30097}]" 31:36.735 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f9dee954-19b2-aeae-d6ec-854464a3f9ff.dc1 127.0.0.1 31:36.736 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f9dee954-19b2-aeae-d6ec-854464a3f9ff 127.0.0.1 2021-10-05T16:31:36.736Z [INFO] agent.router: Initializing LAN area manager 31:36.736 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30113 network=udp 31:36.736 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30097 [Follower]" leader= 31:36.737 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f9dee954-19b2-aeae-d6ec-854464a3f9ff.dc1 area=wan 31:36.737 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30113 network=tcp 31:36.737 [INFO] TestAgent.server: Adding LAN server: server="Node-f9dee954-19b2-aeae-d6ec-854464a3f9ff (Addr: tcp/127.0.0.1:30097) (DC: dc1)" 31:36.737 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30114 network=tcp 31:36.737 [INFO] TestAgent: started state syncer 31:36.737 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30098 network=tcp 31:36.784 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.784 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30097 [Candidate]" term=2 31:36.801 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.801 [DEBUG] TestAgent.server.raft: vote granted: from=f9dee954-19b2-aeae-d6ec-854464a3f9ff term=2 tally=1 31:36.801 [INFO] TestAgent.server.raft: election won: tally=1 31:36.801 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30097 [Leader]" 31:36.801 [INFO] TestAgent.server: cluster leadership acquired 31:36.801 [INFO] TestAgent.server: New leader elected: payload=Node-f9dee954-19b2-aeae-d6ec-854464a3f9ff 31:36.821 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30097 31:36.856 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.930 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.930 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.930 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.930 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.930 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.930 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f9dee954-19b2-aeae-d6ec-854464a3f9ff 31:36.930 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f9dee954-19b2-aeae-d6ec-854464a3f9ff 31:36.951 [INFO] TestAgent.server: federation state anti-entropy synced 31:37.120 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:37.136 [INFO] TestAgent: Synced node info 31:37.168 [INFO] TestAgent: Requesting shutdown 31:37.168 [INFO] TestAgent.server: shutting down server 31:37.168 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:37.168 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:37.168 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:37.168 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:37.168 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.168 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:37.168 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:37.168 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:37.168 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:37.168 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:37.176 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:37.180Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.180Z [INFO] agent.router.manager: shutting down 31:37.180 [INFO] TestAgent: consul server down 31:37.180 [INFO] TestAgent: shutdown complete 31:37.180 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30113 network=tcp 31:37.181 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30113 network=udp 31:37.181 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30114 network=tcp 31:37.681 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.681 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogDeregister (1.03s) === CONT TestAgent_ReloadConfigTLSConfigFailure === CONT TestAgent_JoinWAN_viaMeshGateway agent_test.go:4395: routing {bob.,}server.dc1.consul => 127.0.0.1:30142 agent_test.go:4396: routing {betty.,}server.dc2.consul => 127.0.0.1:30128 agent_test.go:4397: routing {bonnie.,}server.dc3.consul => 127.0.0.1:30129 2021-10-05T16:31:37.052Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.067Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.124 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1a552e86-6965-f97e-e77e-3e1eccadf9ee Address:127.0.0.1:30125}]" 31:37.124 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30125 [Follower]" leader= 31:37.124 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1a552e86-6965-f97e-e77e-3e1eccadf9ee.dc1 127.0.0.1 31:37.125 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1a552e86-6965-f97e-e77e-3e1eccadf9ee 127.0.0.1 2021-10-05T16:31:37.125Z [INFO] agent.router: Initializing LAN area manager 31:37.125 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30099 network=udp 31:37.126 [INFO] TestAgent.server: Adding LAN server: server="Node-1a552e86-6965-f97e-e77e-3e1eccadf9ee (Addr: tcp/127.0.0.1:30125) (DC: dc1)" 31:37.126 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1a552e86-6965-f97e-e77e-3e1eccadf9ee.dc1 area=wan 31:37.126 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30099 network=tcp 31:37.126 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30107 network=tcp 31:37.126 [INFO] TestAgent: started state syncer 31:37.126 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30126 network=tcp 31:37.183 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.183 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30125 [Candidate]" term=2 31:37.208 [DEBUG] TestAgent.server.raft: votes: needed=1 31:37.208 [DEBUG] TestAgent.server.raft: vote granted: from=1a552e86-6965-f97e-e77e-3e1eccadf9ee term=2 tally=1 31:37.208 [INFO] TestAgent.server.raft: election won: tally=1 31:37.208 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30125 [Leader]" 31:37.212 [INFO] TestAgent.server: cluster leadership acquired 31:37.212 [INFO] TestAgent.server: New leader elected: payload=Node-1a552e86-6965-f97e-e77e-3e1eccadf9ee 31:37.225 [INFO] TestAgent: Requesting shutdown 31:37.225 [INFO] TestAgent.server: shutting down server 31:37.225 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.225 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:37.232 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:37.232 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30125 2021-10-05T16:31:37.240Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.240Z [INFO] agent.router.manager: shutting down 31:37.249 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:37.249 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:37.249 [INFO] TestAgent: consul server down 31:37.249 [INFO] TestAgent: shutdown complete 31:37.249 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30099 network=tcp 31:37.249 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30099 network=udp 31:37.249 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30107 network=tcp 31:37.752 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.752 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogRegister_Service_InvalidAddress (0.74s) --- PASS: TestCatalogRegister_Service_InvalidAddress/addr_0.0.0.0 (0.00s) --- PASS: TestCatalogRegister_Service_InvalidAddress/addr_:: (0.00s) --- PASS: TestCatalogRegister_Service_InvalidAddress/addr_[::] (0.00s) === CONT TestAgent_ReloadConfigIncomingRPCConfig [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:36.486Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:36.486Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.521Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:36.521Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.610 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b86e4c3e-b84d-aeab-9487-522c74062f4d Address:127.0.0.1:30013}]" 31:36.610 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30013 [Follower]" leader= 31:36.611 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b86e4c3e-b84d-aeab-9487-522c74062f4d.dc2 127.0.0.1 31:36.612 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b86e4c3e-b84d-aeab-9487-522c74062f4d 127.0.0.1 2021-10-05T16:31:36.612Z [INFO] agent.router: Initializing LAN area manager 31:36.612 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30071 network=udp 31:36.612 [INFO] TestAgent.server: Adding LAN server: server="Node-b86e4c3e-b84d-aeab-9487-522c74062f4d (Addr: tcp/127.0.0.1:30013) (DC: dc2)" 31:36.612 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b86e4c3e-b84d-aeab-9487-522c74062f4d.dc2 area=wan 31:36.613 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30071 network=tcp 31:36.613 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30072 network=tcp 31:36.613 [INFO] TestAgent: started state syncer 31:36.613 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30014 network=tcp 31:36.664 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:36.669 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.669 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30013 [Candidate]" term=2 31:36.691 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.691 [DEBUG] TestAgent.server.raft: vote granted: from=b86e4c3e-b84d-aeab-9487-522c74062f4d term=2 tally=1 31:36.691 [INFO] TestAgent.server.raft: election won: tally=1 31:36.691 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30013 [Leader]" 31:36.691 [INFO] TestAgent.server: cluster leadership acquired 31:36.691 [INFO] TestAgent.server: New leader elected: payload=Node-b86e4c3e-b84d-aeab-9487-522c74062f4d 31:36.701 [INFO] TestAgent.server: initializing acls 31:36.709 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:36.721 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:36.721 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:36.721 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:36.721 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-b86e4c3e-b84d-aeab-9487-522c74062f4d 31:36.721 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-b86e4c3e-b84d-aeab-9487-522c74062f4d.dc2 31:36.721 [INFO] TestAgent.server: Updating LAN server: server="Node-b86e4c3e-b84d-aeab-9487-522c74062f4d (Addr: tcp/127.0.0.1:30013) (DC: dc2)" 31:36.721 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-b86e4c3e-b84d-aeab-9487-522c74062f4d.dc2 area=wan 31:36.760 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.790 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.790 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.790 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.790 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.790 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.790 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b86e4c3e-b84d-aeab-9487-522c74062f4d 31:36.790 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b86e4c3e-b84d-aeab-9487-522c74062f4d 31:36.800 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b86e4c3e-b84d-aeab-9487-522c74062f4d 31:36.817 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.908 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:30033] 31:36.908 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:30033 31:36.911 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f4719165-1ede-f617-6840-8c1098c9744f.dc1 127.0.0.1 31:36.911 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:36.912 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f4719165-1ede-f617-6840-8c1098c9744f.dc1 area=wan 31:36.926 [INFO] TestAgent: Requesting shutdown 31:36.926 [INFO] TestAgent.server: shutting down server 31:36.926 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:36.926 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:36.926 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:36.926 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:36.926 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:36.926 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:36.926 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:36.926 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:36.926 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:36.926 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:36.926 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:36.926 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:36.926 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:36.926 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:36.928 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:36.940 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:36.942 [INFO] TestAgent: Synced node info 2021-10-05T16:31:36.948Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.948Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:36.948Z [INFO] agent.router.manager: shutting down 31:36.948 [INFO] TestAgent: consul server down 31:36.948 [INFO] TestAgent: shutdown complete 31:36.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30071 network=tcp 31:36.948 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30071 network=udp 31:36.948 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30072 network=tcp 31:37.448 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.448 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:36.189Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:36.189Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.207Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:36.207Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.248 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f4719165-1ede-f617-6840-8c1098c9744f Address:127.0.0.1:30034}]" 31:36.248 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30034 [Follower]" leader= 31:36.249 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f4719165-1ede-f617-6840-8c1098c9744f.dc1 127.0.0.1 31:36.249 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f4719165-1ede-f617-6840-8c1098c9744f 127.0.0.1 2021-10-05T16:31:36.249Z [INFO] agent.router: Initializing LAN area manager 31:36.249 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30043 network=udp 31:36.249 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f4719165-1ede-f617-6840-8c1098c9744f.dc1 area=wan 31:36.249 [INFO] TestAgent.server: Adding LAN server: server="Node-f4719165-1ede-f617-6840-8c1098c9744f (Addr: tcp/127.0.0.1:30034) (DC: dc1)" 31:36.250 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30043 network=tcp 31:36.250 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30058 network=tcp 31:36.250 [INFO] TestAgent: started state syncer 31:36.250 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30035 network=tcp 31:36.300 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:36.314 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.314 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30034 [Candidate]" term=2 31:36.333 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.333 [DEBUG] TestAgent.server.raft: vote granted: from=f4719165-1ede-f617-6840-8c1098c9744f term=2 tally=1 31:36.333 [INFO] TestAgent.server.raft: election won: tally=1 31:36.333 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30034 [Leader]" 31:36.334 [INFO] TestAgent.server: cluster leadership acquired 31:36.334 [INFO] TestAgent.server: New leader elected: payload=Node-f4719165-1ede-f617-6840-8c1098c9744f 31:36.339 [INFO] TestAgent.server: initializing acls 31:36.343 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:36.356 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:36.356 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:36.356 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:36.356 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:36.356 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f4719165-1ede-f617-6840-8c1098c9744f 31:36.356 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f4719165-1ede-f617-6840-8c1098c9744f.dc1 31:36.357 [INFO] TestAgent.server: Updating LAN server: server="Node-f4719165-1ede-f617-6840-8c1098c9744f (Addr: tcp/127.0.0.1:30034) (DC: dc1)" 31:36.357 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f4719165-1ede-f617-6840-8c1098c9744f.dc1 area=wan 31:36.400 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.451 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.451 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.451 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.451 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.451 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.451 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f4719165-1ede-f617-6840-8c1098c9744f 31:36.451 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f4719165-1ede-f617-6840-8c1098c9744f 31:36.463 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f4719165-1ede-f617-6840-8c1098c9744f 31:36.470 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.909 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:40736 31:36.910 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b86e4c3e-b84d-aeab-9487-522c74062f4d.dc2 127.0.0.1 31:36.910 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b86e4c3e-b84d-aeab-9487-522c74062f4d.dc2 area=wan 31:37.031 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:37.041 [INFO] TestAgent: Synced node info 31:37.041 [DEBUG] TestAgent: Node info in sync 31:37.448 [INFO] TestAgent: Requesting shutdown 31:37.448 [INFO] TestAgent.server: shutting down server 31:37.448 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:37.448 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:37.448 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:37.448 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:37.448 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:37.448 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:37.448 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.449 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:37.449 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:37.449 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:37.449 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:37.449 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:37.449 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:37.449 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:37.465 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:37.472Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.472Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.472Z [INFO] agent.router.manager: shutting down 31:37.472 [INFO] TestAgent: consul server down 31:37.472 [INFO] TestAgent: shutdown complete 31:37.472 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30043 network=tcp 31:37.472 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30043 network=udp 31:37.472 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30058 network=tcp 31:37.972 [INFO] TestAgent: Waiting for endpoints to shut down 31:37.972 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogNodes_WanTranslation (1.81s) === CONT TestAgent_ReloadConfigOutgoingRPCConfig [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:37.375Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.411Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.500 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d99d5d14-12b7-5654-5c72-b3aa6b0be399 Address:127.0.0.1:30149}]" 31:37.500 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30149 [Follower]" leader= 31:37.504 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d99d5d14-12b7-5654-5c72-b3aa6b0be399.dc1 127.0.0.1 31:37.505 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d99d5d14-12b7-5654-5c72-b3aa6b0be399 127.0.0.1 2021-10-05T16:31:37.505Z [INFO] agent.router: Initializing LAN area manager 31:37.505 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30137 network=udp 31:37.505 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d99d5d14-12b7-5654-5c72-b3aa6b0be399.dc1 area=wan 31:37.505 [INFO] TestAgent.server: Adding LAN server: server="Node-d99d5d14-12b7-5654-5c72-b3aa6b0be399 (Addr: tcp/127.0.0.1:30149) (DC: dc1)" 31:37.505 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30137 network=tcp 31:37.506 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30138 network=tcp 31:37.506 [INFO] TestAgent: started state syncer 31:37.506 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30143 network=tcp 31:37.556 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.556 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30149 [Candidate]" term=2 31:37.570 [DEBUG] TestAgent.server.raft: votes: needed=1 31:37.570 [DEBUG] TestAgent.server.raft: vote granted: from=d99d5d14-12b7-5654-5c72-b3aa6b0be399 term=2 tally=1 31:37.570 [INFO] TestAgent.server.raft: election won: tally=1 31:37.570 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30149 [Leader]" 31:37.571 [INFO] TestAgent.server: cluster leadership acquired 31:37.571 [INFO] TestAgent.server: New leader elected: payload=Node-d99d5d14-12b7-5654-5c72-b3aa6b0be399 31:37.579 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30149 31:37.599 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:37.644 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:37.644 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:37.644 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:37.644 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:37.644 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:37.644 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d99d5d14-12b7-5654-5c72-b3aa6b0be399 31:37.644 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d99d5d14-12b7-5654-5c72-b3aa6b0be399 31:37.669 [INFO] TestAgent.server: federation state anti-entropy synced 31:37.689 [WARN] TestAgent: check has interval below minimum: check=http minimum_interval=1s 31:37.689 [WARN] TestAgent: check has interval below minimum: check=grpc minimum_interval=1s 31:37.689 [INFO] TestAgent: Requesting shutdown 31:37.689 [INFO] TestAgent.server: shutting down server 31:37.689 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:37.689 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:37.689 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:37.689 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:37.689 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.690 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:37.690 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:37.690 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:37.690 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:37.690 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:37.690 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:37.712 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:37.719Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.719Z [INFO] agent.router.manager: shutting down 31:37.719 [INFO] TestAgent: consul server down 31:37.719 [INFO] TestAgent: shutdown complete 31:37.719 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30137 network=tcp 31:37.719 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30137 network=udp 31:37.719 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30138 network=tcp 31:38.220 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.220 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RerouteExistingHTTPChecks (0.89s) === CONT TestAgent_SecurityChecks 2021-10-05T16:31:37.294Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.368Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.436 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:13bbfd6b-cb40-0c48-768f-ee256a0c174c Address:127.0.0.1:30086}]" 31:37.436 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30086 [Follower]" leader= 31:37.437 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-13bbfd6b-cb40-0c48-768f-ee256a0c174c.dc1 127.0.0.1 31:37.437 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-13bbfd6b-cb40-0c48-768f-ee256a0c174c 127.0.0.1 2021-10-05T16:31:37.437Z [INFO] agent.router: Initializing LAN area manager 31:37.437 [INFO] TestAgent.server: Adding LAN server: server="Node-13bbfd6b-cb40-0c48-768f-ee256a0c174c (Addr: tcp/127.0.0.1:30086) (DC: dc1)" 31:37.437 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30074 network=udp 31:37.437 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-13bbfd6b-cb40-0c48-768f-ee256a0c174c.dc1 area=wan 31:37.437 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30074 network=tcp 31:37.438 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30075 network=tcp 31:37.438 [INFO] TestAgent: started state syncer 31:37.438 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30136 network=tcp 31:37.498 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.498 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30086 [Candidate]" term=2 31:37.510 [DEBUG] TestAgent.server.raft: votes: needed=1 31:37.510 [DEBUG] TestAgent.server.raft: vote granted: from=13bbfd6b-cb40-0c48-768f-ee256a0c174c term=2 tally=1 31:37.510 [INFO] TestAgent.server.raft: election won: tally=1 31:37.510 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30086 [Leader]" 31:37.511 [INFO] TestAgent.server: cluster leadership acquired 31:37.511 [INFO] TestAgent.server: New leader elected: payload=Node-13bbfd6b-cb40-0c48-768f-ee256a0c174c 31:37.520 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30086 31:37.536 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:37.563 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:37.563 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:37.563 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:37.563 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:37.563 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:37.563 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-13bbfd6b-cb40-0c48-768f-ee256a0c174c 31:37.563 [INFO] TestAgent.server: member joined, marking health alive: member=Node-13bbfd6b-cb40-0c48-768f-ee256a0c174c 31:37.579 [INFO] TestAgent.server: federation state anti-entropy synced 31:37.785 [WARN] TestAgent: check has interval below minimum: check=http minimum_interval=1s 31:37.785 [WARN] TestAgent: check has interval below minimum: check=grpc minimum_interval=1s 31:37.785 [INFO] TestAgent: Requesting shutdown 31:37.785 [INFO] TestAgent.server: shutting down server 31:37.785 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:37.785 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:37.785 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:37.785 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:37.785 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.786 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:37.786 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:37.786 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:37.786 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:37.787 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:37.787 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:37.792 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:37.799Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.799Z [INFO] agent.router.manager: shutting down 31:37.799 [INFO] TestAgent: consul server down 31:37.799 [INFO] TestAgent: shutdown complete 31:37.799 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30074 network=tcp 31:37.799 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30074 network=udp 31:37.799 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30075 network=tcp 31:38.299 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.299 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RerouteNewHTTPChecks (1.05s) === CONT TestAgent_loadTokens 2021-10-05T16:31:37.434Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.472Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.549 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:71fdfcc4-03fa-8296-d9e7-47b8abbf6a10 Address:127.0.0.1:30135}]" 31:37.549 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30135 [Follower]" leader= 31:37.550 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-71fdfcc4-03fa-8296-d9e7-47b8abbf6a10.dc1 127.0.0.1 31:37.550 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-71fdfcc4-03fa-8296-d9e7-47b8abbf6a10 127.0.0.1 2021-10-05T16:31:37.550Z [INFO] agent.router: Initializing LAN area manager 31:37.550 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30144 network=udp 31:37.550 [INFO] TestAgent.server: Adding LAN server: server="Node-71fdfcc4-03fa-8296-d9e7-47b8abbf6a10 (Addr: tcp/127.0.0.1:30135) (DC: dc1)" 31:37.551 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-71fdfcc4-03fa-8296-d9e7-47b8abbf6a10.dc1 area=wan 31:37.551 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30144 network=tcp 31:37.551 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30145 network=tcp 31:37.551 [INFO] TestAgent: started state syncer 31:37.551 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30150 network=tcp 31:37.586 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.586 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30135 [Candidate]" term=2 31:37.600 [DEBUG] TestAgent.server.raft: votes: needed=1 31:37.600 [DEBUG] TestAgent.server.raft: vote granted: from=71fdfcc4-03fa-8296-d9e7-47b8abbf6a10 term=2 tally=1 31:37.600 [INFO] TestAgent.server.raft: election won: tally=1 31:37.600 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30135 [Leader]" 31:37.601 [INFO] TestAgent.server: cluster leadership acquired 31:37.601 [INFO] TestAgent.server: New leader elected: payload=Node-71fdfcc4-03fa-8296-d9e7-47b8abbf6a10 31:37.613 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30135 31:37.648 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:37.712 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:37.712 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:37.712 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:37.712 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:37.712 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:37.712 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-71fdfcc4-03fa-8296-d9e7-47b8abbf6a10 31:37.712 [INFO] TestAgent.server: member joined, marking health alive: member=Node-71fdfcc4-03fa-8296-d9e7-47b8abbf6a10 31:37.748 [INFO] TestAgent.server: federation state anti-entropy synced 31:37.784 [INFO] TestAgent: Requesting shutdown 31:37.784 [INFO] TestAgent.server: shutting down server 31:37.784 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:37.784 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:37.784 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:37.784 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:37.784 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.785 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:37.785 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:37.785 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:37.785 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:37.785 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:37.785 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:37.796 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:37.804Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.804Z [INFO] agent.router.manager: shutting down 31:37.804 [INFO] TestAgent: consul server down 31:37.804 [INFO] TestAgent: shutdown complete 31:37.804 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30144 network=tcp 31:37.804 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30144 network=udp 31:37.804 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30145 network=tcp 31:38.305 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.305 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_consulConfig_RaftTrailingLogs (0.92s) === CONT TestAgent_reloadWatchesHTTPS 2021-10-05T16:31:37.461Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.492Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.584 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3d24ea61-3542-96e4-fa85-f24f8b9c85f7 Address:127.0.0.1:30156}]" 31:37.584 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30156 [Follower]" leader= 31:37.584 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7.dc1 127.0.0.1 31:37.585 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7 127.0.0.1 2021-10-05T16:31:37.585Z [INFO] agent.router: Initializing LAN area manager 31:37.585 [INFO] TestAgent.server: Adding LAN server: server="Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7 (Addr: tcp/127.0.0.1:30156) (DC: dc1)" 31:37.585 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30151 network=udp 31:37.585 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7.dc1 area=wan 31:37.585 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30151 network=tcp 31:37.586 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30152 network=tcp 31:37.586 [INFO] TestAgent: started state syncer 31:37.586 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30080 network=tcp 31:37.653 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.653 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30156 [Candidate]" term=2 31:37.674 [DEBUG] TestAgent.server.raft: votes: needed=1 31:37.674 [DEBUG] TestAgent.server.raft: vote granted: from=3d24ea61-3542-96e4-fa85-f24f8b9c85f7 term=2 tally=1 31:37.674 [INFO] TestAgent.server.raft: election won: tally=1 31:37.674 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30156 [Leader]" 31:37.674 [INFO] TestAgent.server: cluster leadership acquired 31:37.674 [INFO] TestAgent.server: New leader elected: payload=Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7 31:37.688 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30156 31:37.748 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:37.789 [INFO] TestAgent: Requesting shutdown 31:37.789 [INFO] TestAgent.server: shutting down server 31:37.789 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.789 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:37.789 [INFO] TestAgent.server: shutting down Connect CA roots monitor 31:37.796 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:37.803 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:37.803 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:37.803 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:37.803 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:37.803 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:37.803 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7 31:37.803 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7 2021-10-05T16:31:37.803Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.803Z [INFO] agent.router.manager: shutting down 31:37.803 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:37.803 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:37.803 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:37.803 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:37.803 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:37.813 [INFO] TestAgent: consul server down 31:37.813 [INFO] TestAgent: shutdown complete 31:37.813 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30151 network=tcp 31:37.813 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30151 network=udp 31:37.813 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30152 network=tcp 31:37.813 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-3d24ea61-3542-96e4-fa85-f24f8b9c85f7 127.0.0.1 30154 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:3d24ea61-3542-96e4-fa85-f24f8b9c85f7 port:30156 raft_vsn:3 role:consul segment: use_tls:1 vsn:2 vsn_max:3 vsn_min:2 wan_join_port:30155] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:37.813 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:37.813 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:37.813 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:37.813 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:37.813 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:37.813 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:37.813 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:37.813 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:38.325 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.325 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_consulConfig_AutoEncryptAllowTLS (0.88s) === CONT TestAgent_reloadWatches [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:36.430Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:36.445Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:36.519 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c64765a2-919b-0da1-c797-d0bb5b5991e5 Address:127.0.0.1:30104}]" 31:36.520 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30104 [Follower]" leader= 31:36.520 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c64765a2-919b-0da1-c797-d0bb5b5991e5.dc1 127.0.0.1 31:36.521 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c64765a2-919b-0da1-c797-d0bb5b5991e5 127.0.0.1 2021-10-05T16:31:36.522Z [INFO] agent.router: Initializing LAN area manager 31:36.522 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30050 network=udp 31:36.522 [INFO] TestAgent.server: Adding LAN server: server="Node-c64765a2-919b-0da1-c797-d0bb5b5991e5 (Addr: tcp/127.0.0.1:30104) (DC: dc1)" 31:36.522 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c64765a2-919b-0da1-c797-d0bb5b5991e5.dc1 area=wan 31:36.522 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30050 network=tcp 31:36.523 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30065 network=tcp 31:36.523 [INFO] TestAgent: started state syncer 31:36.523 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30105 network=tcp 31:36.568 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:36.568 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30104 [Candidate]" term=2 31:36.596 [DEBUG] TestAgent.server.raft: votes: needed=1 31:36.596 [DEBUG] TestAgent.server.raft: vote granted: from=c64765a2-919b-0da1-c797-d0bb5b5991e5 term=2 tally=1 31:36.596 [INFO] TestAgent.server.raft: election won: tally=1 31:36.596 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30104 [Leader]" 31:36.596 [INFO] TestAgent.server: cluster leadership acquired 31:36.596 [INFO] TestAgent.server: New leader elected: payload=Node-c64765a2-919b-0da1-c797-d0bb5b5991e5 31:36.608 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30104 31:36.640 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:36.677 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:36.677 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:36.677 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:36.677 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:36.677 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:36.677 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c64765a2-919b-0da1-c797-d0bb5b5991e5 31:36.677 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c64765a2-919b-0da1-c797-d0bb5b5991e5 31:36.709 [INFO] TestAgent.server: federation state anti-entropy synced 31:36.802 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:36.815 [INFO] TestAgent: Synced node info 31:36.815 [DEBUG] TestAgent: Node info in sync 31:37.713 [WARN] TestAgent.server.rpc: Attempting to apply large raft entry: size_in_bytes=4719032 31:37.848 [INFO] TestAgent: Requesting shutdown 31:37.848 [INFO] TestAgent.server: shutting down server 31:37.848 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:37.848 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:37.848 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:37.848 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:37.848 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:37.848 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:37.848 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:37.848 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:37.848 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:37.848 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:37.860 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:37.865Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:37.865Z [INFO] agent.router.manager: shutting down 31:37.865 [INFO] TestAgent: consul server down 31:37.865 [INFO] TestAgent: shutdown complete 31:37.865 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30050 network=tcp 31:37.865 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30050 network=udp 31:37.865 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30065 network=tcp 31:38.365 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.365 [INFO] TestAgent: Endpoints down === RUN TestTxnEndpoint_Bad_Size_Net/allowed_kv_max_backward_compatible [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:38.088Z [WARN] TestAgent_ReloadConfigIncomingRPCConfig: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.807Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.824Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.858 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0c086b67-e9ec-5197-8aaa-37a94e669776 Address:127.0.0.1:30163}]" 31:37.859 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0c086b67-e9ec-5197-8aaa-37a94e669776.dc1 127.0.0.1 31:37.859 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0c086b67-e9ec-5197-8aaa-37a94e669776 127.0.0.1 2021-10-05T16:31:37.859Z [INFO] agent.router: Initializing LAN area manager 31:37.860 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30158 network=udp 31:37.860 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30163 [Follower]" leader= 31:37.860 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0c086b67-e9ec-5197-8aaa-37a94e669776.dc1 area=wan 31:37.860 [INFO] TestAgent.server: Adding LAN server: server="Node-0c086b67-e9ec-5197-8aaa-37a94e669776 (Addr: tcp/127.0.0.1:30163) (DC: dc1)" 31:37.860 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30158 network=tcp 31:37.860 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30159 network=tcp 31:37.861 [INFO] TestAgent: started state syncer 31:37.861 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30164 network=tcp 31:37.911 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.911 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30163 [Candidate]" term=2 31:37.927 [DEBUG] TestAgent.server.raft: votes: needed=1 31:37.927 [DEBUG] TestAgent.server.raft: vote granted: from=0c086b67-e9ec-5197-8aaa-37a94e669776 term=2 tally=1 31:37.927 [INFO] TestAgent.server.raft: election won: tally=1 31:37.927 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30163 [Leader]" 31:37.928 [INFO] TestAgent.server: cluster leadership acquired 31:37.928 [INFO] TestAgent.server: New leader elected: payload=Node-0c086b67-e9ec-5197-8aaa-37a94e669776 31:37.938 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30163 31:37.961 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:37.998 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:37.998 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:37.998 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:37.998 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:37.998 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:37.998 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0c086b67-e9ec-5197-8aaa-37a94e669776 31:37.998 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0c086b67-e9ec-5197-8aaa-37a94e669776 31:38.014 [INFO] TestAgent.server: federation state anti-entropy synced 31:38.090 [INFO] TestAgent: Requesting shutdown 31:38.090 [INFO] TestAgent.server: shutting down server 31:38.090 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:38.090 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:38.090 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:38.094 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:38.098Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:38.098Z [INFO] agent.router.manager: shutting down 31:38.098 [INFO] TestAgent: consul server down 31:38.098 [INFO] TestAgent: shutdown complete 31:38.098 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30158 network=tcp 31:38.098 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30158 network=udp 31:38.098 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30159 network=tcp 31:38.600 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.600 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ReloadConfigIncomingRPCConfig (0.83s) === CONT TestAgent_GetCoordinate 2021-10-05T16:31:38.112Z [WARN] TestAgent_ReloadConfigTLSConfigFailure: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.719Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.788Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.865 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:37f5fad2-b1e1-a077-62e2-c29a5be5607c Address:127.0.0.1:30100}]" 31:37.866 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-37f5fad2-b1e1-a077-62e2-c29a5be5607c.dc1 127.0.0.1 31:37.867 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-37f5fad2-b1e1-a077-62e2-c29a5be5607c 127.0.0.1 2021-10-05T16:31:37.867Z [INFO] agent.router: Initializing LAN area manager 31:37.867 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30081 network=udp 31:37.867 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30100 [Follower]" leader= 31:37.867 [INFO] TestAgent.server: Adding LAN server: server="Node-37f5fad2-b1e1-a077-62e2-c29a5be5607c (Addr: tcp/127.0.0.1:30100) (DC: dc1)" 31:37.867 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-37f5fad2-b1e1-a077-62e2-c29a5be5607c.dc1 area=wan 31:37.867 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30081 network=tcp 31:37.868 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30082 network=tcp 31:37.868 [INFO] TestAgent: started state syncer 31:37.868 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30157 network=tcp 31:37.908 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.908 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30100 [Candidate]" term=2 31:37.928 [DEBUG] TestAgent.server.raft: votes: needed=1 31:37.928 [DEBUG] TestAgent.server.raft: vote granted: from=37f5fad2-b1e1-a077-62e2-c29a5be5607c term=2 tally=1 31:37.928 [INFO] TestAgent.server.raft: election won: tally=1 31:37.928 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30100 [Leader]" 31:37.928 [INFO] TestAgent.server: cluster leadership acquired 31:37.928 [INFO] TestAgent.server: New leader elected: payload=Node-37f5fad2-b1e1-a077-62e2-c29a5be5607c 31:37.948 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30100 31:37.948 [INFO] TestAgent: Synced node info 31:37.948 [DEBUG] TestAgent: Node info in sync 31:37.980 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:38.037 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:38.038 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:38.038 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:38.038 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:38.038 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:38.038 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-37f5fad2-b1e1-a077-62e2-c29a5be5607c 31:38.038 [INFO] TestAgent.server: member joined, marking health alive: member=Node-37f5fad2-b1e1-a077-62e2-c29a5be5607c 31:38.049 [INFO] TestAgent.server: federation state anti-entropy synced 31:38.112 [INFO] TestAgent: Requesting shutdown 31:38.112 [INFO] TestAgent.server: shutting down server 31:38.112 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:38.112 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:38.116 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:38.120Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:38.120Z [INFO] agent.router.manager: shutting down 31:38.120 [INFO] TestAgent: consul server down 31:38.120 [INFO] TestAgent: shutdown complete 31:38.120 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30081 network=tcp 31:38.120 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30081 network=udp 31:38.120 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30082 network=tcp 31:38.622 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.622 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ReloadConfigTLSConfigFailure (0.94s) === CONT TestAgent_purgeCheckState === RUN TestAgent_loadTokens/original-configuration === RUN TestAgent_loadTokens/updated-configuration === RUN TestAgent_loadTokens/persisted-tokens === RUN TestAgent_loadTokens/persisted-tokens-override === RUN TestAgent_loadTokens/partial-persisted === RUN TestAgent_loadTokens/persistence-error-not-json === RUN TestAgent_loadTokens/persistence-error-wrong-top-level 2021-10-05T16:31:38.224Z [WARN] TestAgent_ReloadConfigOutgoingRPCConfig: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.007Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.034Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.083 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 Address:127.0.0.1:30170}]" 31:38.084 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30170 [Follower]" leader= 31:38.084 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bd7782ce-a2ab-5e11-4e52-4d82f8ad6343.dc1 127.0.0.1 31:38.085 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 127.0.0.1 2021-10-05T16:31:38.085Z [INFO] agent.router: Initializing LAN area manager 31:38.085 [INFO] TestAgent.server: Adding LAN server: server="Node-bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 (Addr: tcp/127.0.0.1:30170) (DC: dc1)" 31:38.085 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bd7782ce-a2ab-5e11-4e52-4d82f8ad6343.dc1 area=wan 31:38.085 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30165 network=udp 31:38.085 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30165 network=tcp 31:38.086 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30166 network=tcp 31:38.086 [INFO] TestAgent: started state syncer 31:38.086 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30171 network=tcp 31:38.151 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.151 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30170 [Candidate]" term=2 31:38.164 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.164 [DEBUG] TestAgent.server.raft: vote granted: from=bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 term=2 tally=1 31:38.164 [INFO] TestAgent.server.raft: election won: tally=1 31:38.164 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30170 [Leader]" 31:38.164 [INFO] TestAgent.server: cluster leadership acquired 31:38.164 [INFO] TestAgent.server: New leader elected: payload=Node-bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 31:38.173 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30170 31:38.188 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:38.225 [INFO] TestAgent: Requesting shutdown 31:38.225 [INFO] TestAgent.server: shutting down server 31:38.225 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:38.225 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:38.226 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:38.226 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:38.226 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:38.226 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:38.226 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:38.226 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 31:38.229 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:38.234Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:38.234Z [INFO] agent.router.manager: shutting down 31:38.249 [INFO] TestAgent: consul server down 31:38.249 [INFO] TestAgent: shutdown complete 31:38.249 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30165 network=tcp 31:38.249 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30165 network=udp 31:38.249 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30166 network=tcp 31:38.249 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 127.0.0.1 30168 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:bd7782ce-a2ab-5e11-4e52-4d82f8ad6343 port:30170 raft_vsn:3 role:consul segment: use_tls:1 vsn:2 vsn_max:3 vsn_min:2 wan_join_port:30169] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:38.750 [INFO] TestAgent: Waiting for endpoints to shut down 31:38.750 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ReloadConfigOutgoingRPCConfig (0.78s) === CONT TestAgent_loadCheckState [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! --- PASS: TestAgent_SecurityChecks (0.84s) === CONT TestAgent_persistCheckState [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:38.328Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.341Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.385 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:af7f633f-c516-f1ed-214a-2afaa66b93d3 Address:127.0.0.1:30177}]" 31:38.385 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-af7f633f-c516-f1ed-214a-2afaa66b93d3.dc1 127.0.0.1 31:38.386 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-af7f633f-c516-f1ed-214a-2afaa66b93d3 127.0.0.1 2021-10-05T16:31:38.386Z [INFO] agent.router: Initializing LAN area manager 31:38.386 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30186 network=udp 31:38.386 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30177 [Follower]" leader= 31:38.387 [INFO] TestAgent.server: Adding LAN server: server="Node-af7f633f-c516-f1ed-214a-2afaa66b93d3 (Addr: tcp/127.0.0.1:30177) (DC: dc1)" 31:38.387 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-af7f633f-c516-f1ed-214a-2afaa66b93d3.dc1 area=wan 31:38.387 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30186 network=tcp 31:38.387 [INFO] TestAgent: Started HTTPS server: address=127.0.0.1:30188 network=tcp 31:38.387 [INFO] TestAgent: started state syncer 31:38.387 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30216 network=tcp 31:38.450 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.450 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30177 [Candidate]" term=2 31:38.463 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.463 [DEBUG] TestAgent.server.raft: vote granted: from=af7f633f-c516-f1ed-214a-2afaa66b93d3 term=2 tally=1 31:38.463 [INFO] TestAgent.server.raft: election won: tally=1 31:38.463 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30177 [Leader]" 31:38.463 [INFO] TestAgent.server: cluster leadership acquired 31:38.463 [INFO] TestAgent.server: New leader elected: payload=Node-af7f633f-c516-f1ed-214a-2afaa66b93d3 31:38.473 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30177 31:38.491 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:38.543 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:38.543 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:38.543 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:38.543 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:38.543 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:38.543 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-af7f633f-c516-f1ed-214a-2afaa66b93d3 31:38.543 [INFO] TestAgent.server: member joined, marking health alive: member=Node-af7f633f-c516-f1ed-214a-2afaa66b93d3 31:38.568 [INFO] TestAgent.server: federation state anti-entropy synced 31:38.643 [INFO] TestAgent: Requesting shutdown 31:38.643 [INFO] TestAgent.server: shutting down server 31:38.643 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:38.643 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:38.643 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:38.643 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:38.643 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:38.643 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:38.643 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:38.643 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:38.643 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:38.643 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:38.643 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:38.656 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:38.668Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:38.668Z [INFO] agent.router.manager: shutting down 31:38.668 [INFO] TestAgent: consul server down 31:38.668 [INFO] TestAgent: shutdown complete 31:38.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30186 network=tcp 31:38.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30186 network=udp 31:38.668 [INFO] TestAgent: Stopping server: protocol=HTTPS address=127.0.0.1:30188 network=tcp 31:39.176 [INFO] TestAgent: Waiting for endpoints to shut down 31:39.176 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_reloadWatchesHTTPS (0.87s) === CONT TestAgent_loadChecks_checkFails 2021-10-05T16:31:38.358Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.374Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.429 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5c2e290b-f5ef-c583-c17c-f72444da5ebb Address:127.0.0.1:30198}]" 31:38.430 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb.dc1 127.0.0.1 31:38.431 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb 127.0.0.1 2021-10-05T16:31:38.431Z [INFO] agent.router: Initializing LAN area manager 31:38.431 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30179 network=udp 31:38.431 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30198 [Follower]" leader= 31:38.431 [INFO] TestAgent.server: Adding LAN server: server="Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb (Addr: tcp/127.0.0.1:30198) (DC: dc1)" 31:38.432 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb.dc1 area=wan 31:38.432 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30179 network=tcp 31:38.432 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30180 network=tcp 31:38.432 [INFO] TestAgent: started state syncer 31:38.432 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30185 network=tcp 31:38.482 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:38.500 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.500 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30198 [Candidate]" term=2 31:38.549 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.549 [DEBUG] TestAgent.server.raft: vote granted: from=5c2e290b-f5ef-c583-c17c-f72444da5ebb term=2 tally=1 31:38.549 [INFO] TestAgent.server.raft: election won: tally=1 31:38.549 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30198 [Leader]" 31:38.550 [INFO] TestAgent.server: cluster leadership acquired 31:38.550 [INFO] TestAgent.server: New leader elected: payload=Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb 31:38.556 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:38.568 [INFO] TestAgent.server: initializing acls 31:38.582 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:38.584 [INFO] TestAgent.server: initializing acls 31:38.596 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:38.596 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:38.596 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:38.608 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb 31:38.608 [INFO] TestAgent.server: Updating LAN server: server="Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb (Addr: tcp/127.0.0.1:30198) (DC: dc1)" 31:38.608 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb.dc1 31:38.608 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb.dc1 area=wan 31:38.624 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:38.624 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:38.624 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb 31:38.624 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb.dc1 31:38.624 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb.dc1 area=wan 31:38.624 [INFO] TestAgent.server: Updating LAN server: server="Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb (Addr: tcp/127.0.0.1:30198) (DC: dc1)" 31:38.645 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:38.663 [WARN] TestAgent: "default" token present in both the configuration and persisted token store, using the persisted token 31:38.663 [WARN] TestAgent: "agent" token present in both the configuration and persisted token store, using the persisted token 31:38.663 [WARN] TestAgent: "agent_master" token present in both the configuration and persisted token store, using the persisted token 31:38.663 [WARN] TestAgent: "replication" token present in both the configuration and persisted token store, using the persisted token 31:38.663 [WARN] TestAgent: "default" token present in both the configuration and persisted token store, using the persisted token 31:38.663 [WARN] TestAgent: "agent" token present in both the configuration and persisted token store, using the persisted token 31:38.663 [WARN] TestAgent: "agent_master" token present in both the configuration and persisted token store, using the persisted token 31:38.663 [WARN] TestAgent: "replication" token present in both the configuration and persisted token store, using the persisted token 31:38.672 [WARN] TestAgent: "agent" token present in both the configuration and persisted token store, using the persisted token 31:38.672 [WARN] TestAgent: "agent_master" token present in both the configuration and persisted token store, using the persisted token 31:38.708 [WARN] TestAgent: unable to load persisted tokens: error="failed to decode tokens file "/tmp/consul-test/TestAgent_loadTokens-TestAgent-agent029863868/acl-tokens.json": invalid character '\x01' looking for beginning of value" 31:38.711 [WARN] TestAgent: unable to load persisted tokens: error="failed to decode tokens file "/tmp/consul-test/TestAgent_loadTokens-TestAgent-agent029863868/acl-tokens.json": json: cannot unmarshal array into Go value of type agent.persistedTokens" 31:38.711 [INFO] TestAgent: Requesting shutdown 31:38.712 [INFO] TestAgent.server: shutting down server 31:38.712 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:38.712 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:38.712 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:38.712 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:38.712 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:38.728 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:38.737 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:38.737 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:38.737 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:38.737 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:38.737 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:38.737 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb 31:38.737 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb 2021-10-05T16:31:38.738Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:38.738Z [INFO] agent.router.manager: shutting down 31:38.738 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:38.738 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:38.738 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:38.738 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:38.738 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 31:38.750 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-5c2e290b-f5ef-c583-c17c-f72444da5ebb 127.0.0.1 30182 map[acls:1 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:5c2e290b-f5ef-c583-c17c-f72444da5ebb port:30198 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:30183] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:38.750 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:38.750 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:38.750 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:38.750 [INFO] TestAgent: consul server down 31:38.750 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:38.750 [INFO] TestAgent: shutdown complete 31:38.750 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:38.750 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30179 network=tcp 31:38.750 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:38.750 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:38.750 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:38.750 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30179 network=udp 31:38.750 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30180 network=tcp 31:39.252 [INFO] TestAgent: Waiting for endpoints to shut down 31:39.252 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadTokens (0.95s) --- PASS: TestAgent_loadTokens/original-configuration (0.00s) --- PASS: TestAgent_loadTokens/updated-configuration (0.00s) --- PASS: TestAgent_loadTokens/persisted-tokens (0.00s) --- PASS: TestAgent_loadTokens/persisted-tokens-override (0.00s) --- PASS: TestAgent_loadTokens/partial-persisted (0.01s) --- PASS: TestAgent_loadTokens/persistence-error-not-json (0.04s) --- PASS: TestAgent_loadTokens/persistence-error-wrong-top-level (0.00s) === CONT TestAgent_checkStateSnapshot [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:38.341Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.354Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.409 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4fceb84e-720d-f76b-9337-375a16001b5c Address:127.0.0.1:30209}]" 31:38.409 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30209 [Follower]" leader= 31:38.410 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4fceb84e-720d-f76b-9337-375a16001b5c.dc1 127.0.0.1 31:38.410 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4fceb84e-720d-f76b-9337-375a16001b5c 127.0.0.1 2021-10-05T16:31:38.410Z [INFO] agent.router: Initializing LAN area manager 31:38.411 [INFO] TestAgent.server: Adding LAN server: server="Node-4fceb84e-720d-f76b-9337-375a16001b5c (Addr: tcp/127.0.0.1:30209) (DC: dc1)" 31:38.411 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4fceb84e-720d-f76b-9337-375a16001b5c.dc1 area=wan 31:38.411 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30217 network=udp 31:38.411 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30217 network=tcp 31:38.412 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30205 network=tcp 31:38.414 [INFO] TestAgent: started state syncer 31:38.414 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30210 network=tcp 31:38.480 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.480 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30209 [Candidate]" term=2 31:38.517 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.517 [DEBUG] TestAgent.server.raft: vote granted: from=4fceb84e-720d-f76b-9337-375a16001b5c term=2 tally=1 31:38.517 [INFO] TestAgent.server.raft: election won: tally=1 31:38.517 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30209 [Leader]" 31:38.518 [INFO] TestAgent.server: cluster leadership acquired 31:38.518 [INFO] TestAgent.server: New leader elected: payload=Node-4fceb84e-720d-f76b-9337-375a16001b5c 31:38.540 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30209 31:38.632 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:38.636 [INFO] TestAgent: Synced node info 31:38.636 [DEBUG] TestAgent: Node info in sync 31:38.671 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:38.671 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:38.671 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:38.671 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:38.671 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:38.671 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4fceb84e-720d-f76b-9337-375a16001b5c 31:38.671 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4fceb84e-720d-f76b-9337-375a16001b5c 31:38.728 [INFO] TestAgent.server: federation state anti-entropy synced 31:38.836 [INFO] TestAgent: Requesting shutdown 31:38.836 [INFO] TestAgent.server: shutting down server 31:38.836 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:38.836 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:38.836 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:38.836 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:38.836 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:38.836 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:38.836 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:38.836 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:38.836 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:38.836 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:38.843 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:38.853Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:38.853Z [INFO] agent.router.manager: shutting down 31:38.853 [INFO] TestAgent: consul server down 31:38.853 [INFO] TestAgent: shutdown complete 31:38.853 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30217 network=tcp 31:38.853 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30217 network=udp 31:38.853 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30205 network=tcp 31:39.354 [INFO] TestAgent: Waiting for endpoints to shut down 31:39.354 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_reloadWatches (1.03s) === CONT TestAgent_NodeMaintenanceMode 2021-10-05T16:31:38.805Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.827Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.869 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:588787c8-7777-d7e8-e059-fed60f829407 Address:127.0.0.1:30244}]" 31:38.870 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-588787c8-7777-d7e8-e059-fed60f829407.dc1 127.0.0.1 31:38.870 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-588787c8-7777-d7e8-e059-fed60f829407 127.0.0.1 2021-10-05T16:31:38.870Z [INFO] agent.router: Initializing LAN area manager 31:38.870 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30239 network=udp 31:38.870 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30244 [Follower]" leader= 31:38.871 [INFO] TestAgent.server: Adding LAN server: server="Node-588787c8-7777-d7e8-e059-fed60f829407 (Addr: tcp/127.0.0.1:30244) (DC: dc1)" 31:38.871 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-588787c8-7777-d7e8-e059-fed60f829407.dc1 area=wan 31:38.871 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30239 network=tcp 31:38.872 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30240 network=tcp 31:38.872 [INFO] TestAgent: started state syncer 31:38.872 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30252 network=tcp 31:38.912 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.912 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30244 [Candidate]" term=2 31:38.936 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.936 [DEBUG] TestAgent.server.raft: vote granted: from=588787c8-7777-d7e8-e059-fed60f829407 term=2 tally=1 31:38.936 [INFO] TestAgent.server.raft: election won: tally=1 31:38.936 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30244 [Leader]" 31:38.940 [INFO] TestAgent.server: cluster leadership acquired 31:38.940 [INFO] TestAgent.server: New leader elected: payload=Node-588787c8-7777-d7e8-e059-fed60f829407 31:38.948 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30244 31:38.972 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:39.001 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:39.001 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:39.001 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:39.001 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:39.001 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:39.001 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-588787c8-7777-d7e8-e059-fed60f829407 31:39.001 [INFO] TestAgent.server: member joined, marking health alive: member=Node-588787c8-7777-d7e8-e059-fed60f829407 31:39.032 [INFO] TestAgent.server: federation state anti-entropy synced 31:39.037 [DEBUG] TestAgent: check state expired, not restoring: check=check1 31:39.037 [INFO] TestAgent: Requesting shutdown 31:39.037 [INFO] TestAgent.server: shutting down server 31:39.037 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:39.037 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:39.037 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:39.037 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:39.037 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.037 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:39.037 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:39.038 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:39.038 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:39.038 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:39.038 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:39.045 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.049Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.049Z [INFO] agent.router.manager: shutting down 31:39.050 [INFO] TestAgent: consul server down 31:39.050 [INFO] TestAgent: shutdown complete 31:39.050 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30239 network=tcp 31:39.050 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30239 network=udp 31:39.050 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30240 network=tcp 31:39.551 [INFO] TestAgent: Waiting for endpoints to shut down 31:39.551 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadCheckState (0.80s) === CONT TestAgent_AddCheck_restoresSnapshot [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:38.640Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.655Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.786 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:30391565-950e-6ec7-b66a-fb122719d886 Address:127.0.0.1:30237}]" 31:38.786 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30237 [Follower]" leader= 31:38.792 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-30391565-950e-6ec7-b66a-fb122719d886.dc1 127.0.0.1 31:38.793 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-30391565-950e-6ec7-b66a-fb122719d886 127.0.0.1 2021-10-05T16:31:38.793Z [INFO] agent.router: Initializing LAN area manager 31:38.793 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30225 network=udp 31:38.793 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-30391565-950e-6ec7-b66a-fb122719d886.dc1 area=wan 31:38.793 [INFO] TestAgent.server: Adding LAN server: server="Node-30391565-950e-6ec7-b66a-fb122719d886 (Addr: tcp/127.0.0.1:30237) (DC: dc1)" 31:38.793 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30225 network=tcp 31:38.794 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30233 network=tcp 31:38.794 [INFO] TestAgent: started state syncer 31:38.794 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30238 network=tcp 31:38.848 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.848 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30237 [Candidate]" term=2 31:38.883 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.883 [DEBUG] TestAgent.server.raft: vote granted: from=30391565-950e-6ec7-b66a-fb122719d886 term=2 tally=1 31:38.883 [INFO] TestAgent.server.raft: election won: tally=1 31:38.883 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30237 [Leader]" 31:38.884 [INFO] TestAgent.server: cluster leadership acquired 31:38.884 [INFO] TestAgent.server: New leader elected: payload=Node-30391565-950e-6ec7-b66a-fb122719d886 31:38.894 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30237 31:38.909 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:38.942 [INFO] TestAgent: Synced node info 31:38.942 [DEBUG] TestAgent: Node info in sync 31:38.956 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:38.956 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:38.956 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:38.956 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:38.956 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:38.956 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-30391565-950e-6ec7-b66a-fb122719d886 31:38.956 [INFO] TestAgent.server: member joined, marking health alive: member=Node-30391565-950e-6ec7-b66a-fb122719d886 31:38.967 [INFO] TestAgent.server: federation state anti-entropy synced 31:39.136 [INFO] TestAgent: Requesting shutdown 31:39.136 [INFO] TestAgent.server: shutting down server 31:39.136 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:39.136 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:39.136 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:39.136 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:39.136 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.136 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:39.136 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:39.136 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:39.136 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:39.136 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:39.144 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.151Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.151Z [INFO] agent.router.manager: shutting down 31:39.151 [INFO] TestAgent: consul server down 31:39.151 [INFO] TestAgent: shutdown complete 31:39.151 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30225 network=tcp 31:39.151 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30225 network=udp 31:39.151 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30233 network=tcp 31:39.652 [INFO] TestAgent: Waiting for endpoints to shut down 31:39.652 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_purgeCheckState (1.03s) === CONT TestAgent_Service_MaintenanceMode [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:39.083Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.121Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.215 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:deb8d63b-39f5-9bee-bfe4-55a6600cfcea Address:127.0.0.1:30258}]" 31:39.215 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30258 [Follower]" leader= 31:39.216 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-deb8d63b-39f5-9bee-bfe4-55a6600cfcea.dc1 127.0.0.1 31:39.217 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-deb8d63b-39f5-9bee-bfe4-55a6600cfcea 127.0.0.1 2021-10-05T16:31:39.217Z [INFO] agent.router: Initializing LAN area manager 31:39.217 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30253 network=udp 31:39.217 [INFO] TestAgent.server: Adding LAN server: server="Node-deb8d63b-39f5-9bee-bfe4-55a6600cfcea (Addr: tcp/127.0.0.1:30258) (DC: dc1)" 31:39.217 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-deb8d63b-39f5-9bee-bfe4-55a6600cfcea.dc1 area=wan 31:39.217 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30253 network=tcp 31:39.218 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30254 network=tcp 31:39.218 [INFO] TestAgent: started state syncer 31:39.218 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30245 network=tcp 31:39.281 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.281 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30258 [Candidate]" term=2 31:39.332 [DEBUG] TestAgent.server.raft: votes: needed=1 31:39.332 [DEBUG] TestAgent.server.raft: vote granted: from=deb8d63b-39f5-9bee-bfe4-55a6600cfcea term=2 tally=1 31:39.332 [INFO] TestAgent.server.raft: election won: tally=1 31:39.332 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30258 [Leader]" 31:39.332 [INFO] TestAgent.server: cluster leadership acquired 31:39.333 [INFO] TestAgent.server: New leader elected: payload=Node-deb8d63b-39f5-9bee-bfe4-55a6600cfcea 31:39.351 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30258 31:39.369 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:39.430 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:39.430 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:39.430 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:39.430 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:39.430 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:39.430 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-deb8d63b-39f5-9bee-bfe4-55a6600cfcea 31:39.430 [INFO] TestAgent.server: member joined, marking health alive: member=Node-deb8d63b-39f5-9bee-bfe4-55a6600cfcea 31:39.454 [INFO] TestAgent.server: federation state anti-entropy synced 31:39.464 [INFO] TestAgent: Requesting shutdown 31:39.464 [INFO] TestAgent.server: shutting down server 31:39.464 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:39.464 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:39.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:39.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:39.464 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.464 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:39.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:39.464 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:39.464 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:39.464 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:39.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:39.473 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.492Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.492Z [INFO] agent.router.manager: shutting down 31:39.492 [INFO] TestAgent: consul server down 31:39.492 [INFO] TestAgent: shutdown complete 31:39.492 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30253 network=tcp 31:39.492 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30253 network=udp 31:39.492 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30254 network=tcp 31:39.993 [INFO] TestAgent: Waiting for endpoints to shut down 31:39.993 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_persistCheckState (0.93s) === CONT TestAgent_unloadChecks 2021-10-05T16:31:39.206Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.280Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.348 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e3981e5a-6d1b-5031-40c2-9c43e49ca16a Address:127.0.0.1:30251}]" 31:39.348 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30251 [Follower]" leader= 31:39.349 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e3981e5a-6d1b-5031-40c2-9c43e49ca16a.dc1 127.0.0.1 31:39.350 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e3981e5a-6d1b-5031-40c2-9c43e49ca16a 127.0.0.1 2021-10-05T16:31:39.350Z [INFO] agent.router: Initializing LAN area manager 31:39.350 [INFO] TestAgent.server: Adding LAN server: server="Node-e3981e5a-6d1b-5031-40c2-9c43e49ca16a (Addr: tcp/127.0.0.1:30251) (DC: dc1)" 31:39.350 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30246 network=udp 31:39.350 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e3981e5a-6d1b-5031-40c2-9c43e49ca16a.dc1 area=wan 31:39.351 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30246 network=tcp 31:39.351 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30247 network=tcp 31:39.351 [INFO] TestAgent: started state syncer 31:39.351 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30231 network=tcp 31:39.394 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.394 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30251 [Candidate]" term=2 31:39.417 [DEBUG] TestAgent.server.raft: votes: needed=1 31:39.417 [DEBUG] TestAgent.server.raft: vote granted: from=e3981e5a-6d1b-5031-40c2-9c43e49ca16a term=2 tally=1 31:39.417 [INFO] TestAgent.server.raft: election won: tally=1 31:39.417 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30251 [Leader]" 31:39.417 [INFO] TestAgent.server: cluster leadership acquired 31:39.417 [INFO] TestAgent.server: New leader elected: payload=Node-e3981e5a-6d1b-5031-40c2-9c43e49ca16a 31:39.439 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30251 31:39.472 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:39.496 [WARN] TestAgent: Failed to restore check: check=service:redis error="ServiceID "nope" does not exist" 31:39.496 [DEBUG] TestAgent: restored health check from file: check=service:redis file=/tmp/consul-test/TestAgent_loadChecks_checkFails-TestAgent-agent858968292/checks/60a2ef12de014a05ecdc850d9aab46da 31:39.496 [INFO] TestAgent: Requesting shutdown 31:39.496 [INFO] TestAgent.server: shutting down server 31:39.496 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.496 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:39.508 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.516Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.516Z [INFO] agent.router.manager: shutting down 31:39.528 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 31:39.528 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:39.528 [INFO] TestAgent: consul server down 31:39.528 [INFO] TestAgent: shutdown complete 31:39.528 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30246 network=tcp 31:39.528 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30246 network=udp 31:39.528 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30247 network=tcp 31:40.032 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.032 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadChecks_checkFails (0.86s) === CONT TestAgent_loadChecks_token [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:38.387Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.401Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.447 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fcd4dbfd-9a61-ad84-1410-477f0c7cebaf Address:127.0.0.1:30230}]" 31:38.448 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fcd4dbfd-9a61-ad84-1410-477f0c7cebaf.dc1 127.0.0.1 31:38.448 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30230 [Follower]" leader= 31:38.449 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fcd4dbfd-9a61-ad84-1410-477f0c7cebaf 127.0.0.1 2021-10-05T16:31:38.449Z [INFO] agent.router: Initializing LAN area manager 31:38.449 [INFO] TestAgent.server: Adding LAN server: server="Node-fcd4dbfd-9a61-ad84-1410-477f0c7cebaf (Addr: tcp/127.0.0.1:30230) (DC: dc1)" 31:38.449 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fcd4dbfd-9a61-ad84-1410-477f0c7cebaf.dc1 area=wan 31:38.449 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30211 network=tcp 31:38.449 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30211 network=udp 31:38.450 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30226 network=tcp 31:38.450 [INFO] TestAgent: started state syncer 31:38.450 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30192 network=tcp 31:38.502 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.503 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30230 [Candidate]" term=2 31:38.561 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.561 [DEBUG] TestAgent.server.raft: vote granted: from=fcd4dbfd-9a61-ad84-1410-477f0c7cebaf term=2 tally=1 31:38.561 [INFO] TestAgent.server.raft: election won: tally=1 31:38.561 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30230 [Leader]" 31:38.561 [INFO] TestAgent.server: cluster leadership acquired 31:38.561 [INFO] TestAgent.server: New leader elected: payload=Node-fcd4dbfd-9a61-ad84-1410-477f0c7cebaf 31:38.571 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30230 31:38.608 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:38.744 [INFO] TestAgent: Synced node info 31:38.744 [DEBUG] TestAgent: Node info in sync 31:38.744 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:38.744 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:38.744 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:38.744 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:38.744 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:38.744 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fcd4dbfd-9a61-ad84-1410-477f0c7cebaf 31:38.744 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fcd4dbfd-9a61-ad84-1410-477f0c7cebaf 31:38.784 [INFO] TestAgent.server: federation state anti-entropy synced 31:39.591 [WARN] TestAgent.server.rpc: Attempting to apply large raft entry: size_in_bytes=4719032 31:39.726 [INFO] TestAgent: Requesting shutdown 31:39.726 [INFO] TestAgent.server: shutting down server 31:39.726 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:39.726 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:39.726 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:39.726 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:39.726 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.726 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:39.726 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:39.726 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:39.726 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:39.726 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:39.735 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.751Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.751Z [INFO] agent.router.manager: shutting down 31:39.751 [INFO] TestAgent: consul server down 31:39.751 [INFO] TestAgent: shutdown complete 31:39.751 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30211 network=tcp 31:39.751 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30211 network=udp 31:39.751 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30226 network=tcp 31:40.252 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.252 [INFO] TestAgent: Endpoints down --- PASS: TestTxnEndpoint_Bad_Size_Net (8.00s) --- PASS: TestTxnEndpoint_Bad_Size_Net/exceeds_default_limits (1.31s) --- PASS: TestTxnEndpoint_Bad_Size_Net/exceeds_configured_max_txn_len (1.27s) --- PASS: TestTxnEndpoint_Bad_Size_Net/exceeds_default_max_kv_value_size (1.58s) --- PASS: TestTxnEndpoint_Bad_Size_Net/allowed (1.95s) --- PASS: TestTxnEndpoint_Bad_Size_Net/allowed_kv_max_backward_compatible (1.89s) === CONT TestAgent_DeregisterPersistedSidecarAfterRestart 2021-10-05T16:31:39.285Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.315Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.440 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1a9d62bb-3753-1a2f-d380-cc6bf92adc01 Address:127.0.0.1:30223}]" 31:39.440 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30223 [Follower]" leader= 31:39.441 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1a9d62bb-3753-1a2f-d380-cc6bf92adc01.dc1 127.0.0.1 31:39.441 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1a9d62bb-3753-1a2f-d380-cc6bf92adc01 127.0.0.1 2021-10-05T16:31:39.441Z [INFO] agent.router: Initializing LAN area manager 31:39.441 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30232 network=udp 31:39.442 [INFO] TestAgent.server: Adding LAN server: server="Node-1a9d62bb-3753-1a2f-d380-cc6bf92adc01 (Addr: tcp/127.0.0.1:30223) (DC: dc1)" 31:39.442 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1a9d62bb-3753-1a2f-d380-cc6bf92adc01.dc1 area=wan 31:39.442 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30232 network=tcp 31:39.442 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30219 network=tcp 31:39.442 [INFO] TestAgent: started state syncer 31:39.442 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30199 network=tcp 31:39.503 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.503 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30223 [Candidate]" term=2 31:39.544 [DEBUG] TestAgent.server.raft: votes: needed=1 31:39.544 [DEBUG] TestAgent.server.raft: vote granted: from=1a9d62bb-3753-1a2f-d380-cc6bf92adc01 term=2 tally=1 31:39.544 [INFO] TestAgent.server.raft: election won: tally=1 31:39.544 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30223 [Leader]" 31:39.544 [INFO] TestAgent.server: cluster leadership acquired 31:39.545 [INFO] TestAgent.server: New leader elected: payload=Node-1a9d62bb-3753-1a2f-d380-cc6bf92adc01 31:39.566 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30223 31:39.635 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:39.732 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:39.732 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:39.732 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:39.732 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:39.732 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:39.732 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1a9d62bb-3753-1a2f-d380-cc6bf92adc01 31:39.732 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1a9d62bb-3753-1a2f-d380-cc6bf92adc01 31:39.743 [INFO] TestAgent.server: federation state anti-entropy synced 31:39.750 [DEBUG] TestAgent: removed check: check=service:redis 31:39.751 [DEBUG] TestAgent: restored health check from file: check=service:redis file=/tmp/consul-test/TestAgent_checkStateSnapshot-TestAgent-agent280678131/checks/60a2ef12de014a05ecdc850d9aab46da 31:39.751 [INFO] TestAgent: Requesting shutdown 31:39.751 [INFO] TestAgent.server: shutting down server 31:39.751 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:39.751 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:39.751 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:39.751 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:39.751 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.751 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:39.751 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:39.751 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:39.751 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:39.763 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:39.763 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:39.764 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.774Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.774Z [INFO] agent.router.manager: shutting down 31:39.774 [INFO] TestAgent: consul server down 31:39.774 [INFO] TestAgent: shutdown complete 31:39.774 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30232 network=tcp 31:39.774 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30232 network=udp 31:39.774 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30219 network=tcp 31:40.276 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.276 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_checkStateSnapshot (1.02s) === CONT TestAgent_PurgeCheckOnDuplicate [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:39.374Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.389Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.472 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:934420e6-2d15-a077-ce44-d92467819f70 Address:127.0.0.1:30272}]" 31:39.473 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-934420e6-2d15-a077-ce44-d92467819f70.dc1 127.0.0.1 31:39.473 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30272 [Follower]" leader= 31:39.484 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-934420e6-2d15-a077-ce44-d92467819f70 127.0.0.1 2021-10-05T16:31:39.485Z [INFO] agent.router: Initializing LAN area manager 31:39.485 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30267 network=udp 31:39.485 [INFO] TestAgent.server: Adding LAN server: server="Node-934420e6-2d15-a077-ce44-d92467819f70 (Addr: tcp/127.0.0.1:30272) (DC: dc1)" 31:39.485 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-934420e6-2d15-a077-ce44-d92467819f70.dc1 area=wan 31:39.485 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30267 network=tcp 31:39.486 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30268 network=tcp 31:39.486 [INFO] TestAgent: started state syncer 31:39.486 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30273 network=tcp 31:39.540 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.540 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30272 [Candidate]" term=2 31:39.588 [DEBUG] TestAgent.server.raft: votes: needed=1 31:39.588 [DEBUG] TestAgent.server.raft: vote granted: from=934420e6-2d15-a077-ce44-d92467819f70 term=2 tally=1 31:39.588 [INFO] TestAgent.server.raft: election won: tally=1 31:39.588 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30272 [Leader]" 31:39.588 [INFO] TestAgent.server: cluster leadership acquired 31:39.588 [INFO] TestAgent.server: New leader elected: payload=Node-934420e6-2d15-a077-ce44-d92467819f70 31:39.640 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30272 31:39.718 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:39.764 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:39.764 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:39.764 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:39.764 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:39.764 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:39.764 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-934420e6-2d15-a077-ce44-d92467819f70 31:39.764 [INFO] TestAgent.server: member joined, marking health alive: member=Node-934420e6-2d15-a077-ce44-d92467819f70 31:39.780 [INFO] TestAgent: Node entered maintenance mode 31:39.785 [INFO] TestAgent: Synced node info 31:39.817 [INFO] TestAgent.server: federation state anti-entropy synced 31:39.817 [INFO] TestAgent: Synced check: check=_node_maintenance 31:39.817 [DEBUG] TestAgent: Node info in sync 31:39.817 [DEBUG] TestAgent: Check in sync: check=_node_maintenance 31:39.817 [DEBUG] TestAgent: removed check: check=_node_maintenance 31:39.817 [INFO] TestAgent: Node left maintenance mode 31:39.827 [INFO] TestAgent: Node entered maintenance mode 31:39.827 [INFO] TestAgent: Requesting shutdown 31:39.828 [INFO] TestAgent.server: shutting down server 31:39.828 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:39.828 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:39.828 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:39.828 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:39.828 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.828 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:39.828 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:39.828 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:39.828 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:39.828 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:39.839 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.845Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.845Z [INFO] agent.router.manager: shutting down 31:39.845 [INFO] TestAgent: consul server down 31:39.845 [INFO] TestAgent: shutdown complete 31:39.846 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30267 network=tcp 31:39.846 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30267 network=udp 31:39.846 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30268 network=tcp 31:40.349 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.349 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_NodeMaintenanceMode (1.00s) === CONT TestAgent_PurgeCheck 2021-10-05T16:31:39.431Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.466Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.548 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9ed3be2a-39ed-6592-aee4-a99f67e6eba0 Address:127.0.0.1:30279}]" 31:39.549 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9ed3be2a-39ed-6592-aee4-a99f67e6eba0.dc1 127.0.0.1 31:39.549 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9ed3be2a-39ed-6592-aee4-a99f67e6eba0 127.0.0.1 2021-10-05T16:31:39.549Z [INFO] agent.router: Initializing LAN area manager 31:39.549 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30274 network=udp 31:39.549 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30279 [Follower]" leader= 31:39.550 [INFO] TestAgent.server: Adding LAN server: server="Node-9ed3be2a-39ed-6592-aee4-a99f67e6eba0 (Addr: tcp/127.0.0.1:30279) (DC: dc1)" 31:39.550 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9ed3be2a-39ed-6592-aee4-a99f67e6eba0.dc1 area=wan 31:39.550 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30274 network=tcp 31:39.550 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30275 network=tcp 31:39.551 [INFO] TestAgent: started state syncer 31:39.551 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30259 network=tcp 31:39.616 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.616 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30279 [Candidate]" term=2 31:39.663 [DEBUG] TestAgent.server.raft: votes: needed=1 31:39.663 [DEBUG] TestAgent.server.raft: vote granted: from=9ed3be2a-39ed-6592-aee4-a99f67e6eba0 term=2 tally=1 31:39.663 [INFO] TestAgent.server.raft: election won: tally=1 31:39.663 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30279 [Leader]" 31:39.664 [INFO] TestAgent.server: cluster leadership acquired 31:39.664 [INFO] TestAgent.server: New leader elected: payload=Node-9ed3be2a-39ed-6592-aee4-a99f67e6eba0 31:39.720 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30279 31:39.755 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:39.804 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:39.804 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:39.804 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:39.804 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:39.804 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:39.804 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9ed3be2a-39ed-6592-aee4-a99f67e6eba0 31:39.804 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9ed3be2a-39ed-6592-aee4-a99f67e6eba0 31:39.843 [INFO] TestAgent.server: federation state anti-entropy synced 31:39.864 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:39.869 [INFO] TestAgent: Synced node info 31:39.869 [DEBUG] TestAgent: Node info in sync 31:39.882 [INFO] TestAgent: Requesting shutdown 31:39.882 [INFO] TestAgent.server: shutting down server 31:39.882 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:39.882 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:39.882 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:39.882 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:39.882 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:39.882 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:39.882 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:39.882 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:39.883 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:39.883 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:39.887 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:39.896Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:39.896Z [INFO] agent.router.manager: shutting down 31:39.896 [INFO] TestAgent: consul server down 31:39.896 [INFO] TestAgent: shutdown complete 31:39.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30274 network=tcp 31:39.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30274 network=udp 31:39.896 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30275 network=tcp 31:40.396 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.396 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:38.662Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:38.710Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:38.770 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f7f29e51-5ba1-2a81-be08-f1e127231b53 Address:127.0.0.1:30214}]" 31:38.770 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30214 [Follower]" leader= 31:38.771 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f7f29e51-5ba1-2a81-be08-f1e127231b53.dc1 127.0.0.1 31:38.772 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f7f29e51-5ba1-2a81-be08-f1e127231b53 127.0.0.1 2021-10-05T16:31:38.772Z [INFO] agent.router: Initializing LAN area manager 31:38.772 [INFO] TestAgent.server: Adding LAN server: server="Node-f7f29e51-5ba1-2a81-be08-f1e127231b53 (Addr: tcp/127.0.0.1:30214) (DC: dc1)" 31:38.772 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30193 network=udp 31:38.772 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f7f29e51-5ba1-2a81-be08-f1e127231b53.dc1 area=wan 31:38.772 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30193 network=tcp 31:38.773 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30194 network=tcp 31:38.773 [INFO] TestAgent: started state syncer 31:38.773 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30224 network=tcp 31:38.817 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:38.817 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30214 [Candidate]" term=2 31:38.847 [DEBUG] TestAgent.server.raft: votes: needed=1 31:38.847 [DEBUG] TestAgent.server.raft: vote granted: from=f7f29e51-5ba1-2a81-be08-f1e127231b53 term=2 tally=1 31:38.847 [INFO] TestAgent.server.raft: election won: tally=1 31:38.847 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30214 [Leader]" 31:38.848 [INFO] TestAgent.server: cluster leadership acquired 31:38.848 [INFO] TestAgent.server: New leader elected: payload=Node-f7f29e51-5ba1-2a81-be08-f1e127231b53 31:38.858 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30214 31:38.871 [INFO] TestAgent: Requesting shutdown 31:38.872 [INFO] TestAgent.server: shutting down server 31:38.872 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:38.872 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:38.879 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:38.886 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 2021-10-05T16:31:38.890Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:38.890Z [INFO] agent.router.manager: shutting down 31:38.899 [INFO] TestAgent: consul server down 31:38.899 [INFO] TestAgent: shutdown complete 31:38.899 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30193 network=tcp 31:38.900 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30193 network=udp 31:38.900 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30194 network=tcp 31:38.900 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:38.900 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:38.900 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:39.400 [INFO] TestAgent: Waiting for endpoints to shut down 31:39.400 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_GetCoordinate (1.78s) === CONT TestAgent_PersistCheck 2021-10-05T16:31:39.587Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.633Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.740 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:90547f71-4a03-5221-a677-693c8a577657 Address:127.0.0.1:30265}]" 31:39.741 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-90547f71-4a03-5221-a677-693c8a577657.dc1 127.0.0.1 31:39.742 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-90547f71-4a03-5221-a677-693c8a577657 127.0.0.1 2021-10-05T16:31:39.742Z [INFO] agent.router: Initializing LAN area manager 31:39.742 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30260 network=udp 31:39.742 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30265 [Follower]" leader= 31:39.742 [INFO] TestAgent.server: Adding LAN server: server="Node-90547f71-4a03-5221-a677-693c8a577657 (Addr: tcp/127.0.0.1:30265) (DC: dc1)" 31:39.742 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-90547f71-4a03-5221-a677-693c8a577657.dc1 area=wan 31:39.743 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30260 network=tcp 31:39.743 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30261 network=tcp 31:39.743 [INFO] TestAgent: started state syncer 31:39.743 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30115 network=tcp 31:39.809 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.809 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30265 [Candidate]" term=2 31:39.824 [DEBUG] TestAgent.server.raft: votes: needed=1 31:39.824 [DEBUG] TestAgent.server.raft: vote granted: from=90547f71-4a03-5221-a677-693c8a577657 term=2 tally=1 31:39.824 [INFO] TestAgent.server.raft: election won: tally=1 31:39.824 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30265 [Leader]" 31:39.825 [INFO] TestAgent.server: cluster leadership acquired 31:39.825 [INFO] TestAgent.server: New leader elected: payload=Node-90547f71-4a03-5221-a677-693c8a577657 31:39.840 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30265 31:39.856 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:39.880 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:39.880 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:39.880 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:39.880 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:39.880 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:39.880 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-90547f71-4a03-5221-a677-693c8a577657 31:39.880 [INFO] TestAgent.server: member joined, marking health alive: member=Node-90547f71-4a03-5221-a677-693c8a577657 31:39.895 [INFO] TestAgent.server: federation state anti-entropy synced 31:40.016 [INFO] TestAgent: Requesting shutdown 31:40.016 [INFO] TestAgent.server: shutting down server 31:40.016 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:40.016 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:40.016 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:40.016 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:40.016 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:40.016 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:40.016 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:40.016 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:40.016 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:40.016 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:40.016 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:40.028 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:40.040Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:40.040Z [INFO] agent.router.manager: shutting down 31:40.040 [INFO] TestAgent: consul server down 31:40.040 [INFO] TestAgent: shutdown complete 31:40.040 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30260 network=tcp 31:40.040 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30260 network=udp 31:40.040 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30261 network=tcp 31:40.544 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.544 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_restoresSnapshot (0.99s) === CONT TestAgent_updateTTLCheck [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:39.728Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.793Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.876 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:71e3adc3-57fa-1c29-25a2-dad958bf6eb2 Address:127.0.0.1:30121}]" 31:39.876 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30121 [Follower]" leader= 31:39.876 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-71e3adc3-57fa-1c29-25a2-dad958bf6eb2.dc1 127.0.0.1 31:39.878 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-71e3adc3-57fa-1c29-25a2-dad958bf6eb2 127.0.0.1 2021-10-05T16:31:39.878Z [INFO] agent.router: Initializing LAN area manager 31:39.878 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30116 network=udp 31:39.878 [INFO] TestAgent.server: Adding LAN server: server="Node-71e3adc3-57fa-1c29-25a2-dad958bf6eb2 (Addr: tcp/127.0.0.1:30121) (DC: dc1)" 31:39.878 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-71e3adc3-57fa-1c29-25a2-dad958bf6eb2.dc1 area=wan 31:39.878 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30116 network=tcp 31:39.879 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30117 network=tcp 31:39.879 [INFO] TestAgent: started state syncer 31:39.879 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30280 network=tcp 31:39.939 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.939 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30121 [Candidate]" term=2 31:39.966 [DEBUG] TestAgent.server.raft: votes: needed=1 31:39.966 [DEBUG] TestAgent.server.raft: vote granted: from=71e3adc3-57fa-1c29-25a2-dad958bf6eb2 term=2 tally=1 31:39.966 [INFO] TestAgent.server.raft: election won: tally=1 31:39.966 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30121 [Leader]" 31:39.966 [INFO] TestAgent.server: cluster leadership acquired 31:39.966 [INFO] TestAgent.server: New leader elected: payload=Node-71e3adc3-57fa-1c29-25a2-dad958bf6eb2 31:39.988 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30121 31:39.988 [INFO] TestAgent: Synced node info 31:40.041 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:40.066 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:40.066 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:40.066 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:40.066 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:40.066 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:40.066 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-71e3adc3-57fa-1c29-25a2-dad958bf6eb2 31:40.066 [INFO] TestAgent.server: member joined, marking health alive: member=Node-71e3adc3-57fa-1c29-25a2-dad958bf6eb2 31:40.087 [INFO] TestAgent.server: federation state anti-entropy synced 31:40.312 [INFO] TestAgent: Service entered maintenance mode: service=redis 31:40.312 [DEBUG] TestAgent: removed check: check=_service_maintenance:redis 31:40.312 [INFO] TestAgent: Service left maintenance mode: service=redis 31:40.332 [INFO] TestAgent: Service entered maintenance mode: service=redis 31:40.332 [INFO] TestAgent: Requesting shutdown 31:40.332 [INFO] TestAgent.server: shutting down server 31:40.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:40.332 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:40.332 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:40.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:40.332 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:40.332 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:40.332 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:40.332 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:40.332 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:40.332 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:40.352 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:40.364Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:40.364Z [INFO] agent.router.manager: shutting down 31:40.365 [INFO] TestAgent: consul server down 31:40.365 [INFO] TestAgent: shutdown complete 31:40.365 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30116 network=tcp 31:40.365 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30116 network=udp 31:40.365 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30117 network=tcp 31:40.868 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.868 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Service_MaintenanceMode (1.21s) === CONT TestAgent_HTTPCheck_TLSSkipVerify 2021-10-05T16:31:40.111Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:40.146Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:40.217 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5fe98851-0473-cd54-e322-1452659f54c4 Address:127.0.0.1:30300}]" 31:40.218 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5fe98851-0473-cd54-e322-1452659f54c4.dc1 127.0.0.1 31:40.218 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5fe98851-0473-cd54-e322-1452659f54c4 127.0.0.1 2021-10-05T16:31:40.218Z [INFO] agent.router: Initializing LAN area manager 31:40.219 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30295 network=udp 31:40.219 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30300 [Follower]" leader= 31:40.219 [INFO] TestAgent.server: Adding LAN server: server="Node-5fe98851-0473-cd54-e322-1452659f54c4 (Addr: tcp/127.0.0.1:30300) (DC: dc1)" 31:40.219 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5fe98851-0473-cd54-e322-1452659f54c4.dc1 area=wan 31:40.219 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30295 network=tcp 31:40.220 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30296 network=tcp 31:40.220 [INFO] TestAgent: started state syncer 31:40.220 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30301 network=tcp 31:40.272 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:40.272 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30300 [Candidate]" term=2 31:40.317 [DEBUG] TestAgent.server.raft: votes: needed=1 31:40.317 [DEBUG] TestAgent.server.raft: vote granted: from=5fe98851-0473-cd54-e322-1452659f54c4 term=2 tally=1 31:40.317 [INFO] TestAgent.server.raft: election won: tally=1 31:40.317 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30300 [Leader]" 31:40.317 [INFO] TestAgent.server: cluster leadership acquired 31:40.317 [INFO] TestAgent.server: New leader elected: payload=Node-5fe98851-0473-cd54-e322-1452659f54c4 31:40.359 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30300 31:40.408 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:40.455 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:40.455 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:40.455 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:40.455 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:40.455 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:40.455 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5fe98851-0473-cd54-e322-1452659f54c4 31:40.455 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5fe98851-0473-cd54-e322-1452659f54c4 31:40.460 [INFO] TestAgent: Requesting shutdown 31:40.460 [INFO] TestAgent.server: shutting down server 31:40.460 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:40.460 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:40.460 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:40.460 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:40.460 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:40.460 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:40.460 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:40.460 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:40.460 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:40.465 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:40.465 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:40.472 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:40.484Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:40.484Z [INFO] agent.router.manager: shutting down 31:40.484 [INFO] TestAgent: consul server down 31:40.484 [INFO] TestAgent: shutdown complete 31:40.484 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30295 network=tcp 31:40.484 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30295 network=udp 31:40.484 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30296 network=tcp 31:40.988 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.988 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_loadChecks_token (0.98s) === CONT TestAgent_RemoveCheck 2021-10-05T16:31:40.010Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:40.098Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:40.154 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:02dff127-2beb-741d-d046-6e8232ef052b Address:127.0.0.1:30293}]" 31:40.155 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-02dff127-2beb-741d-d046-6e8232ef052b.dc1 127.0.0.1 31:40.156 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30293 [Follower]" leader= 31:40.156 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-02dff127-2beb-741d-d046-6e8232ef052b 127.0.0.1 2021-10-05T16:31:40.156Z [INFO] agent.router: Initializing LAN area manager 31:40.156 [INFO] TestAgent.server: Adding LAN server: server="Node-02dff127-2beb-741d-d046-6e8232ef052b (Addr: tcp/127.0.0.1:30293) (DC: dc1)" 31:40.156 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30288 network=udp 31:40.156 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-02dff127-2beb-741d-d046-6e8232ef052b.dc1 area=wan 31:40.156 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30288 network=tcp 31:40.157 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30289 network=tcp 31:40.157 [INFO] TestAgent: started state syncer 31:40.157 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30294 network=tcp 31:40.222 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:40.222 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30293 [Candidate]" term=2 31:40.235 [DEBUG] TestAgent.server.raft: votes: needed=1 31:40.236 [DEBUG] TestAgent.server.raft: vote granted: from=02dff127-2beb-741d-d046-6e8232ef052b term=2 tally=1 31:40.236 [INFO] TestAgent.server.raft: election won: tally=1 31:40.236 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30293 [Leader]" 31:40.236 [INFO] TestAgent.server: cluster leadership acquired 31:40.236 [INFO] TestAgent.server: New leader elected: payload=Node-02dff127-2beb-741d-d046-6e8232ef052b 31:40.264 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30293 31:40.312 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:40.404 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:40.404 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:40.404 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:40.404 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:40.404 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:40.404 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-02dff127-2beb-741d-d046-6e8232ef052b 31:40.404 [INFO] TestAgent.server: member joined, marking health alive: member=Node-02dff127-2beb-741d-d046-6e8232ef052b 31:40.427 [INFO] TestAgent.server: federation state anti-entropy synced 31:40.512 [DEBUG] TestAgent: removed check: check=service:redis 31:40.512 [INFO] TestAgent: Requesting shutdown 31:40.512 [INFO] TestAgent.server: shutting down server 31:40.512 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:40.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:40.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:40.512 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:40.512 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:40.512 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:40.512 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:40.512 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:40.512 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:40.512 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:40.512 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:40.520 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:40.536Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:40.536Z [INFO] agent.router.manager: shutting down 31:40.536 [INFO] TestAgent: consul server down 31:40.536 [INFO] TestAgent: shutdown complete 31:40.536 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30288 network=tcp 31:40.536 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30288 network=udp 31:40.536 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30289 network=tcp 31:41.038 [INFO] TestAgent: Waiting for endpoints to shut down 31:41.038 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_unloadChecks (1.05s) === CONT TestAgent_AddCheck_Alias_userAndSetToken [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:40.367Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:40.394Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:40.468 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2b29c8b3-89e0-acea-9a43-56bdf03eb95c Address:127.0.0.1:30321}]" 31:40.468 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30321 [Follower]" leader= 31:40.469 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2b29c8b3-89e0-acea-9a43-56bdf03eb95c.dc1 127.0.0.1 31:40.469 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2b29c8b3-89e0-acea-9a43-56bdf03eb95c 127.0.0.1 2021-10-05T16:31:40.469Z [INFO] agent.router: Initializing LAN area manager 31:40.469 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30316 network=udp 31:40.470 [INFO] TestAgent.server: Adding LAN server: server="Node-2b29c8b3-89e0-acea-9a43-56bdf03eb95c (Addr: tcp/127.0.0.1:30321) (DC: dc1)" 31:40.470 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2b29c8b3-89e0-acea-9a43-56bdf03eb95c.dc1 area=wan 31:40.470 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30316 network=tcp 31:40.470 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30317 network=tcp 31:40.470 [INFO] TestAgent: started state syncer 31:40.470 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30322 network=tcp 31:40.540 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:40.540 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30321 [Candidate]" term=2 31:40.588 [DEBUG] TestAgent.server.raft: votes: needed=1 31:40.588 [DEBUG] TestAgent.server.raft: vote granted: from=2b29c8b3-89e0-acea-9a43-56bdf03eb95c term=2 tally=1 31:40.588 [INFO] TestAgent.server.raft: election won: tally=1 31:40.588 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30321 [Leader]" 31:40.588 [INFO] TestAgent.server: cluster leadership acquired 31:40.588 [INFO] TestAgent.server: New leader elected: payload=Node-2b29c8b3-89e0-acea-9a43-56bdf03eb95c 31:40.596 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30321 31:40.614 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:40.648 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:40.649 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:40.649 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:40.649 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:40.649 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:40.649 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2b29c8b3-89e0-acea-9a43-56bdf03eb95c 31:40.649 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2b29c8b3-89e0-acea-9a43-56bdf03eb95c 31:40.660 [INFO] TestAgent.server: federation state anti-entropy synced 31:40.716 [DEBUG] TestAgent: removed check: check=mem 31:40.716 [DEBUG] TestAgent: removed check: check=mem 31:40.716 [INFO] TestAgent: Requesting shutdown 31:40.716 [INFO] TestAgent.server: shutting down server 31:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:40.716 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:40.716 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:40.716 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:40.721 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:40.728Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:40.728Z [INFO] agent.router.manager: shutting down 31:40.728 [INFO] TestAgent: consul server down 31:40.728 [INFO] TestAgent: shutdown complete 31:40.728 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30316 network=tcp 31:40.728 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30316 network=udp 31:40.728 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30317 network=tcp 31:41.232 [INFO] TestAgent: Waiting for endpoints to shut down 31:41.232 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PurgeCheck (0.88s) === CONT TestAgent_AddCheck_Alias_userToken [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:40.915Z [WARN] agent: Node name "Node 08b983a0-dc37-f7e8-635d-dc3152ee884c" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:40.915Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:40.983Z [WARN] agent.auto_config: Node name "Node 08b983a0-dc37-f7e8-635d-dc3152ee884c" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:40.983Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:40.985 [INFO] Agent2.client.serf.lan: serf: EventMemberJoin: Node 08b983a0-dc37-f7e8-635d-dc3152ee884c 127.0.0.1 2021-10-05T16:31:40.985Z [INFO] agent.router: Initializing LAN area manager 31:40.986 [DEBUG] Agent2: check exists, not restoring from file: check=mem file=/tmp/consul-test/TestAgent_PurgeCheckOnDuplicate-TestAgent-agent123976933/checks/afc4fc7e48a0710a1dc94ef3e8bc5764 31:40.986 [INFO] Agent2: Started DNS server: address=127.0.0.1:30358 network=udp 31:40.986 [WARN] Agent2.client.serf.lan: serf: Failed to re-join any previously known node 31:40.986 [INFO] Agent2: Started DNS server: address=127.0.0.1:30358 network=tcp 31:40.987 [INFO] Agent2: Started HTTP server: address=127.0.0.1:30359 network=tcp 31:40.987 [INFO] Agent2: started state syncer 31:40.988 [INFO] Agent2: Started gRPC server: address=127.0.0.1:30364 network=tcp 31:40.988 [INFO] Agent2: Requesting shutdown 31:40.988 [INFO] Agent2.client: shutting down client 31:40.988 [WARN] Agent2.client.serf.lan: serf: Shutdown without a Leave 2021-10-05T16:31:40.988Z [WARN] agent.router.manager: No servers available 31:40.988 [ERROR] Agent2.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:41.010 [INFO] Agent2: consul client down 31:41.010 [INFO] Agent2: shutdown complete 31:41.010 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30358 network=tcp 31:41.010 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30358 network=udp 31:41.010 [INFO] Agent2: Stopping server: protocol=HTTP address=127.0.0.1:30359 network=tcp 31:41.510 [INFO] Agent2: Waiting for endpoints to shut down 31:41.510 [INFO] Agent2: Endpoints down 2021-10-05T16:31:40.303Z [WARN] agent: Node name "Node 08b983a0-dc37-f7e8-635d-dc3152ee884c" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:40.303Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:40.339Z [WARN] agent.auto_config: Node name "Node 08b983a0-dc37-f7e8-635d-dc3152ee884c" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:40.339Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:40.340 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node 08b983a0-dc37-f7e8-635d-dc3152ee884c 127.0.0.1 2021-10-05T16:31:40.340Z [INFO] agent.router: Initializing LAN area manager 31:40.344 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30309 network=tcp 31:40.344 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30309 network=udp 31:40.344 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30310 network=tcp 31:40.345 [INFO] TestAgent: started state syncer 31:40.345 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30315 network=tcp 2021-10-05T16:31:40.345Z [WARN] agent.router.manager: No servers available 31:40.345 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:40.356 [INFO] TestAgent: Requesting shutdown 31:40.356 [INFO] TestAgent.client: shutting down client 31:40.356 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:40.372 [INFO] TestAgent: consul client down 31:40.372 [INFO] TestAgent: shutdown complete 31:40.372 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30309 network=tcp 31:40.372 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30309 network=udp 31:40.372 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30310 network=tcp 31:40.876 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.876 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PurgeCheckOnDuplicate (1.23s) === CONT TestAgent_AddCheck_Alias_setToken 2021-10-05T16:31:40.908Z [WARN] agent: Node name "Node 2e44cd71-37f1-abc0-0ce5-03c84e7203f5" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:40.957Z [WARN] agent.auto_config: Node name "Node 2e44cd71-37f1-abc0-0ce5-03c84e7203f5" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 31:40.958 [INFO] Agent2.client.serf.lan: serf: EventMemberJoin: Node 2e44cd71-37f1-abc0-0ce5-03c84e7203f5 127.0.0.1 2021-10-05T16:31:40.958Z [INFO] agent.router: Initializing LAN area manager 31:40.959 [DEBUG] Agent2: restored service definition from file: service=svc-sidecar-proxy file=/tmp/consul-test/TestAgent_DeregisterPersistedSidecarAfterRestart-TestAgent-agent632262686/services/18ed17ea501b78b6980ecfa920fcf57a 31:40.959 [DEBUG] Agent2: restored service definition from file: service=svc file=/tmp/consul-test/TestAgent_DeregisterPersistedSidecarAfterRestart-TestAgent-agent632262686/services/961e38b5146c0b07d078f53dec9b699a 31:40.959 [INFO] Agent2: Started DNS server: address=127.0.0.1:30337 network=udp 31:40.965 [WARN] Agent2.client.serf.lan: serf: Failed to re-join any previously known node 31:40.966 [INFO] Agent2: Started DNS server: address=127.0.0.1:30337 network=tcp 31:40.968 [INFO] Agent2: Started HTTP server: address=127.0.0.1:30338 network=tcp 31:40.968 [INFO] Agent2: started state syncer 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.970Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.971Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.971Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.971Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.971Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.971Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.971Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.971Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.972Z [WARN] agent.router.manager: No servers available 31:40.972 [INFO] Agent2: Started gRPC server: address=127.0.0.1:30350 network=tcp 2021-10-05T16:31:40.972Z [WARN] agent.router.manager: No servers available 31:40.972 [ERROR] Agent2.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=service-http-checks:svc error="error filling agent cache: Internal cache failure: service 'svc' not in agent state" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=service-http-checks:svc error="error filling agent cache: Internal cache failure: service 'svc' not in agent state" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=service-http-checks:svc error="error filling agent cache: Internal cache failure: service 'svc' not in agent state" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=service-http-checks:svc error="error filling agent cache: Internal cache failure: service 'svc' not in agent state" 31:40.973 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:40.973Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.973Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.973Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.973Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.974Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.974Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.974Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.974Z [WARN] agent.router.manager: No servers available 31:40.975 [DEBUG] Agent2: removed service: service=svc 2021-10-05T16:31:40.975Z [WARN] agent.router.manager: No servers available 31:40.975 [DEBUG] Agent2: removed service: service=svc-sidecar-proxy 2021-10-05T16:31:40.975Z [WARN] agent.router.manager: No servers available 31:40.975 [INFO] Agent2: Requesting shutdown 2021-10-05T16:31:40.975Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.975Z [WARN] agent.router.manager: No servers available 31:40.975 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 31:40.975 [ERROR] Agent2.proxycfg: watch error: service_id=svc-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:40.975 [INFO] Agent2.client: shutting down client 31:40.975 [WARN] Agent2.client.serf.lan: serf: Shutdown without a Leave 31:41.016 [INFO] Agent2: consul client down 31:41.016 [INFO] Agent2: shutdown complete 31:41.016 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30337 network=tcp 31:41.016 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30337 network=udp 31:41.016 [INFO] Agent2: Stopping server: protocol=HTTP address=127.0.0.1:30338 network=tcp 31:41.517 [INFO] Agent2: Waiting for endpoints to shut down 31:41.517 [INFO] Agent2: Endpoints down 2021-10-05T16:31:40.277Z [WARN] agent: Node name "Node 2e44cd71-37f1-abc0-0ce5-03c84e7203f5" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:31:40.313Z [WARN] agent.auto_config: Node name "Node 2e44cd71-37f1-abc0-0ce5-03c84e7203f5" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 31:40.313 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node 2e44cd71-37f1-abc0-0ce5-03c84e7203f5 127.0.0.1 2021-10-05T16:31:40.313Z [INFO] agent.router: Initializing LAN area manager 31:40.313 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30302 network=udp 31:40.314 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30302 network=tcp 31:40.314 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30303 network=tcp 31:40.314 [INFO] TestAgent: started state syncer 31:40.315 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30308 network=tcp 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 31:40.325 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:40.325 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 31:40.325 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:40.325Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 2021-10-05T16:31:40.326Z [WARN] agent.router.manager: No servers available 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=roots error="error filling agent cache: No known Consul servers" 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=leaf error="error filling agent cache: No known Consul servers" 31:40.326 [ERROR] TestAgent.proxycfg: watch error: service_id=svc-sidecar-proxy id=intentions error="error filling agent cache: No known Consul servers" 31:40.336 [INFO] TestAgent: Requesting shutdown 31:40.336 [INFO] TestAgent.client: shutting down client 31:40.336 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:40.352 [INFO] TestAgent: consul client down 31:40.352 [INFO] TestAgent: shutdown complete 31:40.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30302 network=tcp 31:40.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30302 network=udp 31:40.352 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30303 network=tcp 31:40.854 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.854 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_DeregisterPersistedSidecarAfterRestart (1.26s) === CONT TestAgent_AddCheck_Alias [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:40.570Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:40.604Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:40.685 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b Address:127.0.0.1:30349}]" 31:40.685 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30349 [Follower]" leader= 31:40.686 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b.dc1 127.0.0.1 31:40.686 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b 127.0.0.1 2021-10-05T16:31:40.686Z [INFO] agent.router: Initializing LAN area manager 31:40.687 [INFO] TestAgent.server: Adding LAN server: server="Node-03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b (Addr: tcp/127.0.0.1:30349) (DC: dc1)" 31:40.687 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30344 network=udp 31:40.687 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b.dc1 area=wan 31:40.687 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30344 network=tcp 31:40.687 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30345 network=tcp 31:40.687 [INFO] TestAgent: started state syncer 31:40.687 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30336 network=tcp 31:40.736 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:40.736 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30349 [Candidate]" term=2 31:40.783 [DEBUG] TestAgent.server.raft: votes: needed=1 31:40.783 [DEBUG] TestAgent.server.raft: vote granted: from=03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b term=2 tally=1 31:40.783 [INFO] TestAgent.server.raft: election won: tally=1 31:40.783 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30349 [Leader]" 31:40.784 [INFO] TestAgent.server: cluster leadership acquired 31:40.784 [INFO] TestAgent.server: New leader elected: payload=Node-03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b 31:40.797 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30349 31:40.818 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:40.836 [INFO] TestAgent: Synced node info 31:40.853 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:40.853 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:40.853 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:40.853 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:40.853 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:40.853 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b 31:40.853 [INFO] TestAgent.server: member joined, marking health alive: member=Node-03ed785f-9f4e-c85c-ef2c-f4a0fd22fe3b 31:40.890 [INFO] TestAgent.server: federation state anti-entropy synced 31:41.100 [DEBUG] TestAgent: Check status updated: check=mem status=passing 31:41.101 [DEBUG] TestAgent: Check status updated: check=mem status=critical 31:41.101 [INFO] TestAgent: Requesting shutdown 31:41.101 [INFO] TestAgent.server: shutting down server 31:41.101 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:41.101 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:41.101 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:41.101 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:41.101 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:41.101 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:41.101 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:41.101 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:41.101 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:41.101 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:41.118 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:41.119Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:41.119Z [INFO] agent.router.manager: shutting down 31:41.119 [INFO] TestAgent: consul server down 31:41.119 [INFO] TestAgent: shutdown complete 31:41.119 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30344 network=tcp 31:41.119 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30344 network=udp 31:41.119 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30345 network=tcp 31:41.620 [INFO] TestAgent: Waiting for endpoints to shut down 31:41.620 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_updateTTLCheck (1.08s) === CONT TestAgent_AddCheck_GRPC 2021-10-05T16:31:41.033Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:41.114Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:41.115 [INFO] Agent2.client.serf.lan: serf: EventMemberJoin: Node-0be06c17-199b-8258-9b3c-8bd4eba8431c 127.0.0.1 2021-10-05T16:31:41.115Z [INFO] agent.router: Initializing LAN area manager 31:41.115 [DEBUG] Agent2: restored health check from file: check=mem file=/tmp/consul-test/TestAgent_PersistCheck-TestAgent-agent844221023/checks/afc4fc7e48a0710a1dc94ef3e8bc5764 31:41.115 [INFO] Agent2.client.serf.lan: serf: Attempting re-join to previously known node: Node-36971cda-bf1e-5e57-f91f-cb635f12f30b: 127.0.0.1:30326 31:41.115 [INFO] Agent2: Started DNS server: address=127.0.0.1:30365 network=udp 31:41.116 [INFO] Agent2: Started DNS server: address=127.0.0.1:30365 network=tcp 31:41.116 [DEBUG] Agent2.client.memberlist.lan: memberlist: Failed to join 127.0.0.1: dial tcp 127.0.0.1:30326: connect: connection refused 31:41.116 [WARN] Agent2.client.serf.lan: serf: Failed to re-join any previously known node 31:41.128 [INFO] Agent2: Started HTTP server: address=127.0.0.1:30366 network=tcp 31:41.129 [INFO] Agent2: started state syncer 31:41.131 [INFO] Agent2: Started gRPC server: address=127.0.0.1:30371 network=tcp 2021-10-05T16:31:41.131Z [WARN] agent.router.manager: No servers available 31:41.131 [ERROR] Agent2.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:41.136 [INFO] Agent2: Requesting shutdown 31:41.136 [INFO] Agent2.client: shutting down client 31:41.136 [WARN] Agent2.client.serf.lan: serf: Shutdown without a Leave 31:41.139 [INFO] Agent2: consul client down 31:41.139 [INFO] Agent2: shutdown complete 31:41.139 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30365 network=tcp 31:41.139 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30365 network=udp 31:41.139 [INFO] Agent2: Stopping server: protocol=HTTP address=127.0.0.1:30366 network=tcp 31:41.640 [INFO] Agent2: Waiting for endpoints to shut down 31:41.640 [INFO] Agent2: Endpoints down 2021-10-05T16:31:40.418Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:40.441Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:40.442 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-36971cda-bf1e-5e57-f91f-cb635f12f30b 127.0.0.1 2021-10-05T16:31:40.442Z [INFO] agent.router: Initializing LAN area manager 31:40.442 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30323 network=udp 31:40.442 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30323 network=tcp 31:40.443 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30324 network=tcp 31:40.443 [INFO] TestAgent: started state syncer 31:40.444 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30343 network=tcp 2021-10-05T16:31:40.444Z [WARN] agent.router.manager: No servers available 31:40.444 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:40.458 [INFO] TestAgent: Requesting shutdown 31:40.458 [INFO] TestAgent.client: shutting down client 31:40.458 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:40.466 [INFO] TestAgent: consul client down 31:40.466 [INFO] TestAgent: shutdown complete 31:40.466 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30323 network=tcp 31:40.466 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30323 network=udp 31:40.466 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30324 network=tcp 31:40.966 [INFO] TestAgent: Waiting for endpoints to shut down 31:40.966 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PersistCheck (1.25s) === CONT TestAgent_AddCheck_ExecRemoteDisable [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:41.247Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.263Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:41.320 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f69a916f-cce2-6f69-6484-4dedeb327c4f Address:127.0.0.1:30405}]" 31:41.320 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30405 [Follower]" leader= 31:41.321 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f69a916f-cce2-6f69-6484-4dedeb327c4f.dc1 127.0.0.1 31:41.321 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f69a916f-cce2-6f69-6484-4dedeb327c4f 127.0.0.1 2021-10-05T16:31:41.321Z [INFO] agent.router: Initializing LAN area manager 31:41.321 [INFO] TestAgent.server: Adding LAN server: server="Node-f69a916f-cce2-6f69-6484-4dedeb327c4f (Addr: tcp/127.0.0.1:30405) (DC: dc1)" 31:41.321 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30400 network=udp 31:41.321 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f69a916f-cce2-6f69-6484-4dedeb327c4f.dc1 area=wan 31:41.321 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30400 network=tcp 31:41.322 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30401 network=tcp 31:41.322 [INFO] TestAgent: started state syncer 31:41.322 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30392 network=tcp 31:41.364 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.364 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30405 [Candidate]" term=2 31:41.393 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.393 [DEBUG] TestAgent.server.raft: vote granted: from=f69a916f-cce2-6f69-6484-4dedeb327c4f term=2 tally=1 31:41.393 [INFO] TestAgent.server.raft: election won: tally=1 31:41.393 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30405 [Leader]" 31:41.393 [INFO] TestAgent.server: cluster leadership acquired 31:41.393 [INFO] TestAgent.server: New leader elected: payload=Node-f69a916f-cce2-6f69-6484-4dedeb327c4f 31:41.415 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30405 31:41.435 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.452 [INFO] TestAgent: Requesting shutdown 31:41.452 [INFO] TestAgent.server: shutting down server 31:41.452 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:41.452 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:41.468 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:41.468Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:41.468Z [INFO] agent.router.manager: shutting down 31:41.468 [INFO] TestAgent: consul server down 31:41.468 [INFO] TestAgent: shutdown complete 31:41.468 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30400 network=tcp 31:41.468 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30400 network=udp 31:41.468 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30401 network=tcp 31:41.469 [ERROR] TestAgent.server.connect: Raft apply failed: error="raft is already shutdown" 31:41.469 [ERROR] TestAgent.server: failed to establish leadership: error="raft is already shutdown" 31:41.970 [INFO] TestAgent: Waiting for endpoints to shut down 31:41.970 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_Alias_userToken (0.74s) === CONT TestAgent_AddCheck_ExecDisable 2021-10-05T16:31:41.059Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.059Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:41.101Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.101Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:41.142 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:eb4b0b24-8e78-c0d1-05a2-494594ab07f4 Address:127.0.0.1:30377}]" 31:41.142 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30377 [Follower]" leader= 31:41.143 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-eb4b0b24-8e78-c0d1-05a2-494594ab07f4.dc1 127.0.0.1 31:41.144 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-eb4b0b24-8e78-c0d1-05a2-494594ab07f4 127.0.0.1 2021-10-05T16:31:41.144Z [INFO] agent.router: Initializing LAN area manager 31:41.144 [INFO] TestAgent.server: Adding LAN server: server="Node-eb4b0b24-8e78-c0d1-05a2-494594ab07f4 (Addr: tcp/127.0.0.1:30377) (DC: dc1)" 31:41.144 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30372 network=udp 31:41.144 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-eb4b0b24-8e78-c0d1-05a2-494594ab07f4.dc1 area=wan 31:41.144 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30372 network=tcp 31:41.145 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30373 network=tcp 31:41.145 [INFO] TestAgent: started state syncer 31:41.145 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30378 network=tcp 31:41.198 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.198 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30377 [Candidate]" term=2 31:41.216 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.216 [DEBUG] TestAgent.server.raft: vote granted: from=eb4b0b24-8e78-c0d1-05a2-494594ab07f4 term=2 tally=1 31:41.216 [INFO] TestAgent.server.raft: election won: tally=1 31:41.216 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30377 [Leader]" 31:41.216 [INFO] TestAgent.server: cluster leadership acquired 31:41.216 [INFO] TestAgent.server: New leader elected: payload=Node-eb4b0b24-8e78-c0d1-05a2-494594ab07f4 31:41.245 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30377 31:41.265 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.344 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:41.344 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:41.344 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:41.344 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:41.344 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:41.344 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-eb4b0b24-8e78-c0d1-05a2-494594ab07f4 31:41.344 [INFO] TestAgent.server: member joined, marking health alive: member=Node-eb4b0b24-8e78-c0d1-05a2-494594ab07f4 31:41.376 [INFO] TestAgent.server: federation state anti-entropy synced 31:41.430 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:41.437 [INFO] TestAgent: Synced node info 31:41.496 [DEBUG] TestAgent: removed check: check=mem 31:41.496 [DEBUG] TestAgent: removed check: check=mem 31:41.496 [INFO] TestAgent: Requesting shutdown 31:41.496 [INFO] TestAgent.server: shutting down server 31:41.496 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:41.496 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:41.496 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:41.496 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:41.496 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:41.496 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:41.496 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:41.496 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:41.496 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:41.496 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:41.508 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:41.510Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:41.510Z [INFO] agent.router.manager: shutting down 31:41.510 [INFO] TestAgent: consul server down 31:41.510 [INFO] TestAgent: shutdown complete 31:41.510 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30372 network=tcp 31:41.510 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30372 network=udp 31:41.510 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30373 network=tcp 31:42.010 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.010 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RemoveCheck (1.00s) === CONT TestAgent_AddCheck_RestoreState [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:41.069Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.116Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:41.216 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d10021f9-b4ed-5523-1234-8b9d753a97a4 Address:127.0.0.1:30384}]" 31:41.217 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30384 [Follower]" leader= 31:41.217 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d10021f9-b4ed-5523-1234-8b9d753a97a4.dc1 127.0.0.1 31:41.218 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d10021f9-b4ed-5523-1234-8b9d753a97a4 127.0.0.1 2021-10-05T16:31:41.218Z [INFO] agent.router: Initializing LAN area manager 31:41.218 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30379 network=udp 31:41.218 [INFO] TestAgent.server: Adding LAN server: server="Node-d10021f9-b4ed-5523-1234-8b9d753a97a4 (Addr: tcp/127.0.0.1:30384) (DC: dc1)" 31:41.218 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d10021f9-b4ed-5523-1234-8b9d753a97a4.dc1 area=wan 31:41.218 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30379 network=tcp 31:41.219 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30380 network=tcp 31:41.219 [INFO] TestAgent: started state syncer 31:41.219 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30399 network=tcp 31:41.277 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.277 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30384 [Candidate]" term=2 31:41.295 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.295 [DEBUG] TestAgent.server.raft: vote granted: from=d10021f9-b4ed-5523-1234-8b9d753a97a4 term=2 tally=1 31:41.295 [INFO] TestAgent.server.raft: election won: tally=1 31:41.295 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30384 [Leader]" 31:41.295 [INFO] TestAgent.server: cluster leadership acquired 31:41.295 [INFO] TestAgent.server: New leader elected: payload=Node-d10021f9-b4ed-5523-1234-8b9d753a97a4 31:41.308 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30384 31:41.343 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.404 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:41.404 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:41.404 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:41.404 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:41.404 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:41.404 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d10021f9-b4ed-5523-1234-8b9d753a97a4 31:41.404 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d10021f9-b4ed-5523-1234-8b9d753a97a4 31:41.420 [INFO] TestAgent.server: federation state anti-entropy synced 31:41.532 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:41.544 [INFO] TestAgent: Synced node info 31:41.621 [INFO] TestAgent: Requesting shutdown 31:41.621 [INFO] TestAgent.server: shutting down server 31:41.621 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:41.621 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:41.621 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:41.621 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:41.621 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:41.621 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:41.621 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:41.621 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:41.621 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:41.621 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:41.636 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:41.637Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:41.637Z [INFO] agent.router.manager: shutting down 31:41.637 [INFO] TestAgent: consul server down 31:41.637 [INFO] TestAgent: shutdown complete 31:41.637 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30379 network=tcp 31:41.637 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30379 network=udp 31:41.637 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30380 network=tcp 31:42.138 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.138 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_Alias_userAndSetToken (1.10s) === CONT TestAgent_AddCheck_MissingService [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:41.663Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.695Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:41.775 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3752e28a-8717-c2ad-51f0-35e7a174ce99 Address:127.0.0.1:30419}]" 31:41.776 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30419 [Follower]" leader= 31:41.777 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3752e28a-8717-c2ad-51f0-35e7a174ce99.dc1 127.0.0.1 31:41.777 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3752e28a-8717-c2ad-51f0-35e7a174ce99 127.0.0.1 2021-10-05T16:31:41.777Z [INFO] agent.router: Initializing LAN area manager 31:41.777 [INFO] TestAgent.server: Adding LAN server: server="Node-3752e28a-8717-c2ad-51f0-35e7a174ce99 (Addr: tcp/127.0.0.1:30419) (DC: dc1)" 31:41.778 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3752e28a-8717-c2ad-51f0-35e7a174ce99.dc1 area=wan 31:41.778 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30414 network=udp 31:41.778 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30414 network=tcp 31:41.778 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30415 network=tcp 31:41.778 [INFO] TestAgent: started state syncer 31:41.778 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29477 network=tcp 31:41.837 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.837 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30419 [Candidate]" term=2 31:41.899 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.899 [DEBUG] TestAgent.server.raft: vote granted: from=3752e28a-8717-c2ad-51f0-35e7a174ce99 term=2 tally=1 31:41.899 [INFO] TestAgent.server.raft: election won: tally=1 31:41.899 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30419 [Leader]" 31:41.899 [INFO] TestAgent.server: cluster leadership acquired 31:41.899 [INFO] TestAgent.server: New leader elected: payload=Node-3752e28a-8717-c2ad-51f0-35e7a174ce99 31:41.909 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30419 31:41.927 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.988 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:41.988 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:41.988 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:41.988 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:41.988 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:41.988 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3752e28a-8717-c2ad-51f0-35e7a174ce99 31:41.988 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3752e28a-8717-c2ad-51f0-35e7a174ce99 31:42.014 [INFO] TestAgent.server: federation state anti-entropy synced 31:42.020 [INFO] TestAgent: Requesting shutdown 31:42.020 [INFO] TestAgent.server: shutting down server 31:42.020 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:42.020 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:42.020 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:42.020 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:42.020 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.020 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:42.020 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:42.020 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:42.020 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:42.020 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:42.020 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:42.032 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.036Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.036Z [INFO] agent.router.manager: shutting down 31:42.036 [INFO] TestAgent: consul server down 31:42.036 [INFO] TestAgent: shutdown complete 31:42.036 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30414 network=tcp 31:42.036 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30414 network=udp 31:42.036 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30415 network=tcp 31:42.536 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.536 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_ExecRemoteDisable (0.89s) === CONT TestAgent_AddCheck_MinInterval [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:41.530Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.585Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:41.673 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:38346855-12b6-bf8b-18ca-db4dffce4488 Address:127.0.0.1:30412}]" 31:41.674 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-38346855-12b6-bf8b-18ca-db4dffce4488.dc1 127.0.0.1 31:41.674 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-38346855-12b6-bf8b-18ca-db4dffce4488 127.0.0.1 2021-10-05T16:31:41.674Z [INFO] agent.router: Initializing LAN area manager 31:41.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30407 network=udp 31:41.675 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30412 [Follower]" leader= 31:41.675 [INFO] TestAgent.server: Adding LAN server: server="Node-38346855-12b6-bf8b-18ca-db4dffce4488 (Addr: tcp/127.0.0.1:30412) (DC: dc1)" 31:41.675 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-38346855-12b6-bf8b-18ca-db4dffce4488.dc1 area=wan 31:41.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30407 network=tcp 31:41.680 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30408 network=tcp 31:41.680 [INFO] TestAgent: started state syncer 31:41.680 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29400 network=tcp 31:41.716 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.716 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30412 [Candidate]" term=2 31:41.729 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.729 [DEBUG] TestAgent.server.raft: vote granted: from=38346855-12b6-bf8b-18ca-db4dffce4488 term=2 tally=1 31:41.729 [INFO] TestAgent.server.raft: election won: tally=1 31:41.729 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30412 [Leader]" 31:41.730 [INFO] TestAgent.server: cluster leadership acquired 31:41.730 [INFO] TestAgent.server: New leader elected: payload=Node-38346855-12b6-bf8b-18ca-db4dffce4488 31:41.748 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30412 31:41.784 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.837 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:41.837 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:41.837 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:41.837 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:41.837 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:41.837 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-38346855-12b6-bf8b-18ca-db4dffce4488 31:41.837 [INFO] TestAgent.server: member joined, marking health alive: member=Node-38346855-12b6-bf8b-18ca-db4dffce4488 31:41.896 [INFO] TestAgent.server: federation state anti-entropy synced 31:42.076 [INFO] TestAgent: Requesting shutdown 31:42.076 [INFO] TestAgent.server: shutting down server 31:42.076 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:42.076 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:42.076 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:42.076 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:42.076 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.076 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:42.076 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:42.076 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:42.076 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:42.076 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:42.076 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:42.088 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.089Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.089Z [INFO] agent.router.manager: shutting down 31:42.089 [INFO] TestAgent: consul server down 31:42.089 [INFO] TestAgent: shutdown complete 31:42.089 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30407 network=tcp 31:42.089 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30407 network=udp 31:42.089 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30408 network=tcp 31:42.596 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.596 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_Alias (1.08s) === CONT TestAgent_AddCheck_StartPassing 2021-10-05T16:31:41.642Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.674Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:41.723 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:35ef45cd-b172-17cc-740c-8d1b38b7b1b9 Address:127.0.0.1:29406}]" 31:41.723 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29406 [Follower]" leader= 31:41.724 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-35ef45cd-b172-17cc-740c-8d1b38b7b1b9.dc1 127.0.0.1 31:41.725 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-35ef45cd-b172-17cc-740c-8d1b38b7b1b9 127.0.0.1 2021-10-05T16:31:41.725Z [INFO] agent.router: Initializing LAN area manager 31:41.725 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29401 network=udp 31:41.726 [INFO] TestAgent.server: Adding LAN server: server="Node-35ef45cd-b172-17cc-740c-8d1b38b7b1b9 (Addr: tcp/127.0.0.1:29406) (DC: dc1)" 31:41.726 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-35ef45cd-b172-17cc-740c-8d1b38b7b1b9.dc1 area=wan 31:41.726 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29401 network=tcp 31:41.727 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29402 network=tcp 31:41.727 [INFO] TestAgent: started state syncer 31:41.727 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30413 network=tcp 31:41.762 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.762 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29406 [Candidate]" term=2 31:41.792 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.792 [DEBUG] TestAgent.server.raft: vote granted: from=35ef45cd-b172-17cc-740c-8d1b38b7b1b9 term=2 tally=1 31:41.792 [INFO] TestAgent.server.raft: election won: tally=1 31:41.792 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29406 [Leader]" 31:41.794 [INFO] TestAgent.server: cluster leadership acquired 31:41.794 [INFO] TestAgent.server: New leader elected: payload=Node-35ef45cd-b172-17cc-740c-8d1b38b7b1b9 31:41.801 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29406 31:41.866 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.904 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:41.904 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:41.904 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:41.904 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:41.904 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:41.904 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-35ef45cd-b172-17cc-740c-8d1b38b7b1b9 31:41.904 [INFO] TestAgent.server: member joined, marking health alive: member=Node-35ef45cd-b172-17cc-740c-8d1b38b7b1b9 31:41.922 [INFO] TestAgent.server: federation state anti-entropy synced 31:42.090 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:42.096 [INFO] TestAgent: Synced node info 31:42.096 [DEBUG] TestAgent: Node info in sync 31:42.099 [INFO] TestAgent: Requesting shutdown 31:42.099 [INFO] TestAgent.server: shutting down server 31:42.099 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:42.099 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:42.099 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:42.099 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:42.099 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.099 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:42.099 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:42.099 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:42.099 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:42.099 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:42.104 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.107Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.107Z [INFO] agent.router.manager: shutting down 31:42.107 [INFO] TestAgent: consul server down 31:42.107 [INFO] TestAgent: shutdown complete 31:42.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29401 network=tcp 31:42.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29401 network=udp 31:42.107 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29402 network=tcp 31:42.612 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.612 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_GRPC (0.99s) === CONT TestAgent_AddCheck 2021-10-05T16:31:41.536Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:41.593Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:41.692 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:46a90208-f038-86e5-e768-5bbd9a8f8093 Address:127.0.0.1:30398}]" 31:41.693 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-46a90208-f038-86e5-e768-5bbd9a8f8093.dc1 127.0.0.1 31:41.693 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-46a90208-f038-86e5-e768-5bbd9a8f8093 127.0.0.1 2021-10-05T16:31:41.693Z [INFO] agent.router: Initializing LAN area manager 31:41.694 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30393 network=udp 31:41.694 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30398 [Follower]" leader= 31:41.694 [INFO] TestAgent.server: Adding LAN server: server="Node-46a90208-f038-86e5-e768-5bbd9a8f8093 (Addr: tcp/127.0.0.1:30398) (DC: dc1)" 31:41.694 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-46a90208-f038-86e5-e768-5bbd9a8f8093.dc1 area=wan 31:41.694 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30393 network=tcp 31:41.695 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30394 network=tcp 31:41.695 [INFO] TestAgent: started state syncer 31:41.695 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30406 network=tcp 31:41.736 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.736 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30398 [Candidate]" term=2 31:41.761 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.762 [DEBUG] TestAgent.server.raft: vote granted: from=46a90208-f038-86e5-e768-5bbd9a8f8093 term=2 tally=1 31:41.762 [INFO] TestAgent.server.raft: election won: tally=1 31:41.762 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30398 [Leader]" 31:41.762 [INFO] TestAgent.server: cluster leadership acquired 31:41.762 [INFO] TestAgent.server: New leader elected: payload=Node-46a90208-f038-86e5-e768-5bbd9a8f8093 31:41.774 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30398 31:41.797 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.842 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:41.842 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:41.842 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:41.842 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:41.842 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:41.842 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-46a90208-f038-86e5-e768-5bbd9a8f8093 31:41.842 [INFO] TestAgent.server: member joined, marking health alive: member=Node-46a90208-f038-86e5-e768-5bbd9a8f8093 31:41.873 [INFO] TestAgent.server: federation state anti-entropy synced 31:42.032 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:42.048 [INFO] TestAgent: Synced node info 31:42.116 [INFO] TestAgent: Requesting shutdown 31:42.116 [INFO] TestAgent.server: shutting down server 31:42.116 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:42.116 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:42.116 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:42.116 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:42.116 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.116 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:42.116 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:42.116 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:42.116 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:42.116 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:42.124 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.128Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.128Z [INFO] agent.router.manager: shutting down 31:42.128 [INFO] TestAgent: consul server down 31:42.128 [INFO] TestAgent: shutdown complete 31:42.128 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30393 network=tcp 31:42.128 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30393 network=udp 31:42.128 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30394 network=tcp 31:42.632 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.632 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_Alias_setToken (1.12s) === CONT TestAgent_IndexChurn === RUN TestAgent_IndexChurn/no_tags 2021-10-05T16:31:41.996Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.010Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:42.080 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f3a71674-1519-3158-5206-b4867a45f6ab Address:127.0.0.1:29448}]" 31:42.080 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f3a71674-1519-3158-5206-b4867a45f6ab.dc1 127.0.0.1 31:42.081 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f3a71674-1519-3158-5206-b4867a45f6ab 127.0.0.1 2021-10-05T16:31:42.081Z [INFO] agent.router: Initializing LAN area manager 31:42.081 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29478 network=udp 31:42.081 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29448 [Follower]" leader= 31:42.084 [INFO] TestAgent.server: Adding LAN server: server="Node-f3a71674-1519-3158-5206-b4867a45f6ab (Addr: tcp/127.0.0.1:29448) (DC: dc1)" 31:42.084 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f3a71674-1519-3158-5206-b4867a45f6ab.dc1 area=wan 31:42.084 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29478 network=tcp 31:42.085 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29444 network=tcp 31:42.085 [INFO] TestAgent: started state syncer 31:42.085 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29407 network=tcp 31:42.131 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.131 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29448 [Candidate]" term=2 31:42.161 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.161 [DEBUG] TestAgent.server.raft: vote granted: from=f3a71674-1519-3158-5206-b4867a45f6ab term=2 tally=1 31:42.161 [INFO] TestAgent.server.raft: election won: tally=1 31:42.161 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29448 [Leader]" 31:42.164 [INFO] TestAgent.server: cluster leadership acquired 31:42.164 [INFO] TestAgent.server: New leader elected: payload=Node-f3a71674-1519-3158-5206-b4867a45f6ab 31:42.178 [INFO] TestAgent: Requesting shutdown 31:42.178 [INFO] TestAgent.server: shutting down server 31:42.178 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.178 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:42.179 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29448 31:42.188 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.197Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.197Z [INFO] agent.router.manager: shutting down 31:42.200 [INFO] TestAgent: consul server down 31:42.200 [INFO] TestAgent: shutdown complete 31:42.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29478 network=tcp 31:42.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29478 network=udp 31:42.200 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29444 network=tcp 31:42.200 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:42.200 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:42.200 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:42.200 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 31:42.200 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 31:42.700 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.700 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_ExecDisable (0.73s) === CONT TestAgent_ReconnectConfigWanDisabled 2021-10-05T16:31:40.890Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:40.920Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:41.040 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c35ae4e3-2e5d-5348-d12c-373ef69a5d80 Address:127.0.0.1:30356}]" 31:41.041 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c35ae4e3-2e5d-5348-d12c-373ef69a5d80.dc1 127.0.0.1 31:41.041 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c35ae4e3-2e5d-5348-d12c-373ef69a5d80 127.0.0.1 2021-10-05T16:31:41.041Z [INFO] agent.router: Initializing LAN area manager 31:41.042 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30351 network=udp 31:41.042 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30356 [Follower]" leader= 31:41.042 [INFO] TestAgent.server: Adding LAN server: server="Node-c35ae4e3-2e5d-5348-d12c-373ef69a5d80 (Addr: tcp/127.0.0.1:30356) (DC: dc1)" 31:41.042 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c35ae4e3-2e5d-5348-d12c-373ef69a5d80.dc1 area=wan 31:41.042 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30351 network=tcp 31:41.043 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30352 network=tcp 31:41.043 [INFO] TestAgent: started state syncer 31:41.043 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30357 network=tcp 31:41.093 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:41.093 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30356 [Candidate]" term=2 31:41.109 [DEBUG] TestAgent.server.raft: votes: needed=1 31:41.109 [DEBUG] TestAgent.server.raft: vote granted: from=c35ae4e3-2e5d-5348-d12c-373ef69a5d80 term=2 tally=1 31:41.109 [INFO] TestAgent.server.raft: election won: tally=1 31:41.109 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30356 [Leader]" 31:41.109 [INFO] TestAgent.server: cluster leadership acquired 31:41.110 [INFO] TestAgent.server: New leader elected: payload=Node-c35ae4e3-2e5d-5348-d12c-373ef69a5d80 31:41.118 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30356 31:41.147 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:41.183 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:41.183 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:41.183 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:41.183 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:41.183 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:41.183 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c35ae4e3-2e5d-5348-d12c-373ef69a5d80 31:41.183 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c35ae4e3-2e5d-5348-d12c-373ef69a5d80 31:41.208 [INFO] TestAgent: Synced node info 31:41.209 [DEBUG] TestAgent: Node info in sync 31:41.216 [INFO] TestAgent.server: federation state anti-entropy synced 31:41.458 [WARN] TestAgent: check has interval below minimum: check=tls minimum_interval=1s 31:42.220 [DEBUG] TestAgent: Check status updated: check=tls status=passing 31:42.229 [INFO] TestAgent: Requesting shutdown 31:42.229 [INFO] TestAgent.server: shutting down server 31:42.229 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:42.229 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:42.229 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:42.229 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:42.229 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.229 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:42.229 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:42.229 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:42.229 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:42.229 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:42.238 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.242Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.242Z [INFO] agent.router.manager: shutting down 31:42.242 [INFO] TestAgent: consul server down 31:42.242 [INFO] TestAgent: shutdown complete 31:42.242 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30351 network=tcp 31:42.242 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30351 network=udp 31:42.242 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30352 network=tcp 31:42.743 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.743 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_HTTPCheck_TLSSkipVerify (1.88s) === CONT TestAgent_ReconnectConfigSettings [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:42.038Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.054Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:42.087 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a19e5f7b-47a7-a7f6-6d45-1d17666f8b01 Address:127.0.0.1:29413}]" 31:42.088 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a19e5f7b-47a7-a7f6-6d45-1d17666f8b01.dc1 127.0.0.1 31:42.088 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29413 [Follower]" leader= 31:42.088 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a19e5f7b-47a7-a7f6-6d45-1d17666f8b01 127.0.0.1 2021-10-05T16:31:42.088Z [INFO] agent.router: Initializing LAN area manager 31:42.088 [INFO] TestAgent.server: Adding LAN server: server="Node-a19e5f7b-47a7-a7f6-6d45-1d17666f8b01 (Addr: tcp/127.0.0.1:29413) (DC: dc1)" 31:42.088 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a19e5f7b-47a7-a7f6-6d45-1d17666f8b01.dc1 area=wan 31:42.088 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29408 network=udp 31:42.089 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29408 network=tcp 31:42.089 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29409 network=tcp 31:42.089 [INFO] TestAgent: started state syncer 31:42.089 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29414 network=tcp 31:42.127 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.127 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29413 [Candidate]" term=2 31:42.154 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.154 [DEBUG] TestAgent.server.raft: vote granted: from=a19e5f7b-47a7-a7f6-6d45-1d17666f8b01 term=2 tally=1 31:42.154 [INFO] TestAgent.server.raft: election won: tally=1 31:42.154 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29413 [Leader]" 31:42.154 [INFO] TestAgent.server: cluster leadership acquired 31:42.154 [INFO] TestAgent.server: New leader elected: payload=Node-a19e5f7b-47a7-a7f6-6d45-1d17666f8b01 31:42.167 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29413 31:42.192 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:42.230 [INFO] TestAgent: Synced node info 31:42.243 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:42.243 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:42.243 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:42.243 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:42.243 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:42.243 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a19e5f7b-47a7-a7f6-6d45-1d17666f8b01 31:42.243 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a19e5f7b-47a7-a7f6-6d45-1d17666f8b01 31:42.258 [INFO] TestAgent.server: federation state anti-entropy synced 31:42.456 [INFO] TestAgent: Requesting shutdown 31:42.456 [INFO] TestAgent.server: shutting down server 31:42.457 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:42.457 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:42.457 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:42.457 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:42.457 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.457 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:42.457 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:42.457 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:42.457 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:42.457 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:42.484 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.488Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.488Z [INFO] agent.router.manager: shutting down 31:42.488 [INFO] TestAgent: consul server down 31:42.488 [INFO] TestAgent: shutdown complete 31:42.488 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29408 network=tcp 31:42.488 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29408 network=udp 31:42.488 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29409 network=tcp 31:42.990 [INFO] TestAgent: Waiting for endpoints to shut down 31:42.990 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_RestoreState (0.98s) === CONT TestAgent_TokenStore [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:42.153Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.153Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:42.166Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.166Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:42.243 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d60020e9-7ff5-f2d7-078b-ad428f8771a6 Address:127.0.0.1:29490}]" 31:42.244 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29490 [Follower]" leader= 31:42.244 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d60020e9-7ff5-f2d7-078b-ad428f8771a6.dc1 127.0.0.1 31:42.244 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d60020e9-7ff5-f2d7-078b-ad428f8771a6 127.0.0.1 2021-10-05T16:31:42.244Z [INFO] agent.router: Initializing LAN area manager 31:42.245 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29415 network=udp 31:42.245 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d60020e9-7ff5-f2d7-078b-ad428f8771a6.dc1 area=wan 31:42.245 [INFO] TestAgent.server: Adding LAN server: server="Node-d60020e9-7ff5-f2d7-078b-ad428f8771a6 (Addr: tcp/127.0.0.1:29490) (DC: dc1)" 31:42.245 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29415 network=tcp 31:42.245 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29486 network=tcp 31:42.245 [INFO] TestAgent: started state syncer 31:42.245 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29435 network=tcp 31:42.298 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.298 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29490 [Candidate]" term=2 31:42.313 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.313 [DEBUG] TestAgent.server.raft: vote granted: from=d60020e9-7ff5-f2d7-078b-ad428f8771a6 term=2 tally=1 31:42.313 [INFO] TestAgent.server.raft: election won: tally=1 31:42.313 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29490 [Leader]" 31:42.314 [INFO] TestAgent.server: cluster leadership acquired 31:42.314 [INFO] TestAgent.server: New leader elected: payload=Node-d60020e9-7ff5-f2d7-078b-ad428f8771a6 31:42.319 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29490 31:42.360 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:42.464 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:42.464 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:42.464 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:42.464 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:42.464 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:42.464 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d60020e9-7ff5-f2d7-078b-ad428f8771a6 31:42.464 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d60020e9-7ff5-f2d7-078b-ad428f8771a6 31:42.560 [INFO] TestAgent.server: federation state anti-entropy synced 31:42.580 [INFO] TestAgent: Requesting shutdown 31:42.580 [INFO] TestAgent.server: shutting down server 31:42.580 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:42.580 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:42.580 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:42.580 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:42.580 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.580 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:42.580 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:42.580 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:42.580 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:42.580 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:42.580 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:42.600 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.604Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.604Z [INFO] agent.router.manager: shutting down 31:42.604 [INFO] TestAgent: consul server down 31:42.604 [INFO] TestAgent: shutdown complete 31:42.604 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29415 network=tcp 31:42.604 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29415 network=udp 31:42.604 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29486 network=tcp 31:43.106 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.106 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_MissingService (0.97s) === CONT TestAgent_RPCPing [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:42.670Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.670Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:42.702Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.702Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:42.768 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:49f0226b-eda9-fb08-7734-df6bda4f0ad5 Address:127.0.0.1:29427}]" 31:42.768 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29427 [Follower]" leader= 31:42.768 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-49f0226b-eda9-fb08-7734-df6bda4f0ad5.dc1 127.0.0.1 31:42.770 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-49f0226b-eda9-fb08-7734-df6bda4f0ad5 127.0.0.1 2021-10-05T16:31:42.770Z [INFO] agent.router: Initializing LAN area manager 31:42.771 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29471 network=udp 31:42.771 [INFO] TestAgent.server: Adding LAN server: server="Node-49f0226b-eda9-fb08-7734-df6bda4f0ad5 (Addr: tcp/127.0.0.1:29427) (DC: dc1)" 31:42.771 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-49f0226b-eda9-fb08-7734-df6bda4f0ad5.dc1 area=wan 31:42.771 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29471 network=tcp 31:42.772 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29423 network=tcp 31:42.772 [INFO] TestAgent: started state syncer 31:42.772 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29484 network=tcp 31:42.833 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.833 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29427 [Candidate]" term=2 31:42.853 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.853 [DEBUG] TestAgent.server.raft: vote granted: from=49f0226b-eda9-fb08-7734-df6bda4f0ad5 term=2 tally=1 31:42.853 [INFO] TestAgent.server.raft: election won: tally=1 31:42.853 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29427 [Leader]" 31:42.854 [INFO] TestAgent.server: cluster leadership acquired 31:42.854 [INFO] TestAgent.server: New leader elected: payload=Node-49f0226b-eda9-fb08-7734-df6bda4f0ad5 31:42.866 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29427 31:42.898 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:42.913 [INFO] TestAgent: Requesting shutdown 31:42.914 [INFO] TestAgent.server: shutting down server 31:42.914 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:42.914 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:42.925 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:42.928Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:42.928Z [INFO] agent.router.manager: shutting down 31:42.932 [INFO] TestAgent: consul server down 31:42.932 [INFO] TestAgent: shutdown complete 31:42.932 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29471 network=tcp 31:42.932 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29471 network=udp 31:42.932 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29423 network=tcp 31:42.932 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:42.933 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:43.433 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.433 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_StartPassing (0.84s) === CONT TestAgent_StartStop 2021-10-05T16:31:42.559Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.559Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:42.629Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.629Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:42.715 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:87dc4074-109d-905d-b873-4ecafcb42356 Address:127.0.0.1:29455}]" 31:42.715 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29455 [Follower]" leader= 31:42.716 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-87dc4074-109d-905d-b873-4ecafcb42356.dc1 127.0.0.1 31:42.726 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-87dc4074-109d-905d-b873-4ecafcb42356 127.0.0.1 2021-10-05T16:31:42.726Z [INFO] agent.router: Initializing LAN area manager 31:42.726 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29436 network=udp 31:42.727 [INFO] TestAgent.server: Adding LAN server: server="Node-87dc4074-109d-905d-b873-4ecafcb42356 (Addr: tcp/127.0.0.1:29455) (DC: dc1)" 31:42.727 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-87dc4074-109d-905d-b873-4ecafcb42356.dc1 area=wan 31:42.727 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29436 network=tcp 31:42.727 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29451 network=tcp 31:42.727 [INFO] TestAgent: started state syncer 31:42.727 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29470 network=tcp 31:42.767 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.767 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29455 [Candidate]" term=2 31:42.781 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.781 [DEBUG] TestAgent.server.raft: vote granted: from=87dc4074-109d-905d-b873-4ecafcb42356 term=2 tally=1 31:42.781 [INFO] TestAgent.server.raft: election won: tally=1 31:42.781 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29455 [Leader]" 31:42.782 [INFO] TestAgent.server: cluster leadership acquired 31:42.782 [INFO] TestAgent.server: New leader elected: payload=Node-87dc4074-109d-905d-b873-4ecafcb42356 31:42.790 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29455 31:42.820 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:42.885 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:42.885 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:42.885 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:42.885 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:42.885 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:42.885 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-87dc4074-109d-905d-b873-4ecafcb42356 31:42.885 [INFO] TestAgent.server: member joined, marking health alive: member=Node-87dc4074-109d-905d-b873-4ecafcb42356 31:42.931 [INFO] TestAgent.server: federation state anti-entropy synced 31:43.034 [WARN] TestAgent: check has interval below minimum: check=mem minimum_interval=1s 31:43.034 [INFO] TestAgent: Requesting shutdown 31:43.035 [INFO] TestAgent.server: shutting down server 31:43.035 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:43.035 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:43.035 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:43.035 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:43.035 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:43.035 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:43.035 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:43.035 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:43.035 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:43.035 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:43.035 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:43.038 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:43.042Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:43.042Z [INFO] agent.router.manager: shutting down 31:43.042 [INFO] TestAgent: consul server down 31:43.042 [INFO] TestAgent: shutdown complete 31:43.042 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29436 network=tcp 31:43.042 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29436 network=udp 31:43.042 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29451 network=tcp 31:43.544 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.544 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_AddCheck_MinInterval (1.01s) === CONT TestAgent_Services_ExposeConfig [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:42.724Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.740Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:42.826 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:08fb5da1-9a8b-c3dc-c341-1a438807e80a Address:127.0.0.1:29476}]" 31:42.827 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-08fb5da1-9a8b-c3dc-c341-1a438807e80a 127.0.0.1 2021-10-05T16:31:42.827Z [INFO] agent.router: Initializing LAN area manager 31:42.827 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29450 network=udp 31:42.827 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29476 [Follower]" leader= 31:42.828 [INFO] TestAgent.server: Adding LAN server: server="Node-08fb5da1-9a8b-c3dc-c341-1a438807e80a (Addr: tcp/127.0.0.1:29476) (DC: dc1)" 31:42.828 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29450 network=tcp 31:42.828 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29472 network=tcp 31:42.828 [INFO] TestAgent: started state syncer 31:42.829 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30385 network=tcp 31:42.888 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.888 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29476 [Candidate]" term=2 31:42.925 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.925 [DEBUG] TestAgent.server.raft: vote granted: from=08fb5da1-9a8b-c3dc-c341-1a438807e80a term=2 tally=1 31:42.925 [INFO] TestAgent.server.raft: election won: tally=1 31:42.925 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29476 [Leader]" 31:42.925 [INFO] TestAgent.server: cluster leadership acquired 31:42.925 [INFO] TestAgent.server: New leader elected: payload=Node-08fb5da1-9a8b-c3dc-c341-1a438807e80a 31:42.952 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29476 31:42.990 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:43.052 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:43.052 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:43.052 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:43.052 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:43.052 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:43.052 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-08fb5da1-9a8b-c3dc-c341-1a438807e80a 31:43.052 [INFO] TestAgent.server: member joined, marking health alive: member=Node-08fb5da1-9a8b-c3dc-c341-1a438807e80a 31:43.100 [INFO] TestAgent.server: federation state anti-entropy synced 31:43.176 [INFO] TestAgent: Requesting shutdown 31:43.176 [INFO] TestAgent.server: shutting down server 31:43.176 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:43.176 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:43.176 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:43.176 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:43.176 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:43.176 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:43.176 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:43.176 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:43.176 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:43.176 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:43.176 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 2021-10-05T16:31:43.188Z [INFO] agent.router.manager: shutting down 31:43.188 [INFO] TestAgent: consul server down 31:43.188 [INFO] TestAgent: shutdown complete 31:43.188 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29450 network=tcp 31:43.188 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29450 network=udp 31:43.188 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29472 network=tcp 31:43.692 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.692 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:42.647Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.647Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:42.689Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.689Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:42.755 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:76e452d7-51c0-528e-b122-274aa452d7d9 Address:127.0.0.1:29469}]" 31:42.755 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29469 [Follower]" leader= 31:42.757 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-76e452d7-51c0-528e-b122-274aa452d7d9.dc1 127.0.0.1 31:42.757 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-76e452d7-51c0-528e-b122-274aa452d7d9 127.0.0.1 2021-10-05T16:31:42.757Z [INFO] agent.router: Initializing LAN area manager 31:42.758 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29485 network=udp 31:42.758 [INFO] TestAgent.server: Adding LAN server: server="Node-76e452d7-51c0-528e-b122-274aa452d7d9 (Addr: tcp/127.0.0.1:29469) (DC: dc1)" 31:42.758 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-76e452d7-51c0-528e-b122-274aa452d7d9.dc1 area=wan 31:42.758 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29485 network=tcp 31:42.759 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29465 network=tcp 31:42.759 [INFO] TestAgent: started state syncer 31:42.759 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29463 network=tcp 31:42.799 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.799 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29469 [Candidate]" term=2 31:42.826 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.826 [DEBUG] TestAgent.server.raft: vote granted: from=76e452d7-51c0-528e-b122-274aa452d7d9 term=2 tally=1 31:42.826 [INFO] TestAgent.server.raft: election won: tally=1 31:42.826 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29469 [Leader]" 31:42.828 [INFO] TestAgent.server: cluster leadership acquired 31:42.828 [INFO] TestAgent.server: New leader elected: payload=Node-76e452d7-51c0-528e-b122-274aa452d7d9 31:42.843 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29469 31:42.864 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:42.928 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:42.928 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:42.928 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:42.928 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:42.928 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:42.928 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-76e452d7-51c0-528e-b122-274aa452d7d9 31:42.928 [INFO] TestAgent.server: member joined, marking health alive: member=Node-76e452d7-51c0-528e-b122-274aa452d7d9 31:42.960 [INFO] TestAgent.server: federation state anti-entropy synced 31:43.037 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.053 [INFO] TestAgent: Synced node info 31:43.183 [INFO] TestAgent: Requesting shutdown 31:43.183 [INFO] TestAgent.server: shutting down server 31:43.183 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:43.183 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:43.183 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:43.183 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:43.183 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:43.183 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:43.183 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:43.183 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:43.183 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:43.184 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:43.191 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:43.192Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:43.192Z [INFO] agent.router.manager: shutting down 31:43.192 [INFO] TestAgent: consul server down 31:43.192 [INFO] TestAgent: shutdown complete 31:43.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29485 network=tcp 31:43.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29485 network=udp 31:43.192 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29465 network=tcp 31:43.692 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.692 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ReconnectConfigWanDisabled (0.99s) === CONT TestAgent_HostBadACL --- PASS: TestAgent_AddCheck (1.08s) === CONT TestAgent_Host [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:43.132Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.146Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.186 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:07a53f81-95d3-3371-372a-dc30dde7ad5e Address:127.0.0.1:29441}]" 31:43.186 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-07a53f81-95d3-3371-372a-dc30dde7ad5e.dc1 127.0.0.1 31:43.187 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29441 [Follower]" leader= 31:43.187 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-07a53f81-95d3-3371-372a-dc30dde7ad5e 127.0.0.1 2021-10-05T16:31:43.187Z [INFO] agent.router: Initializing LAN area manager 31:43.187 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29457 network=udp 31:43.188 [INFO] TestAgent.server: Adding LAN server: server="Node-07a53f81-95d3-3371-372a-dc30dde7ad5e (Addr: tcp/127.0.0.1:29441) (DC: dc1)" 31:43.188 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-07a53f81-95d3-3371-372a-dc30dde7ad5e.dc1 area=wan 31:43.188 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29457 network=tcp 31:43.188 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29437 network=tcp 31:43.188 [INFO] TestAgent: started state syncer 31:43.189 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29442 network=tcp 31:43.233 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:43.233 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29441 [Candidate]" term=2 31:43.256 [DEBUG] TestAgent.server.raft: votes: needed=1 31:43.256 [DEBUG] TestAgent.server.raft: vote granted: from=07a53f81-95d3-3371-372a-dc30dde7ad5e term=2 tally=1 31:43.256 [INFO] TestAgent.server.raft: election won: tally=1 31:43.256 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29441 [Leader]" 31:43.257 [INFO] TestAgent.server: cluster leadership acquired 31:43.257 [INFO] TestAgent.server: New leader elected: payload=Node-07a53f81-95d3-3371-372a-dc30dde7ad5e 31:43.289 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29441 31:43.308 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:43.336 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:43.336 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:43.336 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:43.336 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:43.336 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:43.336 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-07a53f81-95d3-3371-372a-dc30dde7ad5e 31:43.336 [INFO] TestAgent.server: member joined, marking health alive: member=Node-07a53f81-95d3-3371-372a-dc30dde7ad5e 31:43.362 [INFO] TestAgent: Requesting shutdown 31:43.362 [INFO] TestAgent.server: shutting down server 31:43.362 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:43.362 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:43.362 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:43.362 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:43.362 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:43.362 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:43.362 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:43.362 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:43.362 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:43.363 [INFO] TestAgent.server: federation state anti-entropy synced 31:43.363 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:43.368 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:43.376Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:43.376Z [INFO] agent.router.manager: shutting down 31:43.376 [INFO] TestAgent: consul server down 31:43.376 [INFO] TestAgent: shutdown complete 31:43.376 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29457 network=tcp 31:43.377 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29457 network=udp 31:43.377 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29437 network=tcp 31:43.882 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.882 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RPCPing (0.78s) === CONT TestAgentConnectAuthorize_defaultAllow 2021-10-05T16:31:43.002Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.016Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.082 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:afa34dfe-ca21-fc5e-9780-ce347e129d38 Address:127.0.0.1:30335}]" 31:43.083 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-afa34dfe-ca21-fc5e-9780-ce347e129d38.dc1 127.0.0.1 31:43.083 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-afa34dfe-ca21-fc5e-9780-ce347e129d38 127.0.0.1 2021-10-05T16:31:43.083Z [INFO] agent.router: Initializing LAN area manager 31:43.084 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30330 network=udp 31:43.084 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30335 [Follower]" leader= 31:43.084 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-afa34dfe-ca21-fc5e-9780-ce347e129d38.dc1 area=wan 31:43.084 [INFO] TestAgent.server: Adding LAN server: server="Node-afa34dfe-ca21-fc5e-9780-ce347e129d38 (Addr: tcp/127.0.0.1:30335) (DC: dc1)" 31:43.084 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30330 network=tcp 31:43.085 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30331 network=tcp 31:43.085 [INFO] TestAgent: started state syncer 31:43.085 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29456 network=tcp 31:43.125 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:43.125 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30335 [Candidate]" term=2 31:43.138 [DEBUG] TestAgent.server.raft: votes: needed=1 31:43.138 [DEBUG] TestAgent.server.raft: vote granted: from=afa34dfe-ca21-fc5e-9780-ce347e129d38 term=2 tally=1 31:43.138 [INFO] TestAgent.server.raft: election won: tally=1 31:43.138 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30335 [Leader]" 31:43.139 [INFO] TestAgent.server: cluster leadership acquired 31:43.139 [INFO] TestAgent.server: New leader elected: payload=Node-afa34dfe-ca21-fc5e-9780-ce347e129d38 31:43.148 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30335 31:43.172 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:43.211 [INFO] TestAgent: Synced node info 31:43.226 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:43.226 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:43.226 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:43.226 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:43.226 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:43.226 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-afa34dfe-ca21-fc5e-9780-ce347e129d38 31:43.226 [INFO] TestAgent.server: member joined, marking health alive: member=Node-afa34dfe-ca21-fc5e-9780-ce347e129d38 31:43.240 [INFO] TestAgent.server: federation state anti-entropy synced 31:43.464 [INFO] TestAgent: Requesting shutdown 31:43.464 [INFO] TestAgent.server: shutting down server 31:43.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:43.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:43.464 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:43.464 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:43.464 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:43.464 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:43.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:43.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:43.464 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:43.464 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:43.471 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:43.476Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:43.476Z [INFO] agent.router.manager: shutting down 31:43.476 [INFO] TestAgent: consul server down 31:43.476 [INFO] TestAgent: shutdown complete 31:43.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30330 network=tcp 31:43.476 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30330 network=udp 31:43.476 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30331 network=tcp 31:43.977 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.977 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_TokenStore (0.99s) === CONT TestAgentConnectAuthorize_defaultDeny [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:42.698Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.731Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:42.844 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b881c3eb-a650-e8ca-411d-5edd3ca0de41 Address:127.0.0.1:29518}]" 31:42.844 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29518 [Follower]" leader= 31:42.845 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b881c3eb-a650-e8ca-411d-5edd3ca0de41.dc1 127.0.0.1 31:42.845 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b881c3eb-a650-e8ca-411d-5edd3ca0de41 127.0.0.1 2021-10-05T16:31:42.845Z [INFO] agent.router: Initializing LAN area manager 31:42.845 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29464 network=udp 31:42.846 [INFO] TestAgent.server: Adding LAN server: server="Node-b881c3eb-a650-e8ca-411d-5edd3ca0de41 (Addr: tcp/127.0.0.1:29518) (DC: dc1)" 31:42.846 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b881c3eb-a650-e8ca-411d-5edd3ca0de41.dc1 area=wan 31:42.846 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29464 network=tcp 31:42.846 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29514 network=tcp 31:42.846 [INFO] TestAgent: started state syncer 31:42.847 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29449 network=tcp 31:42.894 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.894 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29518 [Candidate]" term=2 31:42.926 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.926 [DEBUG] TestAgent.server.raft: vote granted: from=b881c3eb-a650-e8ca-411d-5edd3ca0de41 term=2 tally=1 31:42.926 [INFO] TestAgent.server.raft: election won: tally=1 31:42.926 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29518 [Leader]" 31:42.926 [INFO] TestAgent.server: cluster leadership acquired 31:42.926 [INFO] TestAgent.server: New leader elected: payload=Node-b881c3eb-a650-e8ca-411d-5edd3ca0de41 31:42.940 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29518 31:42.980 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:43.041 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:43.041 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:43.041 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:43.041 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:43.041 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:43.041 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b881c3eb-a650-e8ca-411d-5edd3ca0de41 31:43.041 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b881c3eb-a650-e8ca-411d-5edd3ca0de41 31:43.069 [INFO] TestAgent.server: federation state anti-entropy synced 31:43.108 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.124 [INFO] TestAgent: Synced node info 31:43.136 [INFO] TestAgent: Synced service: service=redis 31:43.136 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.141 [INFO] TestAgent: Synced check: check=node-check 31:43.216 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.216 [DEBUG] TestAgent: Node info in sync 31:43.216 [DEBUG] TestAgent: Service in sync: service=redis 31:43.216 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.216 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.643 [DEBUG] TestAgent: Registered node: node="Node-level check" 31:43.643 [DEBUG] TestAgent: Registered node: node="Serf Health Status" 31:43.643 [DEBUG] TestAgent: Registered node: node="Service-level check" 31:43.643 [INFO] TestAgent: Sync in progress: iteration=1 31:43.643 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.643 [DEBUG] TestAgent: Node info in sync 31:43.643 [DEBUG] TestAgent: Service in sync: service=redis 31:43.643 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.643 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.643 [INFO] TestAgent: Sync in progress: iteration=2 31:43.643 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.643 [DEBUG] TestAgent: Node info in sync 31:43.643 [DEBUG] TestAgent: Service in sync: service=redis 31:43.643 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.643 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.643 [INFO] TestAgent: Sync in progress: iteration=3 31:43.643 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.643 [DEBUG] TestAgent: Node info in sync 31:43.643 [DEBUG] TestAgent: Service in sync: service=redis 31:43.643 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.643 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.643 [INFO] TestAgent: Sync in progress: iteration=4 31:43.643 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.643 [DEBUG] TestAgent: Node info in sync 31:43.643 [DEBUG] TestAgent: Service in sync: service=redis 31:43.643 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.643 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.643 [INFO] TestAgent: Sync in progress: iteration=5 31:43.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.644 [DEBUG] TestAgent: Node info in sync 31:43.644 [DEBUG] TestAgent: Service in sync: service=redis 31:43.644 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.644 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.644 [INFO] TestAgent: Sync in progress: iteration=6 31:43.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.644 [DEBUG] TestAgent: Node info in sync 31:43.644 [DEBUG] TestAgent: Service in sync: service=redis 31:43.644 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.644 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.644 [INFO] TestAgent: Sync in progress: iteration=7 31:43.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.644 [DEBUG] TestAgent: Node info in sync 31:43.644 [DEBUG] TestAgent: Service in sync: service=redis 31:43.644 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.644 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.644 [INFO] TestAgent: Sync in progress: iteration=8 31:43.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.644 [DEBUG] TestAgent: Node info in sync 31:43.644 [DEBUG] TestAgent: Service in sync: service=redis 31:43.644 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.644 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.644 [INFO] TestAgent: Sync in progress: iteration=9 31:43.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.644 [DEBUG] TestAgent: Node info in sync 31:43.644 [DEBUG] TestAgent: Service in sync: service=redis 31:43.644 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.644 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.644 [INFO] TestAgent: Sync in progress: iteration=10 31:43.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:43.644 [DEBUG] TestAgent: Node info in sync 31:43.644 [DEBUG] TestAgent: Service in sync: service=redis 31:43.644 [DEBUG] TestAgent: Check in sync: check=redis-check 31:43.644 [DEBUG] TestAgent: Check in sync: check=node-check 31:43.644 [INFO] TestAgent: Requesting shutdown 31:43.644 [INFO] TestAgent.server: shutting down server 31:43.644 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:43.644 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:43.644 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:43.644 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:43.644 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:43.644 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:43.644 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:43.645 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:43.645 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:43.645 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:43.652 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:43.653Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:43.653Z [INFO] agent.router.manager: shutting down 31:43.653 [INFO] TestAgent: consul server down 31:43.653 [INFO] TestAgent: shutdown complete 31:43.653 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29464 network=tcp 31:43.653 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29464 network=udp 31:43.653 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29514 network=tcp 31:44.154 [INFO] TestAgent: Waiting for endpoints to shut down 31:44.154 [INFO] TestAgent: Endpoints down === RUN TestAgent_IndexChurn/with_tags [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:43.591Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.627Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.764 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2e4a95f7-5ff3-251e-11a6-508f475723e0 Address:127.0.0.1:29483}]" 31:43.764 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29483 [Follower]" leader= 31:43.765 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2e4a95f7-5ff3-251e-11a6-508f475723e0.dc1 127.0.0.1 31:43.765 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2e4a95f7-5ff3-251e-11a6-508f475723e0 127.0.0.1 2021-10-05T16:31:43.765Z [INFO] agent.router: Initializing LAN area manager 31:43.766 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29492 network=udp 31:43.766 [INFO] TestAgent.server: Adding LAN server: server="Node-2e4a95f7-5ff3-251e-11a6-508f475723e0 (Addr: tcp/127.0.0.1:29483) (DC: dc1)" 31:43.766 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2e4a95f7-5ff3-251e-11a6-508f475723e0.dc1 area=wan 31:43.766 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29492 network=tcp 31:43.767 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29479 network=tcp 31:43.767 [INFO] TestAgent: started state syncer 31:43.767 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29428 network=tcp 31:43.821 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:43.821 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29483 [Candidate]" term=2 31:43.864 [DEBUG] TestAgent.server.raft: votes: needed=1 31:43.864 [DEBUG] TestAgent.server.raft: vote granted: from=2e4a95f7-5ff3-251e-11a6-508f475723e0 term=2 tally=1 31:43.864 [INFO] TestAgent.server.raft: election won: tally=1 31:43.864 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29483 [Leader]" 31:43.864 [INFO] TestAgent.server: cluster leadership acquired 31:43.864 [INFO] TestAgent.server: New leader elected: payload=Node-2e4a95f7-5ff3-251e-11a6-508f475723e0 31:43.885 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29483 31:43.968 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:43.968 [INFO] TestAgent: Synced node info 31:43.999 [INFO] TestAgent: Requesting shutdown 31:43.999 [INFO] TestAgent.server: shutting down server 31:43.999 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:44.008 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:44.008Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:44.008Z [INFO] agent.router.manager: shutting down 31:44.008 [INFO] TestAgent: consul server down 31:44.008 [INFO] TestAgent: shutdown complete 31:44.008 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29492 network=tcp 31:44.008 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29492 network=udp 31:44.008 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29479 network=tcp 31:44.008 [ERROR] TestAgent.server.connect: Raft apply failed: error="raft is already shutdown" 31:44.008 [ERROR] TestAgent.server: failed to establish leadership: error="raft is already shutdown" 31:44.509 [INFO] TestAgent: Waiting for endpoints to shut down 31:44.509 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:42.764Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:42.778Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:42.831 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6345a528-8311-bbf2-d0d3-aa746d068da0 Address:127.0.0.1:30391}]" 31:42.831 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6345a528-8311-bbf2-d0d3-aa746d068da0.dc1 127.0.0.1 31:42.832 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30391 [Follower]" leader= 31:42.832 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6345a528-8311-bbf2-d0d3-aa746d068da0 127.0.0.1 2021-10-05T16:31:42.832Z [INFO] agent.router: Initializing LAN area manager 31:42.832 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30386 network=udp 31:42.833 [INFO] TestAgent.server: Adding LAN server: server="Node-6345a528-8311-bbf2-d0d3-aa746d068da0 (Addr: tcp/127.0.0.1:30391) (DC: dc1)" 31:42.833 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6345a528-8311-bbf2-d0d3-aa746d068da0.dc1 area=wan 31:42.833 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30386 network=tcp 31:42.834 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30387 network=tcp 31:42.834 [INFO] TestAgent: started state syncer 31:42.834 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30329 network=tcp 31:42.888 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:42.888 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30391 [Candidate]" term=2 31:42.916 [DEBUG] TestAgent.server.raft: votes: needed=1 31:42.916 [DEBUG] TestAgent.server.raft: vote granted: from=6345a528-8311-bbf2-d0d3-aa746d068da0 term=2 tally=1 31:42.916 [INFO] TestAgent.server.raft: election won: tally=1 31:42.916 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30391 [Leader]" 31:42.916 [INFO] TestAgent.server: cluster leadership acquired 31:42.916 [INFO] TestAgent.server: New leader elected: payload=Node-6345a528-8311-bbf2-d0d3-aa746d068da0 31:42.934 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30391 31:42.947 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:43.023 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:43.023 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:43.023 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:43.023 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:43.023 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:43.023 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6345a528-8311-bbf2-d0d3-aa746d068da0 31:43.023 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6345a528-8311-bbf2-d0d3-aa746d068da0 31:43.026 [INFO] TestAgent: Requesting shutdown 31:43.026 [INFO] TestAgent.server: shutting down server 31:43.026 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:43.026 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:43.026 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:43.026 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:43.026 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:43.026 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:43.026 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:43.026 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:43.026 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:43.037 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:43.039Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:43.039Z [INFO] agent.router.manager: shutting down 31:43.052 [INFO] TestAgent: consul server down 31:43.052 [INFO] TestAgent: shutdown complete 31:43.052 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 31:43.053 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30386 network=tcp 31:43.053 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:43.052 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-6345a528-8311-bbf2-d0d3-aa746d068da0 127.0.0.1 30389 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:6345a528-8311-bbf2-d0d3-aa746d068da0 port:30391 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:30390] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:43.053 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30386 network=udp 31:43.053 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30387 network=tcp 31:43.556 [INFO] TestAgent: Waiting for endpoints to shut down 31:43.556 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ReconnectConfigSettings (1.76s) === CONT TestAgentConnectAuthorize_serviceWrite [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:43.576Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.699Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.852 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8b65ce6a-d7d9-659f-404e-c991f9ba136a Address:127.0.0.1:29504}]" 31:43.853 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8b65ce6a-d7d9-659f-404e-c991f9ba136a.dc1 127.0.0.1 31:43.853 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29504 [Follower]" leader= 31:43.853 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8b65ce6a-d7d9-659f-404e-c991f9ba136a 127.0.0.1 2021-10-05T16:31:43.853Z [INFO] agent.router: Initializing LAN area manager 31:43.854 [INFO] TestAgent.server: Adding LAN server: server="Node-8b65ce6a-d7d9-659f-404e-c991f9ba136a (Addr: tcp/127.0.0.1:29504) (DC: dc1)" 31:43.854 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8b65ce6a-d7d9-659f-404e-c991f9ba136a.dc1 area=wan 31:43.854 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29506 network=udp 31:43.854 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29506 network=tcp 31:43.855 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29500 network=tcp 31:43.855 [INFO] TestAgent: started state syncer 31:43.855 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29491 network=tcp 31:43.917 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:43.917 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29504 [Candidate]" term=2 31:43.944 [DEBUG] TestAgent.server.raft: votes: needed=1 31:43.944 [DEBUG] TestAgent.server.raft: vote granted: from=8b65ce6a-d7d9-659f-404e-c991f9ba136a term=2 tally=1 31:43.944 [INFO] TestAgent.server.raft: election won: tally=1 31:43.944 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29504 [Leader]" 31:43.945 [INFO] TestAgent.server: cluster leadership acquired 31:43.945 [INFO] TestAgent.server: New leader elected: payload=Node-8b65ce6a-d7d9-659f-404e-c991f9ba136a 31:43.958 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29504 31:44.004 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.076 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:44.076 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:44.076 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:44.076 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:44.076 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:44.076 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8b65ce6a-d7d9-659f-404e-c991f9ba136a 31:44.076 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8b65ce6a-d7d9-659f-404e-c991f9ba136a 31:44.122 [INFO] TestAgent.server: federation state anti-entropy synced 31:44.124 [INFO] TestAgent: Requesting shutdown 31:44.125 [INFO] TestAgent.server: shutting down server 31:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:44.125 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:44.125 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:44.125 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:44.125 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:44.125 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:44.125 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:44.125 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:44.132 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:44.133Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:44.133Z [INFO] agent.router.manager: shutting down 31:44.133 [INFO] TestAgent: consul server down 31:44.133 [INFO] TestAgent: shutdown complete 31:44.133 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29506 network=tcp 31:44.133 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29506 network=udp 31:44.133 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29500 network=tcp 31:44.633 [INFO] TestAgent: Waiting for endpoints to shut down 31:44.633 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Services_ExposeConfig (1.09s) === CONT TestAgentConnectAuthorize_denyWildcard 2021-10-05T16:31:43.747Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:43.747Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.835Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:43.835Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.900 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ebafa759-d9f4-61d2-19f3-bf6a320b3d21 Address:127.0.0.1:29462}]" 31:43.900 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21.dc1 127.0.0.1 31:43.901 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 127.0.0.1 2021-10-05T16:31:43.901Z [INFO] agent.router: Initializing LAN area manager 31:43.901 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29429 network=udp 31:43.901 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29462 [Follower]" leader= 31:43.902 [INFO] TestAgent.server: Adding LAN server: server="Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 (Addr: tcp/127.0.0.1:29462) (DC: dc1)" 31:43.902 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21.dc1 area=wan 31:43.902 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29429 network=tcp 31:43.902 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29458 network=tcp 31:43.902 [INFO] TestAgent: started state syncer 31:43.902 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29498 network=tcp 31:43.952 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:43.968 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:43.968 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29462 [Candidate]" term=2 31:43.987 [DEBUG] TestAgent.server.raft: votes: needed=1 31:43.987 [DEBUG] TestAgent.server.raft: vote granted: from=ebafa759-d9f4-61d2-19f3-bf6a320b3d21 term=2 tally=1 31:43.987 [INFO] TestAgent.server.raft: election won: tally=1 31:43.987 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29462 [Leader]" 31:43.988 [INFO] TestAgent.server: cluster leadership acquired 31:43.988 [INFO] TestAgent.server: New leader elected: payload=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.016 [INFO] TestAgent.server: initializing acls 31:44.028 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:44.028 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:44.042 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:44.052 [INFO] TestAgent.server: initializing acls 31:44.052 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:44.078 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:44.078 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:44.078 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:44.078 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.078 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21.dc1 31:44.078 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21.dc1 area=wan 31:44.078 [INFO] TestAgent.server: Updating LAN server: server="Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 (Addr: tcp/127.0.0.1:29462) (DC: dc1)" 31:44.107 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:44.107 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:44.107 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.107 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21.dc1 31:44.107 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21.dc1 area=wan 31:44.107 [INFO] TestAgent.server: Updating LAN server: server="Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 (Addr: tcp/127.0.0.1:29462) (DC: dc1)" 31:44.130 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.164 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:44.164 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:44.164 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:44.164 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:44.164 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:44.164 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.164 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.176 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:44.179 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.179 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.180 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-ebafa759-d9f4-61d2-19f3-bf6a320b3d21 31:44.180 [INFO] TestAgent: Requesting shutdown 31:44.180 [INFO] TestAgent.server: shutting down server 31:44.180 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:44.180 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:44.180 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:44.180 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:44.180 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:44.180 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:44.180 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:44.180 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:44.180 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:44.180 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:44.180 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:44.180 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:44.188 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:44.188Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:44.188Z [INFO] agent.router.manager: shutting down 31:44.195 [INFO] TestAgent: consul server down 31:44.195 [INFO] TestAgent: shutdown complete 31:44.195 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29429 network=tcp 31:44.195 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29429 network=udp 31:44.195 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29458 network=tcp 31:44.195 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 31:44.195 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:44.695 [INFO] TestAgent: Waiting for endpoints to shut down 31:44.695 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_HostBadACL (1.00s) === CONT TestAgentConnectAuthorize_allowTrustDomain 2021-10-05T16:31:43.743Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:43.743Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.804Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:43.804Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.890 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1ce69ccf-469d-a377-5c10-2b8289be8b88 Address:127.0.0.1:29539}]" 31:43.890 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29539 [Follower]" leader= 31:43.891 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1ce69ccf-469d-a377-5c10-2b8289be8b88.dc1 127.0.0.1 31:43.891 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 127.0.0.1 2021-10-05T16:31:43.891Z [INFO] agent.router: Initializing LAN area manager 31:43.892 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1ce69ccf-469d-a377-5c10-2b8289be8b88.dc1 area=wan 31:43.892 [INFO] TestAgent.server: Adding LAN server: server="Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 (Addr: tcp/127.0.0.1:29539) (DC: dc1)" 31:43.892 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29499 network=tcp 31:43.894 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29499 network=udp 31:43.895 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29535 network=tcp 31:43.895 [INFO] TestAgent: started state syncer 31:43.895 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29421 network=tcp 31:43.942 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:43.946 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:43.946 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29539 [Candidate]" term=2 31:43.959 [DEBUG] TestAgent.server.raft: votes: needed=1 31:43.959 [DEBUG] TestAgent.server.raft: vote granted: from=1ce69ccf-469d-a377-5c10-2b8289be8b88 term=2 tally=1 31:43.959 [INFO] TestAgent.server.raft: election won: tally=1 31:43.959 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29539 [Leader]" 31:43.959 [INFO] TestAgent.server: cluster leadership acquired 31:43.960 [INFO] TestAgent.server: New leader elected: payload=Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 31:43.970 [INFO] TestAgent.server: initializing acls 31:43.975 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:43.975 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:43.992 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:44.024 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:44.024 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:44.024 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:44.024 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 31:44.024 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-1ce69ccf-469d-a377-5c10-2b8289be8b88.dc1 31:44.026 [INFO] TestAgent.server: Updating LAN server: server="Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 (Addr: tcp/127.0.0.1:29539) (DC: dc1)" 31:44.026 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-1ce69ccf-469d-a377-5c10-2b8289be8b88.dc1 area=wan 31:44.044 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.089 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:44.089 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:44.089 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:44.089 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:44.090 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:44.090 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 31:44.090 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 31:44.097 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1ce69ccf-469d-a377-5c10-2b8289be8b88 31:44.105 [INFO] TestAgent.server: federation state anti-entropy synced 31:44.188 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:44.243 [INFO] TestAgent: Requesting shutdown 31:44.243 [INFO] TestAgent.server: shutting down server 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:44.243 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:44.243 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:44.251 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:44.252Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:44.252Z [INFO] agent.router.manager: shutting down 31:44.252 [INFO] TestAgent: consul server down 31:44.253 [INFO] TestAgent: shutdown complete 31:44.253 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29499 network=tcp 31:44.253 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29499 network=udp 31:44.253 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29535 network=tcp 31:44.753 [INFO] TestAgent: Waiting for endpoints to shut down 31:44.753 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Host (1.06s) === CONT TestAgentConnectAuthorize_deny 2021-10-05T16:31:43.907Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:43.907Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.921Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:43.921Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.989 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:55847d09-662b-8b57-6b42-beec79a72db1 Address:127.0.0.1:29420}]" 31:43.989 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-55847d09-662b-8b57-6b42-beec79a72db1.dc1 127.0.0.1 31:43.990 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-55847d09-662b-8b57-6b42-beec79a72db1 127.0.0.1 2021-10-05T16:31:43.990Z [INFO] agent.router: Initializing LAN area manager 31:43.990 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29422 network=udp 31:43.990 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29420 [Follower]" leader= 31:43.991 [INFO] TestAgent.server: Adding LAN server: server="Node-55847d09-662b-8b57-6b42-beec79a72db1 (Addr: tcp/127.0.0.1:29420) (DC: dc1)" 31:43.991 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-55847d09-662b-8b57-6b42-beec79a72db1.dc1 area=wan 31:43.991 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29422 network=tcp 31:43.991 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29416 network=tcp 31:43.991 [INFO] TestAgent: started state syncer 31:43.991 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29540 network=tcp 31:44.038 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.038 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29420 [Candidate]" term=2 31:44.041 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:44.065 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.065 [DEBUG] TestAgent.server.raft: vote granted: from=55847d09-662b-8b57-6b42-beec79a72db1 term=2 tally=1 31:44.065 [INFO] TestAgent.server.raft: election won: tally=1 31:44.065 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29420 [Leader]" 31:44.065 [INFO] TestAgent.server: cluster leadership acquired 31:44.065 [INFO] TestAgent.server: New leader elected: payload=Node-55847d09-662b-8b57-6b42-beec79a72db1 31:44.108 [INFO] TestAgent.server: initializing acls 31:44.119 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:44.124 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:44.124 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:44.134 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:44.142 [INFO] TestAgent.server: initializing acls 31:44.142 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:44.162 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:44.162 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:44.162 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:44.162 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:44.162 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-55847d09-662b-8b57-6b42-beec79a72db1 31:44.162 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-55847d09-662b-8b57-6b42-beec79a72db1.dc1 31:44.162 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-55847d09-662b-8b57-6b42-beec79a72db1.dc1 area=wan 31:44.162 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:44.162 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-55847d09-662b-8b57-6b42-beec79a72db1 31:44.163 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-55847d09-662b-8b57-6b42-beec79a72db1.dc1 31:44.164 [INFO] TestAgent.server: Updating LAN server: server="Node-55847d09-662b-8b57-6b42-beec79a72db1 (Addr: tcp/127.0.0.1:29420) (DC: dc1)" 31:44.164 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-55847d09-662b-8b57-6b42-beec79a72db1.dc1 area=wan 31:44.164 [INFO] TestAgent.server: Updating LAN server: server="Node-55847d09-662b-8b57-6b42-beec79a72db1 (Addr: tcp/127.0.0.1:29420) (DC: dc1)" 31:44.198 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.230 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:44.230 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:44.230 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:44.230 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:44.230 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:44.230 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-55847d09-662b-8b57-6b42-beec79a72db1 31:44.230 [INFO] TestAgent.server: member joined, marking health alive: member=Node-55847d09-662b-8b57-6b42-beec79a72db1 31:44.238 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-55847d09-662b-8b57-6b42-beec79a72db1 31:44.238 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-55847d09-662b-8b57-6b42-beec79a72db1 31:44.243 [INFO] TestAgent: Requesting shutdown 31:44.243 [INFO] TestAgent.server: shutting down server 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:44.243 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:44.249 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:44.252Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:44.252Z [INFO] agent.router.manager: shutting down 31:44.256 [INFO] TestAgent: consul server down 31:44.256 [INFO] TestAgent: shutdown complete 31:44.256 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29422 network=tcp 31:44.256 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29422 network=udp 31:44.256 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29416 network=tcp 31:44.256 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 31:44.256 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:44.756 [INFO] TestAgent: Waiting for endpoints to shut down 31:44.756 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_defaultAllow (0.87s) === CONT TestAgentConnectAuthorize_allow 2021-10-05T16:31:44.002Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:44.002Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.022Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:44.022Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.071 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 Address:127.0.0.1:29497}]" 31:44.071 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7.dc1 127.0.0.1 31:44.072 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29497 [Follower]" leader= 31:44.072 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 127.0.0.1 2021-10-05T16:31:44.072Z [INFO] agent.router: Initializing LAN area manager 31:44.072 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7.dc1 area=wan 31:44.072 [INFO] TestAgent.server: Adding LAN server: server="Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 (Addr: tcp/127.0.0.1:29497) (DC: dc1)" 31:44.072 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29541 network=tcp 31:44.072 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29541 network=udp 31:44.073 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29493 network=tcp 31:44.073 [INFO] TestAgent: started state syncer 31:44.073 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29512 network=tcp 31:44.122 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:44.124 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.124 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29497 [Candidate]" term=2 31:44.147 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.147 [DEBUG] TestAgent.server.raft: vote granted: from=0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 term=2 tally=1 31:44.147 [INFO] TestAgent.server.raft: election won: tally=1 31:44.147 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29497 [Leader]" 31:44.148 [INFO] TestAgent.server: cluster leadership acquired 31:44.148 [INFO] TestAgent.server: New leader elected: payload=Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 31:44.157 [INFO] TestAgent.server: initializing acls 31:44.163 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:44.163 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:44.188 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:44.211 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:44.211 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:44.211 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:44.211 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 31:44.211 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7.dc1 31:44.212 [INFO] TestAgent.server: Updating LAN server: server="Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 (Addr: tcp/127.0.0.1:29497) (DC: dc1)" 31:44.212 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7.dc1 area=wan 31:44.244 [INFO] TestAgent: Synced node info 31:44.263 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.272 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 31:44.272 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-0916cdaa-72e1-d8b3-d3ba-56a0f22440e7 31:44.273 [INFO] TestAgent: Requesting shutdown 31:44.273 [INFO] TestAgent.server: shutting down server 31:44.273 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:44.273 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:44.273 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:44.273 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:44.273 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:44.284 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:44.284Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:44.284Z [INFO] agent.router.manager: shutting down 31:44.284 [INFO] TestAgent: consul server down 31:44.284 [INFO] TestAgent: shutdown complete 31:44.284 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29541 network=tcp 31:44.284 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29541 network=udp 31:44.284 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29493 network=tcp 31:44.286 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: raft is already shutdown" 31:44.286 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:44.286 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:44.785 [INFO] TestAgent: Waiting for endpoints to shut down 31:44.785 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_defaultDeny (0.81s) === CONT TestAgentConnectAuthorize_idNotService [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_JoinWAN_viaMeshGateway/dc1_to_dc2 === RUN TestAgent_JoinWAN_viaMeshGateway/dc1_to_dc3 [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_JoinWAN_viaMeshGateway/dc2_to_dc1 === RUN TestAgent_JoinWAN_viaMeshGateway/dc2_to_dc3 === RUN TestAgent_JoinWAN_viaMeshGateway/dc3_to_dc1 === RUN TestAgent_JoinWAN_viaMeshGateway/dc3_to_dc2 2021-10-05T16:31:44.531Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:44.531Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.550Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:44.550Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.641 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b0ab2120-ac40-6097-3473-299af6c60c84 Address:127.0.0.1:29525}]" 31:44.642 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29525 [Follower]" leader= 31:44.642 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b0ab2120-ac40-6097-3473-299af6c60c84.dc1 127.0.0.1 31:44.643 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b0ab2120-ac40-6097-3473-299af6c60c84 127.0.0.1 2021-10-05T16:31:44.643Z [INFO] agent.router: Initializing LAN area manager 31:44.643 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29534 network=udp 31:44.643 [INFO] TestAgent.server: Adding LAN server: server="Node-b0ab2120-ac40-6097-3473-299af6c60c84 (Addr: tcp/127.0.0.1:29525) (DC: dc1)" 31:44.643 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b0ab2120-ac40-6097-3473-299af6c60c84.dc1 area=wan 31:44.643 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29534 network=tcp 31:44.644 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29521 network=tcp 31:44.644 [INFO] TestAgent: started state syncer 31:44.644 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29526 network=tcp 31:44.683 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.683 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29525 [Candidate]" term=2 31:44.693 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:44.701 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.701 [DEBUG] TestAgent.server.raft: vote granted: from=b0ab2120-ac40-6097-3473-299af6c60c84 term=2 tally=1 31:44.701 [INFO] TestAgent.server.raft: election won: tally=1 31:44.701 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29525 [Leader]" 31:44.701 [INFO] TestAgent.server: cluster leadership acquired 31:44.701 [INFO] TestAgent.server: New leader elected: payload=Node-b0ab2120-ac40-6097-3473-299af6c60c84 31:44.719 [INFO] TestAgent.server: initializing acls 31:44.724 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:44.724 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:44.732 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:44.747 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:44.747 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:44.747 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:44.747 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-b0ab2120-ac40-6097-3473-299af6c60c84 31:44.747 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-b0ab2120-ac40-6097-3473-299af6c60c84.dc1 31:44.748 [INFO] TestAgent.server: Updating LAN server: server="Node-b0ab2120-ac40-6097-3473-299af6c60c84 (Addr: tcp/127.0.0.1:29525) (DC: dc1)" 31:44.748 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-b0ab2120-ac40-6097-3473-299af6c60c84.dc1 area=wan 31:44.773 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.821 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:44.821 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:44.821 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:44.821 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:44.821 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:44.821 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b0ab2120-ac40-6097-3473-299af6c60c84 31:44.821 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b0ab2120-ac40-6097-3473-299af6c60c84 31:44.835 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b0ab2120-ac40-6097-3473-299af6c60c84 31:44.860 [INFO] TestAgent.server: federation state anti-entropy synced 31:44.902 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:44.937 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-b0ab2120-ac40-6097-3473-299af6c60c84 31:44.937 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-b0ab2120-ac40-6097-3473-299af6c60c84 31:44.945 [INFO] TestAgent: Synced node info 31:44.972 [INFO] TestAgent: Requesting shutdown 31:44.972 [INFO] TestAgent.server: shutting down server 31:44.972 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:44.972 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:44.972 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:44.972 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:44.972 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:44.972 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:44.972 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:44.973 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:44.973 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:44.973 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:44.973 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:44.973 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:44.973 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:44.973 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:44.979 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:44.992Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:44.992Z [INFO] agent.router.manager: shutting down 31:44.992 [INFO] TestAgent: consul server down 31:44.992 [INFO] TestAgent: shutdown complete 31:44.992 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29534 network=tcp 31:44.992 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29534 network=udp 31:44.992 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29521 network=tcp 31:45.494 [INFO] TestAgent: Waiting for endpoints to shut down 31:45.494 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_serviceWrite (0.99s) === CONT TestAgentConnectAuthorize_idInvalidFormat [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:44.651Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.665Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.701 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a048a145-350a-35e8-5546-7c671c304499 Address:127.0.0.1:29546}]" 31:44.702 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29546 [Follower]" leader= 31:44.702 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a048a145-350a-35e8-5546-7c671c304499.dc1 127.0.0.1 31:44.703 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a048a145-350a-35e8-5546-7c671c304499 127.0.0.1 2021-10-05T16:31:44.703Z [INFO] agent.router: Initializing LAN area manager 31:44.703 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29527 network=udp 31:44.703 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a048a145-350a-35e8-5546-7c671c304499.dc1 area=wan 31:44.704 [INFO] TestAgent.server: Adding LAN server: server="Node-a048a145-350a-35e8-5546-7c671c304499 (Addr: tcp/127.0.0.1:29546) (DC: dc1)" 31:44.704 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29527 network=tcp 31:44.704 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29542 network=tcp 31:44.704 [INFO] TestAgent: started state syncer 31:44.704 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29547 network=tcp 31:44.751 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.751 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29546 [Candidate]" term=2 31:44.783 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.783 [DEBUG] TestAgent.server.raft: vote granted: from=a048a145-350a-35e8-5546-7c671c304499 term=2 tally=1 31:44.783 [INFO] TestAgent.server.raft: election won: tally=1 31:44.783 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29546 [Leader]" 31:44.783 [INFO] TestAgent.server: cluster leadership acquired 31:44.783 [INFO] TestAgent.server: New leader elected: payload=Node-a048a145-350a-35e8-5546-7c671c304499 31:44.805 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29546 31:44.838 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.901 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:44.901 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:44.901 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:44.901 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:44.901 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:44.901 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a048a145-350a-35e8-5546-7c671c304499 31:44.901 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a048a145-350a-35e8-5546-7c671c304499 31:44.974 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.069 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.088 [INFO] TestAgent: Synced node info 31:45.088 [DEBUG] TestAgent: Node info in sync 31:45.091 [INFO] TestAgent: Requesting shutdown 31:45.091 [INFO] TestAgent.server: shutting down server 31:45.091 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.091 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.091 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.091 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.091 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.091 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.091 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.091 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.091 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.091 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.097 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.104Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.104Z [INFO] agent.router.manager: shutting down 31:45.104 [INFO] TestAgent: consul server down 31:45.104 [INFO] TestAgent: shutdown complete 31:45.104 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29527 network=tcp 31:45.104 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29527 network=udp 31:45.104 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29542 network=tcp 31:45.604 [INFO] TestAgent: Waiting for endpoints to shut down 31:45.604 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_denyWildcard (0.97s) === CONT TestAgentConnectAuthorize_noTarget 2021-10-05T16:31:44.796Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.807Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.862 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fa4496ff-49e6-184f-dac9-e1a7f24a4198 Address:127.0.0.1:29574}]" 31:44.863 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fa4496ff-49e6-184f-dac9-e1a7f24a4198.dc1 127.0.0.1 31:44.863 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fa4496ff-49e6-184f-dac9-e1a7f24a4198 127.0.0.1 2021-10-05T16:31:44.863Z [INFO] agent.router: Initializing LAN area manager 31:44.863 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29590 network=udp 31:44.864 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29574 [Follower]" leader= 31:44.864 [INFO] TestAgent.server: Adding LAN server: server="Node-fa4496ff-49e6-184f-dac9-e1a7f24a4198 (Addr: tcp/127.0.0.1:29574) (DC: dc1)" 31:44.864 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fa4496ff-49e6-184f-dac9-e1a7f24a4198.dc1 area=wan 31:44.864 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29590 network=tcp 31:44.864 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29570 network=tcp 31:44.864 [INFO] TestAgent: started state syncer 31:44.865 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29561 network=tcp 31:44.912 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.912 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29574 [Candidate]" term=2 31:44.959 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.959 [DEBUG] TestAgent.server.raft: vote granted: from=fa4496ff-49e6-184f-dac9-e1a7f24a4198 term=2 tally=1 31:44.959 [INFO] TestAgent.server.raft: election won: tally=1 31:44.959 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29574 [Leader]" 31:44.967 [INFO] TestAgent.server: cluster leadership acquired 31:44.967 [INFO] TestAgent.server: New leader elected: payload=Node-fa4496ff-49e6-184f-dac9-e1a7f24a4198 31:44.996 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29574 31:45.036 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.103 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.103 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.103 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.103 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.103 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.103 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fa4496ff-49e6-184f-dac9-e1a7f24a4198 31:45.103 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fa4496ff-49e6-184f-dac9-e1a7f24a4198 31:45.128 [INFO] TestAgent: Requesting shutdown 31:45.128 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.129 [INFO] TestAgent.server: shutting down server 31:45.129 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.129 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.129 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.129 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.129 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.129 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.129 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.129 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:45.129 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.129 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.129 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.134 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.142Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.142Z [INFO] agent.router.manager: shutting down 31:45.142 [INFO] TestAgent: consul server down 31:45.142 [INFO] TestAgent: shutdown complete 31:45.142 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29590 network=tcp 31:45.142 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29590 network=udp 31:45.142 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29570 network=tcp 31:45.642 [INFO] TestAgent: Waiting for endpoints to shut down 31:45.642 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_idNotService (0.86s) === CONT TestRPC_HTTPSMaxConnsPerClient === RUN TestRPC_HTTPSMaxConnsPerClient/HTTP 2021-10-05T16:31:44.181Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.194Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.234 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:25b9ce52-c9a4-e47a-84d3-dac23c8007cb Address:127.0.0.1:29532}]" 31:44.235 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-25b9ce52-c9a4-e47a-84d3-dac23c8007cb.dc1 127.0.0.1 31:44.236 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-25b9ce52-c9a4-e47a-84d3-dac23c8007cb 127.0.0.1 2021-10-05T16:31:44.236Z [INFO] agent.router: Initializing LAN area manager 31:44.236 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29532 [Follower]" leader= 31:44.236 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29513 network=udp 31:44.236 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-25b9ce52-c9a4-e47a-84d3-dac23c8007cb.dc1 area=wan 31:44.236 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29513 network=tcp 31:44.236 [INFO] TestAgent.server: Adding LAN server: server="Node-25b9ce52-c9a4-e47a-84d3-dac23c8007cb (Addr: tcp/127.0.0.1:29532) (DC: dc1)" 31:44.237 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29528 network=tcp 31:44.237 [INFO] TestAgent: started state syncer 31:44.237 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29533 network=tcp 31:44.284 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.284 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29532 [Candidate]" term=2 31:44.292 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.292 [DEBUG] TestAgent.server.raft: vote granted: from=25b9ce52-c9a4-e47a-84d3-dac23c8007cb term=2 tally=1 31:44.292 [INFO] TestAgent.server.raft: election won: tally=1 31:44.292 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29532 [Leader]" 31:44.294 [INFO] TestAgent.server: cluster leadership acquired 31:44.294 [INFO] TestAgent.server: New leader elected: payload=Node-25b9ce52-c9a4-e47a-84d3-dac23c8007cb 31:44.308 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29532 31:44.362 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:44.415 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:44.415 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:44.415 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:44.415 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:44.415 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:44.415 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-25b9ce52-c9a4-e47a-84d3-dac23c8007cb 31:44.415 [INFO] TestAgent.server: member joined, marking health alive: member=Node-25b9ce52-c9a4-e47a-84d3-dac23c8007cb 31:44.431 [INFO] TestAgent.server: federation state anti-entropy synced 31:44.577 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:44.582 [INFO] TestAgent: Synced node info 31:44.582 [DEBUG] TestAgent: Node info in sync 31:44.632 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:44.632 [DEBUG] TestAgent: Node info in sync 31:44.643 [INFO] TestAgent: Synced service: service=redis 31:44.643 [DEBUG] TestAgent: Check in sync: check=redis-check 31:44.648 [INFO] TestAgent: Synced check: check=node-check 31:45.148 [DEBUG] TestAgent: Registered node: node="Node-level check" 31:45.148 [DEBUG] TestAgent: Registered node: node="Serf Health Status" 31:45.148 [DEBUG] TestAgent: Registered node: node="Service-level check" 31:45.148 [INFO] TestAgent: Sync in progress: iteration=1 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.148 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.148 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.148 [INFO] TestAgent: Sync in progress: iteration=2 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.148 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.148 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.148 [INFO] TestAgent: Sync in progress: iteration=3 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.148 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.148 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.148 [INFO] TestAgent: Sync in progress: iteration=4 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.148 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.148 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.148 [INFO] TestAgent: Sync in progress: iteration=5 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.148 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.148 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.148 [INFO] TestAgent: Sync in progress: iteration=6 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.148 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.148 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.148 [INFO] TestAgent: Sync in progress: iteration=7 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.148 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.148 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.148 [INFO] TestAgent: Sync in progress: iteration=8 31:45.148 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.148 [DEBUG] TestAgent: Node info in sync 31:45.148 [DEBUG] TestAgent: Service in sync: service=redis 31:45.149 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.149 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.149 [INFO] TestAgent: Sync in progress: iteration=9 31:45.149 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.149 [DEBUG] TestAgent: Node info in sync 31:45.149 [DEBUG] TestAgent: Service in sync: service=redis 31:45.149 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.149 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.149 [INFO] TestAgent: Sync in progress: iteration=10 31:45.149 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.149 [DEBUG] TestAgent: Node info in sync 31:45.149 [DEBUG] TestAgent: Service in sync: service=redis 31:45.149 [DEBUG] TestAgent: Check in sync: check=redis-check 31:45.149 [DEBUG] TestAgent: Check in sync: check=node-check 31:45.149 [INFO] TestAgent: Requesting shutdown 31:45.149 [INFO] TestAgent.server: shutting down server 31:45.149 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.149 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.149 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.149 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.149 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.149 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.149 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.149 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.149 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.149 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.161 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.163Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.163Z [INFO] agent.router.manager: shutting down 31:45.163 [INFO] TestAgent: consul server down 31:45.163 [INFO] TestAgent: shutdown complete 31:45.163 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29513 network=tcp 31:45.163 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29513 network=udp 31:45.163 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29528 network=tcp 31:45.664 [INFO] TestAgent: Waiting for endpoints to shut down 31:45.664 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:44.776Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.791Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.880 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:359d8597-b871-4105-b012-421690b0ed9d Address:127.0.0.1:29567}]" 31:44.880 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29567 [Follower]" leader= 31:44.881 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-359d8597-b871-4105-b012-421690b0ed9d.dc1 127.0.0.1 31:44.881 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-359d8597-b871-4105-b012-421690b0ed9d 127.0.0.1 2021-10-05T16:31:44.881Z [INFO] agent.router: Initializing LAN area manager 31:44.881 [INFO] TestAgent.server: Adding LAN server: server="Node-359d8597-b871-4105-b012-421690b0ed9d (Addr: tcp/127.0.0.1:29567) (DC: dc1)" 31:44.881 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-359d8597-b871-4105-b012-421690b0ed9d.dc1 area=wan 31:44.882 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29555 network=udp 31:44.889 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29555 network=tcp 31:44.900 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29563 network=tcp 31:44.900 [INFO] TestAgent: started state syncer 31:44.901 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29568 network=tcp 31:44.930 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.930 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29567 [Candidate]" term=2 31:44.972 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.972 [DEBUG] TestAgent.server.raft: vote granted: from=359d8597-b871-4105-b012-421690b0ed9d term=2 tally=1 31:44.972 [INFO] TestAgent.server.raft: election won: tally=1 31:44.972 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29567 [Leader]" 31:44.975 [INFO] TestAgent.server: cluster leadership acquired 31:44.975 [INFO] TestAgent.server: New leader elected: payload=Node-359d8597-b871-4105-b012-421690b0ed9d 31:45.000 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29567 31:45.039 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.117 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.117 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.117 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.117 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.117 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.117 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-359d8597-b871-4105-b012-421690b0ed9d 31:45.117 [INFO] TestAgent.server: member joined, marking health alive: member=Node-359d8597-b871-4105-b012-421690b0ed9d 31:45.144 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.151 [INFO] TestAgent: Requesting shutdown 31:45.151 [INFO] TestAgent.server: shutting down server 31:45.151 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.151 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.151 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.151 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.151 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.151 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.151 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.151 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:45.151 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.151 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.151 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.156 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.164Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.164Z [INFO] agent.router.manager: shutting down 31:45.164 [INFO] TestAgent: consul server down 31:45.164 [INFO] TestAgent: shutdown complete 31:45.164 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29555 network=tcp 31:45.164 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29555 network=udp 31:45.164 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29563 network=tcp 31:45.664 [INFO] TestAgent: Waiting for endpoints to shut down 31:45.664 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_IndexChurn (3.03s) --- PASS: TestAgent_IndexChurn/no_tags (1.52s) --- PASS: TestAgent_IndexChurn/with_tags (1.51s) === CONT TestIntentionsCheck_basic --- PASS: TestAgentConnectAuthorize_deny (0.91s) === CONT TestIntentionsMatch_noName 2021-10-05T16:31:44.718Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.733Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.806 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0c96ee2e-93a6-856d-a5a3-a79b5d263d7d Address:127.0.0.1:29553}]" 31:44.807 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29553 [Follower]" leader= 31:44.810 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0c96ee2e-93a6-856d-a5a3-a79b5d263d7d.dc1 127.0.0.1 31:44.811 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0c96ee2e-93a6-856d-a5a3-a79b5d263d7d 127.0.0.1 2021-10-05T16:31:44.811Z [INFO] agent.router: Initializing LAN area manager 31:44.811 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29548 network=udp 31:44.812 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0c96ee2e-93a6-856d-a5a3-a79b5d263d7d.dc1 area=wan 31:44.812 [INFO] TestAgent.server: Adding LAN server: server="Node-0c96ee2e-93a6-856d-a5a3-a79b5d263d7d (Addr: tcp/127.0.0.1:29553) (DC: dc1)" 31:44.812 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29548 network=tcp 31:44.813 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29549 network=tcp 31:44.813 [INFO] TestAgent: started state syncer 31:44.813 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29554 network=tcp 31:44.847 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.847 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29553 [Candidate]" term=2 31:44.872 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.872 [DEBUG] TestAgent.server.raft: vote granted: from=0c96ee2e-93a6-856d-a5a3-a79b5d263d7d term=2 tally=1 31:44.872 [INFO] TestAgent.server.raft: election won: tally=1 31:44.872 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29553 [Leader]" 31:44.872 [INFO] TestAgent.server: cluster leadership acquired 31:44.872 [INFO] TestAgent.server: New leader elected: payload=Node-0c96ee2e-93a6-856d-a5a3-a79b5d263d7d 31:44.894 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29553 31:44.978 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.019 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.019 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.019 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.019 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.019 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.020 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0c96ee2e-93a6-856d-a5a3-a79b5d263d7d 31:45.020 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0c96ee2e-93a6-856d-a5a3-a79b5d263d7d 31:45.048 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.141 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.147 [INFO] TestAgent: Synced node info 31:45.228 [INFO] TestAgent: Requesting shutdown 31:45.228 [INFO] TestAgent.server: shutting down server 31:45.228 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.228 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.228 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.228 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.228 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.228 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.228 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.228 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.228 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.228 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.236 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.248Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.248Z [INFO] agent.router.manager: shutting down 31:45.248 [INFO] TestAgent: consul server down 31:45.248 [INFO] TestAgent: shutdown complete 31:45.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29548 network=tcp 31:45.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29548 network=udp 31:45.248 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29549 network=tcp 31:45.750 [INFO] TestAgent: Waiting for endpoints to shut down 31:45.750 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_allowTrustDomain (1.06s) === CONT TestIntentionsMatch_byInvalid 2021-10-05T16:31:44.770Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.782Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.839 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:392dda34-c3af-05bf-0ffd-be4b2d6c5f50 Address:127.0.0.1:29560}]" 31:44.839 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29560 [Follower]" leader= 31:44.839 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-392dda34-c3af-05bf-0ffd-be4b2d6c5f50.dc1 127.0.0.1 31:44.841 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-392dda34-c3af-05bf-0ffd-be4b2d6c5f50 127.0.0.1 2021-10-05T16:31:44.841Z [INFO] agent.router: Initializing LAN area manager 31:44.841 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-392dda34-c3af-05bf-0ffd-be4b2d6c5f50.dc1 area=wan 31:44.841 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29569 network=udp 31:44.841 [INFO] TestAgent.server: Adding LAN server: server="Node-392dda34-c3af-05bf-0ffd-be4b2d6c5f50 (Addr: tcp/127.0.0.1:29560) (DC: dc1)" 31:44.841 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29569 network=tcp 31:44.842 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29556 network=tcp 31:44.842 [INFO] TestAgent: started state syncer 31:44.842 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29589 network=tcp 31:44.875 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.875 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29560 [Candidate]" term=2 31:44.930 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.930 [DEBUG] TestAgent.server.raft: vote granted: from=392dda34-c3af-05bf-0ffd-be4b2d6c5f50 term=2 tally=1 31:44.930 [INFO] TestAgent.server.raft: election won: tally=1 31:44.930 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29560 [Leader]" 31:44.930 [INFO] TestAgent.server: cluster leadership acquired 31:44.930 [INFO] TestAgent.server: New leader elected: payload=Node-392dda34-c3af-05bf-0ffd-be4b2d6c5f50 31:44.970 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29560 31:45.003 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.044 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.045 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.045 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.045 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.045 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.045 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-392dda34-c3af-05bf-0ffd-be4b2d6c5f50 31:45.045 [INFO] TestAgent.server: member joined, marking health alive: member=Node-392dda34-c3af-05bf-0ffd-be4b2d6c5f50 31:45.092 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.125 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.146 [INFO] TestAgent: Synced node info 31:45.146 [DEBUG] TestAgent: Node info in sync 31:45.254 [INFO] TestAgent: Requesting shutdown 31:45.254 [INFO] TestAgent.server: shutting down server 31:45.254 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.254 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.254 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.254 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.254 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.254 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.254 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.254 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.254 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.254 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.275 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.281Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.281Z [INFO] agent.router.manager: shutting down 31:45.281 [INFO] TestAgent: consul server down 31:45.281 [INFO] TestAgent: shutdown complete 31:45.281 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29569 network=tcp 31:45.281 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29569 network=udp 31:45.281 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29556 network=tcp 31:45.781 [INFO] TestAgent: Waiting for endpoints to shut down 31:45.781 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_allow (1.03s) === CONT TestIntentionsMatch_noBy [WARN] freeport: 10 out of 52 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:45.659Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.674Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.719 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7da4193b-8da6-ee55-e506-b659744dc4b3 Address:127.0.0.1:29609}]" 31:45.719 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29609 [Follower]" leader= 31:45.720 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7da4193b-8da6-ee55-e506-b659744dc4b3.dc1 127.0.0.1 31:45.721 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7da4193b-8da6-ee55-e506-b659744dc4b3 127.0.0.1 2021-10-05T16:31:45.721Z [INFO] agent.router: Initializing LAN area manager 31:45.721 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29520 network=udp 31:45.721 [INFO] TestAgent.server: Adding LAN server: server="Node-7da4193b-8da6-ee55-e506-b659744dc4b3 (Addr: tcp/127.0.0.1:29609) (DC: dc1)" 31:45.721 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7da4193b-8da6-ee55-e506-b659744dc4b3.dc1 area=wan 31:45.721 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29520 network=tcp 31:45.722 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29605 network=tcp 31:45.722 [INFO] TestAgent: started state syncer 31:45.722 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29610 network=tcp 31:45.772 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.772 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29609 [Candidate]" term=2 31:45.791 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.791 [DEBUG] TestAgent.server.raft: vote granted: from=7da4193b-8da6-ee55-e506-b659744dc4b3 term=2 tally=1 31:45.791 [INFO] TestAgent.server.raft: election won: tally=1 31:45.791 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29609 [Leader]" 31:45.791 [INFO] TestAgent.server: cluster leadership acquired 31:45.791 [INFO] TestAgent.server: New leader elected: payload=Node-7da4193b-8da6-ee55-e506-b659744dc4b3 31:45.802 [INFO] TestAgent: Requesting shutdown 31:45.802 [INFO] TestAgent.server: shutting down server 31:45.802 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.803 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:45.816 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.827Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.827Z [INFO] agent.router.manager: shutting down 31:45.828 [INFO] TestAgent: consul server down 31:45.828 [INFO] TestAgent: shutdown complete 31:45.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29520 network=tcp 31:45.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29520 network=udp 31:45.828 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29605 network=tcp 31:45.828 [ERROR] TestAgent.server: failed to establish leadership: error="error configuring provider: leadership lost while committing log" 31:45.829 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:45.829 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:45.829 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 31:45.829 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 31:46.329 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.329 [INFO] TestAgent: Endpoints down === RUN TestRPC_HTTPSMaxConnsPerClient/HTTPS 2021-10-05T16:31:45.529Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.544Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.575 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1040edc7-aea6-f5de-5573-7cec38da3a2c Address:127.0.0.1:29588}]" 31:45.576 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29588 [Follower]" leader= 31:45.576 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1040edc7-aea6-f5de-5573-7cec38da3a2c.dc1 127.0.0.1 31:45.577 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1040edc7-aea6-f5de-5573-7cec38da3a2c 127.0.0.1 2021-10-05T16:31:45.577Z [INFO] agent.router: Initializing LAN area manager 31:45.577 [INFO] TestAgent.server: Adding LAN server: server="Node-1040edc7-aea6-f5de-5573-7cec38da3a2c (Addr: tcp/127.0.0.1:29588) (DC: dc1)" 31:45.577 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1040edc7-aea6-f5de-5573-7cec38da3a2c.dc1 area=wan 31:45.577 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29562 network=udp 31:45.577 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29562 network=tcp 31:45.577 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29584 network=tcp 31:45.578 [INFO] TestAgent: started state syncer 31:45.578 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29582 network=tcp 31:45.620 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.620 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29588 [Candidate]" term=2 31:45.644 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.644 [DEBUG] TestAgent.server.raft: vote granted: from=1040edc7-aea6-f5de-5573-7cec38da3a2c term=2 tally=1 31:45.644 [INFO] TestAgent.server.raft: election won: tally=1 31:45.644 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29588 [Leader]" 31:45.645 [INFO] TestAgent.server: cluster leadership acquired 31:45.645 [INFO] TestAgent.server: New leader elected: payload=Node-1040edc7-aea6-f5de-5573-7cec38da3a2c 31:45.667 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29588 31:45.693 [INFO] TestAgent: Synced node info 31:45.693 [DEBUG] TestAgent: Node info in sync 31:45.709 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.737 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.737 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.737 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.737 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.737 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.737 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1040edc7-aea6-f5de-5573-7cec38da3a2c 31:45.737 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1040edc7-aea6-f5de-5573-7cec38da3a2c 31:45.754 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.858 [INFO] TestAgent: Requesting shutdown 31:45.858 [INFO] TestAgent.server: shutting down server 31:45.858 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.858 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.858 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.858 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.858 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.858 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.858 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.858 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.858 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.858 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.863 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.872Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.872Z [INFO] agent.router.manager: shutting down 31:45.872 [INFO] TestAgent: consul server down 31:45.872 [INFO] TestAgent: shutdown complete 31:45.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29562 network=tcp 31:45.872 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29562 network=udp 31:45.872 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29584 network=tcp 31:46.373 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.373 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_idInvalidFormat (0.88s) === CONT TestIntentionsMatch_basic 2021-10-05T16:31:45.686Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.705Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.738 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8b4c47e0-44e2-43ae-4995-e92663ace5ec Address:127.0.0.1:29630}]" 31:45.738 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29630 [Follower]" leader= 31:45.739 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec.dc1 127.0.0.1 31:45.744 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec 127.0.0.1 2021-10-05T16:31:45.744Z [INFO] agent.router: Initializing LAN area manager 31:45.744 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29625 network=udp 31:45.744 [INFO] TestAgent.server: Adding LAN server: server="Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec (Addr: tcp/127.0.0.1:29630) (DC: dc1)" 31:45.745 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec.dc1 area=wan 31:45.745 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29625 network=tcp 31:45.745 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29626 network=tcp 31:45.745 [INFO] TestAgent: started state syncer 31:45.745 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29617 network=tcp 31:45.788 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.788 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29630 [Candidate]" term=2 31:45.829 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.829 [DEBUG] TestAgent.server.raft: vote granted: from=8b4c47e0-44e2-43ae-4995-e92663ace5ec term=2 tally=1 31:45.829 [INFO] TestAgent.server.raft: election won: tally=1 31:45.829 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29630 [Leader]" 31:45.829 [INFO] TestAgent.server: cluster leadership acquired 31:45.829 [INFO] TestAgent.server: New leader elected: payload=Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec 31:45.840 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29630 31:45.866 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.900 [INFO] TestAgent: Requesting shutdown 31:45.900 [INFO] TestAgent.server: shutting down server 31:45.900 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.900 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:45.912 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:45.917 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.917 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.917 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.917 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.917 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.917 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec 31:45.917 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec 2021-10-05T16:31:45.924Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.924Z [INFO] agent.router.manager: shutting down 31:45.927 [INFO] TestAgent: consul server down 31:45.927 [INFO] TestAgent: shutdown complete 31:45.927 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29625 network=tcp 31:45.927 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29625 network=udp 31:45.927 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29626 network=tcp 31:45.927 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-8b4c47e0-44e2-43ae-4995-e92663ace5ec 127.0.0.1 29628 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:8b4c47e0-44e2-43ae-4995-e92663ace5ec port:29630 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29629] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:45.927 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.927 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.927 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.927 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.927 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.927 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.927 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.440 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.440 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsMatch_noName (0.78s) === CONT TestIntentionsList_values [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:45.773Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.795Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.834 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:85900922-67a0-29f2-0d98-d5795f0100f4 Address:127.0.0.1:29602}]" 31:45.835 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-85900922-67a0-29f2-0d98-d5795f0100f4.dc1 127.0.0.1 31:45.836 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-85900922-67a0-29f2-0d98-d5795f0100f4 127.0.0.1 2021-10-05T16:31:45.836Z [INFO] agent.router: Initializing LAN area manager 31:45.836 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29602 [Follower]" leader= 31:45.836 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29618 network=udp 31:45.836 [INFO] TestAgent.server: Adding LAN server: server="Node-85900922-67a0-29f2-0d98-d5795f0100f4 (Addr: tcp/127.0.0.1:29602) (DC: dc1)" 31:45.836 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-85900922-67a0-29f2-0d98-d5795f0100f4.dc1 area=wan 31:45.836 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29618 network=tcp 31:45.837 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29598 network=tcp 31:45.837 [INFO] TestAgent: started state syncer 31:45.837 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29575 network=tcp 31:45.901 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.901 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29602 [Candidate]" term=2 31:45.929 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.929 [DEBUG] TestAgent.server.raft: vote granted: from=85900922-67a0-29f2-0d98-d5795f0100f4 term=2 tally=1 31:45.929 [INFO] TestAgent.server.raft: election won: tally=1 31:45.929 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29602 [Leader]" 31:45.929 [INFO] TestAgent.server: cluster leadership acquired 31:45.929 [INFO] TestAgent.server: New leader elected: payload=Node-85900922-67a0-29f2-0d98-d5795f0100f4 31:45.949 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29602 31:45.969 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.016 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.016 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.016 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.016 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.016 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.016 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-85900922-67a0-29f2-0d98-d5795f0100f4 31:46.016 [INFO] TestAgent.server: member joined, marking health alive: member=Node-85900922-67a0-29f2-0d98-d5795f0100f4 31:46.025 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.062 [INFO] TestAgent: Requesting shutdown 31:46.062 [INFO] TestAgent.server: shutting down server 31:46.062 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.062 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.062 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.062 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.062 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.062 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.062 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.062 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:46.062 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.062 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.062 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.072 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.077Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.077Z [INFO] agent.router.manager: shutting down 31:46.077 [INFO] TestAgent: consul server down 31:46.077 [INFO] TestAgent: shutdown complete 31:46.077 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29618 network=tcp 31:46.077 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29618 network=udp 31:46.078 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29598 network=tcp 31:46.578 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.578 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsMatch_byInvalid (0.83s) === CONT TestIntentionsList_empty 2021-10-05T16:31:45.691Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.726Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.816 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:04eee9ab-8e68-0ced-37c1-dbab66d99f32 Address:127.0.0.1:29616}]" 31:45.816 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29616 [Follower]" leader= 31:45.817 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-04eee9ab-8e68-0ced-37c1-dbab66d99f32.dc1 127.0.0.1 31:45.817 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-04eee9ab-8e68-0ced-37c1-dbab66d99f32 127.0.0.1 2021-10-05T16:31:45.817Z [INFO] agent.router: Initializing LAN area manager 31:45.817 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29611 network=udp 31:45.818 [INFO] TestAgent.server: Adding LAN server: server="Node-04eee9ab-8e68-0ced-37c1-dbab66d99f32 (Addr: tcp/127.0.0.1:29616) (DC: dc1)" 31:45.818 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-04eee9ab-8e68-0ced-37c1-dbab66d99f32.dc1 area=wan 31:45.818 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29611 network=tcp 31:45.819 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29612 network=tcp 31:45.819 [INFO] TestAgent: started state syncer 31:45.820 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29624 network=tcp 31:45.868 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.868 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29616 [Candidate]" term=2 31:45.886 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.886 [DEBUG] TestAgent.server.raft: vote granted: from=04eee9ab-8e68-0ced-37c1-dbab66d99f32 term=2 tally=1 31:45.886 [INFO] TestAgent.server.raft: election won: tally=1 31:45.886 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29616 [Leader]" 31:45.886 [INFO] TestAgent.server: cluster leadership acquired 31:45.886 [INFO] TestAgent.server: New leader elected: payload=Node-04eee9ab-8e68-0ced-37c1-dbab66d99f32 31:45.894 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29616 31:45.921 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.962 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.962 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.962 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.962 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.962 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.962 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04eee9ab-8e68-0ced-37c1-dbab66d99f32 31:45.962 [INFO] TestAgent.server: member joined, marking health alive: member=Node-04eee9ab-8e68-0ced-37c1-dbab66d99f32 31:45.983 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.036 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:46.055 [INFO] TestAgent: Synced node info 31:46.073 [INFO] TestAgent: Requesting shutdown 31:46.073 [INFO] TestAgent.server: shutting down server 31:46.073 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.073 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.073 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.073 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.073 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.073 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.073 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.073 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.073 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.073 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.078 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.084Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.084Z [INFO] agent.router.manager: shutting down 31:46.084 [INFO] TestAgent: consul server down 31:46.084 [INFO] TestAgent: shutdown complete 31:46.084 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29611 network=tcp 31:46.084 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29611 network=udp 31:46.084 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29612 network=tcp 31:46.585 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.585 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsCheck_basic (0.92s) === CONT TestAgent_InmemKeyrings === RUN TestAgent_InmemKeyrings/no_keys 2021/10/05 16:31:46 http: TLS handshake error from 127.0.0.1:40764: read tcp 127.0.0.1:29634->127.0.0.1:40764: use of closed network connection 2021-10-05T16:31:45.625Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.643Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.690 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1 Address:127.0.0.1:29511}]" 31:45.690 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1.dc1 127.0.0.1 31:45.691 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1 127.0.0.1 2021-10-05T16:31:45.691Z [INFO] agent.router: Initializing LAN area manager 31:45.691 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29511 [Follower]" leader= 31:45.691 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1.dc1 area=wan 31:45.691 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29583 network=tcp 31:45.691 [INFO] TestAgent.server: Adding LAN server: server="Node-a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1 (Addr: tcp/127.0.0.1:29511) (DC: dc1)" 31:45.692 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29583 network=udp 31:45.692 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29507 network=tcp 31:45.692 [INFO] TestAgent: started state syncer 31:45.692 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29519 network=tcp 31:45.730 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.730 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29511 [Candidate]" term=2 31:45.742 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.742 [DEBUG] TestAgent.server.raft: vote granted: from=a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1 term=2 tally=1 31:45.742 [INFO] TestAgent.server.raft: election won: tally=1 31:45.742 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29511 [Leader]" 31:45.742 [INFO] TestAgent.server: cluster leadership acquired 31:45.742 [INFO] TestAgent.server: New leader elected: payload=Node-a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1 31:45.750 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29511 31:45.764 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.809 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.809 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.809 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.809 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.809 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.809 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1 31:45.809 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a47e9b90-a38b-a47f-3a29-a0f4ba1d4ee1 31:45.836 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.013 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:46.019 [INFO] TestAgent: Synced node info 31:46.019 [DEBUG] TestAgent: Node info in sync 31:46.123 [INFO] TestAgent: Requesting shutdown 31:46.123 [INFO] TestAgent.server: shutting down server 31:46.123 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.123 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.123 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.123 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.123 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.123 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.123 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.123 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.123 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.123 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.130 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.133Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.133Z [INFO] agent.router.manager: shutting down 31:46.133 [INFO] TestAgent: consul server down 31:46.133 [INFO] TestAgent: shutdown complete 31:46.133 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29583 network=tcp 31:46.133 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29583 network=udp 31:46.133 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29507 network=tcp 31:46.635 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.635 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectAuthorize_noTarget (1.03s) === CONT TestKVSEndpoint_GET_Raw 2021/10/05 16:31:46 http: TLS handshake error from 127.0.0.1:40760: EOF 2021/10/05 16:31:46 http: TLS handshake error from 127.0.0.1:40766: EOF 2021/10/05 16:31:46 http: TLS handshake error from 127.0.0.1:40762: EOF 2021-10-05T16:31:45.804Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.831Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.879 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:29463f02-33e3-a243-eb2d-a53f537dcf4c Address:127.0.0.1:29581}]" 31:45.880 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29581 [Follower]" leader= 31:45.880 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-29463f02-33e3-a243-eb2d-a53f537dcf4c.dc1 127.0.0.1 31:45.881 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-29463f02-33e3-a243-eb2d-a53f537dcf4c 127.0.0.1 2021-10-05T16:31:45.881Z [INFO] agent.router: Initializing LAN area manager 31:45.881 [INFO] TestAgent.server: Adding LAN server: server="Node-29463f02-33e3-a243-eb2d-a53f537dcf4c (Addr: tcp/127.0.0.1:29581) (DC: dc1)" 31:45.881 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-29463f02-33e3-a243-eb2d-a53f537dcf4c.dc1 area=wan 31:45.881 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29576 network=udp 31:45.882 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29576 network=tcp 31:45.882 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29577 network=tcp 31:45.882 [INFO] TestAgent: started state syncer 31:45.882 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29638 network=tcp 31:45.938 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.938 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29581 [Candidate]" term=2 31:45.960 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.960 [DEBUG] TestAgent.server.raft: vote granted: from=29463f02-33e3-a243-eb2d-a53f537dcf4c term=2 tally=1 31:45.960 [INFO] TestAgent.server.raft: election won: tally=1 31:45.960 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29581 [Leader]" 31:45.960 [INFO] TestAgent.server: cluster leadership acquired 31:45.961 [INFO] TestAgent.server: New leader elected: payload=Node-29463f02-33e3-a243-eb2d-a53f537dcf4c 31:45.968 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29581 31:45.988 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.018 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.018 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.018 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.018 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.018 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.018 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-29463f02-33e3-a243-eb2d-a53f537dcf4c 31:46.018 [INFO] TestAgent.server: member joined, marking health alive: member=Node-29463f02-33e3-a243-eb2d-a53f537dcf4c 31:46.027 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.192 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:46.197 [INFO] TestAgent: Synced node info 31:46.270 [INFO] TestAgent: Requesting shutdown 31:46.270 [INFO] TestAgent.server: shutting down server 31:46.270 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.270 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.270 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.270 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.270 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.270 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.270 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.270 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.270 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.270 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.274 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.279Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.279Z [INFO] agent.router.manager: shutting down 31:46.280 [INFO] TestAgent: consul server down 31:46.280 [INFO] TestAgent: shutdown complete 31:46.280 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29576 network=tcp 31:46.280 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29576 network=udp 31:46.280 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29577 network=tcp 31:46.780 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.780 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsMatch_noBy (1.00s) === CONT TestKVSEndpoint_AcquireRelease [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:39.930Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.944Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.945 [INFO] bonnie.server.gateway_locator: will dial the primary datacenter through its mesh gateways 31:39.978 [INFO] bonnie.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ba0fdd7a-de15-7320-ed49-c12f977c54c5 Address:127.0.0.1:30129}]" 31:39.979 [INFO] bonnie.server.serf.wan: serf: EventMemberJoin: bonnie.dc3 127.0.0.1 31:39.979 [INFO] bonnie.server.serf.lan: serf: EventMemberJoin: bonnie 127.0.0.1 2021-10-05T16:31:39.979Z [INFO] agent.router: Initializing LAN area manager 31:39.980 [INFO] bonnie: Started DNS server: address=127.0.0.1:30281 network=udp 31:39.980 [INFO] bonnie.server.raft: entering follower state: follower="Node at 127.0.0.1:30129 [Follower]" leader= 31:39.980 [INFO] bonnie.server: Handled event for server in area: event=member-join server=bonnie.dc3 area=wan 31:39.980 [INFO] bonnie: Started DNS server: address=127.0.0.1:30281 network=tcp 31:39.980 [INFO] bonnie.server: Adding LAN server: server="bonnie (Addr: tcp/127.0.0.1:30129) (DC: dc3)" 31:39.980 [INFO] bonnie: Started HTTP server: address=127.0.0.1:30282 network=tcp 31:39.980 [INFO] bonnie: started state syncer 31:39.981 [INFO] bonnie: Started gRPC server: address=127.0.0.1:30287 network=tcp 31:39.981 [INFO] bonnie: Refreshing mesh gateways is supported for the following discovery methods: discovery_methods="aliyun aws gce mdns os packet" 31:39.981 [INFO] bonnie: Refreshing mesh gateways... 31:39.981 [INFO] bonnie.server.gateway_locator: updated fallback list of primary mesh gateways: mesh_gateways=[127.0.0.1:30127] 31:39.981 [INFO] bonnie: Refreshing mesh gateways completed 31:39.981 [INFO] bonnie: Retry join is supported for the following discovery methods: cluster=WAN discovery_methods="aliyun aws gce mdns os packet" 31:39.981 [INFO] bonnie: Joining cluster...: cluster=WAN 31:39.981 [INFO] bonnie: (WAN) joining: wan_addresses=[*.dc1/192.0.2.2] 31:40.047 [WARN] bonnie.server.raft: heartbeat timeout reached, starting election: last-leader= 31:40.047 [INFO] bonnie.server.raft: entering candidate state: node="Node at 127.0.0.1:30129 [Candidate]" term=2 31:40.072 [DEBUG] bonnie.server.raft: votes: needed=1 31:40.072 [DEBUG] bonnie.server.raft: vote granted: from=ba0fdd7a-de15-7320-ed49-c12f977c54c5 term=2 tally=1 31:40.072 [INFO] bonnie.server.raft: election won: tally=1 31:40.072 [INFO] bonnie.server.raft: entering leader state: leader="Node at 127.0.0.1:30129 [Leader]" 31:40.072 [INFO] bonnie.server: cluster leadership acquired 31:40.072 [INFO] bonnie.server: New leader elected: payload=bonnie 31:40.087 [DEBUG] bonnie.server: Cannot upgrade to new ACLs, servers in acl datacenter are not yet upgraded: ACLDatacenter=dc1 mode=1 found=false 31:40.095 [WARN] bonnie.server.connect: primary datacenter is configured but unreachable - deferring initialization of the secondary datacenter CA 31:40.095 [INFO] bonnie.leader: started routine: routine="config entry replication" 31:40.095 [INFO] bonnie.leader: started routine: routine="federation state replication" 31:40.095 [INFO] bonnie.leader: started routine: routine="federation state anti-entropy" 31:40.095 [INFO] bonnie.leader: started routine: routine="secondary CA roots watch" 31:40.095 [INFO] bonnie.leader: started routine: routine="intention replication" 31:40.095 [INFO] bonnie.leader: started routine: routine="intermediate cert renew watch" 31:40.095 [INFO] bonnie.leader: started routine: routine="CA root pruning" 31:40.095 [DEBUG] bonnie.server: Skipping self join check for node since the cluster is too small: node=bonnie 31:40.095 [INFO] bonnie.server: member joined, marking health alive: member=bonnie 31:40.096 [DEBUG] bonnie.server.connect: starting Connect CA root replication from primary datacenter: primary=dc1 31:40.096 [DEBUG] bonnie.server: federation states are not enabled in the primary dc 31:40.096 [WARN] bonnie.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ConnectCA.Roots 31:40.096 [ERROR] bonnie.server.connect: CA root replication failed, will retry: routine="secondary CA roots watch" error="Error retrieving the primary datacenter's roots: No path to datacenter" 31:40.096 [DEBUG] bonnie.server: federation states are not enabled in the primary dc 31:40.096 [WARN] bonnie.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ConfigEntry.ListAll 31:40.096 [DEBUG] bonnie.server: federation states are not enabled in the primary dc 31:40.096 [DEBUG] bonnie.server: federation states are not enabled in the primary dc 31:40.096 [DEBUG] bonnie.server: federation states are not enabled in the primary dc 31:40.096 [DEBUG] bonnie.server.connect: starting Connect intention replication from primary datacenter: primary=dc1 31:40.096 [WARN] bonnie.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=Intention.List 31:40.096 [ERROR] bonnie.server.connect: error replicating intentions: routine="intention replication" error="No path to datacenter" 31:40.096 [DEBUG] bonnie.server: federation states are not enabled in the primary dc 31:40.130 [DEBUG] bonnie.server.memberlist.wan: memberlist: Initiating push/pull sync with: *.dc1 127.0.0.1:30127 31:40.132 [INFO] bonnie: Synced node info 31:40.137 [INFO] bonnie.server.serf.wan: serf: EventMemberJoin: betty.dc2 127.0.0.1 31:40.137 [INFO] bonnie.server.serf.wan: serf: EventMemberJoin: bob.dc1 127.0.0.1 31:40.137 [INFO] bonnie: (WAN) joined: number_of_nodes=1 31:40.137 [INFO] bonnie: Join cluster completed. Synced with initial agents: cluster=WAN num_agents=1 31:40.137 [INFO] bonnie.server: Handled event for server in area: event=member-join server=betty.dc2 area=wan 31:40.137 [INFO] bonnie.server: Handled event for server in area: event=member-join server=bob.dc1 area=wan 31:40.176 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.176 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.176 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.176 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.proxycfg: watch error: service_id=mesh-gateway id=mesh-gateway:dc2 error="error filling agent cache: rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.proxycfg: watch error: service_id=mesh-gateway id=mesh-gateway:dc2 error="error filling agent cache: rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.proxycfg: watch error: service_id=mesh-gateway id=mesh-gateway:dc2 error="error filling agent cache: rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.177 [ERROR] bonnie.proxycfg: watch error: service_id=mesh-gateway id=mesh-gateway:dc2 error="error filling agent cache: rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:40.183 [DEBUG] bonnie: Node info in sync 31:40.192 [INFO] bonnie: Synced service: service=mesh-gateway 31:40.391 [DEBUG] bonnie.server.serf.wan: serf: messageJoinType: betty.dc2 31:40.479 [ERROR] bonnie.server.memberlist.wan: memberlist: Failed to send gossip to 127.0.0.1:30204: Remote DC has no server currently reachable 31:40.777 [DEBUG] bonnie.server.serf.wan: serf: messageJoinType: betty.dc2 31:40.992 [ERROR] bonnie.server.memberlist.wan: memberlist: Failed to send gossip to 127.0.0.1:30204: Remote DC has no server currently reachable 31:41.136 [DEBUG] bonnie.server.replication.config_entry: finished fetching config entries: amount=0 31:41.136 [DEBUG] bonnie.server.replication.config_entry: Config Entry replication: local=0 remote=0 31:41.136 [DEBUG] bonnie.server.replication.config_entry: Config Entry replication: deletions=0 updates=0 31:41.136 [DEBUG] bonnie.server.replication.config_entry: replication completed through remote index: index=1 31:41.177 [INFO] bonnie.server.gateway_locator: will dial the primary datacenter using our local mesh gateways if possible 31:41.177 [DEBUG] bonnie.server: finished fetching remote objects: amount=2 31:41.177 [DEBUG] bonnie.server: diffing replication state: local_amount=0 remote_amount=2 31:41.177 [DEBUG] bonnie.server: diffed replication state: deletions=0 updates=2 31:41.177 [DEBUG] bonnie.server: performing updates: updates=2 31:41.203 [DEBUG] bonnie.server: finished updates 31:41.203 [DEBUG] bonnie.replication.federation_state: replication completed through remote index: index=18 31:41.274 [DEBUG] bonnie.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.610 [DEBUG] bonnie.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.776 [DEBUG] bonnie.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.964 [DEBUG] bonnie.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.981 [INFO] bonnie.server.gateway_locator: new cached locations of mesh gateways: primary=[127.0.0.1:30127] local=[] 31:42.104 [DEBUG] connect.ca.consul: consul CA provider configured: id=ad:4a:c6:ab:ef:63:c9:60:1a:51:7f:19:62:e3:e9:d9:0e:76:55:10:6e:74:24:69:28:a1:6c:b8:b9:8f:fd:89 is_primary=false 31:42.136 [INFO] bonnie.server.connect: received new intermediate certificate from primary datacenter 31:42.156 [INFO] bonnie.server.connect: updated root certificates from primary datacenter 31:42.236 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:43.010 [DEBUG] bonnie: Skipping remote check since it is managed automatically: check=serfHealth 31:43.010 [DEBUG] bonnie: Node info in sync 31:43.010 [DEBUG] bonnie: Service in sync: service=mesh-gateway 31:43.010 [DEBUG] bonnie: Node info in sync 31:43.010 [DEBUG] bonnie: Service in sync: service=mesh-gateway 31:43.149 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:43.407 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:43.894 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:44.058 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:44.058 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:44.058 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:44.058 [ERROR] bonnie.proxycfg: watch error: service_id=mesh-gateway id=mesh-gateway:dc2 error="error filling agent cache: rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:44.058 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30128 datacenter=dc2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: Remote DC has no server currently reachable" 31:44.979 [ERROR] bonnie.server.memberlist.wan: memberlist: Failed to send ping: Remote DC has no server currently reachable 31:45.117 [DEBUG] bonnie.server: finished fetching remote objects: amount=3 31:45.118 [DEBUG] bonnie.server: diffing replication state: local_amount=2 remote_amount=3 31:45.118 [DEBUG] bonnie.server: diffed replication state: deletions=0 updates=1 31:45.118 [DEBUG] bonnie.server: performing updates: updates=1 31:45.120 [INFO] bonnie.server: federation state anti-entropy synced 31:45.144 [DEBUG] bonnie.server: finished updates 31:45.144 [DEBUG] bonnie.replication.federation_state: replication completed through remote index: index=20 31:45.144 [INFO] bonnie.server.gateway_locator: new cached locations of mesh gateways: primary=[127.0.0.1:30127] local=[127.0.0.1:30127] 31:45.588 [INFO] bonnie: Requesting shutdown 31:45.588 [INFO] bonnie.server: shutting down server 31:45.588 [DEBUG] bonnie.leader: stopping routine: routine="config entry replication" 31:45.588 [DEBUG] bonnie.leader: stopping routine: routine="federation state replication" 31:45.588 [DEBUG] bonnie.leader: stopping routine: routine="federation state anti-entropy" 31:45.588 [DEBUG] bonnie.leader: stopping routine: routine="secondary CA roots watch" 31:45.588 [DEBUG] bonnie.leader: stopping routine: routine="intention replication" 31:45.588 [DEBUG] bonnie.leader: stopping routine: routine="intermediate cert renew watch" 31:45.588 [DEBUG] bonnie.leader: stopping routine: routine="CA root pruning" 31:45.588 [WARN] bonnie.server.serf.lan: serf: Shutdown without a Leave 31:45.589 [DEBUG] bonnie.leader: stopped routine: routine="federation state anti-entropy" 31:45.589 [DEBUG] bonnie.leader: stopped routine: routine="intermediate cert renew watch" 31:45.589 [DEBUG] bonnie.leader: stopped routine: routine="CA root pruning" 31:45.600 [WARN] bonnie.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.612Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.612Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.612Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.612Z [INFO] agent.router.manager: shutting down 31:45.612 [INFO] bonnie: consul server down 31:45.612 [INFO] bonnie: shutdown complete 31:45.612 [INFO] bonnie: Stopping server: protocol=DNS address=127.0.0.1:30281 network=tcp 31:45.612 [INFO] bonnie: Stopping server: protocol=DNS address=127.0.0.1:30281 network=udp 31:45.612 [INFO] bonnie: Stopping server: protocol=HTTP address=127.0.0.1:30282 network=tcp 31:45.612 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=Internal.ServiceDump error="rpc error making call: EOF" 31:45.612 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=ConfigEntry.ListAll error="rpc error making call: EOF" 31:45.612 [INFO] bonnie.server.replication.config_entry: stopped replication 31:45.612 [DEBUG] bonnie.leader: stopped routine: routine="config entry replication" 31:45.612 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=ConnectCA.Roots error="rpc error making call: EOF" 31:45.612 [ERROR] bonnie.server.connect: CA root replication failed, will retry: routine="secondary CA roots watch" error="Error retrieving the primary datacenter's roots: rpc error making call: EOF" 31:45.612 [DEBUG] bonnie.leader: stopped routine: routine="secondary CA roots watch" 31:45.612 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=Intention.List error="rpc error making call: EOF" 31:45.612 [ERROR] bonnie.server.connect: error replicating intentions: routine="intention replication" error="rpc error making call: EOF" 31:45.612 [DEBUG] bonnie.leader: stopped routine: routine="intention replication" 31:45.612 [ERROR] bonnie.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=FederationState.List error="rpc error making call: EOF" 31:45.612 [WARN] bonnie.replication.federation_state: replication error (will retry if still leader): error="failed to retrieve federation states: rpc error making call: EOF" 31:45.612 [INFO] bonnie.replication.federation_state: stopped replication 31:45.612 [DEBUG] bonnie.leader: stopped routine: routine="federation state replication" 31:46.113 [INFO] bonnie: Waiting for endpoints to shut down 31:46.113 [INFO] bonnie: Endpoints down 2021-10-05T16:31:39.330Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:39.376Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:39.377 [INFO] betty.server.gateway_locator: will dial the primary datacenter through its mesh gateways 31:39.455 [INFO] betty.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0f6c9c8e-117b-32c8-34da-63dfd926a124 Address:127.0.0.1:30128}]" 31:39.456 [INFO] betty.server.raft: entering follower state: follower="Node at 127.0.0.1:30128 [Follower]" leader= 31:39.456 [INFO] betty.server.serf.wan: serf: EventMemberJoin: betty.dc2 127.0.0.1 31:39.457 [INFO] betty.server.serf.lan: serf: EventMemberJoin: betty 127.0.0.1 2021-10-05T16:31:39.457Z [INFO] agent.router: Initializing LAN area manager 31:39.457 [INFO] betty: Started DNS server: address=127.0.0.1:30200 network=udp 31:39.457 [INFO] betty.server: Adding LAN server: server="betty (Addr: tcp/127.0.0.1:30128) (DC: dc2)" 31:39.457 [INFO] betty.server: Handled event for server in area: event=member-join server=betty.dc2 area=wan 31:39.458 [INFO] betty: Started DNS server: address=127.0.0.1:30200 network=tcp 31:39.458 [INFO] betty: Started HTTP server: address=127.0.0.1:30201 network=tcp 31:39.458 [INFO] betty: started state syncer 31:39.458 [INFO] betty: Started gRPC server: address=127.0.0.1:30266 network=tcp 31:39.458 [INFO] betty: Refreshing mesh gateways is supported for the following discovery methods: discovery_methods="aliyun aws gce mdns os packet" 31:39.458 [INFO] betty: Refreshing mesh gateways... 31:39.458 [INFO] betty.server.gateway_locator: updated fallback list of primary mesh gateways: mesh_gateways=[127.0.0.1:30127] 31:39.458 [INFO] betty: Refreshing mesh gateways completed 31:39.458 [INFO] betty: Retry join is supported for the following discovery methods: cluster=WAN discovery_methods="aliyun aws gce mdns os packet" 31:39.458 [INFO] betty: Joining cluster...: cluster=WAN 31:39.458 [INFO] betty: (WAN) joining: wan_addresses=[*.dc1/192.0.2.2] 31:39.516 [WARN] betty.server.raft: heartbeat timeout reached, starting election: last-leader= 31:39.516 [INFO] betty.server.raft: entering candidate state: node="Node at 127.0.0.1:30128 [Candidate]" term=2 31:39.560 [DEBUG] betty.server.raft: votes: needed=1 31:39.560 [DEBUG] betty.server.raft: vote granted: from=0f6c9c8e-117b-32c8-34da-63dfd926a124 term=2 tally=1 31:39.560 [INFO] betty.server.raft: election won: tally=1 31:39.560 [INFO] betty.server.raft: entering leader state: leader="Node at 127.0.0.1:30128 [Leader]" 31:39.564 [INFO] betty.server: cluster leadership acquired 31:39.564 [INFO] betty.server: New leader elected: payload=betty 31:39.567 [DEBUG] betty.server.memberlist.wan: memberlist: Initiating push/pull sync with: *.dc1 127.0.0.1:30127 31:39.577 [INFO] betty.server.serf.wan: serf: EventMemberJoin: bob.dc1 127.0.0.1 31:39.577 [INFO] betty: (WAN) joined: number_of_nodes=1 31:39.577 [INFO] betty: Join cluster completed. Synced with initial agents: cluster=WAN num_agents=1 31:39.577 [INFO] betty.server: Handled event for server in area: event=member-join server=bob.dc1 area=wan 31:39.628 [INFO] betty: Synced node info 31:39.628 [DEBUG] betty.server: Cannot upgrade to new ACLs, servers in acl datacenter are not yet upgraded: ACLDatacenter=dc1 mode=0 found=true 31:39.807 [DEBUG] connect.ca.consul: consul CA provider configured: id=ad:4a:c6:ab:ef:63:c9:60:1a:51:7f:19:62:e3:e9:d9:0e:76:55:10:6e:74:24:69:28:a1:6c:b8:b9:8f:fd:89 is_primary=false 31:39.865 [INFO] betty.server.connect: received new intermediate certificate from primary datacenter 31:39.880 [INFO] betty.server.connect: updated root certificates from primary datacenter 31:39.880 [INFO] betty.server.connect: initialized secondary datacenter CA with provider: provider=consul 31:39.880 [INFO] betty.leader: started routine: routine="config entry replication" 31:39.880 [INFO] betty.leader: started routine: routine="federation state replication" 31:39.880 [INFO] betty.leader: started routine: routine="federation state anti-entropy" 31:39.880 [INFO] betty.leader: started routine: routine="secondary CA roots watch" 31:39.880 [INFO] betty.leader: started routine: routine="intention replication" 31:39.880 [INFO] betty.leader: started routine: routine="intermediate cert renew watch" 31:39.880 [INFO] betty.leader: started routine: routine="CA root pruning" 31:39.880 [DEBUG] betty.server: Skipping self join check for node since the cluster is too small: node=betty 31:39.880 [INFO] betty.server: member joined, marking health alive: member=betty 31:39.881 [DEBUG] betty.server.connect: starting Connect CA root replication from primary datacenter: primary=dc1 31:39.881 [DEBUG] betty.server.connect: starting Connect intention replication from primary datacenter: primary=dc1 31:39.882 [DEBUG] betty.server.replication.config_entry: finished fetching config entries: amount=0 31:39.882 [DEBUG] betty.server.replication.config_entry: Config Entry replication: local=0 remote=0 31:39.882 [DEBUG] betty.server.replication.config_entry: Config Entry replication: deletions=0 updates=0 31:39.882 [DEBUG] betty.server.replication.config_entry: replication completed through remote index: index=1 31:39.882 [INFO] betty.server.gateway_locator: will dial the primary datacenter using our local mesh gateways if possible 31:39.882 [DEBUG] betty.server: finished fetching remote objects: amount=1 31:39.882 [DEBUG] betty.server: diffing replication state: local_amount=0 remote_amount=1 31:39.882 [DEBUG] betty.server: diffed replication state: deletions=0 updates=1 31:39.882 [DEBUG] betty.server: performing updates: updates=1 31:39.913 [INFO] betty.server.connect: updated root certificates from primary datacenter 31:39.914 [DEBUG] betty.server: finished updates 31:39.914 [DEBUG] betty.replication.federation_state: replication completed through remote index: index=14 31:39.920 [DEBUG] betty.server: finished fetching remote objects: amount=2 31:39.920 [DEBUG] betty.server: diffing replication state: local_amount=1 remote_amount=2 31:39.920 [DEBUG] betty.server: diffed replication state: deletions=0 updates=1 31:39.920 [DEBUG] betty.server: performing updates: updates=1 31:39.921 [INFO] betty.server: federation state anti-entropy synced 31:39.932 [DEBUG] betty.server: finished updates 31:39.932 [DEBUG] betty.replication.federation_state: replication completed through remote index: index=16 31:39.944 [INFO] betty.server: federation state anti-entropy synced 31:39.944 [DEBUG] betty.server: finished fetching remote objects: amount=2 31:39.944 [DEBUG] betty.server: diffing replication state: local_amount=2 remote_amount=2 31:39.944 [DEBUG] betty.server: diffed replication state: deletions=0 updates=1 31:39.944 [DEBUG] betty.server: performing updates: updates=1 31:39.964 [DEBUG] betty.server: finished updates 31:39.964 [DEBUG] betty.replication.federation_state: replication completed through remote index: index=17 31:40.167 [DEBUG] betty: Node info in sync 31:40.173 [INFO] betty: Synced service: service=mesh-gateway 31:40.196 [INFO] betty.server: federation state anti-entropy synced 31:40.200 [DEBUG] betty.server: finished fetching remote objects: amount=2 31:40.200 [DEBUG] betty.server: diffing replication state: local_amount=2 remote_amount=2 31:40.200 [DEBUG] betty.server: diffed replication state: deletions=0 updates=1 31:40.200 [DEBUG] betty.server: performing updates: updates=1 31:40.213 [DEBUG] betty.server: finished updates 31:40.213 [DEBUG] betty.replication.federation_state: replication completed through remote index: index=18 31:40.276 [INFO] betty.server.serf.wan: serf: EventMemberJoin: bonnie.dc3 127.0.0.1 31:40.276 [DEBUG] betty.server.serf.wan: serf: messageJoinType: betty.dc2 31:40.276 [INFO] betty.server: Handled event for server in area: event=member-join server=bonnie.dc3 area=wan 31:40.457 [ERROR] betty.server.memberlist.wan: memberlist: Failed to send gossip to 127.0.0.1:30285: Remote DC has no server currently reachable 31:40.777 [DEBUG] betty.server.serf.wan: serf: messageJoinType: betty.dc2 31:40.997 [ERROR] betty.server.memberlist.wan: memberlist: Failed to send gossip to 127.0.0.1:30285: Remote DC has no server currently reachable 31:41.273 [DEBUG] betty.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.457 [INFO] betty.server.gateway_locator: new cached locations of mesh gateways: primary=[127.0.0.1:30127] local=[127.0.0.1:30127] 31:41.776 [DEBUG] betty.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:42.328 [DEBUG] betty: Skipping remote check since it is managed automatically: check=serfHealth 31:42.328 [DEBUG] betty: Node info in sync 31:42.328 [DEBUG] betty: Service in sync: service=mesh-gateway 31:42.328 [DEBUG] betty: Node info in sync 31:42.328 [DEBUG] betty: Service in sync: service=mesh-gateway 31:45.120 [DEBUG] betty.server: finished fetching remote objects: amount=3 31:45.120 [DEBUG] betty.server: diffing replication state: local_amount=2 remote_amount=3 31:45.120 [DEBUG] betty.server: diffed replication state: deletions=0 updates=1 31:45.120 [DEBUG] betty.server: performing updates: updates=1 31:45.144 [DEBUG] betty.server: finished updates 31:45.144 [DEBUG] betty.replication.federation_state: replication completed through remote index: index=20 31:46.113 [INFO] betty: Requesting shutdown 31:46.113 [INFO] betty.server: shutting down server 31:46.113 [DEBUG] betty.leader: stopping routine: routine="secondary CA roots watch" 31:46.113 [DEBUG] betty.leader: stopping routine: routine="intention replication" 31:46.113 [DEBUG] betty.leader: stopping routine: routine="intermediate cert renew watch" 31:46.113 [DEBUG] betty.leader: stopping routine: routine="CA root pruning" 31:46.113 [DEBUG] betty.leader: stopping routine: routine="config entry replication" 31:46.113 [DEBUG] betty.leader: stopping routine: routine="federation state replication" 31:46.113 [DEBUG] betty.leader: stopping routine: routine="federation state anti-entropy" 31:46.113 [WARN] betty.server.serf.lan: serf: Shutdown without a Leave 31:46.113 [DEBUG] betty.leader: stopped routine: routine="intermediate cert renew watch" 31:46.113 [DEBUG] betty.leader: stopped routine: routine="CA root pruning" 31:46.113 [DEBUG] betty.leader: stopped routine: routine="federation state anti-entropy" 31:46.126 [WARN] betty.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.127Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.127Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.127Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.127Z [INFO] agent.router.manager: shutting down 31:46.128 [INFO] betty: consul server down 31:46.128 [INFO] betty: shutdown complete 31:46.128 [INFO] betty: Stopping server: protocol=DNS address=127.0.0.1:30200 network=tcp 31:46.128 [INFO] betty: Stopping server: protocol=DNS address=127.0.0.1:30200 network=udp 31:46.128 [INFO] betty: Stopping server: protocol=HTTP address=127.0.0.1:30201 network=tcp 31:46.128 [ERROR] betty.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=Intention.List error="rpc error making call: EOF" 31:46.128 [ERROR] betty.server.connect: error replicating intentions: routine="intention replication" error="rpc error making call: EOF" 31:46.128 [DEBUG] betty.leader: stopped routine: routine="intention replication" 31:46.128 [ERROR] betty.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=FederationState.List error="rpc error making call: EOF" 31:46.128 [WARN] betty.replication.federation_state: replication error (will retry if still leader): error="failed to retrieve federation states: rpc error making call: EOF" 31:46.128 [INFO] betty.replication.federation_state: stopped replication 31:46.128 [DEBUG] betty.leader: stopped routine: routine="federation state replication" 31:46.128 [ERROR] betty.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=ConfigEntry.ListAll error="rpc error making call: EOF" 31:46.128 [INFO] betty.server.replication.config_entry: stopped replication 31:46.128 [DEBUG] betty.leader: stopped routine: routine="config entry replication" 31:46.128 [ERROR] betty.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=ConnectCA.Roots error="rpc error making call: EOF" 31:46.128 [ERROR] betty.server.connect: CA root replication failed, will retry: routine="secondary CA roots watch" error="Error retrieving the primary datacenter's roots: rpc error making call: EOF" 31:46.128 [DEBUG] betty.leader: stopped routine: routine="secondary CA roots watch" 31:46.128 [ERROR] betty.server.rpc: RPC failed to server in DC: server=127.0.0.1:30142 datacenter=dc1 method=Internal.ServiceDump error="rpc error making call: EOF" 31:46.628 [INFO] betty: Waiting for endpoints to shut down 31:46.628 [INFO] betty: Endpoints down 2021-10-05T16:31:37.149Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:37.195Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:37.272 [INFO] bob.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:11efacca-32a2-3715-a864-5022a8475258 Address:127.0.0.1:30142}]" 31:37.272 [INFO] bob.server.raft: entering follower state: follower="Node at 127.0.0.1:30142 [Follower]" leader= 31:37.273 [INFO] bob.server.serf.wan: serf: EventMemberJoin: bob.dc1 127.0.0.1 31:37.273 [INFO] bob.server.serf.lan: serf: EventMemberJoin: bob 127.0.0.1 2021-10-05T16:31:37.273Z [INFO] agent.router: Initializing LAN area manager 31:37.273 [INFO] bob: Started DNS server: address=127.0.0.1:30130 network=udp 31:37.274 [INFO] bob.server: Adding LAN server: server="bob (Addr: tcp/127.0.0.1:30142) (DC: dc1)" 31:37.274 [INFO] bob.server: Handled event for server in area: event=member-join server=bob.dc1 area=wan 31:37.274 [INFO] bob: Started DNS server: address=127.0.0.1:30130 network=tcp 31:37.274 [INFO] bob: Started HTTP server: address=127.0.0.1:30131 network=tcp 31:37.274 [INFO] bob: started state syncer 31:37.274 [INFO] bob: Started gRPC server: address=127.0.0.1:30073 network=tcp 31:37.317 [WARN] bob.server.raft: heartbeat timeout reached, starting election: last-leader= 31:37.317 [INFO] bob.server.raft: entering candidate state: node="Node at 127.0.0.1:30142 [Candidate]" term=2 31:37.352 [DEBUG] bob.server.raft: votes: needed=1 31:37.352 [DEBUG] bob.server.raft: vote granted: from=11efacca-32a2-3715-a864-5022a8475258 term=2 tally=1 31:37.352 [INFO] bob.server.raft: election won: tally=1 31:37.352 [INFO] bob.server.raft: entering leader state: leader="Node at 127.0.0.1:30142 [Leader]" 31:37.352 [INFO] bob.server: cluster leadership acquired 31:37.352 [INFO] bob.server: New leader elected: payload=bob 31:37.381 [DEBUG] bob.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30142 31:37.429 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:37.462 [INFO] bob.server.connect: initialized primary datacenter CA with provider: provider=consul 31:37.462 [INFO] bob.leader: started routine: routine="federation state anti-entropy" 31:37.462 [INFO] bob.leader: started routine: routine="federation state pruning" 31:37.462 [INFO] bob.leader: started routine: routine="intermediate cert renew watch" 31:37.462 [INFO] bob.leader: started routine: routine="CA root pruning" 31:37.462 [DEBUG] bob.server: Skipping self join check for node since the cluster is too small: node=bob 31:37.462 [INFO] bob.server: member joined, marking health alive: member=bob 31:37.478 [INFO] bob.server: federation state anti-entropy synced 31:37.554 [DEBUG] bob: Skipping remote check since it is managed automatically: check=serfHealth 31:37.558 [INFO] bob: Synced node info 31:37.736 [DEBUG] bob: Node info in sync 31:37.748 [INFO] bob: Synced service: service=mesh-gateway 31:37.763 [INFO] bob.server: federation state anti-entropy synced 31:38.138 [DEBUG] bob: Skipping remote check since it is managed automatically: check=serfHealth 31:38.138 [DEBUG] bob: Node info in sync 31:38.138 [DEBUG] bob: Service in sync: service=mesh-gateway 31:38.138 [DEBUG] bob: Node info in sync 31:38.138 [DEBUG] bob: Service in sync: service=mesh-gateway 31:39.276 [INFO] bob.server.gateway_locator: new cached locations of mesh gateways: primary=[127.0.0.1:30127] local=[127.0.0.1:30127] 31:39.573 [DEBUG] bob.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:39496 31:39.574 [INFO] bob.server.serf.wan: serf: EventMemberJoin: betty.dc2 127.0.0.1 31:39.574 [INFO] bob.server: Handled event for server in area: event=member-join server=betty.dc2 area=wan 31:40.066 [DEBUG] bob.server.serf.wan: serf: messageJoinType: betty.dc2 31:40.133 [DEBUG] bob.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:39514 31:40.134 [INFO] bob.server.serf.wan: serf: EventMemberJoin: bonnie.dc3 127.0.0.1 31:40.134 [INFO] bob.server: Handled event for server in area: event=member-join server=bonnie.dc3 area=wan 31:40.460 [DEBUG] bob.server.serf.wan: serf: messageJoinType: betty.dc2 31:41.110 [DEBUG] bob.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.460 [DEBUG] bob.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.480 [DEBUG] bob.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:41.964 [DEBUG] bob.server.serf.wan: serf: messageJoinType: bonnie.dc3 31:46.628 [INFO] bob: Requesting shutdown 31:46.628 [INFO] bob.server: shutting down server 31:46.628 [DEBUG] bob.leader: stopping routine: routine="federation state anti-entropy" 31:46.628 [DEBUG] bob.leader: stopping routine: routine="federation state pruning" 31:46.628 [DEBUG] bob.leader: stopping routine: routine="intermediate cert renew watch" 31:46.628 [DEBUG] bob.leader: stopping routine: routine="CA root pruning" 31:46.628 [WARN] bob.server.serf.lan: serf: Shutdown without a Leave 31:46.629 [ERROR] bob.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.629 [DEBUG] bob.leader: stopped routine: routine="federation state anti-entropy" 31:46.629 [DEBUG] bob.leader: stopped routine: routine="federation state pruning" 31:46.629 [DEBUG] bob.leader: stopped routine: routine="intermediate cert renew watch" 31:46.629 [DEBUG] bob.leader: stopped routine: routine="CA root pruning" 31:46.645 [WARN] bob.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.650Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.650Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.650Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.650Z [INFO] agent.router.manager: shutting down 31:46.651 [INFO] bob: consul server down 31:46.651 [INFO] bob: shutdown complete 31:46.651 [INFO] bob: Stopping server: protocol=DNS address=127.0.0.1:30130 network=tcp 31:46.651 [INFO] bob: Stopping server: protocol=DNS address=127.0.0.1:30130 network=udp 31:46.651 [INFO] bob: Stopping server: protocol=HTTP address=127.0.0.1:30131 network=tcp 31:47.151 [INFO] bob: Waiting for endpoints to shut down 31:47.151 [INFO] bob: Endpoints down --- PASS: TestAgent_JoinWAN_viaMeshGateway (10.04s) --- PASS: TestAgent_JoinWAN_viaMeshGateway/dc1_to_dc2 (0.07s) --- PASS: TestAgent_JoinWAN_viaMeshGateway/dc1_to_dc3 (0.14s) --- PASS: TestAgent_JoinWAN_viaMeshGateway/dc2_to_dc1 (0.01s) --- PASS: TestAgent_JoinWAN_viaMeshGateway/dc2_to_dc3 (0.11s) --- PASS: TestAgent_JoinWAN_viaMeshGateway/dc3_to_dc1 (0.01s) --- PASS: TestAgent_JoinWAN_viaMeshGateway/dc3_to_dc2 (0.10s) === CONT TestKVSEndpoint_ListKeys 2021-10-05T16:31:46.345Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.363Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.448 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1eb32792-a765-7db5-bc09-010f2986e680 Address:127.0.0.1:29637}]" 31:46.449 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1eb32792-a765-7db5-bc09-010f2986e680.dc1 127.0.0.1 31:46.450 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1eb32792-a765-7db5-bc09-010f2986e680 127.0.0.1 2021-10-05T16:31:46.450Z [INFO] agent.router: Initializing LAN area manager 31:46.450 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29639 network=udp 31:46.450 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29637 [Follower]" leader= 31:46.451 [INFO] TestAgent.server: Adding LAN server: server="Node-1eb32792-a765-7db5-bc09-010f2986e680 (Addr: tcp/127.0.0.1:29637) (DC: dc1)" 31:46.451 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1eb32792-a765-7db5-bc09-010f2986e680.dc1 area=wan 31:46.452 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29639 network=tcp 31:46.453 [INFO] TestAgent: Started HTTPS server: address=127.0.0.1:29634 network=tcp 31:46.453 [INFO] TestAgent: started state syncer 31:46.453 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29603 network=tcp 31:46.519 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.519 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29637 [Candidate]" term=2 31:46.529 [DEBUG] TestAgent.server.raft: votes: needed=1 31:46.529 [DEBUG] TestAgent.server.raft: vote granted: from=1eb32792-a765-7db5-bc09-010f2986e680 term=2 tally=1 31:46.529 [INFO] TestAgent.server.raft: election won: tally=1 31:46.529 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29637 [Leader]" 31:46.530 [INFO] TestAgent.server: cluster leadership acquired 31:46.530 [INFO] TestAgent.server: New leader elected: payload=Node-1eb32792-a765-7db5-bc09-010f2986e680 31:46.541 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29637 31:46.572 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.625 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.625 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.625 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.625 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.625 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.625 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1eb32792-a765-7db5-bc09-010f2986e680 31:46.625 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1eb32792-a765-7db5-bc09-010f2986e680 31:46.636 [INFO] TestAgent: Requesting shutdown 31:46.636 [INFO] TestAgent.server: shutting down server 31:46.636 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.636 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:46.644 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.645 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.654Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.654Z [INFO] agent.router.manager: shutting down 31:46.654 [INFO] TestAgent: consul server down 31:46.654 [INFO] TestAgent: shutdown complete 31:46.654 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29639 network=tcp 31:46.654 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29639 network=udp 31:46.654 [INFO] TestAgent: Stopping server: protocol=HTTPS address=127.0.0.1:29634 network=tcp 31:47.154 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.154 [INFO] TestAgent: Endpoints down --- PASS: TestRPC_HTTPSMaxConnsPerClient (1.51s) --- PASS: TestRPC_HTTPSMaxConnsPerClient/HTTP (0.69s) --- PASS: TestRPC_HTTPSMaxConnsPerClient/HTTPS (0.82s) === CONT TestKVSEndpoint_CAS [WARN] freeport: 10 out of 41 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:46.400Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.414Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.512 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:35c950ab-f93f-0fdd-3fc9-659432c8fe30 Address:127.0.0.1:29623}]" 31:46.513 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-35c950ab-f93f-0fdd-3fc9-659432c8fe30.dc1 127.0.0.1 31:46.513 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-35c950ab-f93f-0fdd-3fc9-659432c8fe30 127.0.0.1 2021-10-05T16:31:46.513Z [INFO] agent.router: Initializing LAN area manager 31:46.514 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29604 network=udp 31:46.514 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29623 [Follower]" leader= 31:46.514 [INFO] TestAgent.server: Adding LAN server: server="Node-35c950ab-f93f-0fdd-3fc9-659432c8fe30 (Addr: tcp/127.0.0.1:29623) (DC: dc1)" 31:46.514 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-35c950ab-f93f-0fdd-3fc9-659432c8fe30.dc1 area=wan 31:46.514 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29604 network=tcp 31:46.515 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29619 network=tcp 31:46.515 [INFO] TestAgent: started state syncer 31:46.515 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29645 network=tcp 31:46.572 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.572 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29623 [Candidate]" term=2 31:46.599 [DEBUG] TestAgent.server.raft: votes: needed=1 31:46.599 [DEBUG] TestAgent.server.raft: vote granted: from=35c950ab-f93f-0fdd-3fc9-659432c8fe30 term=2 tally=1 31:46.599 [INFO] TestAgent.server.raft: election won: tally=1 31:46.599 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29623 [Leader]" 31:46.600 [INFO] TestAgent.server: cluster leadership acquired 31:46.600 [INFO] TestAgent.server: New leader elected: payload=Node-35c950ab-f93f-0fdd-3fc9-659432c8fe30 31:46.624 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29623 31:46.643 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.684 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.684 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.684 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.684 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.684 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.684 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-35c950ab-f93f-0fdd-3fc9-659432c8fe30 31:46.684 [INFO] TestAgent.server: member joined, marking health alive: member=Node-35c950ab-f93f-0fdd-3fc9-659432c8fe30 31:46.706 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.902 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:46.924 [INFO] TestAgent: Synced node info 31:46.925 [DEBUG] TestAgent: Node info in sync 31:46.925 [INFO] TestAgent: Requesting shutdown 31:46.925 [INFO] TestAgent.server: shutting down server 31:46.925 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.925 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.925 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.925 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.925 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.925 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.925 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.925 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.925 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.925 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.932 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.935Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.935Z [INFO] agent.router.manager: shutting down 31:46.936 [INFO] TestAgent: consul server down 31:46.936 [INFO] TestAgent: shutdown complete 31:46.936 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29604 network=tcp 31:46.936 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29604 network=udp 31:46.936 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29619 network=tcp 31:47.436 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.436 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsMatch_basic (1.06s) === CONT TestKVSEndpoint_DELETE_CAS 2021-10-05T16:31:46.621Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.642Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.691 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:de2daa55-212a-aef8-f32d-640e13fd1b9b Address:127.0.0.1:29595}]" 31:46.692 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29595 [Follower]" leader= 31:46.692 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-de2daa55-212a-aef8-f32d-640e13fd1b9b.dc1 127.0.0.1 31:46.693 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-de2daa55-212a-aef8-f32d-640e13fd1b9b 127.0.0.1 2021-10-05T16:31:46.693Z [INFO] agent.router: Initializing LAN area manager 31:46.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29632 network=udp 31:46.693 [INFO] TestAgent.server: Adding LAN server: server="Node-de2daa55-212a-aef8-f32d-640e13fd1b9b (Addr: tcp/127.0.0.1:29595) (DC: dc1)" 31:46.694 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-de2daa55-212a-aef8-f32d-640e13fd1b9b.dc1 area=wan 31:46.694 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29632 network=tcp 31:46.694 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29591 network=tcp 31:46.694 [INFO] TestAgent: started state syncer 31:46.694 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29680 network=tcp 31:46.751 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.751 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29595 [Candidate]" term=2 31:46.773 [DEBUG] TestAgent.server.raft: votes: needed=1 31:46.773 [DEBUG] TestAgent.server.raft: vote granted: from=de2daa55-212a-aef8-f32d-640e13fd1b9b term=2 tally=1 31:46.773 [INFO] TestAgent.server.raft: election won: tally=1 31:46.773 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29595 [Leader]" 31:46.773 [INFO] TestAgent.server: cluster leadership acquired 31:46.773 [INFO] TestAgent.server: New leader elected: payload=Node-de2daa55-212a-aef8-f32d-640e13fd1b9b 31:46.788 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29595 31:46.808 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.880 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.880 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.880 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.880 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.880 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.881 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-de2daa55-212a-aef8-f32d-640e13fd1b9b 31:46.881 [INFO] TestAgent.server: member joined, marking health alive: member=Node-de2daa55-212a-aef8-f32d-640e13fd1b9b 31:46.904 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:46.921 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.921 [INFO] TestAgent: Synced node info 31:46.954 [INFO] TestAgent: Requesting shutdown 31:46.954 [INFO] TestAgent.server: shutting down server 31:46.954 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.954 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.954 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.954 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.954 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.954 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.954 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.954 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.954 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.954 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.959 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.965Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.965Z [INFO] agent.router.manager: shutting down 31:46.965 [INFO] TestAgent: consul server down 31:46.965 [INFO] TestAgent: shutdown complete 31:46.965 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29632 network=tcp 31:46.965 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29632 network=udp 31:46.965 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29591 network=tcp 31:47.467 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.467 [INFO] TestAgent: Endpoints down === RUN TestAgent_InmemKeyrings/server_with_keys 2021-10-05T16:31:46.651Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.668Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.756 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:78ee195b-b7f0-bd9f-db4d-8582c4585f37 Address:127.0.0.1:29665}]" 31:46.756 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29665 [Follower]" leader= 31:46.757 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-78ee195b-b7f0-bd9f-db4d-8582c4585f37.dc1 127.0.0.1 31:46.757 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-78ee195b-b7f0-bd9f-db4d-8582c4585f37 127.0.0.1 2021-10-05T16:31:46.757Z [INFO] agent.router: Initializing LAN area manager 31:46.757 [INFO] TestAgent.server: Adding LAN server: server="Node-78ee195b-b7f0-bd9f-db4d-8582c4585f37 (Addr: tcp/127.0.0.1:29665) (DC: dc1)" 31:46.757 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-78ee195b-b7f0-bd9f-db4d-8582c4585f37.dc1 area=wan 31:46.757 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29681 network=udp 31:46.757 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29681 network=tcp 31:46.758 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29661 network=tcp 31:46.758 [INFO] TestAgent: started state syncer 31:46.758 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29687 network=tcp 31:46.820 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.824 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29665 [Candidate]" term=2 31:46.846 [DEBUG] TestAgent.server.raft: votes: needed=1 31:46.846 [DEBUG] TestAgent.server.raft: vote granted: from=78ee195b-b7f0-bd9f-db4d-8582c4585f37 term=2 tally=1 31:46.846 [INFO] TestAgent.server.raft: election won: tally=1 31:46.846 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29665 [Leader]" 31:46.846 [INFO] TestAgent.server: cluster leadership acquired 31:46.847 [INFO] TestAgent.server: New leader elected: payload=Node-78ee195b-b7f0-bd9f-db4d-8582c4585f37 31:46.858 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29665 31:46.883 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.924 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.924 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.924 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.924 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.924 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.924 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-78ee195b-b7f0-bd9f-db4d-8582c4585f37 31:46.924 [INFO] TestAgent.server: member joined, marking health alive: member=Node-78ee195b-b7f0-bd9f-db4d-8582c4585f37 31:46.956 [INFO] TestAgent.server: federation state anti-entropy synced 31:46.981 [INFO] TestAgent: Requesting shutdown 31:46.981 [INFO] TestAgent.server: shutting down server 31:46.981 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.981 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.981 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.981 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.981 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.981 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.981 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.981 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:46.981 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.981 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.981 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.989 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.996Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.996Z [INFO] agent.router.manager: shutting down 31:46.996 [INFO] TestAgent: consul server down 31:46.996 [INFO] TestAgent: shutdown complete 31:46.996 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29681 network=tcp 31:46.996 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29681 network=udp 31:46.996 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29661 network=tcp 31:47.500 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.500 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_GET_Raw (0.86s) === CONT TestKVSEndpoint_Recurse 2021-10-05T16:31:46.481Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.528Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.621 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:44b8c83b-d92d-4a63-f97d-1b0e3763898b Address:127.0.0.1:29658}]" 31:46.622 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-44b8c83b-d92d-4a63-f97d-1b0e3763898b.dc1 127.0.0.1 31:46.623 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-44b8c83b-d92d-4a63-f97d-1b0e3763898b 127.0.0.1 2021-10-05T16:31:46.623Z [INFO] agent.router: Initializing LAN area manager 31:46.623 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29646 network=udp 31:46.623 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29658 [Follower]" leader= 31:46.623 [INFO] TestAgent.server: Adding LAN server: server="Node-44b8c83b-d92d-4a63-f97d-1b0e3763898b (Addr: tcp/127.0.0.1:29658) (DC: dc1)" 31:46.624 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-44b8c83b-d92d-4a63-f97d-1b0e3763898b.dc1 area=wan 31:46.624 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29646 network=tcp 31:46.624 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29654 network=tcp 31:46.624 [INFO] TestAgent: started state syncer 31:46.624 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29652 network=tcp 31:46.685 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.685 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29658 [Candidate]" term=2 31:46.703 [DEBUG] TestAgent.server.raft: votes: needed=1 31:46.703 [DEBUG] TestAgent.server.raft: vote granted: from=44b8c83b-d92d-4a63-f97d-1b0e3763898b term=2 tally=1 31:46.703 [INFO] TestAgent.server.raft: election won: tally=1 31:46.703 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29658 [Leader]" 31:46.703 [INFO] TestAgent.server: cluster leadership acquired 31:46.704 [INFO] TestAgent.server: New leader elected: payload=Node-44b8c83b-d92d-4a63-f97d-1b0e3763898b 31:46.711 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29658 31:46.725 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.751 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.751 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.751 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.751 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.751 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.751 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-44b8c83b-d92d-4a63-f97d-1b0e3763898b 31:46.751 [INFO] TestAgent.server: member joined, marking health alive: member=Node-44b8c83b-d92d-4a63-f97d-1b0e3763898b 31:46.772 [INFO] TestAgent: Synced node info 31:46.772 [DEBUG] TestAgent: Node info in sync 31:46.777 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.004 [INFO] TestAgent: Requesting shutdown 31:47.004 [INFO] TestAgent.server: shutting down server 31:47.004 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.004 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.004 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.004 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.004 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.004 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.004 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.004 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.004 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.004 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.011 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.023Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.023Z [INFO] agent.router.manager: shutting down 31:47.023 [INFO] TestAgent: consul server down 31:47.023 [INFO] TestAgent: shutdown complete 31:47.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29646 network=tcp 31:47.024 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29646 network=udp 31:47.024 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29654 network=tcp 31:47.524 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.524 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsList_values (1.08s) === CONT TestKVSEndpoint_PUT_GET_DELETE 2021-10-05T16:31:46.631Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.649Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.720 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4b3bcc6c-6522-e0a5-5300-ca21a6b4630c Address:127.0.0.1:29679}]" 31:46.720 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29679 [Follower]" leader= 31:46.724 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4b3bcc6c-6522-e0a5-5300-ca21a6b4630c.dc1 127.0.0.1 31:46.725 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4b3bcc6c-6522-e0a5-5300-ca21a6b4630c 127.0.0.1 2021-10-05T16:31:46.725Z [INFO] agent.router: Initializing LAN area manager 31:46.725 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29653 network=udp 31:46.725 [INFO] TestAgent.server: Adding LAN server: server="Node-4b3bcc6c-6522-e0a5-5300-ca21a6b4630c (Addr: tcp/127.0.0.1:29679) (DC: dc1)" 31:46.725 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4b3bcc6c-6522-e0a5-5300-ca21a6b4630c.dc1 area=wan 31:46.726 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29653 network=tcp 31:46.726 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29675 network=tcp 31:46.726 [INFO] TestAgent: started state syncer 31:46.726 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29631 network=tcp 31:46.786 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.786 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29679 [Candidate]" term=2 31:46.800 [DEBUG] TestAgent.server.raft: votes: needed=1 31:46.800 [DEBUG] TestAgent.server.raft: vote granted: from=4b3bcc6c-6522-e0a5-5300-ca21a6b4630c term=2 tally=1 31:46.800 [INFO] TestAgent.server.raft: election won: tally=1 31:46.800 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29679 [Leader]" 31:46.800 [INFO] TestAgent.server: cluster leadership acquired 31:46.800 [INFO] TestAgent.server: New leader elected: payload=Node-4b3bcc6c-6522-e0a5-5300-ca21a6b4630c 31:46.811 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29679 31:46.845 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:46.888 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:46.888 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:46.888 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:46.888 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:46.888 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:46.888 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4b3bcc6c-6522-e0a5-5300-ca21a6b4630c 31:46.888 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4b3bcc6c-6522-e0a5-5300-ca21a6b4630c 31:46.924 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.038 [INFO] TestAgent: Requesting shutdown 31:47.038 [INFO] TestAgent.server: shutting down server 31:47.038 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.038 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.038 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.038 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.038 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.038 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.039 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.039 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:47.039 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.039 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.039 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.044 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.056Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.056Z [INFO] agent.router.manager: shutting down 31:47.056 [INFO] TestAgent: consul server down 31:47.056 [INFO] TestAgent: shutdown complete 31:47.056 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29653 network=tcp 31:47.056 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29653 network=udp 31:47.056 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29675 network=tcp 31:47.559 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.559 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsList_empty (0.98s) === CONT TestAgentKeyring_ACL [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:46.797Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.815Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.900 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9fe1b291-6618-3398-79ce-cdf7d43e0bde Address:127.0.0.1:29644}]" 31:46.900 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29644 [Follower]" leader= 31:46.900 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9fe1b291-6618-3398-79ce-cdf7d43e0bde.dc1 127.0.0.1 31:46.901 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9fe1b291-6618-3398-79ce-cdf7d43e0bde 127.0.0.1 2021-10-05T16:31:46.901Z [INFO] agent.router: Initializing LAN area manager 31:46.901 [INFO] TestAgent.server: Adding LAN server: server="Node-9fe1b291-6618-3398-79ce-cdf7d43e0bde (Addr: tcp/127.0.0.1:29644) (DC: dc1)" 31:46.901 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9fe1b291-6618-3398-79ce-cdf7d43e0bde.dc1 area=wan 31:46.901 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29688 network=udp 31:46.901 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29688 network=tcp 31:46.902 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29640 network=tcp 31:46.902 [INFO] TestAgent: started state syncer 31:46.902 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29694 network=tcp 31:46.965 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.965 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29644 [Candidate]" term=2 31:46.983 [DEBUG] TestAgent.server.raft: votes: needed=1 31:46.983 [DEBUG] TestAgent.server.raft: vote granted: from=9fe1b291-6618-3398-79ce-cdf7d43e0bde term=2 tally=1 31:46.983 [INFO] TestAgent.server.raft: election won: tally=1 31:46.983 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29644 [Leader]" 31:46.983 [INFO] TestAgent.server: cluster leadership acquired 31:46.983 [INFO] TestAgent.server: New leader elected: payload=Node-9fe1b291-6618-3398-79ce-cdf7d43e0bde 31:46.996 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29644 31:47.022 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.048 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.048 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.048 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.048 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.048 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.048 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9fe1b291-6618-3398-79ce-cdf7d43e0bde 31:47.048 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9fe1b291-6618-3398-79ce-cdf7d43e0bde 31:47.076 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.142 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:47.145 [INFO] TestAgent: Synced node info 31:47.145 [DEBUG] TestAgent: Node info in sync 31:47.323 [INFO] TestAgent: Requesting shutdown 31:47.323 [INFO] TestAgent.server: shutting down server 31:47.323 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.323 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.323 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.323 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.323 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.323 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.323 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.323 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.323 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.323 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.332 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.340Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.340Z [INFO] agent.router.manager: shutting down 31:47.340 [INFO] TestAgent: consul server down 31:47.340 [INFO] TestAgent: shutdown complete 31:47.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29688 network=tcp 31:47.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29688 network=udp 31:47.340 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29640 network=tcp 31:47.841 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.841 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_AcquireRelease (1.06s) === CONT TestAgent_InitKeyring --- PASS: TestAgent_InitKeyring (0.00s) === CONT TestIntentionsSpecificGet_good 2021-10-05T16:31:47.170Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.185Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.242 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:512e7810-743a-29a5-706f-dd51462babed Address:127.0.0.1:29700}]" 31:47.242 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29700 [Follower]" leader= 31:47.243 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-512e7810-743a-29a5-706f-dd51462babed.dc1 127.0.0.1 31:47.243 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-512e7810-743a-29a5-706f-dd51462babed 127.0.0.1 2021-10-05T16:31:47.243Z [INFO] agent.router: Initializing LAN area manager 31:47.244 [INFO] TestAgent.server: Adding LAN server: server="Node-512e7810-743a-29a5-706f-dd51462babed (Addr: tcp/127.0.0.1:29700) (DC: dc1)" 31:47.244 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-512e7810-743a-29a5-706f-dd51462babed.dc1 area=wan 31:47.244 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29695 network=udp 31:47.244 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29695 network=tcp 31:47.244 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29696 network=tcp 31:47.245 [INFO] TestAgent: started state syncer 31:47.245 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29701 network=tcp 31:47.294 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.294 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29700 [Candidate]" term=2 31:47.313 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.313 [DEBUG] TestAgent.server.raft: vote granted: from=512e7810-743a-29a5-706f-dd51462babed term=2 tally=1 31:47.313 [INFO] TestAgent.server.raft: election won: tally=1 31:47.313 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29700 [Leader]" 31:47.313 [INFO] TestAgent.server: cluster leadership acquired 31:47.313 [INFO] TestAgent.server: New leader elected: payload=Node-512e7810-743a-29a5-706f-dd51462babed 31:47.323 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29700 31:47.345 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.374 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.374 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.374 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.374 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.374 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.374 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-512e7810-743a-29a5-706f-dd51462babed 31:47.374 [INFO] TestAgent.server: member joined, marking health alive: member=Node-512e7810-743a-29a5-706f-dd51462babed 31:47.402 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.425 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:47.431 [INFO] TestAgent: Synced node info 31:47.431 [DEBUG] TestAgent: Node info in sync 31:47.458 [INFO] TestAgent: Requesting shutdown 31:47.458 [INFO] TestAgent.server: shutting down server 31:47.458 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.458 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.458 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.458 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.458 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.458 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.458 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.458 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.458 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.458 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.468 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.480Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.480Z [INFO] agent.router.manager: shutting down 31:47.480 [INFO] TestAgent: consul server down 31:47.480 [INFO] TestAgent: shutdown complete 31:47.480 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29695 network=tcp 31:47.480 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29695 network=udp 31:47.480 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29696 network=tcp 31:47.981 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.981 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_ListKeys (0.83s) === CONT TestAgent_LoadKeyrings === RUN TestAgent_LoadKeyrings/no_keys [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:47.171Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.185Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.231 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b8fceaa5-b17b-d3cc-cb2f-4625a2219042 Address:127.0.0.1:29728}]" 31:47.231 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29728 [Follower]" leader= 31:47.231 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b8fceaa5-b17b-d3cc-cb2f-4625a2219042.dc1 127.0.0.1 31:47.232 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b8fceaa5-b17b-d3cc-cb2f-4625a2219042 127.0.0.1 2021-10-05T16:31:47.232Z [INFO] agent.router: Initializing LAN area manager 31:47.232 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29702 network=udp 31:47.233 [INFO] TestAgent.server: Adding LAN server: server="Node-b8fceaa5-b17b-d3cc-cb2f-4625a2219042 (Addr: tcp/127.0.0.1:29728) (DC: dc1)" 31:47.233 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b8fceaa5-b17b-d3cc-cb2f-4625a2219042.dc1 area=wan 31:47.233 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29702 network=tcp 31:47.233 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29724 network=tcp 31:47.233 [INFO] TestAgent: started state syncer 31:47.234 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29596 network=tcp 31:47.276 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.276 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29728 [Candidate]" term=2 31:47.288 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.288 [DEBUG] TestAgent.server.raft: vote granted: from=b8fceaa5-b17b-d3cc-cb2f-4625a2219042 term=2 tally=1 31:47.288 [INFO] TestAgent.server.raft: election won: tally=1 31:47.288 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29728 [Leader]" 31:47.288 [INFO] TestAgent.server: cluster leadership acquired 31:47.288 [INFO] TestAgent.server: New leader elected: payload=Node-b8fceaa5-b17b-d3cc-cb2f-4625a2219042 31:47.316 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29728 31:47.364 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.417 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.417 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.417 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.417 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.417 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.417 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b8fceaa5-b17b-d3cc-cb2f-4625a2219042 31:47.417 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b8fceaa5-b17b-d3cc-cb2f-4625a2219042 31:47.440 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.440 [INFO] TestAgent: Synced node info 31:47.596 [INFO] TestAgent: Requesting shutdown 31:47.596 [INFO] TestAgent.server: shutting down server 31:47.596 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.596 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.596 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.596 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.596 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.596 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.596 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.597 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.597 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.597 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.603 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.608Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.608Z [INFO] agent.router.manager: shutting down 31:47.608 [INFO] TestAgent: consul server down 31:47.608 [INFO] TestAgent: shutdown complete 31:47.608 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29702 network=tcp 31:47.608 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29702 network=udp 31:47.608 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29724 network=tcp 31:48.109 [INFO] TestAgent: Waiting for endpoints to shut down 31:48.109 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_CAS (0.96s) === CONT TestIntentionsSpecificDelete_good [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:47.521Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.536Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.573 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 Address:127.0.0.1:29721}]" 31:47.574 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29721 [Follower]" leader= 31:47.574 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659.dc1 127.0.0.1 31:47.575 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 127.0.0.1 2021-10-05T16:31:47.575Z [INFO] agent.router: Initializing LAN area manager 31:47.575 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29716 network=udp 31:47.575 [INFO] TestAgent.server: Adding LAN server: server="Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 (Addr: tcp/127.0.0.1:29721) (DC: dc1)" 31:47.575 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659.dc1 area=wan 31:47.575 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29716 network=tcp 31:47.576 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29717 network=tcp 31:47.577 [INFO] TestAgent: started state syncer 31:47.577 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29743 network=tcp 31:47.624 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.624 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29721 [Candidate]" term=2 31:47.664 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.664 [DEBUG] TestAgent.server.raft: vote granted: from=e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 term=2 tally=1 31:47.664 [INFO] TestAgent.server.raft: election won: tally=1 31:47.664 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29721 [Leader]" 31:47.665 [INFO] TestAgent.server: cluster leadership acquired 31:47.665 [INFO] TestAgent.server: New leader elected: payload=Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 31:47.682 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29721 31:47.736 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.861 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.861 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.861 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.861 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.861 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.861 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 31:47.861 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 31:47.876 [INFO] TestAgent: Requesting shutdown 31:47.876 [INFO] TestAgent.server: shutting down server 31:47.876 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.876 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.876 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.876 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.876 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.876 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:47.876 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.876 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.876 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.883 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.890Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.890Z [INFO] agent.router.manager: shutting down 31:47.890 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: raft is already shutdown" 31:47.890 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.896 [INFO] TestAgent: consul server down 31:47.896 [INFO] TestAgent: shutdown complete 31:47.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29716 network=tcp 31:47.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29716 network=udp 31:47.896 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29717 network=tcp 31:47.896 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 127.0.0.1 29719 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:e5c6dc1c-ae7b-a6d1-e07c-38e7fcfb1659 port:29721 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29720] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:48.400 [INFO] TestAgent: Waiting for endpoints to shut down 31:48.400 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_Recurse (0.90s) === CONT TestIntentionsSpecificUpdate_good 2021-10-05T16:31:47.485Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.503Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.557 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bf768d51-ebaf-a2eb-4497-633fcc763c2b Address:127.0.0.1:29714}]" 31:47.558 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bf768d51-ebaf-a2eb-4497-633fcc763c2b.dc1 127.0.0.1 31:47.558 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bf768d51-ebaf-a2eb-4497-633fcc763c2b 127.0.0.1 2021-10-05T16:31:47.558Z [INFO] agent.router: Initializing LAN area manager 31:47.558 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29737 network=udp 31:47.558 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29714 [Follower]" leader= 31:47.559 [INFO] TestAgent.server: Adding LAN server: server="Node-bf768d51-ebaf-a2eb-4497-633fcc763c2b (Addr: tcp/127.0.0.1:29714) (DC: dc1)" 31:47.559 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bf768d51-ebaf-a2eb-4497-633fcc763c2b.dc1 area=wan 31:47.559 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29737 network=tcp 31:47.559 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29710 network=tcp 31:47.559 [INFO] TestAgent: started state syncer 31:47.559 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29715 network=tcp 31:47.624 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.624 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29714 [Candidate]" term=2 31:47.660 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.660 [DEBUG] TestAgent.server.raft: vote granted: from=bf768d51-ebaf-a2eb-4497-633fcc763c2b term=2 tally=1 31:47.660 [INFO] TestAgent.server.raft: election won: tally=1 31:47.660 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29714 [Leader]" 31:47.672 [INFO] TestAgent.server: cluster leadership acquired 31:47.672 [INFO] TestAgent.server: New leader elected: payload=Node-bf768d51-ebaf-a2eb-4497-633fcc763c2b 31:47.691 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29714 31:47.739 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.784 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.784 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.784 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.784 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.784 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.784 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bf768d51-ebaf-a2eb-4497-633fcc763c2b 31:47.784 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bf768d51-ebaf-a2eb-4497-633fcc763c2b 31:47.808 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.920 [INFO] TestAgent: Requesting shutdown 31:47.920 [INFO] TestAgent.server: shutting down server 31:47.920 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.920 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.920 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.920 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.920 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.920 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.920 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.920 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:47.920 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.920 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.920 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.932 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.940Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.940Z [INFO] agent.router.manager: shutting down 31:47.940 [INFO] TestAgent: consul server down 31:47.940 [INFO] TestAgent: shutdown complete 31:47.940 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29737 network=tcp 31:47.940 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29737 network=udp 31:47.940 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29710 network=tcp 31:48.444 [INFO] TestAgent: Waiting for endpoints to shut down 31:48.444 [INFO] TestAgent: Endpoints down === RUN TestAgent_InmemKeyrings/client_with_keys 2021-10-05T16:31:47.456Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.467Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.525 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ac5a99f9-6868-075c-809d-497a86c27e50 Address:127.0.0.1:29693}]" 31:47.526 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29693 [Follower]" leader= 31:47.527 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ac5a99f9-6868-075c-809d-497a86c27e50.dc1 127.0.0.1 31:47.528 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ac5a99f9-6868-075c-809d-497a86c27e50 127.0.0.1 2021-10-05T16:31:47.528Z [INFO] agent.router: Initializing LAN area manager 31:47.528 [INFO] TestAgent.server: Adding LAN server: server="Node-ac5a99f9-6868-075c-809d-497a86c27e50 (Addr: tcp/127.0.0.1:29693) (DC: dc1)" 31:47.528 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29597 network=udp 31:47.528 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ac5a99f9-6868-075c-809d-497a86c27e50.dc1 area=wan 31:47.528 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29597 network=tcp 31:47.529 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29689 network=tcp 31:47.529 [INFO] TestAgent: started state syncer 31:47.529 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29736 network=tcp 31:47.563 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.563 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29693 [Candidate]" term=2 31:47.594 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.594 [DEBUG] TestAgent.server.raft: vote granted: from=ac5a99f9-6868-075c-809d-497a86c27e50 term=2 tally=1 31:47.594 [INFO] TestAgent.server.raft: election won: tally=1 31:47.594 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29693 [Leader]" 31:47.594 [INFO] TestAgent.server: cluster leadership acquired 31:47.594 [INFO] TestAgent.server: New leader elected: payload=Node-ac5a99f9-6868-075c-809d-497a86c27e50 31:47.604 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29693 31:47.657 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.727 [INFO] TestAgent: Synced node info 31:47.727 [DEBUG] TestAgent: Node info in sync 31:47.748 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.748 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.748 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.748 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.748 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.748 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ac5a99f9-6868-075c-809d-497a86c27e50 31:47.748 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ac5a99f9-6868-075c-809d-497a86c27e50 31:47.780 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.947 [INFO] TestAgent: Requesting shutdown 31:47.947 [INFO] TestAgent.server: shutting down server 31:47.947 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.947 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.947 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.947 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.947 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.947 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.947 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.947 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.947 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.947 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.955 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.965Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.965Z [INFO] agent.router.manager: shutting down 31:47.965 [INFO] TestAgent: consul server down 31:47.965 [INFO] TestAgent: shutdown complete 31:47.965 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29597 network=tcp 31:47.965 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29597 network=udp 31:47.965 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29689 network=tcp 31:48.466 [INFO] TestAgent: Waiting for endpoints to shut down 31:48.466 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_DELETE_CAS (1.03s) === CONT TestIntentionsSpecificGet_invalidId 2021-10-05T16:31:47.598Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:47.598Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.663Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:47.663Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.742 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:453fa430-bd5a-9d86-c54e-6b39b7c75719 Address:127.0.0.1:29749}]" 31:47.743 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 127.0.0.1 31:47.743 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29749 [Follower]" leader= 31:47.745 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 127.0.0.1 2021-10-05T16:31:47.745Z [INFO] agent.router: Initializing LAN area manager 31:47.745 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29730 network=udp 31:47.745 [INFO] TestAgent.server: Adding LAN server: server="Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 (Addr: tcp/127.0.0.1:29749) (DC: dc1)" 31:47.745 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 area=wan 31:47.745 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29730 network=tcp 31:47.746 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29745 network=tcp 31:47.746 [INFO] TestAgent: started state syncer 31:47.746 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29757 network=tcp 31:47.796 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:47.810 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.811 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29749 [Candidate]" term=2 31:47.826 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.826 [DEBUG] TestAgent.server.raft: vote granted: from=453fa430-bd5a-9d86-c54e-6b39b7c75719 term=2 tally=1 31:47.826 [INFO] TestAgent.server.raft: election won: tally=1 31:47.826 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29749 [Leader]" 31:47.826 [INFO] TestAgent.server: cluster leadership acquired 31:47.826 [INFO] TestAgent.server: New leader elected: payload=Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.832 [INFO] TestAgent.server: initializing acls 31:47.835 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:47.835 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:47.841 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:47.856 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:47.856 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:47.856 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:47.856 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.856 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 31:47.856 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 area=wan 31:47.857 [INFO] TestAgent.server: Updating LAN server: server="Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 (Addr: tcp/127.0.0.1:29749) (DC: dc1)" 31:47.868 [INFO] TestAgent: Synced node info 31:47.881 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.916 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.916 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.916 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.916 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.916 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.916 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.916 [INFO] TestAgent.server: member joined, marking health alive: member=Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.943 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.948 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.949 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 31:47.949 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 31:47.949 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 31:47.949 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.949 [INFO] TestAgent.server.serf.wan: serf: Received install-key query 31:47.950 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 31:47.950 [INFO] TestAgent.server.serf.lan: serf: Received install-key query 31:47.950 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.950 [INFO] TestAgent.server.serf.wan: serf: Received use-key query 31:47.951 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 31:47.951 [INFO] TestAgent.server.serf.lan: serf: Received use-key query 31:47.951 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.951 [INFO] TestAgent.server.serf.wan: serf: Received remove-key query 31:47.953 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719.dc1 31:47.953 [INFO] TestAgent.server.serf.lan: serf: Received remove-key query 31:47.953 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-453fa430-bd5a-9d86-c54e-6b39b7c75719 31:47.953 [INFO] TestAgent: Requesting shutdown 31:47.953 [INFO] TestAgent.server: shutting down server 31:47.953 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:47.953 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:47.953 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.953 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.953 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.953 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.953 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.953 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:47.953 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:47.953 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.953 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.953 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.956 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.956 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.962 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.972Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.972Z [INFO] agent.router.manager: shutting down 31:47.972 [INFO] TestAgent: consul server down 31:47.972 [INFO] TestAgent: shutdown complete 31:47.972 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29730 network=tcp 31:47.972 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29730 network=udp 31:47.972 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29745 network=tcp 31:48.476 [INFO] TestAgent: Waiting for endpoints to shut down 31:48.476 [INFO] TestAgent: Endpoints down --- PASS: TestAgentKeyring_ACL (0.91s) === CONT TestParseConsistency_Invalid 2021-10-05T16:31:47.565Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.584Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.644 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:801ac18c-4393-70a8-4068-576ea898ae01 Address:127.0.0.1:29756}]" 31:47.645 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-801ac18c-4393-70a8-4068-576ea898ae01.dc1 127.0.0.1 31:47.646 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-801ac18c-4393-70a8-4068-576ea898ae01 127.0.0.1 2021-10-05T16:31:47.646Z [INFO] agent.router: Initializing LAN area manager 31:47.646 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29744 network=udp 31:47.646 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29756 [Follower]" leader= 31:47.648 [INFO] TestAgent.server: Adding LAN server: server="Node-801ac18c-4393-70a8-4068-576ea898ae01 (Addr: tcp/127.0.0.1:29756) (DC: dc1)" 31:47.649 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-801ac18c-4393-70a8-4068-576ea898ae01.dc1 area=wan 31:47.649 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29744 network=tcp 31:47.652 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29752 network=tcp 31:47.652 [INFO] TestAgent: started state syncer 31:47.654 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29729 network=tcp 31:47.712 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.712 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29756 [Candidate]" term=2 31:47.760 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.760 [DEBUG] TestAgent.server.raft: vote granted: from=801ac18c-4393-70a8-4068-576ea898ae01 term=2 tally=1 31:47.760 [INFO] TestAgent.server.raft: election won: tally=1 31:47.760 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29756 [Leader]" 31:47.760 [INFO] TestAgent.server: cluster leadership acquired 31:47.760 [INFO] TestAgent.server: New leader elected: payload=Node-801ac18c-4393-70a8-4068-576ea898ae01 31:47.792 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29756 31:47.878 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.940 [INFO] TestAgent: Synced node info 31:47.961 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.961 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.961 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.961 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.961 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.961 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-801ac18c-4393-70a8-4068-576ea898ae01 31:47.961 [INFO] TestAgent.server: member joined, marking health alive: member=Node-801ac18c-4393-70a8-4068-576ea898ae01 31:47.996 [INFO] TestAgent.server: federation state anti-entropy synced 31:48.004 [INFO] TestAgent: Requesting shutdown 31:48.004 [INFO] TestAgent.server: shutting down server 31:48.004 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:48.004 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:48.004 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:48.004 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:48.004 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:48.004 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:48.004 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:48.004 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:48.004 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:48.004 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:48.012 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:48.020Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:48.020Z [INFO] agent.router.manager: shutting down 31:48.020 [INFO] TestAgent: consul server down 31:48.020 [INFO] TestAgent: shutdown complete 31:48.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29744 network=tcp 31:48.020 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29744 network=udp 31:48.020 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29752 network=tcp 31:48.520 [INFO] TestAgent: Waiting for endpoints to shut down 31:48.520 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_PUT_GET_DELETE (1.00s) === CONT TestHTTPServer_HandshakeTimeout [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:47.856Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:47.869Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:47.932 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4ad15b60-363c-8559-e1d5-bfe5f06f1983 Address:127.0.0.1:29707}]" 31:47.932 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29707 [Follower]" leader= 31:47.933 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4ad15b60-363c-8559-e1d5-bfe5f06f1983.dc1 127.0.0.1 31:47.933 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4ad15b60-363c-8559-e1d5-bfe5f06f1983 127.0.0.1 2021-10-05T16:31:47.933Z [INFO] agent.router: Initializing LAN area manager 31:47.933 [INFO] TestAgent.server: Adding LAN server: server="Node-4ad15b60-363c-8559-e1d5-bfe5f06f1983 (Addr: tcp/127.0.0.1:29707) (DC: dc1)" 31:47.933 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4ad15b60-363c-8559-e1d5-bfe5f06f1983.dc1 area=wan 31:47.934 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29758 network=udp 31:47.934 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29758 network=tcp 31:47.934 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29703 network=tcp 31:47.934 [INFO] TestAgent: started state syncer 31:47.934 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29673 network=tcp 31:47.980 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:47.980 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29707 [Candidate]" term=2 31:48.028 [DEBUG] TestAgent.server.raft: votes: needed=1 31:48.028 [DEBUG] TestAgent.server.raft: vote granted: from=4ad15b60-363c-8559-e1d5-bfe5f06f1983 term=2 tally=1 31:48.028 [INFO] TestAgent.server.raft: election won: tally=1 31:48.028 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29707 [Leader]" 31:48.028 [INFO] TestAgent.server: cluster leadership acquired 31:48.028 [INFO] TestAgent.server: New leader elected: payload=Node-4ad15b60-363c-8559-e1d5-bfe5f06f1983 31:48.064 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29707 31:48.108 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:48.146 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:48.146 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:48.146 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:48.146 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:48.146 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:48.146 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4ad15b60-363c-8559-e1d5-bfe5f06f1983 31:48.146 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4ad15b60-363c-8559-e1d5-bfe5f06f1983 31:48.166 [INFO] TestAgent.server: federation state anti-entropy synced 31:48.344 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:48.356 [INFO] TestAgent: Synced node info 31:48.356 [DEBUG] TestAgent: Node info in sync 31:48.373 [INFO] TestAgent: Requesting shutdown 31:48.373 [INFO] TestAgent.server: shutting down server 31:48.373 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:48.373 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:48.373 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:48.373 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:48.373 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:48.373 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:48.373 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:48.373 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:48.373 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:48.373 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:48.384 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:48.391Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:48.391Z [INFO] agent.router.manager: shutting down 31:48.391 [INFO] TestAgent: consul server down 31:48.391 [INFO] TestAgent: shutdown complete 31:48.391 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29758 network=tcp 31:48.391 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29758 network=udp 31:48.391 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29703 network=tcp 31:48.891 [INFO] TestAgent: Waiting for endpoints to shut down 31:48.891 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsSpecificGet_good (1.05s) === CONT TestEnableWebUI 2021/10/05 16:31:48 http: TLS handshake error from 127.0.0.1:59194: read tcp 127.0.0.1:29823->127.0.0.1:59194: i/o timeout 31:48.518 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-a619c316-37a3-ae1c-971b-5cab01522175 127.0.0.1 2021-10-05T16:31:48.518Z [INFO] agent.router: Initializing LAN area manager 31:48.519 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29751 network=udp 31:48.519 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29751 network=tcp 31:48.519 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29759 network=tcp 31:48.519 [INFO] TestAgent: started state syncer 31:48.520 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29785 network=tcp 2021-10-05T16:31:48.520Z [WARN] agent.router.manager: No servers available 31:48.520 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:48.533 [INFO] TestAgent: Requesting shutdown 31:48.533 [INFO] TestAgent.client: shutting down client 31:48.533 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:48.540 [INFO] TestAgent: consul client down 31:48.540 [INFO] TestAgent: shutdown complete 31:48.540 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29751 network=tcp 31:48.540 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29751 network=udp 31:48.540 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29759 network=tcp 31:49.040 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.040 [INFO] TestAgent: Endpoints down === RUN TestAgent_InmemKeyrings/ignore_files 2021-10-05T16:31:48.143Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:48.178Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:48.215 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4a8cfc0a-1284-1f7f-a99b-438b89e1ae05 Address:127.0.0.1:29672}]" 31:48.215 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4a8cfc0a-1284-1f7f-a99b-438b89e1ae05.dc1 127.0.0.1 31:48.216 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29672 [Follower]" leader= 31:48.216 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4a8cfc0a-1284-1f7f-a99b-438b89e1ae05 127.0.0.1 2021-10-05T16:31:48.216Z [INFO] agent.router: Initializing LAN area manager 31:48.216 [INFO] TestAgent.server: Adding LAN server: server="Node-4a8cfc0a-1284-1f7f-a99b-438b89e1ae05 (Addr: tcp/127.0.0.1:29672) (DC: dc1)" 31:48.216 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4a8cfc0a-1284-1f7f-a99b-438b89e1ae05.dc1 area=wan 31:48.216 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29709 network=udp 31:48.216 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29709 network=tcp 31:48.217 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29668 network=tcp 31:48.217 [INFO] TestAgent: started state syncer 31:48.217 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29764 network=tcp 31:48.284 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:48.284 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29672 [Candidate]" term=2 31:48.304 [DEBUG] TestAgent.server.raft: votes: needed=1 31:48.304 [DEBUG] TestAgent.server.raft: vote granted: from=4a8cfc0a-1284-1f7f-a99b-438b89e1ae05 term=2 tally=1 31:48.304 [INFO] TestAgent.server.raft: election won: tally=1 31:48.304 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29672 [Leader]" 31:48.304 [INFO] TestAgent.server: cluster leadership acquired 31:48.304 [INFO] TestAgent.server: New leader elected: payload=Node-4a8cfc0a-1284-1f7f-a99b-438b89e1ae05 31:48.320 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29672 31:48.354 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:48.409 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:48.409 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:48.409 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:48.409 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:48.409 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:48.409 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4a8cfc0a-1284-1f7f-a99b-438b89e1ae05 31:48.409 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4a8cfc0a-1284-1f7f-a99b-438b89e1ae05 31:48.449 [INFO] TestAgent.server: federation state anti-entropy synced 31:48.534 [INFO] TestAgent: Requesting shutdown 31:48.534 [INFO] TestAgent.server: shutting down server 31:48.534 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:48.534 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:48.534 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:48.534 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:48.534 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:48.534 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:48.534 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:48.534 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:48.534 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:48.534 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:48.534 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:48.544 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:48.565Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:48.565Z [INFO] agent.router.manager: shutting down 31:48.565 [INFO] TestAgent: consul server down 31:48.565 [INFO] TestAgent: shutdown complete 31:48.565 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29709 network=tcp 31:48.565 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29709 network=udp 31:48.565 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29668 network=tcp 31:49.068 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.068 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsSpecificDelete_good (0.96s) === CONT TestACLResolution [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:48.027Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:48.065Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:48.128 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:575edd4a-8125-3caa-2e3e-169842ab026d Address:127.0.0.1:29742}]" 31:48.128 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29742 [Follower]" leader= 31:48.129 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-575edd4a-8125-3caa-2e3e-169842ab026d.dc1 127.0.0.1 31:48.129 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-575edd4a-8125-3caa-2e3e-169842ab026d 127.0.0.1 2021-10-05T16:31:48.129Z [INFO] agent.router: Initializing LAN area manager 31:48.130 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29674 network=udp 31:48.130 [INFO] TestAgent.server: Adding LAN server: server="Node-575edd4a-8125-3caa-2e3e-169842ab026d (Addr: tcp/127.0.0.1:29742) (DC: dc1)" 31:48.130 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-575edd4a-8125-3caa-2e3e-169842ab026d.dc1 area=wan 31:48.130 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29674 network=tcp 31:48.131 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29738 network=tcp 31:48.131 [INFO] TestAgent: started state syncer 31:48.131 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29708 network=tcp 31:48.182 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:48.182 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29742 [Candidate]" term=2 31:48.201 [DEBUG] TestAgent.server.raft: votes: needed=1 31:48.201 [DEBUG] TestAgent.server.raft: vote granted: from=575edd4a-8125-3caa-2e3e-169842ab026d term=2 tally=1 31:48.201 [INFO] TestAgent.server.raft: election won: tally=1 31:48.201 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29742 [Leader]" 31:48.202 [INFO] TestAgent.server: cluster leadership acquired 31:48.202 [INFO] TestAgent.server: New leader elected: payload=Node-575edd4a-8125-3caa-2e3e-169842ab026d 31:48.211 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29742 31:48.240 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:48.304 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:48.304 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:48.304 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:48.304 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:48.304 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:48.304 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-575edd4a-8125-3caa-2e3e-169842ab026d 31:48.304 [INFO] TestAgent.server: member joined, marking health alive: member=Node-575edd4a-8125-3caa-2e3e-169842ab026d 31:48.332 [INFO] TestAgent.server: federation state anti-entropy synced 31:48.550 [INFO] TestAgent: Requesting shutdown 31:48.550 [INFO] TestAgent.server: shutting down server 31:48.550 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:48.550 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:48.550 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:48.550 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:48.550 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:48.550 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:48.550 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:48.550 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:48.550 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:48.550 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:48.550 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:48.576 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:48.594Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:48.594Z [INFO] agent.router.manager: shutting down 31:48.594 [INFO] TestAgent: consul server down 31:48.594 [INFO] TestAgent: shutdown complete 31:48.594 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29674 network=tcp 31:48.594 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29674 network=udp 31:48.594 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29738 network=tcp 31:49.104 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.104 [INFO] TestAgent: Endpoints down === RUN TestAgent_LoadKeyrings/server_with_keys 2021-10-05T16:31:48.521Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:48.556Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:48.617 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6ec16b21-d3ff-4a98-df91-0142e10f9a98 Address:127.0.0.1:29791}]" 31:48.618 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29791 [Follower]" leader= 31:48.618 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6ec16b21-d3ff-4a98-df91-0142e10f9a98.dc1 127.0.0.1 31:48.619 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6ec16b21-d3ff-4a98-df91-0142e10f9a98 127.0.0.1 2021-10-05T16:31:48.619Z [INFO] agent.router: Initializing LAN area manager 31:48.619 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29786 network=udp 31:48.619 [INFO] TestAgent.server: Adding LAN server: server="Node-6ec16b21-d3ff-4a98-df91-0142e10f9a98 (Addr: tcp/127.0.0.1:29791) (DC: dc1)" 31:48.619 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6ec16b21-d3ff-4a98-df91-0142e10f9a98.dc1 area=wan 31:48.620 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29786 network=tcp 31:48.620 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29787 network=tcp 31:48.620 [INFO] TestAgent: started state syncer 31:48.620 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29778 network=tcp 31:48.668 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:48.668 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29791 [Candidate]" term=2 31:48.701 [DEBUG] TestAgent.server.raft: votes: needed=1 31:48.701 [DEBUG] TestAgent.server.raft: vote granted: from=6ec16b21-d3ff-4a98-df91-0142e10f9a98 term=2 tally=1 31:48.701 [INFO] TestAgent.server.raft: election won: tally=1 31:48.701 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29791 [Leader]" 31:48.702 [INFO] TestAgent.server: cluster leadership acquired 31:48.702 [INFO] TestAgent.server: New leader elected: payload=Node-6ec16b21-d3ff-4a98-df91-0142e10f9a98 31:48.724 [INFO] TestAgent: Synced node info 31:48.724 [DEBUG] TestAgent: Node info in sync 31:48.724 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29791 31:48.749 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:48.752 [INFO] TestAgent: Requesting shutdown 31:48.752 [INFO] TestAgent.server: shutting down server 31:48.752 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:48.756 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:48.763Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:48.763Z [INFO] agent.router.manager: shutting down 31:48.763 [INFO] TestAgent: consul server down 31:48.763 [INFO] TestAgent: shutdown complete 31:48.763 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29786 network=tcp 31:48.763 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29786 network=udp 31:48.763 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29787 network=tcp 31:48.766 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: raft is already shutdown" 31:48.766 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:49.264 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.264 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsSpecificGet_invalidId (0.80s) === CONT TestOperator_Keyring_InvalidRelayFactor [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:48.413Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:48.434Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:48.497 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cca88a19-1937-1861-30fb-023ed7e2cb8f Address:127.0.0.1:29784}]" 31:48.498 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cca88a19-1937-1861-30fb-023ed7e2cb8f.dc1 127.0.0.1 31:48.499 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cca88a19-1937-1861-30fb-023ed7e2cb8f 127.0.0.1 2021-10-05T16:31:48.499Z [INFO] agent.router: Initializing LAN area manager 31:48.499 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29765 network=udp 31:48.499 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29784 [Follower]" leader= 31:48.499 [INFO] TestAgent.server: Adding LAN server: server="Node-cca88a19-1937-1861-30fb-023ed7e2cb8f (Addr: tcp/127.0.0.1:29784) (DC: dc1)" 31:48.499 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cca88a19-1937-1861-30fb-023ed7e2cb8f.dc1 area=wan 31:48.500 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29765 network=tcp 31:48.500 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29780 network=tcp 31:48.500 [INFO] TestAgent: started state syncer 31:48.500 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29750 network=tcp 31:48.556 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:48.556 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29784 [Candidate]" term=2 31:48.591 [DEBUG] TestAgent.server.raft: votes: needed=1 31:48.591 [DEBUG] TestAgent.server.raft: vote granted: from=cca88a19-1937-1861-30fb-023ed7e2cb8f term=2 tally=1 31:48.591 [INFO] TestAgent.server.raft: election won: tally=1 31:48.591 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29784 [Leader]" 31:48.592 [INFO] TestAgent.server: cluster leadership acquired 31:48.592 [INFO] TestAgent.server: New leader elected: payload=Node-cca88a19-1937-1861-30fb-023ed7e2cb8f 31:48.601 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29784 31:48.622 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:48.680 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:48.680 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:48.680 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:48.680 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:48.680 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:48.680 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cca88a19-1937-1861-30fb-023ed7e2cb8f 31:48.680 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cca88a19-1937-1861-30fb-023ed7e2cb8f 31:48.715 [INFO] TestAgent.server: federation state anti-entropy synced 31:48.846 [INFO] TestAgent: Requesting shutdown 31:48.846 [INFO] TestAgent.server: shutting down server 31:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:48.846 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:48.846 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:48.847 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:48.847 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:48.847 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:48.847 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:48.847 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:48.847 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:48.851 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:48.855Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:48.855Z [INFO] agent.router.manager: shutting down 31:48.855 [INFO] TestAgent: consul server down 31:48.855 [INFO] TestAgent: shutdown complete 31:48.855 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29765 network=tcp 31:48.855 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29765 network=udp 31:48.855 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29780 network=tcp 31:49.356 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.356 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsSpecificUpdate_good (0.96s) === CONT TestPreparedQuery_Create 2021-10-05T16:31:48.540Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:48.572Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:48.641 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:96ac7dbd-bea3-e031-aa97-d6203df3a28b Address:127.0.0.1:29840}]" 31:48.641 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29840 [Follower]" leader= 31:48.641 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-96ac7dbd-bea3-e031-aa97-d6203df3a28b.dc1 127.0.0.1 31:48.642 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-96ac7dbd-bea3-e031-aa97-d6203df3a28b 127.0.0.1 2021-10-05T16:31:48.642Z [INFO] agent.router: Initializing LAN area manager 31:48.642 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29779 network=udp 31:48.642 [INFO] TestAgent.server: Adding LAN server: server="Node-96ac7dbd-bea3-e031-aa97-d6203df3a28b (Addr: tcp/127.0.0.1:29840) (DC: dc1)" 31:48.642 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29779 network=tcp 31:48.642 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-96ac7dbd-bea3-e031-aa97-d6203df3a28b.dc1 area=wan 31:48.643 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29836 network=tcp 31:48.643 [INFO] TestAgent: started state syncer 31:48.643 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29820 network=tcp 31:48.696 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:48.696 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29840 [Candidate]" term=2 31:48.727 [DEBUG] TestAgent.server.raft: votes: needed=1 31:48.727 [DEBUG] TestAgent.server.raft: vote granted: from=96ac7dbd-bea3-e031-aa97-d6203df3a28b term=2 tally=1 31:48.727 [INFO] TestAgent.server.raft: election won: tally=1 31:48.727 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29840 [Leader]" 31:48.727 [INFO] TestAgent.server: cluster leadership acquired 31:48.727 [INFO] TestAgent.server: New leader elected: payload=Node-96ac7dbd-bea3-e031-aa97-d6203df3a28b 31:48.739 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29840 31:48.762 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:48.803 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:48.803 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:48.803 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:48.803 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:48.803 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:48.804 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-96ac7dbd-bea3-e031-aa97-d6203df3a28b 31:48.804 [INFO] TestAgent.server: member joined, marking health alive: member=Node-96ac7dbd-bea3-e031-aa97-d6203df3a28b 31:48.820 [INFO] TestAgent.server: federation state anti-entropy synced 31:48.939 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:48.947 [INFO] TestAgent: Synced node info 31:48.947 [DEBUG] TestAgent: Node info in sync 31:48.961 [INFO] TestAgent: Requesting shutdown 31:48.961 [INFO] TestAgent.server: shutting down server 31:48.961 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:48.961 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:48.961 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:48.961 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:48.961 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:48.961 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:48.961 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:48.961 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:48.961 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:48.961 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:48.966 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:48.972Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:48.972Z [INFO] agent.router.manager: shutting down 31:48.972 [INFO] TestAgent: consul server down 31:48.972 [INFO] TestAgent: shutdown complete 31:48.972 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29779 network=tcp 31:48.972 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29779 network=udp 31:48.972 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29836 network=tcp 31:49.474 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.474 [INFO] TestAgent: Endpoints down --- PASS: TestParseConsistency_Invalid (1.00s) === CONT TestOperator_ServerHealth_Unhealthy 2021-10-05T16:31:48.534Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:48.546Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:48.632 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b2e4a8a8-1b65-d449-abd5-028de13e025e Address:127.0.0.1:29826}]" 31:48.633 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b2e4a8a8-1b65-d449-abd5-028de13e025e.dc1 127.0.0.1 31:48.633 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b2e4a8a8-1b65-d449-abd5-028de13e025e 127.0.0.1 2021-10-05T16:31:48.633Z [INFO] agent.router: Initializing LAN area manager 31:48.633 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29821 network=udp 31:48.633 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29826 [Follower]" leader= 31:48.634 [INFO] TestAgent.server: Adding LAN server: server="Node-b2e4a8a8-1b65-d449-abd5-028de13e025e (Addr: tcp/127.0.0.1:29826) (DC: dc1)" 31:48.634 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b2e4a8a8-1b65-d449-abd5-028de13e025e.dc1 area=wan 31:48.634 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29821 network=tcp 31:48.635 [INFO] TestAgent: Started HTTPS server: address=127.0.0.1:29823 network=tcp 31:48.635 [INFO] TestAgent: started state syncer 31:48.635 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29813 network=tcp 31:48.677 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:48.677 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29826 [Candidate]" term=2 31:48.702 [DEBUG] TestAgent.server.raft: votes: needed=1 31:48.702 [DEBUG] TestAgent.server.raft: vote granted: from=b2e4a8a8-1b65-d449-abd5-028de13e025e term=2 tally=1 31:48.702 [INFO] TestAgent.server.raft: election won: tally=1 31:48.702 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29826 [Leader]" 31:48.703 [INFO] TestAgent.server: cluster leadership acquired 31:48.703 [INFO] TestAgent.server: New leader elected: payload=Node-b2e4a8a8-1b65-d449-abd5-028de13e025e 31:48.736 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29826 31:48.776 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:48.844 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:48.844 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:48.844 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:48.844 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:48.844 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:48.844 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b2e4a8a8-1b65-d449-abd5-028de13e025e 31:48.844 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b2e4a8a8-1b65-d449-abd5-028de13e025e 31:48.870 [INFO] TestAgent.server: federation state anti-entropy synced 31:48.910 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:48.915 [INFO] TestAgent: Synced node info 31:48.915 [DEBUG] TestAgent: Node info in sync 31:49.032 [INFO] TestAgent: Requesting shutdown 31:49.032 [INFO] TestAgent.server: shutting down server 31:49.032 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:49.032 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:49.032 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:49.032 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:49.032 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:49.032 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:49.032 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:49.032 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:49.032 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:49.032 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:49.044 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:49.052Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:49.052Z [INFO] agent.router.manager: shutting down 31:49.052 [INFO] TestAgent: consul server down 31:49.052 [INFO] TestAgent: shutdown complete 31:49.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29821 network=tcp 31:49.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29821 network=udp 31:49.052 [INFO] TestAgent: Stopping server: protocol=HTTPS address=127.0.0.1:29823 network=tcp 31:49.552 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.552 [INFO] TestAgent: Endpoints down --- PASS: TestHTTPServer_HandshakeTimeout (1.03s) === CONT TestOperator_ServerHealth [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:48.910Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:48.924Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:48.959 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:501bed91-a5f3-740f-5d2d-c7af94c0a4c4 Address:127.0.0.1:29819}]" 31:48.960 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-501bed91-a5f3-740f-5d2d-c7af94c0a4c4.dc1 127.0.0.1 31:48.960 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29819 [Follower]" leader= 31:48.960 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-501bed91-a5f3-740f-5d2d-c7af94c0a4c4 127.0.0.1 2021-10-05T16:31:48.961Z [INFO] agent.router: Initializing LAN area manager 31:48.961 [INFO] TestAgent.server: Adding LAN server: server="Node-501bed91-a5f3-740f-5d2d-c7af94c0a4c4 (Addr: tcp/127.0.0.1:29819) (DC: dc1)" 31:48.961 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-501bed91-a5f3-740f-5d2d-c7af94c0a4c4.dc1 area=wan 31:48.961 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29814 network=udp 31:48.961 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29814 network=tcp 31:48.962 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29815 network=tcp 31:48.962 [INFO] TestAgent: started state syncer 31:48.962 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29827 network=tcp 31:49.000 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.000 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29819 [Candidate]" term=2 31:49.015 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.015 [DEBUG] TestAgent.server.raft: vote granted: from=501bed91-a5f3-740f-5d2d-c7af94c0a4c4 term=2 tally=1 31:49.015 [INFO] TestAgent.server.raft: election won: tally=1 31:49.015 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29819 [Leader]" 31:49.016 [INFO] TestAgent.server: cluster leadership acquired 31:49.016 [INFO] TestAgent.server: New leader elected: payload=Node-501bed91-a5f3-740f-5d2d-c7af94c0a4c4 31:49.048 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29819 31:49.100 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.160 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:49.160 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:49.160 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:49.160 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:49.160 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:49.160 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-501bed91-a5f3-740f-5d2d-c7af94c0a4c4 31:49.160 [INFO] TestAgent.server: member joined, marking health alive: member=Node-501bed91-a5f3-740f-5d2d-c7af94c0a4c4 31:49.194 [INFO] TestAgent.server: federation state anti-entropy synced 31:49.313 [INFO] TestAgent: Requesting shutdown 31:49.313 [INFO] TestAgent.server: shutting down server 31:49.313 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:49.313 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:49.313 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:49.313 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:49.313 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:49.313 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:49.313 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:49.313 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:49.313 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:49.313 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:49.313 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:49.332 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:49.344Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:49.344Z [INFO] agent.router.manager: shutting down 31:49.344 [INFO] TestAgent: consul server down 31:49.344 [INFO] TestAgent: shutdown complete 31:49.344 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29814 network=tcp 31:49.344 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29814 network=udp 31:49.344 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29815 network=tcp 31:49.844 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.844 [INFO] TestAgent: Endpoints down --- PASS: TestEnableWebUI (0.95s) === CONT TestOperator_AutopilotCASConfiguration 2021-10-05T16:31:49.058Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.135Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.209 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:77536064-012f-f850-6ec5-034fc000452c Address:127.0.0.1:29798}]" 31:49.209 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29798 [Follower]" leader= 31:49.210 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-77536064-012f-f850-6ec5-034fc000452c.dc1 127.0.0.1 31:49.210 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-77536064-012f-f850-6ec5-034fc000452c 127.0.0.1 2021-10-05T16:31:49.210Z [INFO] agent.router: Initializing LAN area manager 31:49.211 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29828 network=udp 31:49.211 [INFO] TestAgent.server: Adding LAN server: server="Node-77536064-012f-f850-6ec5-034fc000452c (Addr: tcp/127.0.0.1:29798) (DC: dc1)" 31:49.211 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-77536064-012f-f850-6ec5-034fc000452c.dc1 area=wan 31:49.211 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29828 network=tcp 31:49.212 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29794 network=tcp 31:49.212 [INFO] TestAgent: started state syncer 31:49.212 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29834 network=tcp 31:49.261 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.261 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29798 [Candidate]" term=2 31:49.277 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.277 [DEBUG] TestAgent.server.raft: vote granted: from=77536064-012f-f850-6ec5-034fc000452c term=2 tally=1 31:49.277 [INFO] TestAgent.server.raft: election won: tally=1 31:49.277 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29798 [Leader]" 31:49.277 [INFO] TestAgent.server: cluster leadership acquired 31:49.277 [INFO] TestAgent.server: New leader elected: payload=Node-77536064-012f-f850-6ec5-034fc000452c 31:49.288 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29798 31:49.312 [INFO] TestAgent: Requesting shutdown 31:49.312 [INFO] TestAgent.server: shutting down server 31:49.312 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:49.312 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:49.323 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.328 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:49.340Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:49.340Z [INFO] agent.router.manager: shutting down 31:49.362 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:49.363 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:49.363 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:49.363 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 31:49.363 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 31:49.363 [INFO] TestAgent: consul server down 31:49.363 [INFO] TestAgent: shutdown complete 31:49.363 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29828 network=tcp 31:49.363 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29828 network=udp 31:49.363 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29794 network=tcp 31:49.864 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.864 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_InmemKeyrings (3.28s) --- PASS: TestAgent_InmemKeyrings/no_keys (0.88s) --- PASS: TestAgent_InmemKeyrings/server_with_keys (0.98s) --- PASS: TestAgent_InmemKeyrings/client_with_keys (0.60s) --- PASS: TestAgent_InmemKeyrings/ignore_files (0.82s) === CONT TestOperator_AutopilotSetConfiguration 2021-10-05T16:31:49.162Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.199Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.256 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b9f88975-1d69-4a55-27df-a24fc7e34dbf Address:127.0.0.1:29833}]" 31:49.257 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b9f88975-1d69-4a55-27df-a24fc7e34dbf.dc1 127.0.0.1 31:49.258 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b9f88975-1d69-4a55-27df-a24fc7e34dbf 127.0.0.1 2021-10-05T16:31:49.258Z [INFO] agent.router: Initializing LAN area manager 31:49.258 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29800 network=udp 31:49.258 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29833 [Follower]" leader= 31:49.258 [INFO] TestAgent.server: Adding LAN server: server="Node-b9f88975-1d69-4a55-27df-a24fc7e34dbf (Addr: tcp/127.0.0.1:29833) (DC: dc1)" 31:49.258 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b9f88975-1d69-4a55-27df-a24fc7e34dbf.dc1 area=wan 31:49.258 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29800 network=tcp 31:49.259 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29829 network=tcp 31:49.259 [INFO] TestAgent: started state syncer 31:49.259 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29792 network=tcp 31:49.304 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.304 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29833 [Candidate]" term=2 31:49.326 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.326 [DEBUG] TestAgent.server.raft: vote granted: from=b9f88975-1d69-4a55-27df-a24fc7e34dbf term=2 tally=1 31:49.326 [INFO] TestAgent.server.raft: election won: tally=1 31:49.326 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29833 [Leader]" 31:49.328 [INFO] TestAgent.server: cluster leadership acquired 31:49.328 [INFO] TestAgent.server: New leader elected: payload=Node-b9f88975-1d69-4a55-27df-a24fc7e34dbf 31:49.351 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29833 31:49.352 [INFO] TestAgent: Synced node info 31:49.352 [DEBUG] TestAgent: Node info in sync 31:49.388 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.412 [INFO] TestAgent: Requesting shutdown 31:49.412 [INFO] TestAgent.server: shutting down server 31:49.412 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:49.419 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:49.427Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:49.427Z [INFO] agent.router.manager: shutting down 31:49.431 [INFO] TestAgent: consul server down 31:49.431 [INFO] TestAgent: shutdown complete 31:49.431 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29800 network=tcp 31:49.431 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29800 network=udp 31:49.431 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29829 network=tcp 31:49.431 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 31:49.431 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:49.931 [INFO] TestAgent: Waiting for endpoints to shut down 31:49.931 [INFO] TestAgent: Endpoints down === RUN TestAgent_LoadKeyrings/client_with_keys [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:49.138Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.197Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.251 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:41a59a80-737a-af66-4263-c293fd906d62 Address:127.0.0.1:29770}]" 31:49.251 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-41a59a80-737a-af66-4263-c293fd906d62.dc1 127.0.0.1 31:49.252 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29770 [Follower]" leader= 31:49.254 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-41a59a80-737a-af66-4263-c293fd906d62 127.0.0.1 2021-10-05T16:31:49.254Z [INFO] agent.router: Initializing LAN area manager 31:49.254 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29835 network=udp 31:49.254 [INFO] TestAgent.server: Adding LAN server: server="Node-41a59a80-737a-af66-4263-c293fd906d62 (Addr: tcp/127.0.0.1:29770) (DC: dc1)" 31:49.254 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-41a59a80-737a-af66-4263-c293fd906d62.dc1 area=wan 31:49.254 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29835 network=tcp 31:49.255 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29766 network=tcp 31:49.255 [INFO] TestAgent: started state syncer 31:49.255 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29799 network=tcp 31:49.316 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.316 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29770 [Candidate]" term=2 31:49.348 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.348 [DEBUG] TestAgent.server.raft: vote granted: from=41a59a80-737a-af66-4263-c293fd906d62 term=2 tally=1 31:49.348 [INFO] TestAgent.server.raft: election won: tally=1 31:49.348 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29770 [Leader]" 31:49.350 [INFO] TestAgent.server: cluster leadership acquired 31:49.350 [INFO] TestAgent.server: New leader elected: payload=Node-41a59a80-737a-af66-4263-c293fd906d62 31:49.361 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29770 31:49.402 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.439 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:49.439 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:49.439 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:49.439 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:49.439 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:49.439 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-41a59a80-737a-af66-4263-c293fd906d62 31:49.439 [INFO] TestAgent.server: member joined, marking health alive: member=Node-41a59a80-737a-af66-4263-c293fd906d62 31:49.456 [INFO] TestAgent.server: federation state anti-entropy synced 31:49.569 [INFO] TestAgent: Requesting shutdown 31:49.569 [INFO] TestAgent.server: shutting down server 31:49.569 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:49.569 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:49.569 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:49.569 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:49.569 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:49.569 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:49.569 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:49.569 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:49.569 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:49.569 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:49.570 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:49.579 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:49.592Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:49.592Z [INFO] agent.router.manager: shutting down 31:49.592 [INFO] TestAgent: consul server down 31:49.592 [INFO] TestAgent: shutdown complete 31:49.592 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29835 network=tcp 31:49.592 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29835 network=udp 31:49.592 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29766 network=tcp 31:50.096 [INFO] TestAgent: Waiting for endpoints to shut down 31:50.096 [INFO] TestAgent: Endpoints down --- PASS: TestACLResolution (1.03s) === CONT TestOperator_AutopilotGetConfiguration 2021-10-05T16:31:49.292Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.317Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.414 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8cf1f7cf-5741-dc40-95fe-652c50789c47 Address:127.0.0.1:29805}]" 31:49.415 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29805 [Follower]" leader= 31:49.415 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8cf1f7cf-5741-dc40-95fe-652c50789c47.dc1 127.0.0.1 31:49.417 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8cf1f7cf-5741-dc40-95fe-652c50789c47 127.0.0.1 2021-10-05T16:31:49.417Z [INFO] agent.router: Initializing LAN area manager 31:49.417 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29793 network=udp 31:49.417 [INFO] TestAgent.server: Adding LAN server: server="Node-8cf1f7cf-5741-dc40-95fe-652c50789c47 (Addr: tcp/127.0.0.1:29805) (DC: dc1)" 31:49.417 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8cf1f7cf-5741-dc40-95fe-652c50789c47.dc1 area=wan 31:49.417 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29793 network=tcp 31:49.418 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29801 network=tcp 31:49.418 [INFO] TestAgent: started state syncer 31:49.418 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29806 network=tcp 31:49.465 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.465 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29805 [Candidate]" term=2 31:49.475 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.475 [DEBUG] TestAgent.server.raft: vote granted: from=8cf1f7cf-5741-dc40-95fe-652c50789c47 term=2 tally=1 31:49.475 [INFO] TestAgent.server.raft: election won: tally=1 31:49.475 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29805 [Leader]" 31:49.476 [INFO] TestAgent.server: cluster leadership acquired 31:49.476 [INFO] TestAgent.server: New leader elected: payload=Node-8cf1f7cf-5741-dc40-95fe-652c50789c47 31:49.486 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29805 31:49.524 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.560 [INFO] TestAgent: Synced node info 31:49.560 [DEBUG] TestAgent: Node info in sync 31:49.604 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:49.604 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:49.604 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:49.604 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:49.604 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:49.604 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8cf1f7cf-5741-dc40-95fe-652c50789c47 31:49.604 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8cf1f7cf-5741-dc40-95fe-652c50789c47 31:49.624 [INFO] TestAgent.server: federation state anti-entropy synced 31:49.739 [INFO] TestAgent: Requesting shutdown 31:49.739 [INFO] TestAgent.server: shutting down server 31:49.739 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:49.739 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:49.739 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:49.739 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:49.739 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:49.739 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:49.739 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:49.739 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:49.739 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:49.739 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:49.744 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:49.749Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:49.749Z [INFO] agent.router.manager: shutting down 31:49.749 [INFO] TestAgent: consul server down 31:49.749 [INFO] TestAgent: shutdown complete 31:49.749 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29793 network=tcp 31:49.749 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29793 network=udp 31:49.749 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29801 network=tcp 31:50.252 [INFO] TestAgent: Waiting for endpoints to shut down 31:50.252 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_Keyring_InvalidRelayFactor (0.99s) === CONT TestOperator_Keyring_LocalOnly 2021-10-05T16:31:49.380Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.402Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.455 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:382460e2-b022-4c6d-3cb8-4d9094ecb691 Address:127.0.0.1:29812}]" 31:49.456 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29812 [Follower]" leader= 31:49.456 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-382460e2-b022-4c6d-3cb8-4d9094ecb691.dc1 127.0.0.1 31:49.457 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-382460e2-b022-4c6d-3cb8-4d9094ecb691 127.0.0.1 2021-10-05T16:31:49.457Z [INFO] agent.router: Initializing LAN area manager 31:49.457 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29807 network=udp 31:49.457 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-382460e2-b022-4c6d-3cb8-4d9094ecb691.dc1 area=wan 31:49.457 [INFO] TestAgent.server: Adding LAN server: server="Node-382460e2-b022-4c6d-3cb8-4d9094ecb691 (Addr: tcp/127.0.0.1:29812) (DC: dc1)" 31:49.457 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29807 network=tcp 31:49.458 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29808 network=tcp 31:49.458 [INFO] TestAgent: started state syncer 31:49.458 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29855 network=tcp 31:49.525 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.525 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29812 [Candidate]" term=2 31:49.546 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.546 [DEBUG] TestAgent.server.raft: vote granted: from=382460e2-b022-4c6d-3cb8-4d9094ecb691 term=2 tally=1 31:49.546 [INFO] TestAgent.server.raft: election won: tally=1 31:49.546 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29812 [Leader]" 31:49.546 [INFO] TestAgent.server: cluster leadership acquired 31:49.547 [INFO] TestAgent.server: New leader elected: payload=Node-382460e2-b022-4c6d-3cb8-4d9094ecb691 31:49.576 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29812 31:49.659 [INFO] TestAgent: Synced node info 31:49.659 [DEBUG] TestAgent: Node info in sync 31:49.659 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.700 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:49.700 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:49.700 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:49.700 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:49.700 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:49.701 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-382460e2-b022-4c6d-3cb8-4d9094ecb691 31:49.701 [INFO] TestAgent.server: member joined, marking health alive: member=Node-382460e2-b022-4c6d-3cb8-4d9094ecb691 31:49.732 [INFO] TestAgent.server: federation state anti-entropy synced 31:49.764 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 31:49.764 [INFO] TestAgent: Requesting shutdown 31:49.764 [INFO] TestAgent.server: shutting down server 31:49.764 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:49.764 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:49.764 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:49.764 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:49.764 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:49.764 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:49.764 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:49.764 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:49.764 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:49.764 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:49.768 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:49.774Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:49.774Z [INFO] agent.router.manager: shutting down 31:49.774 [INFO] TestAgent: consul server down 31:49.774 [INFO] TestAgent: shutdown complete 31:49.774 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29807 network=tcp 31:49.774 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29807 network=udp 31:49.774 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29808 network=tcp 31:50.276 [INFO] TestAgent: Waiting for endpoints to shut down 31:50.276 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_Create (0.92s) === CONT TestOperator_KeyringList [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 31:49.975 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-7d68848b-426e-7177-f650-c540b659da5d 127.0.0.1 2021-10-05T16:31:49.975Z [INFO] agent.router: Initializing LAN area manager 31:49.975 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29660 network=udp 31:49.975 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29660 network=tcp 31:49.976 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29647 network=tcp 31:49.976 [INFO] TestAgent: started state syncer 31:49.976 [INFO] TestAgent: Requesting shutdown 31:49.976 [INFO] TestAgent.client: shutting down client 31:49.976 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:49.977 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29841 network=tcp 31:49.977 [ERROR] TestAgent: gRPC server failed: error="grpc: the server has been stopped" 2021-10-05T16:31:49.977Z [WARN] agent.router.manager: No servers available 31:49.977 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:49.986 [INFO] TestAgent: consul client down 31:49.986 [INFO] TestAgent: shutdown complete 31:49.986 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29660 network=tcp 31:49.986 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29660 network=udp 31:49.986 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29647 network=tcp 31:50.488 [INFO] TestAgent: Waiting for endpoints to shut down 31:50.488 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_LoadKeyrings (2.51s) --- PASS: TestAgent_LoadKeyrings/no_keys (1.13s) --- PASS: TestAgent_LoadKeyrings/server_with_keys (0.82s) --- PASS: TestAgent_LoadKeyrings/client_with_keys (0.56s) === CONT TestOperator_KeyringUse [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:49.865Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.877Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.945 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:31ad9173-4622-42a6-7cbd-9704e49fd97f Address:127.0.0.1:29889}]" 31:49.945 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29889 [Follower]" leader= 31:49.946 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-31ad9173-4622-42a6-7cbd-9704e49fd97f.dc1 127.0.0.1 31:49.947 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-31ad9173-4622-42a6-7cbd-9704e49fd97f 127.0.0.1 2021-10-05T16:31:49.947Z [INFO] agent.router: Initializing LAN area manager 31:49.947 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29884 network=udp 31:49.947 [INFO] TestAgent.server: Adding LAN server: server="Node-31ad9173-4622-42a6-7cbd-9704e49fd97f (Addr: tcp/127.0.0.1:29889) (DC: dc1)" 31:49.947 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-31ad9173-4622-42a6-7cbd-9704e49fd97f.dc1 area=wan 31:49.947 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29884 network=tcp 31:49.948 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29885 network=tcp 31:49.948 [INFO] TestAgent: started state syncer 31:49.948 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29666 network=tcp 31:50.011 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:50.011 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29889 [Candidate]" term=2 31:50.022 [DEBUG] TestAgent.server.raft: votes: needed=1 31:50.022 [DEBUG] TestAgent.server.raft: vote granted: from=31ad9173-4622-42a6-7cbd-9704e49fd97f term=2 tally=1 31:50.022 [INFO] TestAgent.server.raft: election won: tally=1 31:50.022 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29889 [Leader]" 31:50.022 [INFO] TestAgent.server: cluster leadership acquired 31:50.022 [INFO] TestAgent.server: New leader elected: payload=Node-31ad9173-4622-42a6-7cbd-9704e49fd97f 31:50.040 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29889 31:50.076 [INFO] TestAgent: Synced node info 31:50.076 [DEBUG] TestAgent: Node info in sync 31:50.097 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:50.135 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:50.135 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:50.135 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:50.135 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:50.135 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:50.135 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-31ad9173-4622-42a6-7cbd-9704e49fd97f 31:50.136 [INFO] TestAgent.server: member joined, marking health alive: member=Node-31ad9173-4622-42a6-7cbd-9704e49fd97f 31:50.161 [INFO] TestAgent.server: federation state anti-entropy synced 31:50.220 [INFO] TestAgent: Requesting shutdown 31:50.220 [INFO] TestAgent.server: shutting down server 31:50.220 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:50.220 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:50.220 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:50.220 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:50.220 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:50.220 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:50.220 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:50.220 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:50.220 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:50.220 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:50.228 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:50.236Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:50.236Z [INFO] agent.router.manager: shutting down 31:50.236 [INFO] TestAgent: consul server down 31:50.236 [INFO] TestAgent: shutdown complete 31:50.236 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29884 network=tcp 31:50.236 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29884 network=udp 31:50.236 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29885 network=tcp 31:50.740 [INFO] TestAgent: Waiting for endpoints to shut down 31:50.740 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_AutopilotCASConfiguration (0.90s) === CONT TestOperator_KeyringRemove [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:49.885Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.898Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.968 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a6b831f3-df57-5fde-789a-efb156424fc9 Address:127.0.0.1:29686}]" 31:49.968 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29686 [Follower]" leader= 31:49.969 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a6b831f3-df57-5fde-789a-efb156424fc9.dc1 127.0.0.1 31:49.970 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a6b831f3-df57-5fde-789a-efb156424fc9 127.0.0.1 2021-10-05T16:31:49.970Z [INFO] agent.router: Initializing LAN area manager 31:49.970 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29667 network=udp 31:49.970 [INFO] TestAgent.server: Adding LAN server: server="Node-a6b831f3-df57-5fde-789a-efb156424fc9 (Addr: tcp/127.0.0.1:29686) (DC: dc1)" 31:49.970 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a6b831f3-df57-5fde-789a-efb156424fc9.dc1 area=wan 31:49.970 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29667 network=tcp 31:49.971 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29682 network=tcp 31:49.971 [INFO] TestAgent: started state syncer 31:49.971 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29659 network=tcp 31:50.039 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:50.039 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29686 [Candidate]" term=2 31:50.051 [DEBUG] TestAgent.server.raft: votes: needed=1 31:50.051 [DEBUG] TestAgent.server.raft: vote granted: from=a6b831f3-df57-5fde-789a-efb156424fc9 term=2 tally=1 31:50.051 [INFO] TestAgent.server.raft: election won: tally=1 31:50.051 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29686 [Leader]" 31:50.051 [INFO] TestAgent.server: cluster leadership acquired 31:50.051 [INFO] TestAgent.server: New leader elected: payload=Node-a6b831f3-df57-5fde-789a-efb156424fc9 31:50.080 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29686 31:50.118 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:50.149 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:50.149 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:50.149 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:50.149 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:50.149 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:50.149 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a6b831f3-df57-5fde-789a-efb156424fc9 31:50.149 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a6b831f3-df57-5fde-789a-efb156424fc9 31:50.180 [INFO] TestAgent.server: federation state anti-entropy synced 31:50.312 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:50.318 [INFO] TestAgent: Synced node info 31:50.457 [INFO] TestAgent: Requesting shutdown 31:50.457 [INFO] TestAgent.server: shutting down server 31:50.457 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:50.457 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:50.457 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:50.457 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:50.457 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:50.457 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:50.457 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:50.457 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:50.457 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:50.457 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:50.467 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:50.490Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:50.490Z [INFO] agent.router.manager: shutting down 31:50.490 [INFO] TestAgent: consul server down 31:50.490 [INFO] TestAgent: shutdown complete 31:50.490 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29667 network=tcp 31:50.490 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29667 network=udp 31:50.490 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29682 network=tcp 31:50.992 [INFO] TestAgent: Waiting for endpoints to shut down 31:50.992 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_AutopilotSetConfiguration (1.13s) === CONT TestOperator_KeyringListLocalOnly 2021-10-05T16:31:50.297Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:50.321Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:50.396 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4a2129af-e775-65c4-75fe-89f8c114e68d Address:127.0.0.1:29909}]" 31:50.397 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4a2129af-e775-65c4-75fe-89f8c114e68d.dc1 127.0.0.1 31:50.398 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4a2129af-e775-65c4-75fe-89f8c114e68d 127.0.0.1 2021-10-05T16:31:50.398Z [INFO] agent.router: Initializing LAN area manager 31:50.398 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29877 network=udp 31:50.398 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29909 [Follower]" leader= 31:50.399 [INFO] TestAgent.server: Adding LAN server: server="Node-4a2129af-e775-65c4-75fe-89f8c114e68d (Addr: tcp/127.0.0.1:29909) (DC: dc1)" 31:50.399 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4a2129af-e775-65c4-75fe-89f8c114e68d.dc1 area=wan 31:50.399 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29877 network=tcp 31:50.399 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29905 network=tcp 31:50.399 [INFO] TestAgent: started state syncer 31:50.400 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29862 network=tcp 31:50.447 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:50.447 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29909 [Candidate]" term=2 31:50.496 [DEBUG] TestAgent.server.raft: votes: needed=1 31:50.496 [DEBUG] TestAgent.server.raft: vote granted: from=4a2129af-e775-65c4-75fe-89f8c114e68d term=2 tally=1 31:50.496 [INFO] TestAgent.server.raft: election won: tally=1 31:50.496 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29909 [Leader]" 31:50.497 [INFO] TestAgent.server: cluster leadership acquired 31:50.497 [INFO] TestAgent.server: New leader elected: payload=Node-4a2129af-e775-65c4-75fe-89f8c114e68d 31:50.528 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 31:50.530 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29909 31:50.532 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4a2129af-e775-65c4-75fe-89f8c114e68d.dc1 31:50.532 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 31:50.532 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4a2129af-e775-65c4-75fe-89f8c114e68d 31:50.532 [INFO] TestAgent: Requesting shutdown 31:50.532 [INFO] TestAgent.server: shutting down server 31:50.532 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:50.533 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:50.546 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:50.560Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:50.560Z [INFO] agent.router.manager: shutting down 31:50.567 [INFO] TestAgent: consul server down 31:50.567 [INFO] TestAgent: shutdown complete 31:50.567 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29877 network=tcp 31:50.567 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29877 network=udp 31:50.567 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29905 network=tcp 31:50.567 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:50.568 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:51.068 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.068 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_KeyringList (0.79s) === CONT TestIntentionsCreate_good [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:50.278Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:50.311Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:50.347 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 Address:127.0.0.1:29875}]" 31:50.348 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29875 [Follower]" leader= 31:50.348 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192.dc1 127.0.0.1 31:50.349 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 127.0.0.1 2021-10-05T16:31:50.351Z [INFO] agent.router: Initializing LAN area manager 31:50.351 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29849 network=udp 31:50.351 [INFO] TestAgent.server: Adding LAN server: server="Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 (Addr: tcp/127.0.0.1:29875) (DC: dc1)" 31:50.351 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192.dc1 area=wan 31:50.352 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29849 network=tcp 31:50.353 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29871 network=tcp 31:50.353 [INFO] TestAgent: started state syncer 31:50.353 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29876 network=tcp 31:50.417 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:50.418 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29875 [Candidate]" term=2 31:50.452 [DEBUG] TestAgent.server.raft: votes: needed=1 31:50.452 [DEBUG] TestAgent.server.raft: vote granted: from=9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 term=2 tally=1 31:50.452 [INFO] TestAgent.server.raft: election won: tally=1 31:50.452 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29875 [Leader]" 31:50.452 [INFO] TestAgent.server: cluster leadership acquired 31:50.452 [INFO] TestAgent.server: New leader elected: payload=Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 31:50.501 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29875 31:50.548 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:50.602 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 31:50.603 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 31:50.603 [INFO] TestAgent: Requesting shutdown 31:50.603 [INFO] TestAgent.server: shutting down server 31:50.603 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:50.603 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:50.609 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:50.618Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:50.618Z [INFO] agent.router.manager: shutting down 31:50.618 [INFO] TestAgent: consul server down 31:50.618 [INFO] TestAgent: shutdown complete 31:50.618 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29849 network=tcp 31:50.618 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29849 network=udp 31:50.618 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29871 network=tcp 31:50.619 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:50.619 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:50.619 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:50.619 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:50.619 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:50.619 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 31:50.619 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 31:50.619 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 127.0.0.1 29873 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:9d27f4c8-c9e2-a7a9-d3b1-6bd86eaa1192 port:29875 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29874] alive 1 5 2 2 5 4}" error="raft is already shutdown" 31:50.619 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:50.619 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:50.619 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:50.619 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:50.619 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:50.619 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:50.619 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:50.619 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:51.120 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.120 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_Keyring_LocalOnly (0.87s) === CONT TestIntentionsCreate_noBody 2021-10-05T16:31:50.132Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:50.167Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:50.268 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:405c4068-6d40-8ef3-c593-3d9743efa5d1 Address:127.0.0.1:29847}]" 31:50.269 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-405c4068-6d40-8ef3-c593-3d9743efa5d1.dc1 127.0.0.1 31:50.269 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-405c4068-6d40-8ef3-c593-3d9743efa5d1 127.0.0.1 2021-10-05T16:31:50.269Z [INFO] agent.router: Initializing LAN area manager 31:50.269 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29847 [Follower]" leader= 31:50.270 [INFO] TestAgent.server: Adding LAN server: server="Node-405c4068-6d40-8ef3-c593-3d9743efa5d1 (Addr: tcp/127.0.0.1:29847) (DC: dc1)" 31:50.270 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-405c4068-6d40-8ef3-c593-3d9743efa5d1.dc1 area=wan 31:50.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29842 network=tcp 31:50.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29842 network=udp 31:50.271 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29843 network=tcp 31:50.271 [INFO] TestAgent: started state syncer 31:50.271 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29848 network=tcp 31:50.328 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:50.328 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29847 [Candidate]" term=2 31:50.380 [DEBUG] TestAgent.server.raft: votes: needed=1 31:50.380 [DEBUG] TestAgent.server.raft: vote granted: from=405c4068-6d40-8ef3-c593-3d9743efa5d1 term=2 tally=1 31:50.380 [INFO] TestAgent.server.raft: election won: tally=1 31:50.380 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29847 [Leader]" 31:50.380 [INFO] TestAgent.server: cluster leadership acquired 31:50.380 [INFO] TestAgent.server: New leader elected: payload=Node-405c4068-6d40-8ef3-c593-3d9743efa5d1 31:50.406 [INFO] TestAgent: Synced node info 31:50.406 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29847 31:50.463 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:50.530 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:50.530 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:50.530 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:50.530 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:50.530 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:50.530 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-405c4068-6d40-8ef3-c593-3d9743efa5d1 31:50.530 [INFO] TestAgent.server: member joined, marking health alive: member=Node-405c4068-6d40-8ef3-c593-3d9743efa5d1 31:50.560 [INFO] TestAgent.server: federation state anti-entropy synced 31:50.665 [INFO] TestAgent: Requesting shutdown 31:50.665 [INFO] TestAgent.server: shutting down server 31:50.665 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:50.665 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:50.665 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:50.665 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:50.665 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:50.666 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:50.666 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:50.666 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:50.666 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:50.666 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:50.669 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:50.675Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:50.675Z [INFO] agent.router.manager: shutting down 31:50.675 [INFO] TestAgent: consul server down 31:50.675 [INFO] TestAgent: shutdown complete 31:50.675 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29842 network=tcp 31:50.675 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29842 network=udp 31:50.675 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29843 network=tcp 31:51.176 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.176 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_AutopilotGetConfiguration (1.08s) === CONT TestStatusLeaderSecondary [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:50.542Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:50.569Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:50.656 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d8385449-a9e5-8413-26fc-942f7000e811 Address:127.0.0.1:29861}]" 31:50.656 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29861 [Follower]" leader= 31:50.657 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d8385449-a9e5-8413-26fc-942f7000e811.dc1 127.0.0.1 31:50.657 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d8385449-a9e5-8413-26fc-942f7000e811 127.0.0.1 2021-10-05T16:31:50.657Z [INFO] agent.router: Initializing LAN area manager 31:50.657 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29863 network=udp 31:50.657 [INFO] TestAgent.server: Adding LAN server: server="Node-d8385449-a9e5-8413-26fc-942f7000e811 (Addr: tcp/127.0.0.1:29861) (DC: dc1)" 31:50.657 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d8385449-a9e5-8413-26fc-942f7000e811.dc1 area=wan 31:50.657 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29863 network=tcp 31:50.658 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29857 network=tcp 31:50.658 [INFO] TestAgent: started state syncer 31:50.658 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29910 network=tcp 31:50.716 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:50.716 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29861 [Candidate]" term=2 31:50.764 [DEBUG] TestAgent.server.raft: votes: needed=1 31:50.764 [DEBUG] TestAgent.server.raft: vote granted: from=d8385449-a9e5-8413-26fc-942f7000e811 term=2 tally=1 31:50.764 [INFO] TestAgent.server.raft: election won: tally=1 31:50.764 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29861 [Leader]" 31:50.764 [INFO] TestAgent.server: cluster leadership acquired 31:50.764 [INFO] TestAgent.server: New leader elected: payload=Node-d8385449-a9e5-8413-26fc-942f7000e811 31:50.796 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29861 31:50.816 [INFO] TestAgent.server.serf.wan: serf: Received install-key query 31:50.820 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811.dc1 31:50.820 [INFO] TestAgent.server.serf.lan: serf: Received install-key query 31:50.824 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811 31:50.824 [INFO] TestAgent.server.serf.wan: serf: Received use-key query 31:50.828 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811.dc1 31:50.828 [INFO] TestAgent.server.serf.lan: serf: Received use-key query 31:50.828 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811 31:50.828 [INFO] TestAgent.server.serf.wan: serf: Received remove-key query 31:50.829 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811.dc1 31:50.829 [INFO] TestAgent.server.serf.lan: serf: Received remove-key query 31:50.829 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811 31:50.829 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 31:50.829 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811.dc1 31:50.829 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 31:50.830 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-d8385449-a9e5-8413-26fc-942f7000e811 31:50.830 [INFO] TestAgent: Requesting shutdown 31:50.830 [INFO] TestAgent.server: shutting down server 31:50.830 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:50.830 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:50.840 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:50.852Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:50.852Z [INFO] agent.router.manager: shutting down 31:50.860 [ERROR] TestAgent.server: failed to establish leadership: error="error configuring provider: leadership lost while committing log" 31:50.862 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:50.862 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 31:50.862 [INFO] TestAgent: consul server down 31:50.862 [INFO] TestAgent: shutdown complete 31:50.862 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29863 network=tcp 31:50.862 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29863 network=udp 31:50.862 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29857 network=tcp 31:51.364 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.364 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_KeyringUse (0.88s) === CONT TestStatusPeersSecondary [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:51.018Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.049Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.128 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:07609ce0-a3a9-0001-8de3-e354057bb352 Address:127.0.0.1:29930}]" 31:51.129 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-07609ce0-a3a9-0001-8de3-e354057bb352.dc1 127.0.0.1 31:51.129 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-07609ce0-a3a9-0001-8de3-e354057bb352 127.0.0.1 2021-10-05T16:31:51.129Z [INFO] agent.router: Initializing LAN area manager 31:51.130 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29904 network=udp 31:51.130 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29930 [Follower]" leader= 31:51.130 [INFO] TestAgent.server: Adding LAN server: server="Node-07609ce0-a3a9-0001-8de3-e354057bb352 (Addr: tcp/127.0.0.1:29930) (DC: dc1)" 31:51.130 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-07609ce0-a3a9-0001-8de3-e354057bb352.dc1 area=wan 31:51.130 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29904 network=tcp 31:51.131 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29926 network=tcp 31:51.131 [INFO] TestAgent: started state syncer 31:51.131 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29917 network=tcp 31:51.172 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.172 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29930 [Candidate]" term=2 31:51.208 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.208 [DEBUG] TestAgent.server.raft: vote granted: from=07609ce0-a3a9-0001-8de3-e354057bb352 term=2 tally=1 31:51.208 [INFO] TestAgent.server.raft: election won: tally=1 31:51.208 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29930 [Leader]" 31:51.208 [INFO] TestAgent.server: cluster leadership acquired 31:51.208 [INFO] TestAgent.server: New leader elected: payload=Node-07609ce0-a3a9-0001-8de3-e354057bb352 31:51.227 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29930 31:51.259 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 31:51.259 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-07609ce0-a3a9-0001-8de3-e354057bb352 31:51.259 [INFO] TestAgent: Requesting shutdown 31:51.260 [INFO] TestAgent.server: shutting down server 31:51.260 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:51.260 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:51.276 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:51.277 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 2021-10-05T16:31:51.284Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.284Z [INFO] agent.router.manager: shutting down 31:51.292 [INFO] TestAgent: consul server down 31:51.292 [INFO] TestAgent: shutdown complete 31:51.292 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29904 network=tcp 31:51.292 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29904 network=udp 31:51.292 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29926 network=tcp 31:51.292 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 31:51.796 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.796 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_KeyringListLocalOnly (0.80s) === CONT TestStatusPeers [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:50.777Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:50.825Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:50.896 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8ab7c864-a39a-efb6-0949-9ca1f012d99e Address:127.0.0.1:29923}]" 31:50.896 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29923 [Follower]" leader= 31:50.896 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e.dc1 127.0.0.1 31:50.897 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 127.0.0.1 2021-10-05T16:31:50.897Z [INFO] agent.router: Initializing LAN area manager 31:50.897 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29897 network=udp 31:50.898 [INFO] TestAgent.server: Adding LAN server: server="Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e (Addr: tcp/127.0.0.1:29923) (DC: dc1)" 31:50.898 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e.dc1 area=wan 31:50.898 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29897 network=tcp 31:50.898 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29919 network=tcp 31:50.898 [INFO] TestAgent: started state syncer 31:50.898 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29892 network=tcp 31:50.952 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:50.952 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29923 [Candidate]" term=2 31:51.000 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.000 [DEBUG] TestAgent.server.raft: vote granted: from=8ab7c864-a39a-efb6-0949-9ca1f012d99e term=2 tally=1 31:51.000 [INFO] TestAgent.server.raft: election won: tally=1 31:51.000 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29923 [Leader]" 31:51.000 [INFO] TestAgent.server: cluster leadership acquired 31:51.000 [INFO] TestAgent.server: New leader elected: payload=Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 31:51.020 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29923 31:51.040 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:51.104 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:51.104 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:51.104 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:51.104 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:51.104 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:51.104 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 31:51.104 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 31:51.148 [INFO] TestAgent.server: federation state anti-entropy synced 31:51.188 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:51.208 [INFO] TestAgent: Synced node info 31:51.336 [INFO] TestAgent.server.serf.wan: serf: Received install-key query 31:51.344 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e.dc1 31:51.344 [INFO] TestAgent.server.serf.lan: serf: Received install-key query 31:51.345 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 31:51.345 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 31:51.345 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e.dc1 31:51.345 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 31:51.345 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 31:51.345 [INFO] TestAgent.server.serf.wan: serf: Received remove-key query 31:51.346 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e.dc1 31:51.346 [INFO] TestAgent.server.serf.lan: serf: Received remove-key query 31:51.346 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 31:51.346 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 31:51.346 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e.dc1 31:51.346 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 31:51.347 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-8ab7c864-a39a-efb6-0949-9ca1f012d99e 31:51.347 [INFO] TestAgent: Requesting shutdown 31:51.347 [INFO] TestAgent.server: shutting down server 31:51.347 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:51.347 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:51.347 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:51.347 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:51.347 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:51.347 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:51.347 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:51.347 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:51.347 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:51.347 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:51.360 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:51.376Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.376Z [INFO] agent.router.manager: shutting down 31:51.376 [INFO] TestAgent: consul server down 31:51.376 [INFO] TestAgent: shutdown complete 31:51.376 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29897 network=tcp 31:51.376 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29897 network=udp 31:51.376 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29919 network=tcp 31:51.876 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.876 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_KeyringRemove (1.14s) === CONT TestIntentionsCheck_noDestination 2021-10-05T16:31:51.098Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.129Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.203 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f87021de-be1b-bfa2-4d6b-2e9932a55106 Address:127.0.0.1:29902}]" 31:51.203 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29902 [Follower]" leader= 31:51.205 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f87021de-be1b-bfa2-4d6b-2e9932a55106.dc1 127.0.0.1 31:51.206 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f87021de-be1b-bfa2-4d6b-2e9932a55106 127.0.0.1 2021-10-05T16:31:51.206Z [INFO] agent.router: Initializing LAN area manager 31:51.207 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29918 network=udp 31:51.207 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f87021de-be1b-bfa2-4d6b-2e9932a55106.dc1 area=wan 31:51.207 [INFO] TestAgent.server: Adding LAN server: server="Node-f87021de-be1b-bfa2-4d6b-2e9932a55106 (Addr: tcp/127.0.0.1:29902) (DC: dc1)" 31:51.207 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29918 network=tcp 31:51.207 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29898 network=tcp 31:51.207 [INFO] TestAgent: started state syncer 31:51.207 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29931 network=tcp 31:51.260 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.260 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29902 [Candidate]" term=2 31:51.294 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.294 [DEBUG] TestAgent.server.raft: vote granted: from=f87021de-be1b-bfa2-4d6b-2e9932a55106 term=2 tally=1 31:51.294 [INFO] TestAgent.server.raft: election won: tally=1 31:51.294 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29902 [Leader]" 31:51.295 [INFO] TestAgent.server: cluster leadership acquired 31:51.295 [INFO] TestAgent.server: New leader elected: payload=Node-f87021de-be1b-bfa2-4d6b-2e9932a55106 31:51.302 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29902 31:51.352 [INFO] TestAgent: Requesting shutdown 31:51.352 [INFO] TestAgent.server: shutting down server 31:51.352 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:51.352 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:51.352 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:51.362 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:51.369Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.369Z [INFO] agent.router.manager: shutting down 31:51.380 [INFO] TestAgent: consul server down 31:51.380 [INFO] TestAgent: shutdown complete 31:51.380 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29918 network=tcp 31:51.380 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 31:51.380 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:51.380 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29918 network=udp 31:51.380 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:51.380 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29898 network=tcp 31:51.880 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.880 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsCreate_good (0.81s) === CONT TestStatusLeader 2021-10-05T16:31:51.148Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.179Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.273 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0294718b-8e83-083f-77ee-d7b7c77da585 Address:127.0.0.1:29916}]" 31:51.274 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0294718b-8e83-083f-77ee-d7b7c77da585.dc1 127.0.0.1 31:51.274 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0294718b-8e83-083f-77ee-d7b7c77da585 127.0.0.1 2021-10-05T16:31:51.274Z [INFO] agent.router: Initializing LAN area manager 31:51.275 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29932 network=udp 31:51.275 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29916 [Follower]" leader= 31:51.275 [INFO] TestAgent.server: Adding LAN server: server="Node-0294718b-8e83-083f-77ee-d7b7c77da585 (Addr: tcp/127.0.0.1:29916) (DC: dc1)" 31:51.275 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0294718b-8e83-083f-77ee-d7b7c77da585.dc1 area=wan 31:51.275 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29932 network=tcp 31:51.276 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29912 network=tcp 31:51.276 [INFO] TestAgent: started state syncer 31:51.276 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29903 network=tcp 31:51.320 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.320 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29916 [Candidate]" term=2 31:51.358 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.358 [DEBUG] TestAgent.server.raft: vote granted: from=0294718b-8e83-083f-77ee-d7b7c77da585 term=2 tally=1 31:51.358 [INFO] TestAgent.server.raft: election won: tally=1 31:51.358 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29916 [Leader]" 31:51.360 [INFO] TestAgent.server: cluster leadership acquired 31:51.360 [INFO] TestAgent.server: New leader elected: payload=Node-0294718b-8e83-083f-77ee-d7b7c77da585 31:51.370 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29916 31:51.404 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:51.422 [INFO] TestAgent: Requesting shutdown 31:51.422 [INFO] TestAgent.server: shutting down server 31:51.422 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:51.422 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:51.428 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:51.436Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.436Z [INFO] agent.router.manager: shutting down 31:51.441 [INFO] TestAgent: consul server down 31:51.441 [INFO] TestAgent: shutdown complete 31:51.441 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29932 network=tcp 31:51.441 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29932 network=udp 31:51.441 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29912 network=tcp 31:51.441 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 31:51.441 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 31:51.441 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 31:51.942 [INFO] TestAgent: Waiting for endpoints to shut down 31:51.943 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsCreate_noBody (0.82s) === CONT TestSnapshot_Options === RUN TestSnapshot_Options/GET [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:49.491Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.506Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.550 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:58357369-b5be-54e3-9419-baa3577b326c Address:127.0.0.1:29777}]" 31:49.551 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29777 [Follower]" leader= 31:49.556 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-58357369-b5be-54e3-9419-baa3577b326c.dc1 127.0.0.1 31:49.564 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-58357369-b5be-54e3-9419-baa3577b326c 127.0.0.1 2021-10-05T16:31:49.564Z [INFO] agent.router: Initializing LAN area manager 31:49.565 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29856 network=udp 31:49.565 [INFO] TestAgent.server: Adding LAN server: server="Node-58357369-b5be-54e3-9419-baa3577b326c (Addr: tcp/127.0.0.1:29777) (DC: dc1)" 31:49.565 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29856 network=tcp 31:49.565 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-58357369-b5be-54e3-9419-baa3577b326c.dc1 area=wan 31:49.566 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29773 network=tcp 31:49.566 [INFO] TestAgent: started state syncer 31:49.566 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29771 network=tcp 31:49.592 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.592 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29777 [Candidate]" term=2 31:49.632 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.632 [DEBUG] TestAgent.server.raft: vote granted: from=58357369-b5be-54e3-9419-baa3577b326c term=2 tally=1 31:49.632 [INFO] TestAgent.server.raft: election won: tally=1 31:49.632 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29777 [Leader]" 31:49.633 [INFO] TestAgent.server: cluster leadership acquired 31:49.633 [INFO] TestAgent.server: New leader elected: payload=Node-58357369-b5be-54e3-9419-baa3577b326c 31:49.655 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29777 31:49.680 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.728 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:49.728 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:49.728 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:49.728 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:49.728 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:49.728 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-58357369-b5be-54e3-9419-baa3577b326c 31:49.728 [INFO] TestAgent.server: member joined, marking health alive: member=Node-58357369-b5be-54e3-9419-baa3577b326c 31:49.756 [INFO] TestAgent.server: federation state anti-entropy synced 31:49.878 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:49.891 [INFO] TestAgent: Synced node info 31:49.891 [DEBUG] TestAgent: Node info in sync 31:51.676 [INFO] TestAgent: Requesting shutdown 31:51.676 [INFO] TestAgent.server: shutting down server 31:51.676 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:51.676 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:51.676 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:51.676 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:51.676 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:51.676 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:51.676 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:51.676 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:51.676 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:51.676 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:51.688 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:51.696Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.696Z [INFO] agent.router.manager: shutting down 31:51.696 [INFO] TestAgent: consul server down 31:51.696 [INFO] TestAgent: shutdown complete 31:51.696 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29856 network=tcp 31:51.696 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29856 network=udp 31:51.696 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29773 network=tcp 31:52.199 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.199 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_ServerHealth_Unhealthy (2.72s) === CONT TestAgent_Join [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:49.589Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:49.618Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:49.700 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:41891d93-afb4-f98e-f7fc-7fcca1cdc75e Address:127.0.0.1:29854}]" 31:49.701 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-41891d93-afb4-f98e-f7fc-7fcca1cdc75e.dc1 127.0.0.1 31:49.701 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29854 [Follower]" leader= 31:49.701 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-41891d93-afb4-f98e-f7fc-7fcca1cdc75e 127.0.0.1 2021-10-05T16:31:49.701Z [INFO] agent.router: Initializing LAN area manager 31:49.702 [INFO] TestAgent.server: Adding LAN server: server="Node-41891d93-afb4-f98e-f7fc-7fcca1cdc75e (Addr: tcp/127.0.0.1:29854) (DC: dc1)" 31:49.702 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-41891d93-afb4-f98e-f7fc-7fcca1cdc75e.dc1 area=wan 31:49.702 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29772 network=udp 31:49.702 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29772 network=tcp 31:49.714 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29850 network=tcp 31:49.715 [INFO] TestAgent: started state syncer 31:49.715 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29883 network=tcp 31:49.752 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:49.752 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29854 [Candidate]" term=2 31:49.784 [DEBUG] TestAgent.server.raft: votes: needed=1 31:49.784 [DEBUG] TestAgent.server.raft: vote granted: from=41891d93-afb4-f98e-f7fc-7fcca1cdc75e term=2 tally=1 31:49.784 [INFO] TestAgent.server.raft: election won: tally=1 31:49.784 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29854 [Leader]" 31:49.784 [INFO] TestAgent.server: cluster leadership acquired 31:49.784 [INFO] TestAgent.server: New leader elected: payload=Node-41891d93-afb4-f98e-f7fc-7fcca1cdc75e 31:49.796 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29854 31:49.822 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:49.872 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:49.872 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:49.872 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:49.872 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:49.872 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:49.872 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-41891d93-afb4-f98e-f7fc-7fcca1cdc75e 31:49.872 [INFO] TestAgent.server: member joined, marking health alive: member=Node-41891d93-afb4-f98e-f7fc-7fcca1cdc75e 31:49.898 [INFO] TestAgent.server: federation state anti-entropy synced 31:49.927 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:49.937 [INFO] TestAgent: Synced node info 31:51.837 [INFO] TestAgent: Requesting shutdown 31:51.837 [INFO] TestAgent.server: shutting down server 31:51.837 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:51.837 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:51.837 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:51.837 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:51.837 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:51.838 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:51.838 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:51.838 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:51.838 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:51.838 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:51.844 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:51.852Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.852Z [INFO] agent.router.manager: shutting down 31:51.852 [INFO] TestAgent: consul server down 31:51.852 [INFO] TestAgent: shutdown complete 31:51.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29772 network=tcp 31:51.852 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29772 network=udp 31:51.852 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29850 network=tcp 31:52.353 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.353 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_ServerHealth (2.80s) === CONT TestAgentConnectCALeafCert_secondaryDC_good [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:51.814Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.828Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.873 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e186114a-78b4-eb51-9ce4-559e6d12760d Address:127.0.0.1:29951}]" 31:51.873 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29951 [Follower]" leader= 31:51.879 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e186114a-78b4-eb51-9ce4-559e6d12760d.dc1 127.0.0.1 31:51.881 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e186114a-78b4-eb51-9ce4-559e6d12760d 127.0.0.1 2021-10-05T16:31:51.881Z [INFO] agent.router: Initializing LAN area manager 31:51.882 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29946 network=udp 31:51.882 [INFO] TestAgent.server: Adding LAN server: server="Node-e186114a-78b4-eb51-9ce4-559e6d12760d (Addr: tcp/127.0.0.1:29951) (DC: dc1)" 31:51.882 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e186114a-78b4-eb51-9ce4-559e6d12760d.dc1 area=wan 31:51.882 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29946 network=tcp 31:51.882 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29947 network=tcp 31:51.882 [INFO] TestAgent: started state syncer 31:51.883 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30001 network=tcp 31:51.940 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.940 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29951 [Candidate]" term=2 31:51.974 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.974 [DEBUG] TestAgent.server.raft: vote granted: from=e186114a-78b4-eb51-9ce4-559e6d12760d term=2 tally=1 31:51.974 [INFO] TestAgent.server.raft: election won: tally=1 31:51.974 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29951 [Leader]" 31:51.975 [INFO] TestAgent.server: cluster leadership acquired 31:51.975 [INFO] TestAgent.server: New leader elected: payload=Node-e186114a-78b4-eb51-9ce4-559e6d12760d 31:51.984 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29951 31:52.010 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.058 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.058 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:52.058 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:52.058 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:52.058 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:52.059 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e186114a-78b4-eb51-9ce4-559e6d12760d 31:52.059 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e186114a-78b4-eb51-9ce4-559e6d12760d 31:52.075 [INFO] TestAgent.server: federation state anti-entropy synced 31:52.138 [INFO] TestAgent: Requesting shutdown 31:52.138 [INFO] TestAgent.server: shutting down server 31:52.138 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.138 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.138 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.138 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.138 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.138 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:52.138 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:52.138 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:52.138 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.138 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.138 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.143 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:52.156Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.156Z [INFO] agent.router.manager: shutting down 31:52.156 [INFO] TestAgent: consul server down 31:52.156 [INFO] TestAgent: shutdown complete 31:52.156 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29946 network=tcp 31:52.156 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29946 network=udp 31:52.156 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29947 network=tcp 31:52.657 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.657 [INFO] TestAgent: Endpoints down --- PASS: TestStatusPeers (0.86s) === CONT TestAgentConnectCALeafCert_aclServiceReadDeny 2021-10-05T16:31:51.964Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.993Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.046 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e4196fa9-8879-a445-8e0d-a0e6e79c3225 Address:127.0.0.1:29993}]" 31:52.046 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e4196fa9-8879-a445-8e0d-a0e6e79c3225.dc1 127.0.0.1 31:52.047 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e4196fa9-8879-a445-8e0d-a0e6e79c3225 127.0.0.1 2021-10-05T16:31:52.047Z [INFO] agent.router: Initializing LAN area manager 31:52.047 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29988 network=udp 31:52.047 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29993 [Follower]" leader= 31:52.048 [INFO] TestAgent.server: Adding LAN server: server="Node-e4196fa9-8879-a445-8e0d-a0e6e79c3225 (Addr: tcp/127.0.0.1:29993) (DC: dc1)" 31:52.048 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e4196fa9-8879-a445-8e0d-a0e6e79c3225.dc1 area=wan 31:52.048 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29988 network=tcp 31:52.048 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29989 network=tcp 31:52.048 [INFO] TestAgent: started state syncer 31:52.048 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29973 network=tcp 31:52.113 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.113 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29993 [Candidate]" term=2 31:52.138 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.138 [DEBUG] TestAgent.server.raft: vote granted: from=e4196fa9-8879-a445-8e0d-a0e6e79c3225 term=2 tally=1 31:52.138 [INFO] TestAgent.server.raft: election won: tally=1 31:52.138 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29993 [Leader]" 31:52.138 [INFO] TestAgent.server: cluster leadership acquired 31:52.138 [INFO] TestAgent.server: New leader elected: payload=Node-e4196fa9-8879-a445-8e0d-a0e6e79c3225 31:52.149 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29993 31:52.167 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.204 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.204 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:52.204 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:52.204 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:52.204 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:52.204 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e4196fa9-8879-a445-8e0d-a0e6e79c3225 31:52.204 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e4196fa9-8879-a445-8e0d-a0e6e79c3225 31:52.228 [INFO] TestAgent.server: federation state anti-entropy synced 31:52.251 [INFO] TestAgent: Requesting shutdown 31:52.251 [INFO] TestAgent.server: shutting down server 31:52.251 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.251 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.251 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.251 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.251 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.251 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:52.251 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:52.251 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:52.251 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.251 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.251 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.266 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:52.271Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.271Z [INFO] agent.router.manager: shutting down 31:52.271 [INFO] TestAgent: consul server down 31:52.271 [INFO] TestAgent: shutdown complete 31:52.271 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29988 network=tcp 31:52.271 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29988 network=udp 31:52.271 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29989 network=tcp 31:52.771 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.771 [INFO] TestAgent: Endpoints down --- PASS: TestIntentionsCheck_noDestination (0.89s) === CONT TestAgentConnectCALeafCert_aclServiceWrite 2021-10-05T16:31:51.988Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:51.988Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.011Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.011Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.068 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8c4f9841-f84c-07cd-ca94-303cb1917dd6 Address:127.0.0.1:30021}]" 31:52.069 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30021 [Follower]" leader= 31:52.069 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6.dc1 127.0.0.1 31:52.070 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 127.0.0.1 2021-10-05T16:31:52.070Z [INFO] agent.router: Initializing LAN area manager 31:52.070 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29995 network=udp 31:52.070 [INFO] TestAgent.server: Adding LAN server: server="Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 (Addr: tcp/127.0.0.1:30021) (DC: dc1)" 31:52.070 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6.dc1 area=wan 31:52.070 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29995 network=tcp 31:52.071 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30017 network=tcp 31:52.071 [INFO] TestAgent: started state syncer 31:52.071 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29987 network=tcp 31:52.109 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.109 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30021 [Candidate]" term=2 31:52.124 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:52.128 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.128 [DEBUG] TestAgent.server.raft: vote granted: from=8c4f9841-f84c-07cd-ca94-303cb1917dd6 term=2 tally=1 31:52.128 [INFO] TestAgent.server.raft: election won: tally=1 31:52.128 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30021 [Leader]" 31:52.128 [INFO] TestAgent.server: cluster leadership acquired 31:52.128 [INFO] TestAgent.server: New leader elected: payload=Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 31:52.142 [INFO] TestAgent.server: initializing acls 31:52.148 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:52.148 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:52.159 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:52.174 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:52.174 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:52.174 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:52.174 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 31:52.174 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6.dc1 31:52.175 [INFO] TestAgent.server: Updating LAN server: server="Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 (Addr: tcp/127.0.0.1:30021) (DC: dc1)" 31:52.175 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6.dc1 area=wan 31:52.194 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.234 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.234 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:52.234 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:52.234 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:52.234 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:52.234 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 31:52.234 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 31:52.248 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 31:52.256 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8c4f9841-f84c-07cd-ca94-303cb1917dd6 31:52.256 [INFO] TestAgent: Requesting shutdown 31:52.256 [INFO] TestAgent.server: shutting down server 31:52.256 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.256 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.256 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.256 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:52.256 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:52.256 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.256 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.256 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:52.256 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.256 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.256 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.256 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:52.256 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:52.264 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:52.272Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.272Z [INFO] agent.router.manager: shutting down 31:52.272 [INFO] TestAgent: consul server down 31:52.272 [INFO] TestAgent: shutdown complete 31:52.272 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29995 network=tcp 31:52.272 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29995 network=udp 31:52.272 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30017 network=tcp 31:52.272 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 31:52.272 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:52.773 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.773 [INFO] TestAgent: Endpoints down === RUN TestSnapshot_Options/GET#01 [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:51.928Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.963Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.034 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0283a109-d299-8bc1-083f-e199e329a5d8 Address:127.0.0.1:30000}]" 31:52.034 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30000 [Follower]" leader= 31:52.035 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0283a109-d299-8bc1-083f-e199e329a5d8.dc1 127.0.0.1 31:52.035 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0283a109-d299-8bc1-083f-e199e329a5d8 127.0.0.1 2021-10-05T16:31:52.035Z [INFO] agent.router: Initializing LAN area manager 31:52.035 [INFO] TestAgent.server: Adding LAN server: server="Node-0283a109-d299-8bc1-083f-e199e329a5d8 (Addr: tcp/127.0.0.1:30000) (DC: dc1)" 31:52.035 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0283a109-d299-8bc1-083f-e199e329a5d8.dc1 area=wan 31:52.035 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29974 network=udp 31:52.035 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29974 network=tcp 31:52.036 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29996 network=tcp 31:52.036 [INFO] TestAgent: started state syncer 31:52.036 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29980 network=tcp 31:52.071 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.071 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30000 [Candidate]" term=2 31:52.087 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.087 [DEBUG] TestAgent.server.raft: vote granted: from=0283a109-d299-8bc1-083f-e199e329a5d8 term=2 tally=1 31:52.087 [INFO] TestAgent.server.raft: election won: tally=1 31:52.087 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30000 [Leader]" 31:52.087 [INFO] TestAgent.server: cluster leadership acquired 31:52.087 [INFO] TestAgent.server: New leader elected: payload=Node-0283a109-d299-8bc1-083f-e199e329a5d8 31:52.103 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30000 31:52.120 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.159 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.159 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:52.159 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:52.159 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:52.159 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:52.159 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0283a109-d299-8bc1-083f-e199e329a5d8 31:52.159 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0283a109-d299-8bc1-083f-e199e329a5d8 31:52.185 [INFO] TestAgent.server: federation state anti-entropy synced 31:52.336 [INFO] TestAgent: Requesting shutdown 31:52.337 [INFO] TestAgent.server: shutting down server 31:52.337 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.337 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.337 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.337 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.337 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.337 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:52.337 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:52.337 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:52.337 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.337 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.337 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.348 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:52.360Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.360Z [INFO] agent.router.manager: shutting down 31:52.360 [INFO] TestAgent: consul server down 31:52.360 [INFO] TestAgent: shutdown complete 31:52.360 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29974 network=tcp 31:52.360 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29974 network=udp 31:52.360 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29996 network=tcp 31:52.864 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.864 [INFO] TestAgent: Endpoints down --- PASS: TestStatusLeader (0.98s) === CONT TestAgentConnectCALeafCert_aclDefaultDeny 2021-10-05T16:31:51.471Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.511Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.604 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:04f6becf-87f7-acdf-b927-9d2050c5b397 Address:127.0.0.1:29868}]" 31:51.604 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29868 [Follower]" leader= 31:51.605 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-04f6becf-87f7-acdf-b927-9d2050c5b397.secondary 127.0.0.1 31:51.605 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-04f6becf-87f7-acdf-b927-9d2050c5b397 127.0.0.1 2021-10-05T16:31:51.605Z [INFO] agent.router: Initializing LAN area manager 31:51.605 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29870 network=udp 31:51.606 [INFO] TestAgent.server: Adding LAN server: server="Node-04f6becf-87f7-acdf-b927-9d2050c5b397 (Addr: tcp/127.0.0.1:29868) (DC: secondary)" 31:51.606 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-04f6becf-87f7-acdf-b927-9d2050c5b397.secondary area=wan 31:51.606 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29870 network=tcp 31:51.606 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29864 network=tcp 31:51.607 [INFO] TestAgent: started state syncer 31:51.607 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29938 network=tcp 31:51.664 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.664 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29868 [Candidate]" term=2 31:51.704 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.704 [DEBUG] TestAgent.server.raft: vote granted: from=04f6becf-87f7-acdf-b927-9d2050c5b397 term=2 tally=1 31:51.704 [INFO] TestAgent.server.raft: election won: tally=1 31:51.704 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29868 [Leader]" 31:51.705 [INFO] TestAgent.server: cluster leadership acquired 31:51.705 [INFO] TestAgent.server: New leader elected: payload=Node-04f6becf-87f7-acdf-b927-9d2050c5b397 31:51.732 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29868 31:51.786 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:51.850 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:51.850 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:51.850 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:51.850 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:51.850 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:51.850 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04f6becf-87f7-acdf-b927-9d2050c5b397 31:51.850 [INFO] TestAgent.server: member joined, marking health alive: member=Node-04f6becf-87f7-acdf-b927-9d2050c5b397 31:51.876 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:29936] 31:51.880 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29936 31:51.893 [INFO] TestAgent.server: federation state anti-entropy synced 31:51.899 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1fd99831-7a92-b5d3-c201-f834d2196c7f.primary 127.0.0.1 31:51.899 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:51.900 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1fd99831-7a92-b5d3-c201-f834d2196c7f.primary area=wan 31:51.904 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:51.907 [INFO] TestAgent: Requesting shutdown 31:51.907 [INFO] TestAgent.server: shutting down server 31:51.907 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:51.907 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:51.907 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:51.907 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:51.907 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:51.912 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:51.912 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:51.912 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:51.912 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:51.912 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:51.928 [INFO] TestAgent: Synced node info 31:51.940 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:51.956Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.956Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:51.956Z [INFO] agent.router.manager: shutting down 31:51.957 [INFO] TestAgent: consul server down 31:51.957 [INFO] TestAgent: shutdown complete 31:51.957 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29870 network=tcp 31:51.957 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29870 network=udp 31:51.957 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29864 network=tcp 31:52.461 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.461 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:51.207Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.251Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.336 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1fd99831-7a92-b5d3-c201-f834d2196c7f Address:127.0.0.1:29937}]" 31:51.337 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1fd99831-7a92-b5d3-c201-f834d2196c7f.primary 127.0.0.1 31:51.337 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1fd99831-7a92-b5d3-c201-f834d2196c7f 127.0.0.1 2021-10-05T16:31:51.337Z [INFO] agent.router: Initializing LAN area manager 31:51.338 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29911 network=udp 31:51.338 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29937 [Follower]" leader= 31:51.338 [INFO] TestAgent.server: Adding LAN server: server="Node-1fd99831-7a92-b5d3-c201-f834d2196c7f (Addr: tcp/127.0.0.1:29937) (DC: primary)" 31:51.338 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1fd99831-7a92-b5d3-c201-f834d2196c7f.primary area=wan 31:51.338 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29911 network=tcp 31:51.339 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29933 network=tcp 31:51.339 [INFO] TestAgent: started state syncer 31:51.339 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29924 network=tcp 31:51.400 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.400 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29937 [Candidate]" term=2 31:51.427 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.427 [DEBUG] TestAgent.server.raft: vote granted: from=1fd99831-7a92-b5d3-c201-f834d2196c7f term=2 tally=1 31:51.427 [INFO] TestAgent.server.raft: election won: tally=1 31:51.427 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29937 [Leader]" 31:51.428 [INFO] TestAgent.server: cluster leadership acquired 31:51.428 [INFO] TestAgent.server: New leader elected: payload=Node-1fd99831-7a92-b5d3-c201-f834d2196c7f 31:51.437 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29937 31:51.472 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:51.536 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:51.536 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:51.536 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:51.536 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:51.536 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:51.536 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1fd99831-7a92-b5d3-c201-f834d2196c7f 31:51.536 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1fd99831-7a92-b5d3-c201-f834d2196c7f 31:51.566 [INFO] TestAgent.server: federation state anti-entropy synced 31:51.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:51.656 [INFO] TestAgent: Synced node info 31:51.656 [DEBUG] TestAgent: Node info in sync 31:51.880 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:58902 31:51.896 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-04f6becf-87f7-acdf-b927-9d2050c5b397.secondary 127.0.0.1 31:51.897 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-04f6becf-87f7-acdf-b927-9d2050c5b397.secondary area=wan 31:52.461 [INFO] TestAgent: Requesting shutdown 31:52.461 [INFO] TestAgent.server: shutting down server 31:52.461 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.461 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.461 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.461 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.461 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.461 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:52.461 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:52.461 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.461 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.461 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.470 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:52.474Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.474Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.474Z [INFO] agent.router.manager: shutting down 31:52.474 [INFO] TestAgent: consul server down 31:52.474 [INFO] TestAgent: shutdown complete 31:52.474 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29911 network=tcp 31:52.475 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29911 network=udp 31:52.475 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29933 network=tcp 31:52.975 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.975 [INFO] TestAgent: Endpoints down --- PASS: TestStatusLeaderSecondary (1.80s) === CONT TestAgentConnectCARoots_list [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:51.692Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.723Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.816 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:678f51a7-51ef-ef7b-2cea-d9f98839e1ce Address:127.0.0.1:29944}]" 31:51.816 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29944 [Follower]" leader= 31:51.817 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce.secondary 127.0.0.1 31:51.817 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce 127.0.0.1 2021-10-05T16:31:51.817Z [INFO] agent.router: Initializing LAN area manager 31:51.818 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29939 network=udp 31:51.818 [INFO] TestAgent.server: Adding LAN server: server="Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce (Addr: tcp/127.0.0.1:29944) (DC: secondary)" 31:51.818 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce.secondary area=wan 31:51.818 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29939 network=tcp 31:51.819 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29940 network=tcp 31:51.819 [INFO] TestAgent: started state syncer 31:51.819 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29945 network=tcp 31:51.856 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.856 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29944 [Candidate]" term=2 31:51.883 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.883 [DEBUG] TestAgent.server.raft: vote granted: from=678f51a7-51ef-ef7b-2cea-d9f98839e1ce term=2 tally=1 31:51.883 [INFO] TestAgent.server.raft: election won: tally=1 31:51.883 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29944 [Leader]" 31:51.884 [INFO] TestAgent.server: cluster leadership acquired 31:51.884 [INFO] TestAgent.server: New leader elected: payload=Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce 31:51.917 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29944 31:51.954 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.011 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.011 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:52.011 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:52.011 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:52.011 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:52.012 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce 31:52.012 [INFO] TestAgent.server: member joined, marking health alive: member=Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce 31:52.030 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:29881] 31:52.030 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29881 31:52.031 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7d1b16ab-753b-8942-3fe8-3906e061001e.primary 127.0.0.1 31:52.031 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:52.031 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7d1b16ab-753b-8942-3fe8-3906e061001e.primary area=wan 31:52.039 [INFO] TestAgent.server: federation state anti-entropy synced 31:52.041 [INFO] TestAgent: Requesting shutdown 31:52.041 [INFO] TestAgent.server: shutting down server 31:52.042 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.042 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.042 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.042 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.042 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.042 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:52.042 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:52.042 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.042 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:52.042 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.042 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.052 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:52.059Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.059Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.059Z [INFO] agent.router.manager: shutting down 31:52.059 [INFO] TestAgent: consul server down 31:52.060 [INFO] TestAgent: shutdown complete 31:52.060 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29939 network=tcp 31:52.060 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29939 network=udp 31:52.060 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29940 network=tcp 31:52.564 [INFO] TestAgent: Waiting for endpoints to shut down 31:52.564 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:51.405Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:51.449Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:51.548 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7d1b16ab-753b-8942-3fe8-3906e061001e Address:127.0.0.1:29882}]" 31:51.549 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7d1b16ab-753b-8942-3fe8-3906e061001e.primary 127.0.0.1 31:51.549 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7d1b16ab-753b-8942-3fe8-3906e061001e 127.0.0.1 2021-10-05T16:31:51.549Z [INFO] agent.router: Initializing LAN area manager 31:51.549 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29925 network=udp 31:51.549 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29882 [Follower]" leader= 31:51.550 [INFO] TestAgent.server: Adding LAN server: server="Node-7d1b16ab-753b-8942-3fe8-3906e061001e (Addr: tcp/127.0.0.1:29882) (DC: primary)" 31:51.550 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7d1b16ab-753b-8942-3fe8-3906e061001e.primary area=wan 31:51.550 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29925 network=tcp 31:51.550 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29878 network=tcp 31:51.551 [INFO] TestAgent: started state syncer 31:51.551 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29869 network=tcp 31:51.596 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:51.596 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29882 [Candidate]" term=2 31:51.644 [DEBUG] TestAgent.server.raft: votes: needed=1 31:51.644 [DEBUG] TestAgent.server.raft: vote granted: from=7d1b16ab-753b-8942-3fe8-3906e061001e term=2 tally=1 31:51.644 [INFO] TestAgent.server.raft: election won: tally=1 31:51.644 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29882 [Leader]" 31:51.644 [INFO] TestAgent.server: cluster leadership acquired 31:51.644 [INFO] TestAgent.server: New leader elected: payload=Node-7d1b16ab-753b-8942-3fe8-3906e061001e 31:51.679 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29882 31:51.705 [INFO] TestAgent: Synced node info 31:51.738 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:51.782 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:51.782 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:51.782 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:51.782 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:51.782 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:51.782 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7d1b16ab-753b-8942-3fe8-3906e061001e 31:51.782 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7d1b16ab-753b-8942-3fe8-3906e061001e 31:51.797 [INFO] TestAgent.server: federation state anti-entropy synced 31:52.030 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:49370 31:52.031 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce.secondary 127.0.0.1 31:52.031 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-678f51a7-51ef-ef7b-2cea-d9f98839e1ce.secondary area=wan 31:52.564 [INFO] TestAgent: Requesting shutdown 31:52.564 [INFO] TestAgent.server: shutting down server 31:52.564 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.564 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.564 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.564 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.564 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:52.564 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:52.564 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.564 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.564 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.564 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.572 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:52.576Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.576Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.576Z [INFO] agent.router.manager: shutting down 31:52.576 [INFO] TestAgent: consul server down 31:52.576 [INFO] TestAgent: shutdown complete 31:52.576 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29925 network=tcp 31:52.576 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29925 network=udp 31:52.576 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29878 network=tcp 31:53.076 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.076 [INFO] TestAgent: Endpoints down --- PASS: TestStatusPeersSecondary (1.71s) === CONT TestAgentConnectCARoots_empty [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:52.678Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.678Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.704Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.704Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.795 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:94732591-0f18-5891-521b-5b326f6e4720 Address:127.0.0.1:29979}]" 31:52.795 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-94732591-0f18-5891-521b-5b326f6e4720.dc1 127.0.0.1 31:52.796 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29979 [Follower]" leader= 31:52.796 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-94732591-0f18-5891-521b-5b326f6e4720 127.0.0.1 2021-10-05T16:31:52.796Z [INFO] agent.router: Initializing LAN area manager 31:52.796 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30002 network=udp 31:52.796 [INFO] TestAgent.server: Adding LAN server: server="Node-94732591-0f18-5891-521b-5b326f6e4720 (Addr: tcp/127.0.0.1:29979) (DC: dc1)" 31:52.796 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-94732591-0f18-5891-521b-5b326f6e4720.dc1 area=wan 31:52.797 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30002 network=tcp 31:52.797 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29975 network=tcp 31:52.797 [INFO] TestAgent: started state syncer 31:52.797 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29959 network=tcp 31:52.836 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.836 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29979 [Candidate]" term=2 31:52.847 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:52.877 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.877 [DEBUG] TestAgent.server.raft: vote granted: from=94732591-0f18-5891-521b-5b326f6e4720 term=2 tally=1 31:52.877 [INFO] TestAgent.server.raft: election won: tally=1 31:52.877 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29979 [Leader]" 31:52.877 [INFO] TestAgent.server: cluster leadership acquired 31:52.877 [INFO] TestAgent.server: New leader elected: payload=Node-94732591-0f18-5891-521b-5b326f6e4720 31:52.884 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:52.891 [INFO] TestAgent.server: initializing acls 31:52.897 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:52.897 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:52.911 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:52.941 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:52.941 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:52.941 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:52.942 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-94732591-0f18-5891-521b-5b326f6e4720 31:52.944 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-94732591-0f18-5891-521b-5b326f6e4720.dc1 31:52.944 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-94732591-0f18-5891-521b-5b326f6e4720.dc1 area=wan 31:52.944 [INFO] TestAgent.server: Updating LAN server: server="Node-94732591-0f18-5891-521b-5b326f6e4720 (Addr: tcp/127.0.0.1:29979) (DC: dc1)" 31:52.996 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:53.057 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:53.057 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:53.057 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:53.057 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:53.057 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:53.057 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-94732591-0f18-5891-521b-5b326f6e4720 31:53.057 [INFO] TestAgent.server: member joined, marking health alive: member=Node-94732591-0f18-5891-521b-5b326f6e4720 31:53.080 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-94732591-0f18-5891-521b-5b326f6e4720 31:53.088 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-94732591-0f18-5891-521b-5b326f6e4720 31:53.088 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-94732591-0f18-5891-521b-5b326f6e4720 31:53.114 [INFO] TestAgent.server: federation state anti-entropy synced 31:53.140 [INFO] TestAgent: Synced node info 31:53.157 [INFO] TestAgent: Synced service: service=test-id 31:53.157 [DEBUG] TestAgent: Check in sync: check=service:test-id 31:53.196 [INFO] TestAgent: Requesting shutdown 31:53.197 [INFO] TestAgent.server: shutting down server 31:53.197 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:53.197 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:53.197 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:53.197 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:53.197 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:53.197 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:53.197 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:53.197 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:53.197 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:53.197 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:53.197 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:53.197 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:53.197 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:53.197 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:53.204 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:53.212Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:53.212Z [INFO] agent.router.manager: shutting down 31:53.212 [INFO] TestAgent: consul server down 31:53.212 [INFO] TestAgent: shutdown complete 31:53.212 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30002 network=tcp 31:53.212 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30002 network=udp 31:53.212 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29975 network=tcp 31:53.715 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.715 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectCALeafCert_aclServiceReadDeny (1.08s) === CONT TestAgent_Token 2021-10-05T16:31:52.798Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.798Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.814Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.814Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.853 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:279fd5b9-4b89-4f43-ad54-466fb339bf93 Address:127.0.0.1:29972}]" 31:52.853 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-279fd5b9-4b89-4f43-ad54-466fb339bf93.dc1 127.0.0.1 31:52.854 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29972 [Follower]" leader= 31:52.854 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 127.0.0.1 2021-10-05T16:31:52.854Z [INFO] agent.router: Initializing LAN area manager 31:52.854 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29953 network=udp 31:52.854 [INFO] TestAgent.server: Adding LAN server: server="Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 (Addr: tcp/127.0.0.1:29972) (DC: dc1)" 31:52.854 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93.dc1 area=wan 31:52.855 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29953 network=tcp 31:52.855 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29968 network=tcp 31:52.855 [INFO] TestAgent: started state syncer 31:52.856 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30029 network=tcp 31:52.905 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:52.913 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.913 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29972 [Candidate]" term=2 31:52.944 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.944 [DEBUG] TestAgent.server.raft: vote granted: from=279fd5b9-4b89-4f43-ad54-466fb339bf93 term=2 tally=1 31:52.944 [INFO] TestAgent.server.raft: election won: tally=1 31:52.944 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29972 [Leader]" 31:52.948 [INFO] TestAgent.server: cluster leadership acquired 31:52.948 [INFO] TestAgent.server: New leader elected: payload=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:52.972 [INFO] TestAgent.server: initializing acls 31:52.982 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:52.982 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:53.004 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:53.007 [INFO] TestAgent.server: initializing acls 31:53.007 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:53.033 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:53.033 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:53.033 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:53.033 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:53.033 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-279fd5b9-4b89-4f43-ad54-466fb339bf93.dc1 31:53.033 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93.dc1 area=wan 31:53.034 [INFO] TestAgent.server: Updating LAN server: server="Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 (Addr: tcp/127.0.0.1:29972) (DC: dc1)" 31:53.044 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:53.044 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:53.044 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:53.044 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-279fd5b9-4b89-4f43-ad54-466fb339bf93.dc1 31:53.044 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93.dc1 area=wan 31:53.044 [INFO] TestAgent.server: Updating LAN server: server="Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 (Addr: tcp/127.0.0.1:29972) (DC: dc1)" 31:53.089 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:53.200 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:53.200 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:53.200 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:53.200 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:53.200 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:53.200 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:53.200 [INFO] TestAgent.server: member joined, marking health alive: member=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:53.208 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:53.208 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:53.224 [INFO] TestAgent.server: federation state anti-entropy synced 31:53.248 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:53.268 [INFO] TestAgent: Synced node info 31:53.294 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-279fd5b9-4b89-4f43-ad54-466fb339bf93 31:53.294 [INFO] TestAgent: Requesting shutdown 31:53.294 [INFO] TestAgent.server: shutting down server 31:53.294 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:53.294 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:53.294 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:53.294 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:53.294 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:53.294 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:53.294 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:53.295 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:53.295 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:53.295 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:53.295 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:53.295 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:53.295 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:53.295 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:53.304 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:53.310Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:53.310Z [INFO] agent.router.manager: shutting down 31:53.310 [INFO] TestAgent: consul server down 31:53.310 [INFO] TestAgent: shutdown complete 31:53.310 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29953 network=tcp 31:53.310 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29953 network=udp 31:53.310 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29968 network=tcp 31:53.811 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.811 [INFO] TestAgent: Endpoints down === RUN TestSnapshot_Options/GET#02 [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:52.811Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.811Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.836Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.836Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.886 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:36e1da33-7e4f-d50b-e24b-11de5dc1200d Address:127.0.0.1:30007}]" 31:52.887 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d.dc1 127.0.0.1 31:52.887 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 127.0.0.1 2021-10-05T16:31:52.887Z [INFO] agent.router: Initializing LAN area manager 31:52.887 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30009 network=udp 31:52.887 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30007 [Follower]" leader= 31:52.888 [INFO] TestAgent.server: Adding LAN server: server="Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d (Addr: tcp/127.0.0.1:30007) (DC: dc1)" 31:52.888 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d.dc1 area=wan 31:52.888 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30009 network=tcp 31:52.889 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30003 network=tcp 31:52.889 [INFO] TestAgent: started state syncer 31:52.889 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29966 network=tcp 31:52.940 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:52.956 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.956 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30007 [Candidate]" term=2 31:52.983 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.983 [DEBUG] TestAgent.server.raft: vote granted: from=36e1da33-7e4f-d50b-e24b-11de5dc1200d term=2 tally=1 31:52.983 [INFO] TestAgent.server.raft: election won: tally=1 31:52.983 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30007 [Leader]" 31:52.983 [INFO] TestAgent.server: cluster leadership acquired 31:52.983 [INFO] TestAgent.server: New leader elected: payload=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 31:52.993 [INFO] TestAgent.server: initializing acls 31:52.998 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:52.998 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:53.005 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:53.028 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:53.028 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:53.028 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:53.029 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 31:53.029 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d.dc1 31:53.029 [INFO] TestAgent.server: Updating LAN server: server="Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d (Addr: tcp/127.0.0.1:30007) (DC: dc1)" 31:53.029 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d.dc1 area=wan 31:53.070 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:53.167 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:53.167 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:53.167 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:53.167 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:53.167 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:53.167 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 31:53.167 [INFO] TestAgent.server: member joined, marking health alive: member=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 31:53.180 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 31:53.180 [INFO] TestAgent.server: federation state anti-entropy synced 31:53.196 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 31:53.196 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-36e1da33-7e4f-d50b-e24b-11de5dc1200d 31:53.232 [INFO] TestAgent: Synced node info 31:53.248 [INFO] TestAgent: Synced service: service=test-id 31:53.248 [DEBUG] TestAgent: Check in sync: check=service:test-id 31:53.269 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:53.269 [DEBUG] TestAgent: Node info in sync 31:53.269 [DEBUG] TestAgent: Service in sync: service=test-id 31:53.269 [DEBUG] TestAgent: Check in sync: check=service:test-id 31:53.269 [DEBUG] TestAgent: Node info in sync 31:53.269 [DEBUG] TestAgent: Service in sync: service=test-id 31:53.269 [DEBUG] TestAgent: Check in sync: check=service:test-id 31:53.315 [INFO] TestAgent: Requesting shutdown 31:53.315 [INFO] TestAgent.server: shutting down server 31:53.315 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:53.315 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:53.315 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:53.315 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:53.315 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:53.315 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:53.315 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:53.315 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:53.315 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:53.315 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:53.315 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:53.315 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:53.315 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:53.315 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:53.326 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:53.332Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:53.332Z [INFO] agent.router.manager: shutting down 31:53.332 [INFO] TestAgent: consul server down 31:53.332 [INFO] TestAgent: shutdown complete 31:53.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30009 network=tcp 31:53.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30009 network=udp 31:53.332 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30003 network=tcp 31:53.832 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.832 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectCALeafCert_aclServiceWrite (1.06s) === CONT TestAgent_TokenTriggersFullSync === RUN TestAgent_TokenTriggersFullSync/acl_agent_token 2021-10-05T16:31:53.142Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:53.183Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:53.231 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b Address:127.0.0.1:30049}]" 31:53.232 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30049 [Follower]" leader= 31:53.233 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b.dc1 127.0.0.1 31:53.233 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b 127.0.0.1 2021-10-05T16:31:53.233Z [INFO] agent.router: Initializing LAN area manager 31:53.234 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30044 network=udp 31:53.234 [INFO] TestAgent.server: Adding LAN server: server="Node-ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b (Addr: tcp/127.0.0.1:30049) (DC: dc1)" 31:53.234 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b.dc1 area=wan 31:53.234 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30044 network=tcp 31:53.235 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30045 network=tcp 31:53.235 [INFO] TestAgent: started state syncer 31:53.235 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30015 network=tcp 31:53.286 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:53.286 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30049 [Candidate]" term=2 31:53.310 [DEBUG] TestAgent.server.raft: votes: needed=1 31:53.310 [DEBUG] TestAgent.server.raft: vote granted: from=ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b term=2 tally=1 31:53.310 [INFO] TestAgent.server.raft: election won: tally=1 31:53.310 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30049 [Leader]" 31:53.312 [INFO] TestAgent.server: cluster leadership acquired 31:53.312 [INFO] TestAgent.server: New leader elected: payload=Node-ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b 31:53.318 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30049 31:53.324 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:53.324 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:53.324 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b 31:53.324 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ca7f8e96-3b7e-e67b-d0a1-9d16d1898d7b 31:53.346 [INFO] TestAgent.server: federation state anti-entropy synced 31:53.356 [INFO] TestAgent: Requesting shutdown 31:53.356 [INFO] TestAgent.server: shutting down server 31:53.356 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:53.356 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:53.356 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:53.356 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:53.356 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:53.356 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:53.356 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:53.365 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:53.376Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:53.376Z [INFO] agent.router.manager: shutting down 31:53.376 [INFO] TestAgent: consul server down 31:53.376 [INFO] TestAgent: shutdown complete 31:53.376 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30044 network=tcp 31:53.376 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30044 network=udp 31:53.376 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30045 network=tcp 31:53.876 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.876 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectCARoots_empty (0.80s) === CONT TestAgent_Monitor_ACLDeny 2021-10-05T16:31:52.891Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.891Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.926Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:52.926Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:53.020 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6fbdaa14-e7b7-0a41-7f91-df93135da507 Address:127.0.0.1:30056}]" 31:53.020 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30056 [Follower]" leader= 31:53.024 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6fbdaa14-e7b7-0a41-7f91-df93135da507.dc1 127.0.0.1 31:53.025 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 127.0.0.1 2021-10-05T16:31:53.025Z [INFO] agent.router: Initializing LAN area manager 31:53.025 [INFO] TestAgent.server: Adding LAN server: server="Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 (Addr: tcp/127.0.0.1:30056) (DC: dc1)" 31:53.025 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30051 network=udp 31:53.025 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507.dc1 area=wan 31:53.025 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30051 network=tcp 31:53.026 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30052 network=tcp 31:53.026 [INFO] TestAgent: started state syncer 31:53.026 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30057 network=tcp 31:53.062 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:53.062 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30056 [Candidate]" term=2 31:53.075 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:53.124 [DEBUG] TestAgent.server.raft: votes: needed=1 31:53.124 [DEBUG] TestAgent.server.raft: vote granted: from=6fbdaa14-e7b7-0a41-7f91-df93135da507 term=2 tally=1 31:53.124 [INFO] TestAgent.server.raft: election won: tally=1 31:53.124 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30056 [Leader]" 31:53.128 [INFO] TestAgent.server: cluster leadership acquired 31:53.128 [INFO] TestAgent.server: New leader elected: payload=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.158 [INFO] TestAgent.server: initializing acls 31:53.166 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:53.166 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:53.176 [INFO] TestAgent.server: initializing acls 31:53.176 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:53.206 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:53.208 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:53.216 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:53.216 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:53.216 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:53.216 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:53.216 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.216 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-6fbdaa14-e7b7-0a41-7f91-df93135da507.dc1 31:53.216 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507.dc1 area=wan 31:53.216 [INFO] TestAgent.server: Updating LAN server: server="Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 (Addr: tcp/127.0.0.1:30056) (DC: dc1)" 31:53.222 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:53.222 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.223 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-6fbdaa14-e7b7-0a41-7f91-df93135da507.dc1 31:53.223 [INFO] TestAgent.server: Updating LAN server: server="Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 (Addr: tcp/127.0.0.1:30056) (DC: dc1)" 31:53.223 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507.dc1 area=wan 31:53.256 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:53.320 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:53.320 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:53.320 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:53.320 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:53.320 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:53.320 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.320 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.338 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.338 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.346 [INFO] TestAgent.server: federation state anti-entropy synced 31:53.364 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-6fbdaa14-e7b7-0a41-7f91-df93135da507 31:53.389 [INFO] TestAgent: Synced node info 31:53.397 [INFO] TestAgent: Synced service: service=test-id 31:53.397 [DEBUG] TestAgent: Check in sync: check=service:test-id 31:53.400 [INFO] TestAgent: Requesting shutdown 31:53.400 [INFO] TestAgent.server: shutting down server 31:53.400 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:53.400 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:53.400 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:53.400 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:53.400 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:53.400 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:53.400 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:53.400 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:53.400 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:53.401 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:53.401 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:53.401 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:53.401 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:53.401 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:53.401 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:53.404 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:53.410Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:53.410Z [INFO] agent.router.manager: shutting down 31:53.410 [INFO] TestAgent: consul server down 31:53.410 [INFO] TestAgent: shutdown complete 31:53.410 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30051 network=tcp 31:53.410 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30051 network=udp 31:53.410 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30052 network=tcp 31:53.912 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.912 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectCALeafCert_aclDefaultDeny (1.05s) === CONT TestAgent_Monitor 2021-10-05T16:31:52.618Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.664Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.730 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d7cda1b4-bd7c-069b-7f6e-e521f053213b Address:127.0.0.1:29965}]" 31:52.732 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29965 [Follower]" leader= 31:52.733 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b.dc1 127.0.0.1 31:52.734 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b 127.0.0.1 2021-10-05T16:31:52.734Z [INFO] agent.router: Initializing LAN area manager 31:52.735 [INFO] TestAgent.server: Adding LAN server: server="Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b (Addr: tcp/127.0.0.1:29965) (DC: dc1)" 31:52.735 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b.dc1 area=wan 31:52.735 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29960 network=udp 31:52.735 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29960 network=tcp 31:52.737 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29961 network=tcp 31:52.737 [INFO] TestAgent: started state syncer 31:52.738 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29994 network=tcp 31:52.794 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.794 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29965 [Candidate]" term=2 31:52.805 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.805 [DEBUG] TestAgent.server.raft: vote granted: from=d7cda1b4-bd7c-069b-7f6e-e521f053213b term=2 tally=1 31:52.805 [INFO] TestAgent.server.raft: election won: tally=1 31:52.805 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29965 [Leader]" 31:52.805 [INFO] TestAgent.server: cluster leadership acquired 31:52.806 [INFO] TestAgent.server: New leader elected: payload=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b 31:52.817 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29965 31:52.843 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.890 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.890 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:52.890 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:52.890 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:52.890 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:52.890 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b 31:52.890 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b 31:52.904 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:53564 31:52.908 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 127.0.0.1 31:52.908 [INFO] TestAgent.server: Adding LAN server: server="Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 (Addr: tcp/127.0.0.1:29958) (DC: dc1)" 31:52.908 [INFO] TestAgent.server: New leader elected: payload=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 31:52.908 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 other=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b 31:52.909 [INFO] TestAgent.server: member joined, marking health alive: member=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 31:52.909 [INFO] TestAgent: Requesting shutdown 31:52.909 [INFO] TestAgent.server: shutting down server 31:52.909 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:52.909 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:52.909 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:52.909 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:52.909 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:52.910 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:52.910 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:52.910 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:52.910 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:52.916 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:37910 31:52.916 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-789ce253-6eeb-34cf-ec33-df7b2222dd81.dc1 127.0.0.1:29957 31:52.916 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-789ce253-6eeb-34cf-ec33-df7b2222dd81.dc1 127.0.0.1 31:52.917 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81.dc1 area=wan 31:52.917 [DEBUG] TestAgent.server: Successfully performed flood-join for server at address: server=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81.dc1 address=127.0.0.1:29957 31:52.918 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:52.923 [INFO] TestAgent.server: federation state anti-entropy synced 31:52.923 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:31:52.932Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:52.932Z [INFO] agent.router.manager: shutting down 31:52.932 [INFO] TestAgent: consul server down 31:52.932 [INFO] TestAgent: shutdown complete 31:52.932 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29960 network=tcp 31:52.932 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29960 network=udp 31:52.932 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29961 network=tcp 31:53.432 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.432 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:52.211Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.223Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.281 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:789ce253-6eeb-34cf-ec33-df7b2222dd81 Address:127.0.0.1:29958}]" 31:52.282 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-789ce253-6eeb-34cf-ec33-df7b2222dd81.dc1 127.0.0.1 31:52.283 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 127.0.0.1 2021-10-05T16:31:52.283Z [INFO] agent.router: Initializing LAN area manager 31:52.283 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30016 network=udp 31:52.283 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29958 [Follower]" leader= 31:52.283 [INFO] TestAgent.server: Adding LAN server: server="Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 (Addr: tcp/127.0.0.1:29958) (DC: dc1)" 31:52.283 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81.dc1 area=wan 31:52.283 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30016 network=tcp 31:52.284 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29954 network=tcp 31:52.284 [INFO] TestAgent: started state syncer 31:52.284 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30008 network=tcp 31:52.327 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.327 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29958 [Candidate]" term=2 31:52.344 [DEBUG] TestAgent.server.raft: votes: needed=1 31:52.344 [DEBUG] TestAgent.server.raft: vote granted: from=789ce253-6eeb-34cf-ec33-df7b2222dd81 term=2 tally=1 31:52.344 [INFO] TestAgent.server.raft: election won: tally=1 31:52.344 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29958 [Leader]" 31:52.345 [INFO] TestAgent.server: cluster leadership acquired 31:52.345 [INFO] TestAgent.server: New leader elected: payload=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 31:52.355 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29958 31:52.370 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.398 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.398 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:52.398 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:52.398 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:52.398 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:52.398 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 31:52.398 [INFO] TestAgent.server: member joined, marking health alive: member=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 31:52.436 [INFO] TestAgent.server: federation state anti-entropy synced 31:52.604 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:52.607 [INFO] TestAgent: Synced node info 31:52.607 [DEBUG] TestAgent: Node info in sync 31:52.903 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:29963] 31:52.904 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:29963 31:52.909 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b 127.0.0.1 31:52.909 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 31:52.909 [DEBUG] TestAgent: systemd notify failed: error="No socket" 31:52.909 [INFO] TestAgent.server: Adding LAN server: server="Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b (Addr: tcp/127.0.0.1:29965) (DC: dc1)" 31:52.909 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b other=Node-789ce253-6eeb-34cf-ec33-df7b2222dd81 31:52.909 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b 31:52.916 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b.dc1 127.0.0.1:29964 31:52.916 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:54382 31:52.917 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b.dc1 127.0.0.1 31:52.917 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b.dc1 area=wan 31:52.917 [DEBUG] TestAgent.server: Successfully performed flood-join for server at address: server=Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b.dc1 address=127.0.0.1:29964 31:53.432 [INFO] TestAgent: Requesting shutdown 31:53.432 [INFO] TestAgent.server: shutting down server 31:53.432 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:53.432 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:53.432 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:53.432 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:53.433 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:53.433 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:53.433 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:53.433 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:53.433 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:53.433 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:53.439 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:53.445Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:53.445Z [INFO] agent.router.manager: shutting down 31:53.445 [INFO] TestAgent: consul server down 31:53.445 [INFO] TestAgent: shutdown complete 31:53.445 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30016 network=tcp 31:53.445 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30016 network=udp 31:53.445 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29954 network=tcp 31:53.788 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-d7cda1b4-bd7c-069b-7f6e-e521f053213b (timeout reached) 31:53.948 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.948 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Join (1.75s) === CONT TestAgent_RegisterCheck_Service 2021-10-05T16:31:52.994Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:53.009Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:53.087 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d2664cf1-33f1-9a7f-7739-dd43884819eb Address:127.0.0.1:30042}]" 31:53.088 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30042 [Follower]" leader= 31:53.088 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d2664cf1-33f1-9a7f-7739-dd43884819eb.dc1 127.0.0.1 31:53.088 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d2664cf1-33f1-9a7f-7739-dd43884819eb 127.0.0.1 2021-10-05T16:31:53.088Z [INFO] agent.router: Initializing LAN area manager 31:53.089 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30037 network=udp 31:53.089 [INFO] TestAgent.server: Adding LAN server: server="Node-d2664cf1-33f1-9a7f-7739-dd43884819eb (Addr: tcp/127.0.0.1:30042) (DC: dc1)" 31:53.089 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d2664cf1-33f1-9a7f-7739-dd43884819eb.dc1 area=wan 31:53.089 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30037 network=tcp 31:53.090 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30038 network=tcp 31:53.090 [INFO] TestAgent: started state syncer 31:53.090 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30064 network=tcp 31:53.152 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:53.152 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30042 [Candidate]" term=2 31:53.208 [DEBUG] TestAgent.server.raft: votes: needed=1 31:53.208 [DEBUG] TestAgent.server.raft: vote granted: from=d2664cf1-33f1-9a7f-7739-dd43884819eb term=2 tally=1 31:53.208 [INFO] TestAgent.server.raft: election won: tally=1 31:53.208 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30042 [Leader]" 31:53.208 [INFO] TestAgent.server: cluster leadership acquired 31:53.208 [INFO] TestAgent.server: New leader elected: payload=Node-d2664cf1-33f1-9a7f-7739-dd43884819eb 31:53.233 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30042 31:53.284 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:53.342 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:53.342 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:53.342 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:53.342 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:53.342 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:53.342 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d2664cf1-33f1-9a7f-7739-dd43884819eb 31:53.342 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d2664cf1-33f1-9a7f-7739-dd43884819eb 31:53.354 [INFO] TestAgent.server: federation state anti-entropy synced 31:53.383 [DEBUG] connect.ca.consul: consul CA provider configured: id=0a:20:1f:5b:13:04:ac:12:64:a5:0e:ad:7e:a0:58:c0:c0:18:66:16:14:5e:e7:6a:9d:ad:65:c2:ce:15:a4:a7 is_primary=true 31:53.424 [INFO] TestAgent.server.connect: CA rotated to new root under provider: provider=consul 31:53.439 [DEBUG] connect.ca.consul: consul CA provider configured: id=bf:97:30:14:95:aa:2b:be:43:eb:9d:c1:5f:54:ca:eb:27:9f:c3:9e:de:58:b4:86:e7:5a:86:f8:59:81:2b:97 is_primary=true 31:53.464 [INFO] TestAgent.server.connect: CA rotated to new root under provider: provider=consul 31:53.465 [INFO] TestAgent: Requesting shutdown 31:53.465 [INFO] TestAgent.server: shutting down server 31:53.465 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:53.465 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:53.465 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:53.465 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:53.465 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:53.465 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:53.465 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:53.465 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:53.465 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:53.465 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:53.465 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:53.471 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:53.478Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:53.478Z [INFO] agent.router.manager: shutting down 31:53.478 [INFO] TestAgent: consul server down 31:53.478 [INFO] TestAgent: shutdown complete 31:53.478 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30037 network=tcp 31:53.478 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30037 network=udp 31:53.478 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30038 network=tcp 31:53.978 [INFO] TestAgent: Waiting for endpoints to shut down 31:53.978 [INFO] TestAgent: Endpoints down --- PASS: TestAgentConnectCARoots_list (1.00s) === CONT TestAgent_NodeMaintenance_ACLDeny [WARN] freeport: 10 out of 52 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_Monitor/unknown_log_level === RUN TestAgent_Monitor/stream_unstructured_logs [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_Token/bad_token_name === RUN TestAgent_Token/bad_JSON === RUN TestAgent_Token/set_user_legacy === RUN TestAgent_Token/set_default === RUN TestAgent_Token/set_agent_legacy === RUN TestAgent_Token/set_agent === RUN TestAgent_Token/set_master_legacy === RUN TestAgent_Token/set_master_ === RUN TestAgent_Token/set_repl_legacy === RUN TestAgent_Token/set_repl === RUN TestAgent_Token/clear_user_legacy === RUN TestAgent_Token/clear_default === RUN TestAgent_Token/clear_agent_legacy === RUN TestAgent_Token/clear_agent === RUN TestAgent_Token/clear_master_legacy === RUN TestAgent_Token/clear_master === RUN TestAgent_Token/clear_repl_legacy === RUN TestAgent_Token/clear_repl === RUN TestAgent_Token/permission_denied === RUN TestAgent_Monitor/stream_JSON_logs === RUN TestAgent_NodeMaintenance_ACLDeny/no_token === RUN TestAgent_NodeMaintenance_ACLDeny/root_token === RUN TestAgent_Monitor/serf_shutdown_logging [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:53.786Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.786Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:53.830Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.830Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:53.942 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8db302a7-a9f4-4748-6339-a3969d057942 Address:127.0.0.1:30112}]" 31:53.943 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8db302a7-a9f4-4748-6339-a3969d057942.dc1 127.0.0.1 31:53.943 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8db302a7-a9f4-4748-6339-a3969d057942 127.0.0.1 2021-10-05T16:31:53.943Z [INFO] agent.router: Initializing LAN area manager 31:53.943 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30030 network=udp 31:53.943 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30112 [Follower]" leader= 31:53.944 [INFO] TestAgent.server: Adding LAN server: server="Node-8db302a7-a9f4-4748-6339-a3969d057942 (Addr: tcp/127.0.0.1:30112) (DC: dc1)" 31:53.944 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30030 network=tcp 31:53.944 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8db302a7-a9f4-4748-6339-a3969d057942.dc1 area=wan 31:53.945 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30108 network=tcp 31:53.945 [INFO] TestAgent: started state syncer 31:53.945 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30036 network=tcp 31:53.994 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:54.000 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:54.000 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30112 [Candidate]" term=2 31:54.028 [DEBUG] TestAgent.server.raft: votes: needed=1 31:54.028 [DEBUG] TestAgent.server.raft: vote granted: from=8db302a7-a9f4-4748-6339-a3969d057942 term=2 tally=1 31:54.028 [INFO] TestAgent.server.raft: election won: tally=1 31:54.028 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30112 [Leader]" 31:54.029 [INFO] TestAgent.server: cluster leadership acquired 31:54.029 [INFO] TestAgent.server: New leader elected: payload=Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.043 [INFO] TestAgent.server: initializing acls 31:54.053 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:54.053 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.067 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:54.071 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:54.094 [INFO] TestAgent.server: initializing acls 31:54.094 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.098 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.098 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:54.098 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:54.098 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.098 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8db302a7-a9f4-4748-6339-a3969d057942.dc1 31:54.099 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8db302a7-a9f4-4748-6339-a3969d057942.dc1 area=wan 31:54.099 [INFO] TestAgent.server: Updating LAN server: server="Node-8db302a7-a9f4-4748-6339-a3969d057942 (Addr: tcp/127.0.0.1:30112) (DC: dc1)" 31:54.106 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.106 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:54.107 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.107 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8db302a7-a9f4-4748-6339-a3969d057942.dc1 31:54.107 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8db302a7-a9f4-4748-6339-a3969d057942.dc1 area=wan 31:54.107 [INFO] TestAgent.server: Updating LAN server: server="Node-8db302a7-a9f4-4748-6339-a3969d057942 (Addr: tcp/127.0.0.1:30112) (DC: dc1)" 31:54.130 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:54.167 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:54.167 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:54.167 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:54.167 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:54.167 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:54.167 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.167 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.189 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.189 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.201 [INFO] TestAgent.server: federation state anti-entropy synced 31:54.350 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.350 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8db302a7-a9f4-4748-6339-a3969d057942 31:54.353 [INFO] TestAgent: Updated agent's ACL token: token=acl_token 31:54.354 [INFO] TestAgent: Updated agent's ACL token: token=default 31:54.354 [INFO] TestAgent: Updated agent's ACL token: token=acl_agent_token 31:54.354 [INFO] TestAgent: Updated agent's ACL token: token=agent 31:54.354 [INFO] TestAgent: Updated agent's ACL token: token=acl_agent_master_token 31:54.354 [INFO] TestAgent: Updated agent's ACL token: token=agent_master 31:54.354 [INFO] TestAgent: Updated agent's ACL token: token=acl_replication_token 31:54.355 [INFO] TestAgent: Updated agent's ACL token: token=replication 31:54.355 [INFO] TestAgent: Updated agent's ACL token: token=acl_token 31:54.355 [INFO] TestAgent: Updated agent's ACL token: token=default 31:54.355 [INFO] TestAgent: Updated agent's ACL token: token=acl_agent_token 31:54.357 [INFO] TestAgent: Updated agent's ACL token: token=agent 31:54.357 [INFO] TestAgent: Updated agent's ACL token: token=acl_agent_master_token 31:54.358 [INFO] TestAgent: Updated agent's ACL token: token=agent_master 31:54.358 [INFO] TestAgent: Updated agent's ACL token: token=acl_replication_token 31:54.358 [INFO] TestAgent: Updated agent's ACL token: token=replication 31:54.358 [INFO] TestAgent: Requesting shutdown 31:54.358 [INFO] TestAgent.server: shutting down server 31:54.358 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.358 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:54.358 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:54.358 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.358 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.358 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.358 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:54.359 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:54.359 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.359 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:54.359 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:54.359 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.360 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:54.360 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.371 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:54.373Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:54.373Z [INFO] agent.router.manager: shutting down 31:54.373 [INFO] TestAgent: consul server down 31:54.373 [INFO] TestAgent: shutdown complete 31:54.373 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30030 network=tcp 31:54.373 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30030 network=udp 31:54.373 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30108 network=tcp 31:54.876 [INFO] TestAgent: Waiting for endpoints to shut down 31:54.876 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Token (1.14s) --- PASS: TestAgent_Token/bad_token_name (0.00s) --- PASS: TestAgent_Token/bad_JSON (0.00s) --- PASS: TestAgent_Token/set_user_legacy (0.00s) --- PASS: TestAgent_Token/set_default (0.00s) --- PASS: TestAgent_Token/set_agent_legacy (0.00s) --- PASS: TestAgent_Token/set_agent (0.00s) --- PASS: TestAgent_Token/set_master_legacy (0.00s) --- PASS: TestAgent_Token/set_master_ (0.00s) --- PASS: TestAgent_Token/set_repl_legacy (0.00s) --- PASS: TestAgent_Token/set_repl (0.00s) --- PASS: TestAgent_Token/clear_user_legacy (0.00s) --- PASS: TestAgent_Token/clear_default (0.00s) --- PASS: TestAgent_Token/clear_agent_legacy (0.00s) --- PASS: TestAgent_Token/clear_agent (0.00s) --- PASS: TestAgent_Token/clear_master_legacy (0.00s) --- PASS: TestAgent_Token/clear_master (0.00s) --- PASS: TestAgent_Token/clear_repl_legacy (0.00s) --- PASS: TestAgent_Token/clear_repl (0.00s) --- PASS: TestAgent_Token/permission_denied (0.00s) === CONT TestAgent_NodeMaintenance_Disable 2021-10-05T16:31:53.857Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.857Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:53.905Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.905Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:53.982 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8f491f49-49cb-5b2e-a251-1e913962dcf7 Address:127.0.0.1:30063}]" 31:53.982 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30063 [Follower]" leader= 31:53.983 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8f491f49-49cb-5b2e-a251-1e913962dcf7.dc1 127.0.0.1 31:53.983 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 127.0.0.1 2021-10-05T16:31:53.983Z [INFO] agent.router: Initializing LAN area manager 31:53.984 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8f491f49-49cb-5b2e-a251-1e913962dcf7.dc1 area=wan 31:53.984 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30023 network=udp 31:53.984 [INFO] TestAgent.server: Adding LAN server: server="Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 (Addr: tcp/127.0.0.1:30063) (DC: dc1)" 31:53.984 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30023 network=tcp 31:53.984 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30059 network=tcp 31:53.984 [INFO] TestAgent: started state syncer 31:53.984 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30106 network=tcp 31:54.028 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:54.029 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30063 [Candidate]" term=2 31:54.034 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:54.058 [DEBUG] TestAgent.server.raft: votes: needed=1 31:54.058 [DEBUG] TestAgent.server.raft: vote granted: from=8f491f49-49cb-5b2e-a251-1e913962dcf7 term=2 tally=1 31:54.058 [INFO] TestAgent.server.raft: election won: tally=1 31:54.058 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30063 [Leader]" 31:54.058 [INFO] TestAgent.server: cluster leadership acquired 31:54.058 [INFO] TestAgent.server: New leader elected: payload=Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 31:54.077 [INFO] TestAgent.server: initializing acls 31:54.093 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:54.093 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.105 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:54.124 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.124 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:54.124 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:54.124 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 31:54.124 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8f491f49-49cb-5b2e-a251-1e913962dcf7.dc1 31:54.124 [INFO] TestAgent.server: Updating LAN server: server="Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 (Addr: tcp/127.0.0.1:30063) (DC: dc1)" 31:54.125 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8f491f49-49cb-5b2e-a251-1e913962dcf7.dc1 area=wan 31:54.144 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:54.202 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:54.202 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:54.202 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:54.202 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:54.202 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:54.202 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 31:54.202 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 31:54.216 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 31:54.222 [INFO] TestAgent.server: federation state anti-entropy synced 31:54.368 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8f491f49-49cb-5b2e-a251-1e913962dcf7 31:54.368 [INFO] TestAgent.server.fsm: snapshot created: duration=54.406µs 31:54.368 [INFO] TestAgent.server.raft: starting snapshot up to: index=14 31:54.368 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshot_Options_GET#02-TestAgent-agent138019399/raft/snapshots/2-14-1633451514368.tmp 31:54.448 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:54.496 [INFO] TestAgent: Synced node info 31:54.496 [DEBUG] TestAgent: Node info in sync 31:54.508 [INFO] TestAgent.server.raft: snapshot complete up to: index=14 31:54.540 [INFO] TestAgent: Requesting shutdown 31:54.541 [INFO] TestAgent.server: shutting down server 31:54.541 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:54.541 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.541 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.541 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.541 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.541 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:54.541 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:54.541 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:54.541 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.541 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:54.541 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.541 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.541 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:54.541 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:54.546 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:54.547Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:54.547Z [INFO] agent.router.manager: shutting down 31:54.547 [INFO] TestAgent: consul server down 31:54.547 [INFO] TestAgent: shutdown complete 31:54.547 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30023 network=tcp 31:54.547 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30023 network=udp 31:54.547 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30059 network=tcp 31:55.048 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.048 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:53.911Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.911Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:53.954Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.954Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:54.051 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:376a3752-3096-e38e-f647-25c6a9ada849 Address:127.0.0.1:30098}]" 31:54.052 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30098 [Follower]" leader= 31:54.052 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-376a3752-3096-e38e-f647-25c6a9ada849.dc1 127.0.0.1 31:54.052 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-376a3752-3096-e38e-f647-25c6a9ada849 127.0.0.1 2021-10-05T16:31:54.053Z [INFO] agent.router: Initializing LAN area manager 31:54.053 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30114 network=udp 31:54.053 [INFO] TestAgent.server: Adding LAN server: server="Node-376a3752-3096-e38e-f647-25c6a9ada849 (Addr: tcp/127.0.0.1:30098) (DC: dc1)" 31:54.053 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-376a3752-3096-e38e-f647-25c6a9ada849.dc1 area=wan 31:54.053 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30114 network=tcp 31:54.053 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30094 network=tcp 31:54.054 [INFO] TestAgent: started state syncer 31:54.054 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30099 network=tcp 31:54.088 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:54.088 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30098 [Candidate]" term=2 31:54.103 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:54.114 [DEBUG] TestAgent.server.raft: votes: needed=1 31:54.114 [DEBUG] TestAgent.server.raft: vote granted: from=376a3752-3096-e38e-f647-25c6a9ada849 term=2 tally=1 31:54.115 [INFO] TestAgent.server.raft: election won: tally=1 31:54.115 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30098 [Leader]" 31:54.115 [INFO] TestAgent.server: cluster leadership acquired 31:54.115 [INFO] TestAgent.server: New leader elected: payload=Node-376a3752-3096-e38e-f647-25c6a9ada849 31:54.132 [INFO] TestAgent.server: initializing acls 31:54.137 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:54.137 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.158 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:54.180 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.180 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:54.180 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:54.180 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-376a3752-3096-e38e-f647-25c6a9ada849 31:54.180 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-376a3752-3096-e38e-f647-25c6a9ada849.dc1 31:54.181 [INFO] TestAgent.server: Updating LAN server: server="Node-376a3752-3096-e38e-f647-25c6a9ada849 (Addr: tcp/127.0.0.1:30098) (DC: dc1)" 31:54.181 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-376a3752-3096-e38e-f647-25c6a9ada849.dc1 area=wan 31:54.247 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:54.247 [INFO] TestAgent: Synced node info 31:54.247 [DEBUG] TestAgent: Node info in sync 31:54.284 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:54.284 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:54.284 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:54.284 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:54.284 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:54.284 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-376a3752-3096-e38e-f647-25c6a9ada849 31:54.284 [INFO] TestAgent.server: member joined, marking health alive: member=Node-376a3752-3096-e38e-f647-25c6a9ada849 31:54.316 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-376a3752-3096-e38e-f647-25c6a9ada849 31:54.316 [INFO] TestAgent.server: federation state anti-entropy synced 31:54.508 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-376a3752-3096-e38e-f647-25c6a9ada849 31:54.508 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-376a3752-3096-e38e-f647-25c6a9ada849 31:54.508 [INFO] TestAgent: Requesting shutdown 31:54.508 [INFO] TestAgent.server: shutting down server 31:54.508 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:54.508 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.508 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.508 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.508 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.508 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:54.508 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:54.508 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:54.508 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.508 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:54.508 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.508 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.508 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:54.508 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:54.540 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:54.544Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:54.544Z [INFO] agent.router.manager: shutting down 31:54.544 [INFO] TestAgent: consul server down 31:54.544 [INFO] TestAgent: shutdown complete 31:54.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30114 network=tcp 31:54.544 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30114 network=udp 31:54.544 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30094 network=tcp 31:55.048 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.048 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Monitor_ACLDeny (1.17s) === CONT TestAgent_NodeMaintenance_Enable === RUN TestSnapshot_Options/PUT [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:53.866Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.866Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:53.905Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:53.905Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:53.990 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:36ee82cc-a1ce-c78b-0d38-918d729fc18a Address:127.0.0.1:30070}]" 31:53.991 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a.dc1 127.0.0.1 31:53.991 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 127.0.0.1 2021-10-05T16:31:53.991Z [INFO] agent.router: Initializing LAN area manager 31:53.991 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30070 [Follower]" leader= 31:53.991 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30093 network=udp 31:53.992 [INFO] TestAgent.server: Adding LAN server: server="Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a (Addr: tcp/127.0.0.1:30070) (DC: dc1)" 31:53.992 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a.dc1 area=wan 31:53.992 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30093 network=tcp 31:53.992 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30066 network=tcp 31:53.993 [INFO] TestAgent: started state syncer 31:53.993 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30113 network=tcp 31:54.034 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:54.034 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30070 [Candidate]" term=2 31:54.042 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:54.063 [DEBUG] TestAgent.server.raft: votes: needed=1 31:54.063 [DEBUG] TestAgent.server.raft: vote granted: from=36ee82cc-a1ce-c78b-0d38-918d729fc18a term=2 tally=1 31:54.063 [INFO] TestAgent.server.raft: election won: tally=1 31:54.063 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30070 [Leader]" 31:54.064 [INFO] TestAgent.server: cluster leadership acquired 31:54.064 [INFO] TestAgent.server: New leader elected: payload=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.088 [INFO] TestAgent.server: initializing acls 31:54.095 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:54.095 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.120 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:54.143 [INFO] TestAgent.server: initializing acls 31:54.143 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.152 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.152 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:54.152 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:54.152 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.152 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a.dc1 31:54.152 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a.dc1 area=wan 31:54.153 [INFO] TestAgent.server: Updating LAN server: server="Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a (Addr: tcp/127.0.0.1:30070) (DC: dc1)" 31:54.185 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.185 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:54.185 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.185 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a.dc1 31:54.185 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a.dc1 area=wan 31:54.185 [INFO] TestAgent.server: Updating LAN server: server="Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a (Addr: tcp/127.0.0.1:30070) (DC: dc1)" 31:54.224 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:54.284 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:54.284 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:54.284 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:54.284 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:54.284 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:54.284 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.284 [INFO] TestAgent.server: member joined, marking health alive: member=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.301 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.301 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.316 [INFO] TestAgent.server: federation state anti-entropy synced 31:54.321 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-36ee82cc-a1ce-c78b-0d38-918d729fc18a 31:54.335 [INFO] TestAgent: Updated agent's ACL token: token=acl_agent_token 31:54.491 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 31:54.525 [INFO] TestAgent: Synced node info 31:54.545 [INFO] TestAgent: Requesting shutdown 31:54.545 [INFO] TestAgent.server: shutting down server 31:54.545 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.545 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.545 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.545 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:54.545 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:54.545 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.545 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:54.545 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:54.545 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.545 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.545 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.545 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:54.545 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:54.545 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:54.568 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:54.572Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:54.572Z [INFO] agent.router.manager: shutting down 31:54.573 [INFO] TestAgent: consul server down 31:54.573 [INFO] TestAgent: shutdown complete 31:54.573 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30093 network=tcp 31:54.573 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30093 network=udp 31:54.573 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30066 network=tcp 31:55.073 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.073 [INFO] TestAgent: Endpoints down === RUN TestAgent_TokenTriggersFullSync/agent 2021-10-05T16:31:54.005Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:54.005Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:54.029Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:54.029Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:54.110 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 Address:127.0.0.1:30035}]" 31:54.111 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30035 [Follower]" leader= 31:54.111 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1.dc1 127.0.0.1 31:54.112 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 127.0.0.1 2021-10-05T16:31:54.112Z [INFO] agent.router: Initializing LAN area manager 31:54.112 [INFO] TestAgent.server: Adding LAN server: server="Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 (Addr: tcp/127.0.0.1:30035) (DC: dc1)" 31:54.112 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1.dc1 area=wan 31:54.112 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30058 network=tcp 31:54.112 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30058 network=udp 31:54.113 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30031 network=tcp 31:54.113 [INFO] TestAgent: started state syncer 31:54.113 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30137 network=tcp 31:54.163 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:54.171 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:54.171 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30035 [Candidate]" term=2 31:54.202 [DEBUG] TestAgent.server.raft: votes: needed=1 31:54.202 [DEBUG] TestAgent.server.raft: vote granted: from=3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 term=2 tally=1 31:54.202 [INFO] TestAgent.server.raft: election won: tally=1 31:54.202 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30035 [Leader]" 31:54.202 [INFO] TestAgent.server: cluster leadership acquired 31:54.202 [INFO] TestAgent.server: New leader elected: payload=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.228 [INFO] TestAgent.server: initializing acls 31:54.242 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:54.242 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.256 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:54.264 [INFO] TestAgent.server: initializing acls 31:54.264 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:54.282 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.282 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:54.282 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:54.283 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.283 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1.dc1 31:54.283 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1.dc1 area=wan 31:54.283 [INFO] TestAgent.server: Updating LAN server: server="Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 (Addr: tcp/127.0.0.1:30035) (DC: dc1)" 31:54.312 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:54.312 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:54.313 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.313 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1.dc1 31:54.313 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1.dc1 area=wan 31:54.313 [INFO] TestAgent.server: Updating LAN server: server="Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 (Addr: tcp/127.0.0.1:30035) (DC: dc1)" 31:54.348 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:54.380 [INFO] TestAgent: Synced node info 31:54.474 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.475 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.487 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:54.487 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:54.487 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:54.487 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:54.487 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:54.487 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.487 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.509 [INFO] TestAgent: Node entered maintenance mode 31:54.509 [DEBUG] TestAgent: Node info in sync 31:54.536 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.536 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3e0cab74-004d-c4f1-9e1c-5a162c6dc3c1 31:54.552 [INFO] TestAgent: Synced check: check=_node_maintenance 31:54.552 [INFO] TestAgent: Requesting shutdown 31:54.552 [INFO] TestAgent.server: shutting down server 31:54.552 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:54.552 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:54.552 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.552 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.552 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.552 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.552 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:54.552 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:54.552 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:54.552 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.552 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.552 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:54.570 [INFO] TestAgent.server: federation state anti-entropy synced 31:54.570 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.572 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:54.576Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:54.576Z [INFO] agent.router.manager: shutting down 31:54.576 [INFO] TestAgent: consul server down 31:54.576 [INFO] TestAgent: shutdown complete 31:54.576 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30058 network=tcp 31:54.576 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30058 network=udp 31:54.576 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30031 network=tcp 31:55.076 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.076 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_NodeMaintenance_ACLDeny (1.11s) --- PASS: TestAgent_NodeMaintenance_ACLDeny/no_token (0.00s) --- PASS: TestAgent_NodeMaintenance_ACLDeny/root_token (0.08s) === CONT TestAgent_NodeMaintenance_BadRequest 2021-10-05T16:31:53.969Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:54.009Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:54.084 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a336161f-64d3-0ef7-9431-3fd30db145d0 Address:127.0.0.1:30014}]" 31:54.084 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30014 [Follower]" leader= 31:54.085 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a336161f-64d3-0ef7-9431-3fd30db145d0.dc1 127.0.0.1 31:54.086 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a336161f-64d3-0ef7-9431-3fd30db145d0 127.0.0.1 2021-10-05T16:31:54.086Z [INFO] agent.router: Initializing LAN area manager 31:54.087 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30072 network=udp 31:54.087 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a336161f-64d3-0ef7-9431-3fd30db145d0.dc1 area=wan 31:54.087 [INFO] TestAgent.server: Adding LAN server: server="Node-a336161f-64d3-0ef7-9431-3fd30db145d0 (Addr: tcp/127.0.0.1:30014) (DC: dc1)" 31:54.087 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30072 network=tcp 31:54.088 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30010 network=tcp 31:54.088 [INFO] TestAgent: started state syncer 31:54.088 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30043 network=tcp 31:54.153 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:54.153 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30014 [Candidate]" term=2 31:54.187 [DEBUG] TestAgent.server.raft: votes: needed=1 31:54.187 [DEBUG] TestAgent.server.raft: vote granted: from=a336161f-64d3-0ef7-9431-3fd30db145d0 term=2 tally=1 31:54.187 [INFO] TestAgent.server.raft: election won: tally=1 31:54.187 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30014 [Leader]" 31:54.188 [INFO] TestAgent.server: cluster leadership acquired 31:54.188 [INFO] TestAgent.server: New leader elected: payload=Node-a336161f-64d3-0ef7-9431-3fd30db145d0 31:54.204 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30014 31:54.241 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:54.316 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:54.316 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:54.316 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:54.316 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:54.316 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:54.316 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a336161f-64d3-0ef7-9431-3fd30db145d0 31:54.316 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a336161f-64d3-0ef7-9431-3fd30db145d0 31:54.339 [INFO] TestAgent.server: federation state anti-entropy synced 31:54.472 [INFO] TestAgent: Synced node info 31:54.532 [INFO] TestAgent: Synced service: service=memcache 31:54.532 [DEBUG] TestAgent: Check in sync: check=service:memcache 31:54.532 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:54.541 [INFO] TestAgent: Synced node info 31:54.549 [INFO] TestAgent: Synced service: service=memcache 31:54.549 [DEBUG] TestAgent: Check in sync: check=service:memcache 31:54.549 [DEBUG] TestAgent: Node info in sync 31:54.549 [DEBUG] TestAgent: Service in sync: service=memcache 31:54.549 [DEBUG] TestAgent: Check in sync: check=service:memcache 31:54.616 [DEBUG] TestAgent: Node info in sync 31:54.616 [DEBUG] TestAgent: Service in sync: service=memcache 31:54.616 [DEBUG] TestAgent: Check in sync: check=service:memcache 31:54.653 [INFO] TestAgent: Synced check: check=memcache_check2 31:54.653 [INFO] TestAgent: Requesting shutdown 31:54.653 [INFO] TestAgent.server: shutting down server 31:54.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.653 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.653 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.654 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:54.654 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:54.654 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.654 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.654 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.654 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:54.657 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:54.660Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:54.660Z [INFO] agent.router.manager: shutting down 31:54.668 [INFO] TestAgent: consul server down 31:54.668 [INFO] TestAgent: shutdown complete 31:54.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30072 network=tcp 31:54.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30072 network=udp 31:54.668 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30010 network=tcp 31:55.170 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.178 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterCheck_Service (1.23s) === CONT TestAgent_ServiceMaintenance_ACLDeny 2021-10-05T16:31:53.941Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:53.955Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:54.027 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:557d98be-24fe-7243-1db2-8fa8fd1a25fb Address:127.0.0.1:30126}]" 31:54.028 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-557d98be-24fe-7243-1db2-8fa8fd1a25fb.dc1 127.0.0.1 31:54.028 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30126 [Follower]" leader= 31:54.031 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-557d98be-24fe-7243-1db2-8fa8fd1a25fb 127.0.0.1 2021-10-05T16:31:54.031Z [INFO] agent.router: Initializing LAN area manager 31:54.031 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30107 network=udp 31:54.031 [INFO] TestAgent.server: Adding LAN server: server="Node-557d98be-24fe-7243-1db2-8fa8fd1a25fb (Addr: tcp/127.0.0.1:30126) (DC: dc1)" 31:54.031 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-557d98be-24fe-7243-1db2-8fa8fd1a25fb.dc1 area=wan 31:54.031 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30107 network=tcp 31:54.032 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30122 network=tcp 31:54.032 [INFO] TestAgent: started state syncer 31:54.032 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30071 network=tcp 31:54.076 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:54.076 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30126 [Candidate]" term=2 31:54.104 [DEBUG] TestAgent.server.raft: votes: needed=1 31:54.104 [DEBUG] TestAgent.server.raft: vote granted: from=557d98be-24fe-7243-1db2-8fa8fd1a25fb term=2 tally=1 31:54.104 [INFO] TestAgent.server.raft: election won: tally=1 31:54.104 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30126 [Leader]" 31:54.105 [INFO] TestAgent.server: cluster leadership acquired 31:54.106 [INFO] TestAgent.server: New leader elected: payload=Node-557d98be-24fe-7243-1db2-8fa8fd1a25fb 31:54.118 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30126 31:54.144 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:54.204 [INFO] TestAgent: Synced node info 31:54.204 [DEBUG] TestAgent: Node info in sync 31:54.215 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:54.215 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:54.215 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:54.215 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:54.215 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:54.216 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-557d98be-24fe-7243-1db2-8fa8fd1a25fb 31:54.216 [INFO] TestAgent.server: member joined, marking health alive: member=Node-557d98be-24fe-7243-1db2-8fa8fd1a25fb 31:54.232 [INFO] TestAgent.server: federation state anti-entropy synced 31:54.257 [DEBUG] TestAgent: Node info in sync 31:54.264 [INFO] TestAgent: Synced service: service=monitor 31:54.264 [DEBUG] TestAgent: Check in sync: check=service:monitor 31:54.443 [DEBUG] TestAgent: Node info in sync 31:54.469 [INFO] TestAgent: Synced service: service=monitor 31:54.469 [DEBUG] TestAgent: Check in sync: check=service:monitor 31:54.570 [INFO] TestAgent: Requesting shutdown 31:54.570 [INFO] TestAgent.server: shutting down server 31:54.570 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.570 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.570 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.570 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.570 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:54.570 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:54.570 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.570 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.570 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.570 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:54.588 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:54.590Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:54.590Z [INFO] agent.router.manager: shutting down 31:54.590 [INFO] TestAgent: consul server down 31:54.590 [INFO] TestAgent: shutdown complete 31:54.590 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30107 network=tcp 31:54.590 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30107 network=udp 31:54.590 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30122 network=tcp 31:55.092 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.092 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Monitor (1.28s) --- PASS: TestAgent_Monitor/unknown_log_level (0.00s) --- PASS: TestAgent_Monitor/stream_unstructured_logs (0.12s) --- PASS: TestAgent_Monitor/stream_JSON_logs (0.20s) --- PASS: TestAgent_Monitor/serf_shutdown_logging (0.63s) === CONT TestAgent_ServiceMaintenance_Disable [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:43.472Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:43.507Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:43.600 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:11cb0771-3341-f728-53b2-2b5965a5ba00 Address:127.0.0.1:29434}]" 31:43.601 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-11cb0771-3341-f728-53b2-2b5965a5ba00.dc1 127.0.0.1 31:43.601 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29434 [Follower]" leader= 31:43.601 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-11cb0771-3341-f728-53b2-2b5965a5ba00 127.0.0.1 2021-10-05T16:31:43.601Z [INFO] agent.router: Initializing LAN area manager 31:43.602 [INFO] TestAgent.server: Adding LAN server: server="Node-11cb0771-3341-f728-53b2-2b5965a5ba00 (Addr: tcp/127.0.0.1:29434) (DC: dc1)" 31:43.602 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29443 network=udp 31:43.602 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-11cb0771-3341-f728-53b2-2b5965a5ba00.dc1 area=wan 31:43.602 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29443 network=tcp 31:43.602 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29430 network=tcp 31:43.602 [INFO] TestAgent: started state syncer 31:43.602 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29505 network=tcp 31:43.653 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:43.653 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29434 [Candidate]" term=2 31:43.764 [DEBUG] TestAgent.server.raft: votes: needed=1 31:43.764 [DEBUG] TestAgent.server.raft: vote granted: from=11cb0771-3341-f728-53b2-2b5965a5ba00 term=2 tally=1 31:43.764 [INFO] TestAgent.server.raft: election won: tally=1 31:43.764 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29434 [Leader]" 31:43.767 [INFO] TestAgent.server: cluster leadership acquired 31:43.767 [INFO] TestAgent.server: New leader elected: payload=Node-11cb0771-3341-f728-53b2-2b5965a5ba00 31:43.815 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29434 31:43.860 [INFO] TestAgent.server: server starting leave 31:43.861 [INFO] TestAgent.server.serf.wan: serf: EventMemberLeave: Node-11cb0771-3341-f728-53b2-2b5965a5ba00.dc1 127.0.0.1 31:43.861 [INFO] TestAgent.server: Handled event for server in area: event=member-leave server=Node-11cb0771-3341-f728-53b2-2b5965a5ba00.dc1 area=wan 2021-10-05T16:31:43.861Z [INFO] agent.router.manager: shutting down 31:43.868 [INFO] TestAgent: Synced node info 31:43.868 [DEBUG] TestAgent: Node info in sync 31:43.902 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:43.943 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:43.943 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:43.943 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:43.943 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:43.943 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:43.943 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-11cb0771-3341-f728-53b2-2b5965a5ba00 31:43.943 [INFO] TestAgent.server: member joined, marking health alive: member=Node-11cb0771-3341-f728-53b2-2b5965a5ba00 31:43.973 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.166 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.166 [DEBUG] TestAgent: Node info in sync 31:46.861 [INFO] TestAgent.server.serf.lan: serf: EventMemberLeave: Node-11cb0771-3341-f728-53b2-2b5965a5ba00 127.0.0.1 31:46.861 [INFO] TestAgent.server: Removing LAN server: server="Node-11cb0771-3341-f728-53b2-2b5965a5ba00 (Addr: tcp/127.0.0.1:29434) (DC: dc1)" 31:46.861 [WARN] TestAgent.server: deregistering self should be done by follower: name=Node-11cb0771-3341-f728-53b2-2b5965a5ba00 31:47.872 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 31:49.862 [INFO] TestAgent.server: Waiting to drain RPC traffic: drain_time=5s 31:49.871 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 31:51.872 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 31:53.869 [ERROR] TestAgent.server.autopilot: Error promoting servers: error="error getting server raft protocol versions: No servers found" 31:53.869 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 31:54.864 [INFO] TestAgent: Requesting shutdown 31:54.864 [INFO] TestAgent.server: shutting down server 31:54.864 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:54.864 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:54.864 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:54.864 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:54.864 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:54.864 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:54.864 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:54.864 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:54.864 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 2021-10-05T16:31:54.880Z [INFO] agent.router.manager: shutting down 31:54.880 [INFO] TestAgent: consul server down 31:54.880 [INFO] TestAgent: shutdown complete 31:54.880 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29443 network=tcp 31:54.880 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29443 network=udp 31:54.880 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29430 network=tcp 31:55.384 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.384 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_StartStop (11.95s) === CONT TestAgent_ServiceMaintenance_Enable [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_ServiceMaintenance_ACLDeny/no_token === RUN TestAgent_ServiceMaintenance_ACLDeny/root_token [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:54.901Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:54.921Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:54.955 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c2032ecb-35c5-c54c-88ab-da78f354cbc8 Address:127.0.0.1:30143}]" 31:54.955 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c2032ecb-35c5-c54c-88ab-da78f354cbc8.dc1 127.0.0.1 31:54.956 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c2032ecb-35c5-c54c-88ab-da78f354cbc8 127.0.0.1 2021-10-05T16:31:54.956Z [INFO] agent.router: Initializing LAN area manager 31:54.956 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30138 network=udp 31:54.956 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30143 [Follower]" leader= 31:54.957 [INFO] TestAgent.server: Adding LAN server: server="Node-c2032ecb-35c5-c54c-88ab-da78f354cbc8 (Addr: tcp/127.0.0.1:30143) (DC: dc1)" 31:54.957 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c2032ecb-35c5-c54c-88ab-da78f354cbc8.dc1 area=wan 31:54.957 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30138 network=tcp 31:54.957 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30139 network=tcp 31:54.957 [INFO] TestAgent: started state syncer 31:54.958 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30074 network=tcp 31:55.028 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.028 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30143 [Candidate]" term=2 31:55.072 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.072 [DEBUG] TestAgent.server.raft: vote granted: from=c2032ecb-35c5-c54c-88ab-da78f354cbc8 term=2 tally=1 31:55.072 [INFO] TestAgent.server.raft: election won: tally=1 31:55.072 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30143 [Leader]" 31:55.073 [INFO] TestAgent.server: cluster leadership acquired 31:55.073 [INFO] TestAgent.server: New leader elected: payload=Node-c2032ecb-35c5-c54c-88ab-da78f354cbc8 31:55.100 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30143 31:55.168 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.236 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.236 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.236 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.236 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.236 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.236 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c2032ecb-35c5-c54c-88ab-da78f354cbc8 31:55.236 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c2032ecb-35c5-c54c-88ab-da78f354cbc8 31:55.260 [INFO] TestAgent.server: federation state anti-entropy synced 31:55.292 [INFO] TestAgent: Synced node info 31:55.292 [DEBUG] TestAgent: Node info in sync 31:55.324 [INFO] TestAgent: Node entered maintenance mode 31:55.324 [DEBUG] TestAgent: removed check: check=_node_maintenance 31:55.324 [INFO] TestAgent: Node left maintenance mode 31:55.324 [DEBUG] TestAgent: Node info in sync 31:55.340 [INFO] TestAgent: Deregistered check: check=_node_maintenance 31:55.340 [INFO] TestAgent: Requesting shutdown 31:55.340 [INFO] TestAgent.server: shutting down server 31:55.340 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:55.340 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:55.340 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:55.340 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:55.340 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:55.340 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:55.340 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:55.340 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:55.340 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:55.340 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:55.348 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:55.352Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:55.352Z [INFO] agent.router.manager: shutting down 31:55.352 [INFO] TestAgent: consul server down 31:55.352 [INFO] TestAgent: shutdown complete 31:55.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30138 network=tcp 31:55.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30138 network=udp 31:55.352 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30139 network=tcp 31:55.853 [INFO] TestAgent: Waiting for endpoints to shut down 31:55.853 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_NodeMaintenance_Disable (0.98s) === CONT TestAgent_ServiceMaintenance_BadRequest [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:55.109Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:55.109Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.199Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:55.199Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.300 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:587b2b40-4989-5a78-0763-30d873ddfc29 Address:127.0.0.1:30150}]" 31:55.302 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30150 [Follower]" leader= 31:55.304 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-587b2b40-4989-5a78-0763-30d873ddfc29.dc1 127.0.0.1 31:55.305 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-587b2b40-4989-5a78-0763-30d873ddfc29 127.0.0.1 2021-10-05T16:31:55.305Z [INFO] agent.router: Initializing LAN area manager 31:55.305 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30145 network=udp 31:55.305 [INFO] TestAgent.server: Adding LAN server: server="Node-587b2b40-4989-5a78-0763-30d873ddfc29 (Addr: tcp/127.0.0.1:30150) (DC: dc1)" 31:55.306 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-587b2b40-4989-5a78-0763-30d873ddfc29.dc1 area=wan 31:55.306 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30145 network=tcp 31:55.306 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30146 network=tcp 31:55.306 [INFO] TestAgent: started state syncer 31:55.306 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30151 network=tcp 31:55.356 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:55.371 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.371 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30150 [Candidate]" term=2 31:55.400 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.400 [DEBUG] TestAgent.server.raft: vote granted: from=587b2b40-4989-5a78-0763-30d873ddfc29 term=2 tally=1 31:55.400 [INFO] TestAgent.server.raft: election won: tally=1 31:55.400 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30150 [Leader]" 31:55.400 [INFO] TestAgent.server: cluster leadership acquired 31:55.400 [INFO] TestAgent.server: New leader elected: payload=Node-587b2b40-4989-5a78-0763-30d873ddfc29 31:55.429 [INFO] TestAgent.server: initializing acls 31:55.434 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:55.434 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:55.445 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:55.456 [INFO] TestAgent.server: initializing acls 31:55.456 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:55.490 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:55.490 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:55.490 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:55.491 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-587b2b40-4989-5a78-0763-30d873ddfc29 31:55.491 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-587b2b40-4989-5a78-0763-30d873ddfc29.dc1 31:55.491 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-587b2b40-4989-5a78-0763-30d873ddfc29.dc1 area=wan 31:55.491 [INFO] TestAgent.server: Updating LAN server: server="Node-587b2b40-4989-5a78-0763-30d873ddfc29 (Addr: tcp/127.0.0.1:30150) (DC: dc1)" 31:55.504 [INFO] TestAgent: Synced node info 31:55.504 [DEBUG] TestAgent: Node info in sync 31:55.504 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:55.504 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:55.504 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-587b2b40-4989-5a78-0763-30d873ddfc29 31:55.504 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-587b2b40-4989-5a78-0763-30d873ddfc29.dc1 31:55.504 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-587b2b40-4989-5a78-0763-30d873ddfc29.dc1 area=wan 31:55.504 [INFO] TestAgent.server: Updating LAN server: server="Node-587b2b40-4989-5a78-0763-30d873ddfc29 (Addr: tcp/127.0.0.1:30150) (DC: dc1)" 31:55.535 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.587 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.587 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.587 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.587 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.587 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.588 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-587b2b40-4989-5a78-0763-30d873ddfc29 31:55.588 [INFO] TestAgent.server: member joined, marking health alive: member=Node-587b2b40-4989-5a78-0763-30d873ddfc29 31:55.591 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-587b2b40-4989-5a78-0763-30d873ddfc29 31:55.591 [INFO] TestAgent: Requesting shutdown 31:55.591 [INFO] TestAgent.server: shutting down server 31:55.592 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:55.592 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:55.592 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:55.592 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:55.592 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:55.592 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:55.592 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:55.592 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:55.592 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:55.592 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:55.592 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:55.592 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:55.597 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:55.601 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:55.601 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:31:55.602Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:55.602Z [INFO] agent.router.manager: shutting down 31:55.603 [INFO] TestAgent: consul server down 31:55.603 [INFO] TestAgent: shutdown complete 31:55.603 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30145 network=tcp 31:55.603 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30145 network=udp 31:55.603 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30146 network=tcp 31:56.103 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.103 [INFO] TestAgent: Endpoints down === RUN TestSnapshot_Options/PUT#01 === RUN TestAgent_ServiceMaintenance_BadRequest/not_enabled === RUN TestAgent_ServiceMaintenance_BadRequest/no_service_id === RUN TestAgent_ServiceMaintenance_BadRequest/bad_service_id 2021-10-05T16:31:55.075Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.155Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.316 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c66fff29-44c4-b90d-9ec3-87302adc505a Address:127.0.0.1:30136}]" 31:55.317 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c66fff29-44c4-b90d-9ec3-87302adc505a.dc1 127.0.0.1 31:55.317 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c66fff29-44c4-b90d-9ec3-87302adc505a 127.0.0.1 2021-10-05T16:31:55.317Z [INFO] agent.router: Initializing LAN area manager 31:55.318 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30075 network=udp 31:55.318 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30136 [Follower]" leader= 31:55.318 [INFO] TestAgent.server: Adding LAN server: server="Node-c66fff29-44c4-b90d-9ec3-87302adc505a (Addr: tcp/127.0.0.1:30136) (DC: dc1)" 31:55.318 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c66fff29-44c4-b90d-9ec3-87302adc505a.dc1 area=wan 31:55.318 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30075 network=tcp 31:55.319 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30076 network=tcp 31:55.319 [INFO] TestAgent: started state syncer 31:55.319 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30144 network=tcp 31:55.360 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.360 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30136 [Candidate]" term=2 31:55.424 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.424 [DEBUG] TestAgent.server.raft: vote granted: from=c66fff29-44c4-b90d-9ec3-87302adc505a term=2 tally=1 31:55.424 [INFO] TestAgent.server.raft: election won: tally=1 31:55.424 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30136 [Leader]" 31:55.424 [INFO] TestAgent.server: cluster leadership acquired 31:55.424 [INFO] TestAgent.server: New leader elected: payload=Node-c66fff29-44c4-b90d-9ec3-87302adc505a 31:55.460 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30136 31:55.488 [INFO] TestAgent: Synced node info 31:55.532 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.600 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.600 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.600 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.600 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.600 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.600 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c66fff29-44c4-b90d-9ec3-87302adc505a 31:55.600 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c66fff29-44c4-b90d-9ec3-87302adc505a 31:55.636 [INFO] TestAgent.server: federation state anti-entropy synced 31:55.660 [INFO] TestAgent: Node entered maintenance mode 31:55.660 [DEBUG] TestAgent: Node info in sync 31:55.666 [INFO] TestAgent: Synced check: check=_node_maintenance 31:55.666 [INFO] TestAgent: Requesting shutdown 31:55.666 [INFO] TestAgent.server: shutting down server 31:55.666 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:55.667 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:55.667 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:55.667 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:55.667 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:55.667 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:55.667 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:55.667 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:55.667 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:55.667 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:55.675 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:55.678Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:55.678Z [INFO] agent.router.manager: shutting down 31:55.678 [INFO] TestAgent: consul server down 31:55.678 [INFO] TestAgent: shutdown complete 31:55.678 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30075 network=tcp 31:55.678 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30075 network=udp 31:55.678 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30076 network=tcp 31:56.179 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.179 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_NodeMaintenance_Enable (1.13s) === CONT TestAgent_DeregisterService_ACLDeny 2021-10-05T16:31:55.202Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.253Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.337 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:afab7003-dd57-95a9-e38f-979a8f3e961c Address:127.0.0.1:30105}]" 31:55.338 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-afab7003-dd57-95a9-e38f-979a8f3e961c.dc1 127.0.0.1 31:55.339 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-afab7003-dd57-95a9-e38f-979a8f3e961c 127.0.0.1 2021-10-05T16:31:55.339Z [INFO] agent.router: Initializing LAN area manager 31:55.339 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30105 [Follower]" leader= 31:55.339 [INFO] TestAgent.server: Adding LAN server: server="Node-afab7003-dd57-95a9-e38f-979a8f3e961c (Addr: tcp/127.0.0.1:30105) (DC: dc1)" 31:55.339 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-afab7003-dd57-95a9-e38f-979a8f3e961c.dc1 area=wan 31:55.339 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30065 network=tcp 31:55.339 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30065 network=udp 31:55.340 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30101 network=tcp 31:55.341 [INFO] TestAgent: started state syncer 31:55.341 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30158 network=tcp 31:55.408 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.408 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30105 [Candidate]" term=2 31:55.485 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.485 [DEBUG] TestAgent.server.raft: vote granted: from=afab7003-dd57-95a9-e38f-979a8f3e961c term=2 tally=1 31:55.485 [INFO] TestAgent.server.raft: election won: tally=1 31:55.485 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30105 [Leader]" 31:55.485 [INFO] TestAgent.server: cluster leadership acquired 31:55.486 [INFO] TestAgent.server: New leader elected: payload=Node-afab7003-dd57-95a9-e38f-979a8f3e961c 31:55.507 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30105 31:55.553 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.617 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.617 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.617 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.617 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.617 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.617 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-afab7003-dd57-95a9-e38f-979a8f3e961c 31:55.617 [INFO] TestAgent.server: member joined, marking health alive: member=Node-afab7003-dd57-95a9-e38f-979a8f3e961c 31:55.657 [INFO] TestAgent.server: federation state anti-entropy synced 31:55.709 [INFO] TestAgent: Requesting shutdown 31:55.709 [INFO] TestAgent.server: shutting down server 31:55.709 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:55.709 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:55.709 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:55.709 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:55.709 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:55.709 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:55.709 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:55.709 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:55.709 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:55.709 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:55.709 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:55.719 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:55.722Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:55.722Z [INFO] agent.router.manager: shutting down 31:55.722 [INFO] TestAgent: consul server down 31:55.722 [INFO] TestAgent: shutdown complete 31:55.722 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30065 network=tcp 31:55.722 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30065 network=udp 31:55.723 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30101 network=tcp 31:56.224 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.224 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_NodeMaintenance_BadRequest (1.13s) === CONT TestAgent_DeregisterService 2021-10-05T16:31:55.234Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.253Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.348 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0f666680-1a45-692c-f3da-57ff1844fe6a Address:127.0.0.1:30157}]" 31:55.349 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0f666680-1a45-692c-f3da-57ff1844fe6a.dc1 127.0.0.1 31:55.349 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0f666680-1a45-692c-f3da-57ff1844fe6a 127.0.0.1 2021-10-05T16:31:55.349Z [INFO] agent.router: Initializing LAN area manager 31:55.349 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30082 network=udp 31:55.349 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30157 [Follower]" leader= 31:55.350 [INFO] TestAgent.server: Adding LAN server: server="Node-0f666680-1a45-692c-f3da-57ff1844fe6a (Addr: tcp/127.0.0.1:30157) (DC: dc1)" 31:55.350 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0f666680-1a45-692c-f3da-57ff1844fe6a.dc1 area=wan 31:55.350 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30082 network=tcp 31:55.350 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30083 network=tcp 31:55.350 [INFO] TestAgent: started state syncer 31:55.351 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30165 network=tcp 31:55.420 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.420 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30157 [Candidate]" term=2 31:55.496 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.496 [DEBUG] TestAgent.server.raft: vote granted: from=0f666680-1a45-692c-f3da-57ff1844fe6a term=2 tally=1 31:55.496 [INFO] TestAgent.server.raft: election won: tally=1 31:55.496 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30157 [Leader]" 31:55.497 [INFO] TestAgent.server: cluster leadership acquired 31:55.498 [INFO] TestAgent.server: New leader elected: payload=Node-0f666680-1a45-692c-f3da-57ff1844fe6a 31:55.532 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30157 31:55.562 [INFO] TestAgent: Synced node info 31:55.606 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.665 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.665 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.665 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.665 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.665 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.665 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0f666680-1a45-692c-f3da-57ff1844fe6a 31:55.665 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0f666680-1a45-692c-f3da-57ff1844fe6a 31:55.698 [INFO] TestAgent.server: federation state anti-entropy synced 31:55.726 [INFO] TestAgent: Service entered maintenance mode: service=test 31:55.726 [DEBUG] TestAgent: removed check: check=_service_maintenance:test 31:55.726 [INFO] TestAgent: Service left maintenance mode: service=test 31:55.726 [DEBUG] TestAgent: Node info in sync 31:55.737 [INFO] TestAgent: Synced service: service=test 31:55.742 [INFO] TestAgent: Deregistered check: check=_service_maintenance:test 31:55.742 [INFO] TestAgent: Requesting shutdown 31:55.742 [INFO] TestAgent.server: shutting down server 31:55.742 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:55.742 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:55.742 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:55.742 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:55.742 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:55.742 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:55.742 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:55.742 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:55.742 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:55.742 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:55.746 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:55.749Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:55.749Z [INFO] agent.router.manager: shutting down 31:55.749 [INFO] TestAgent: consul server down 31:55.749 [INFO] TestAgent: shutdown complete 31:55.749 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30082 network=tcp 31:55.749 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30082 network=udp 31:55.749 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30083 network=tcp 31:56.252 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.252 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ServiceMaintenance_Disable (1.06s) === CONT TestAgent_UpdateCheck_ACLDeny 2021-10-05T16:31:55.230Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:55.230Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.270Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:55.270Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.356 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1cc86b31-a8d1-3e00-c528-93b6bd88f1ad Address:127.0.0.1:30164}]" 31:55.357 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad.dc1 127.0.0.1 31:55.358 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 127.0.0.1 2021-10-05T16:31:55.358Z [INFO] agent.router: Initializing LAN area manager 31:55.358 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30159 network=udp 31:55.358 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30164 [Follower]" leader= 31:55.359 [INFO] TestAgent.server: Adding LAN server: server="Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad (Addr: tcp/127.0.0.1:30164) (DC: dc1)" 31:55.359 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad.dc1 area=wan 31:55.359 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30159 network=tcp 31:55.359 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30160 network=tcp 31:55.360 [INFO] TestAgent: started state syncer 31:55.360 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30081 network=tcp 31:55.412 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:55.424 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.424 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30164 [Candidate]" term=2 31:55.443 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.444 [DEBUG] TestAgent.server.raft: vote granted: from=1cc86b31-a8d1-3e00-c528-93b6bd88f1ad term=2 tally=1 31:55.444 [INFO] TestAgent.server.raft: election won: tally=1 31:55.444 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30164 [Leader]" 31:55.444 [INFO] TestAgent.server: cluster leadership acquired 31:55.444 [INFO] TestAgent.server: New leader elected: payload=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.496 [INFO] TestAgent.server: initializing acls 31:55.506 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:55.506 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:55.513 [INFO] TestAgent.server: initializing acls 31:55.513 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:55.552 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:55.552 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:55.585 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:55.585 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:55.585 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:55.585 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.585 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad.dc1 31:55.587 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:55.587 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:55.587 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.587 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad.dc1 31:55.587 [INFO] TestAgent.server: Updating LAN server: server="Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad (Addr: tcp/127.0.0.1:30164) (DC: dc1)" 31:55.587 [INFO] TestAgent.server: Updating LAN server: server="Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad (Addr: tcp/127.0.0.1:30164) (DC: dc1)" 31:55.587 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad.dc1 area=wan 31:55.587 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad.dc1 area=wan 31:55.621 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.687 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.687 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.687 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.687 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.687 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.687 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.687 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.696 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.696 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.712 [INFO] TestAgent.server: federation state anti-entropy synced 31:55.718 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-1cc86b31-a8d1-3e00-c528-93b6bd88f1ad 31:55.726 [INFO] TestAgent: Service entered maintenance mode: service=test 31:55.734 [INFO] TestAgent: Synced node info 31:55.734 [WARN] TestAgent: Service registration blocked by ACLs: service=test accessorID=00000000-0000-0000-0000-000000000002 31:55.743 [INFO] TestAgent: Synced check: check=_service_maintenance:test 31:55.743 [INFO] TestAgent: Requesting shutdown 31:55.743 [INFO] TestAgent.server: shutting down server 31:55.743 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:55.743 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:55.743 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:55.743 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:55.743 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:55.743 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:55.743 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:55.743 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:55.743 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:55.743 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:55.743 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:55.743 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:55.743 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:55.743 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:55.743 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:55.746 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:55.748Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:55.748Z [INFO] agent.router.manager: shutting down 31:55.748 [INFO] TestAgent: consul server down 31:55.748 [INFO] TestAgent: shutdown complete 31:55.748 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30159 network=tcp 31:55.748 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30159 network=udp 31:55.748 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30160 network=tcp 31:56.256 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.256 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ServiceMaintenance_ACLDeny (1.08s) --- PASS: TestAgent_ServiceMaintenance_ACLDeny/no_token (0.00s) --- PASS: TestAgent_ServiceMaintenance_ACLDeny/root_token (0.02s) === CONT TestAgent_FailCheck_ACLDeny 2021-10-05T16:31:55.411Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.441Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.555 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6948ad5a-2409-21f9-af18-0ae59283a2c9 Address:127.0.0.1:30171}]" 31:55.556 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6948ad5a-2409-21f9-af18-0ae59283a2c9.dc1 127.0.0.1 31:55.556 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30171 [Follower]" leader= 31:55.556 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6948ad5a-2409-21f9-af18-0ae59283a2c9 127.0.0.1 2021-10-05T16:31:55.556Z [INFO] agent.router: Initializing LAN area manager 31:55.557 [INFO] TestAgent.server: Adding LAN server: server="Node-6948ad5a-2409-21f9-af18-0ae59283a2c9 (Addr: tcp/127.0.0.1:30171) (DC: dc1)" 31:55.557 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30166 network=udp 31:55.557 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6948ad5a-2409-21f9-af18-0ae59283a2c9.dc1 area=wan 31:55.557 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30166 network=tcp 31:55.557 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30167 network=tcp 31:55.557 [INFO] TestAgent: started state syncer 31:55.557 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30172 network=tcp 31:55.591 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.591 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30171 [Candidate]" term=2 31:55.616 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.616 [DEBUG] TestAgent.server.raft: vote granted: from=6948ad5a-2409-21f9-af18-0ae59283a2c9 term=2 tally=1 31:55.616 [INFO] TestAgent.server.raft: election won: tally=1 31:55.616 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30171 [Leader]" 31:55.618 [INFO] TestAgent.server: cluster leadership acquired 31:55.618 [INFO] TestAgent.server: New leader elected: payload=Node-6948ad5a-2409-21f9-af18-0ae59283a2c9 31:55.640 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30171 31:55.664 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.714 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.714 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.715 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.715 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.715 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.715 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6948ad5a-2409-21f9-af18-0ae59283a2c9 31:55.715 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6948ad5a-2409-21f9-af18-0ae59283a2c9 31:55.737 [INFO] TestAgent.server: federation state anti-entropy synced 31:55.750 [INFO] TestAgent: Service entered maintenance mode: service=test 31:55.753 [INFO] TestAgent: Synced node info 31:55.756 [INFO] TestAgent: Synced service: service=test 31:55.762 [INFO] TestAgent: Synced check: check=_service_maintenance:test 31:55.762 [INFO] TestAgent: Requesting shutdown 31:55.762 [INFO] TestAgent.server: shutting down server 31:55.762 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:55.762 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:55.762 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:55.762 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:55.762 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:55.762 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:55.762 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:55.762 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:55.762 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:55.762 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:55.762 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:55.767 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:55.767Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:55.767Z [INFO] agent.router.manager: shutting down 31:55.767 [INFO] TestAgent: consul server down 31:55.767 [INFO] TestAgent: shutdown complete 31:55.767 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30166 network=tcp 31:55.767 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30166 network=udp 31:55.767 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30167 network=tcp 31:56.268 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.268 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ServiceMaintenance_Enable (0.89s) === CONT TestAgent_FailCheck [WARN] freeport: 10 out of 52 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_UpdateCheck_ACLDeny/no_token === RUN TestAgent_UpdateCheck_ACLDeny/root_token === RUN TestAgent_FailCheck_ACLDeny/no_token === RUN TestAgent_FailCheck_ACLDeny/root_token 2021-10-05T16:31:55.876Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.901Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.978 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1445d07f-355e-3404-c6ad-98a2bef12a19 Address:127.0.0.1:30178}]" 31:55.978 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1445d07f-355e-3404-c6ad-98a2bef12a19.dc1 127.0.0.1 31:55.979 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1445d07f-355e-3404-c6ad-98a2bef12a19 127.0.0.1 2021-10-05T16:31:55.979Z [INFO] agent.router: Initializing LAN area manager 31:55.979 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30173 network=udp 31:55.979 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30178 [Follower]" leader= 31:55.980 [INFO] TestAgent.server: Adding LAN server: server="Node-1445d07f-355e-3404-c6ad-98a2bef12a19 (Addr: tcp/127.0.0.1:30178) (DC: dc1)" 31:55.980 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1445d07f-355e-3404-c6ad-98a2bef12a19.dc1 area=wan 31:55.980 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30173 network=tcp 31:55.981 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30174 network=tcp 31:55.981 [INFO] TestAgent: started state syncer 31:55.981 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30186 network=tcp 31:56.049 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.049 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30178 [Candidate]" term=2 31:56.062 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.062 [DEBUG] TestAgent.server.raft: vote granted: from=1445d07f-355e-3404-c6ad-98a2bef12a19 term=2 tally=1 31:56.062 [INFO] TestAgent.server.raft: election won: tally=1 31:56.062 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30178 [Leader]" 31:56.062 [INFO] TestAgent.server: cluster leadership acquired 31:56.062 [INFO] TestAgent.server: New leader elected: payload=Node-1445d07f-355e-3404-c6ad-98a2bef12a19 31:56.069 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30178 31:56.092 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:56.136 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:56.136 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:56.136 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:56.136 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:56.136 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:56.136 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1445d07f-355e-3404-c6ad-98a2bef12a19 31:56.136 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1445d07f-355e-3404-c6ad-98a2bef12a19 31:56.151 [INFO] TestAgent.server: federation state anti-entropy synced 31:56.171 [INFO] TestAgent: Requesting shutdown 31:56.171 [INFO] TestAgent.server: shutting down server 31:56.171 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.171 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.171 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.171 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.171 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.171 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:56.171 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:56.171 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:56.171 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.171 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.171 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.179 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:56.179Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.179Z [INFO] agent.router.manager: shutting down 31:56.179 [INFO] TestAgent: consul server down 31:56.179 [INFO] TestAgent: shutdown complete 31:56.179 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30173 network=tcp 31:56.179 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30173 network=udp 31:56.179 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30174 network=tcp 31:56.680 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.680 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ServiceMaintenance_BadRequest (0.83s) --- PASS: TestAgent_ServiceMaintenance_BadRequest/not_enabled (0.00s) --- PASS: TestAgent_ServiceMaintenance_BadRequest/no_service_id (0.00s) --- PASS: TestAgent_ServiceMaintenance_BadRequest/bad_service_id (0.00s) === CONT TestAgent_WarnCheck_ACLDeny === RUN TestAgent_DeregisterService_ACLDeny/no_token === RUN TestAgent_DeregisterService_ACLDeny/root_token [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:56.122Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.122Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:56.134Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.134Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:56.171 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 Address:127.0.0.1:30216}]" 31:56.173 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4.dc1 127.0.0.1 31:56.173 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 127.0.0.1 2021-10-05T16:31:56.173Z [INFO] agent.router: Initializing LAN area manager 31:56.174 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30187 network=udp 31:56.174 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30216 [Follower]" leader= 31:56.174 [INFO] TestAgent.server: Adding LAN server: server="Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 (Addr: tcp/127.0.0.1:30216) (DC: dc1)" 31:56.174 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4.dc1 area=wan 31:56.174 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30187 network=tcp 31:56.174 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30188 network=tcp 31:56.175 [INFO] TestAgent: started state syncer 31:56.175 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30179 network=tcp 31:56.224 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:56.244 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.244 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30216 [Candidate]" term=2 31:56.280 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.280 [DEBUG] TestAgent.server.raft: vote granted: from=8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 term=2 tally=1 31:56.280 [INFO] TestAgent.server.raft: election won: tally=1 31:56.280 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30216 [Leader]" 31:56.280 [INFO] TestAgent.server: cluster leadership acquired 31:56.280 [INFO] TestAgent.server: New leader elected: payload=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.295 [INFO] TestAgent.server: initializing acls 31:56.304 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:56.304 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.311 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:56.324 [INFO] TestAgent.server: initializing acls 31:56.325 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.333 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.333 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:56.333 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:56.334 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.334 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4.dc1 31:56.334 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4.dc1 area=wan 31:56.334 [INFO] TestAgent.server: Updating LAN server: server="Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 (Addr: tcp/127.0.0.1:30216) (DC: dc1)" 31:56.339 [INFO] TestAgent: Synced node info 31:56.339 [DEBUG] TestAgent: Node info in sync 31:56.339 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.339 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:56.339 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.339 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4.dc1 31:56.339 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4.dc1 area=wan 31:56.339 [INFO] TestAgent.server: Updating LAN server: server="Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 (Addr: tcp/127.0.0.1:30216) (DC: dc1)" 31:56.354 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:56.394 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:56.394 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:56.394 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:56.394 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:56.394 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:56.394 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.394 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.410 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.410 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.416 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8ed1f317-9e1c-ee1b-9dd0-4e9e9d76a3b4 31:56.416 [INFO] TestAgent: Requesting shutdown 31:56.416 [INFO] TestAgent.server: shutting down server 31:56.416 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:56.416 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:56.416 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.416 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.416 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.416 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.416 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.416 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:56.416 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:56.416 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.416 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.416 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.423 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 31:56.428 [INFO] TestAgent.server: federation state anti-entropy synced 31:56.428 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:31:56.432Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.432Z [INFO] agent.router.manager: shutting down 31:56.432 [INFO] TestAgent: consul server down 31:56.432 [INFO] TestAgent: shutdown complete 31:56.432 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30187 network=tcp 31:56.432 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30187 network=udp 31:56.432 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30188 network=tcp 31:56.935 [INFO] TestAgent: Waiting for endpoints to shut down 31:56.935 [INFO] TestAgent: Endpoints down === RUN TestSnapshot_Options/PUT#02 === RUN TestAgent_WarnCheck_ACLDeny/no_token === RUN TestAgent_WarnCheck_ACLDeny/root_token [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:56.267Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.267Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:56.280Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.280Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:56.333 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:92a004a5-5374-472e-802b-47cff2c6a2bc Address:127.0.0.1:30252}]" 31:56.334 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-92a004a5-5374-472e-802b-47cff2c6a2bc.dc1 127.0.0.1 31:56.334 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30252 [Follower]" leader= 31:56.334 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-92a004a5-5374-472e-802b-47cff2c6a2bc 127.0.0.1 2021-10-05T16:31:56.334Z [INFO] agent.router: Initializing LAN area manager 31:56.334 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30240 network=udp 31:56.335 [INFO] TestAgent.server: Adding LAN server: server="Node-92a004a5-5374-472e-802b-47cff2c6a2bc (Addr: tcp/127.0.0.1:30252) (DC: dc1)" 31:56.335 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-92a004a5-5374-472e-802b-47cff2c6a2bc.dc1 area=wan 31:56.335 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30240 network=tcp 31:56.335 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30241 network=tcp 31:56.335 [INFO] TestAgent: started state syncer 31:56.335 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30225 network=tcp 31:56.385 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:56.400 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.400 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30252 [Candidate]" term=2 31:56.441 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.441 [DEBUG] TestAgent.server.raft: vote granted: from=92a004a5-5374-472e-802b-47cff2c6a2bc term=2 tally=1 31:56.441 [INFO] TestAgent.server.raft: election won: tally=1 31:56.441 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30252 [Leader]" 31:56.441 [INFO] TestAgent.server: cluster leadership acquired 31:56.441 [INFO] TestAgent.server: New leader elected: payload=Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.463 [INFO] TestAgent.server: initializing acls 31:56.484 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:56.484 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.485 [INFO] TestAgent.server: initializing acls 31:56.485 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.493 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:56.518 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.518 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:56.518 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:56.518 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.518 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-92a004a5-5374-472e-802b-47cff2c6a2bc.dc1 31:56.518 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:56.519 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:56.519 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.519 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-92a004a5-5374-472e-802b-47cff2c6a2bc.dc1 31:56.519 [INFO] TestAgent.server: Updating LAN server: server="Node-92a004a5-5374-472e-802b-47cff2c6a2bc (Addr: tcp/127.0.0.1:30252) (DC: dc1)" 31:56.519 [INFO] TestAgent.server: Updating LAN server: server="Node-92a004a5-5374-472e-802b-47cff2c6a2bc (Addr: tcp/127.0.0.1:30252) (DC: dc1)" 31:56.519 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-92a004a5-5374-472e-802b-47cff2c6a2bc.dc1 area=wan 31:56.519 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-92a004a5-5374-472e-802b-47cff2c6a2bc.dc1 area=wan 31:56.541 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:56.572 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:56.572 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:56.572 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:56.572 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:56.572 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:56.572 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.572 [INFO] TestAgent.server: member joined, marking health alive: member=Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.581 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.581 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.583 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.583 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-92a004a5-5374-472e-802b-47cff2c6a2bc 31:56.585 [DEBUG] TestAgent: Check status updated: check=test status=passing 31:56.620 [INFO] TestAgent: Synced node info 31:56.621 [WARN] TestAgent: Check registration blocked by ACLs: check=test accessorID=00000000-0000-0000-0000-000000000002 31:56.621 [INFO] TestAgent: Requesting shutdown 31:56.621 [INFO] TestAgent.server: shutting down server 31:56.621 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:56.621 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:56.621 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.621 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.621 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.621 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.621 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.621 [INFO] TestAgent.server: federation state anti-entropy synced 31:56.621 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:56.621 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:56.621 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.621 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:56.622 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:56.622 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.622 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.633 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:56.640Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.640Z [INFO] agent.router.manager: shutting down 31:56.644 [INFO] TestAgent: consul server down 31:56.644 [INFO] TestAgent: shutdown complete 31:56.644 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30240 network=tcp 31:56.644 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30240 network=udp 31:56.644 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30241 network=tcp 31:56.644 [WARN] TestAgent: Syncing node info failed.: error="leadership lost while committing log" 31:56.644 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="leadership lost while committing log" 31:57.144 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.144 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_UpdateCheck_ACLDeny (0.89s) --- PASS: TestAgent_UpdateCheck_ACLDeny/no_token (0.00s) --- PASS: TestAgent_UpdateCheck_ACLDeny/root_token (0.04s) === CONT TestAgent_WarnCheck 2021-10-05T16:31:56.241Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:56.260Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:56.325 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d2897bdd-5998-a856-d877-d7615ba14481 Address:127.0.0.1:30210}]" 31:56.325 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30210 [Follower]" leader= 31:56.326 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d2897bdd-5998-a856-d877-d7615ba14481.dc1 127.0.0.1 31:56.326 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d2897bdd-5998-a856-d877-d7615ba14481 127.0.0.1 2021-10-05T16:31:56.326Z [INFO] agent.router: Initializing LAN area manager 31:56.327 [INFO] TestAgent.server: Adding LAN server: server="Node-d2897bdd-5998-a856-d877-d7615ba14481 (Addr: tcp/127.0.0.1:30210) (DC: dc1)" 31:56.327 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d2897bdd-5998-a856-d877-d7615ba14481.dc1 area=wan 31:56.327 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30205 network=udp 31:56.327 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30205 network=tcp 31:56.327 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30206 network=tcp 31:56.327 [INFO] TestAgent: started state syncer 31:56.327 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30239 network=tcp 31:56.363 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.363 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30210 [Candidate]" term=2 31:56.416 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.416 [DEBUG] TestAgent.server.raft: vote granted: from=d2897bdd-5998-a856-d877-d7615ba14481 term=2 tally=1 31:56.416 [INFO] TestAgent.server.raft: election won: tally=1 31:56.416 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30210 [Leader]" 31:56.416 [INFO] TestAgent.server: cluster leadership acquired 31:56.416 [INFO] TestAgent.server: New leader elected: payload=Node-d2897bdd-5998-a856-d877-d7615ba14481 31:56.452 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30210 31:56.508 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:56.573 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:56.573 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:56.573 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:56.573 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:56.573 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:56.573 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d2897bdd-5998-a856-d877-d7615ba14481 31:56.574 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d2897bdd-5998-a856-d877-d7615ba14481 31:56.605 [DEBUG] TestAgent: removed service: service=test 31:56.619 [INFO] TestAgent.server: federation state anti-entropy synced 31:56.648 [INFO] TestAgent: Synced node info 31:56.653 [INFO] TestAgent: Deregistered service: service=test 31:56.653 [INFO] TestAgent: Requesting shutdown 31:56.653 [INFO] TestAgent.server: shutting down server 31:56.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.653 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.653 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.653 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.653 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:56.653 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:56.653 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:56.653 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.653 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.653 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.659 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:56.664Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.664Z [INFO] agent.router.manager: shutting down 31:56.665 [INFO] TestAgent: consul server down 31:56.665 [INFO] TestAgent: shutdown complete 31:56.665 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30205 network=tcp 31:56.665 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30205 network=udp 31:56.665 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30206 network=tcp 31:57.165 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.165 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_DeregisterService (0.94s) === CONT TestAgent_PassCheck_ACLDeny 2021-10-05T16:31:56.281Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.281Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:56.297Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.297Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:56.352 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f588c486-2cee-856e-b8bf-cb411a65d95f Address:127.0.0.1:30238}]" 31:56.352 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30238 [Follower]" leader= 31:56.353 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f588c486-2cee-856e-b8bf-cb411a65d95f.dc1 127.0.0.1 31:56.353 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f588c486-2cee-856e-b8bf-cb411a65d95f 127.0.0.1 2021-10-05T16:31:56.353Z [INFO] agent.router: Initializing LAN area manager 31:56.353 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30233 network=udp 31:56.354 [INFO] TestAgent.server: Adding LAN server: server="Node-f588c486-2cee-856e-b8bf-cb411a65d95f (Addr: tcp/127.0.0.1:30238) (DC: dc1)" 31:56.354 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f588c486-2cee-856e-b8bf-cb411a65d95f.dc1 area=wan 31:56.354 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30233 network=tcp 31:56.354 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30234 network=tcp 31:56.354 [INFO] TestAgent: started state syncer 31:56.354 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30253 network=tcp 31:56.404 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:56.416 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.416 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30238 [Candidate]" term=2 31:56.454 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.454 [DEBUG] TestAgent.server.raft: vote granted: from=f588c486-2cee-856e-b8bf-cb411a65d95f term=2 tally=1 31:56.454 [INFO] TestAgent.server.raft: election won: tally=1 31:56.454 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30238 [Leader]" 31:56.454 [INFO] TestAgent.server: cluster leadership acquired 31:56.454 [INFO] TestAgent.server: New leader elected: payload=Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.480 [INFO] TestAgent.server: initializing acls 31:56.487 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:56.487 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.499 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:56.508 [INFO] TestAgent.server: initializing acls 31:56.508 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.527 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.527 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:56.527 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:56.527 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:56.527 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.527 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f588c486-2cee-856e-b8bf-cb411a65d95f.dc1 31:56.527 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f588c486-2cee-856e-b8bf-cb411a65d95f.dc1 area=wan 31:56.527 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.527 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.528 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f588c486-2cee-856e-b8bf-cb411a65d95f.dc1 31:56.528 [INFO] TestAgent.server: Updating LAN server: server="Node-f588c486-2cee-856e-b8bf-cb411a65d95f (Addr: tcp/127.0.0.1:30238) (DC: dc1)" 31:56.528 [INFO] TestAgent.server: Updating LAN server: server="Node-f588c486-2cee-856e-b8bf-cb411a65d95f (Addr: tcp/127.0.0.1:30238) (DC: dc1)" 31:56.528 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f588c486-2cee-856e-b8bf-cb411a65d95f.dc1 area=wan 31:56.547 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:56.576 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:56.576 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:56.576 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:56.576 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:56.576 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:56.577 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.577 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.613 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.613 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.613 [INFO] TestAgent.server: federation state anti-entropy synced 31:56.619 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-f588c486-2cee-856e-b8bf-cb411a65d95f 31:56.620 [DEBUG] TestAgent: Check status updated: check=test status=critical 31:56.644 [INFO] TestAgent: Synced node info 31:56.644 [WARN] TestAgent: Check registration blocked by ACLs: check=test accessorID=00000000-0000-0000-0000-000000000002 31:56.644 [INFO] TestAgent: Requesting shutdown 31:56.644 [INFO] TestAgent.server: shutting down server 31:56.644 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.644 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:56.644 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:56.644 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.644 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.644 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.644 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.644 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.644 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 31:56.644 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:56.645 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.645 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:56.645 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.646 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:56.646 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:56.660 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:56.672Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.672Z [INFO] agent.router.manager: shutting down 31:56.672 [INFO] TestAgent: consul server down 31:56.672 [INFO] TestAgent: shutdown complete 31:56.672 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30233 network=tcp 31:56.672 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30233 network=udp 31:56.672 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30234 network=tcp 31:57.173 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.173 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_FailCheck_ACLDeny (0.92s) --- PASS: TestAgent_FailCheck_ACLDeny/no_token (0.00s) --- PASS: TestAgent_FailCheck_ACLDeny/root_token (0.02s) === CONT TestAgent_PassCheck 2021-10-05T16:31:56.308Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:56.324Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:56.400 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:86fbd723-536e-4ad0-b4b8-c9cbca1b6384 Address:127.0.0.1:30245}]" 31:56.401 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-86fbd723-536e-4ad0-b4b8-c9cbca1b6384.dc1 127.0.0.1 31:56.401 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-86fbd723-536e-4ad0-b4b8-c9cbca1b6384 127.0.0.1 2021-10-05T16:31:56.401Z [INFO] agent.router: Initializing LAN area manager 31:56.402 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30254 network=udp 31:56.402 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30245 [Follower]" leader= 31:56.402 [INFO] TestAgent.server: Adding LAN server: server="Node-86fbd723-536e-4ad0-b4b8-c9cbca1b6384 (Addr: tcp/127.0.0.1:30245) (DC: dc1)" 31:56.402 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-86fbd723-536e-4ad0-b4b8-c9cbca1b6384.dc1 area=wan 31:56.402 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30254 network=tcp 31:56.403 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30255 network=tcp 31:56.403 [INFO] TestAgent: started state syncer 31:56.403 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30246 network=tcp 31:56.444 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.444 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30245 [Candidate]" term=2 31:56.484 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.484 [DEBUG] TestAgent.server.raft: vote granted: from=86fbd723-536e-4ad0-b4b8-c9cbca1b6384 term=2 tally=1 31:56.484 [INFO] TestAgent.server.raft: election won: tally=1 31:56.484 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30245 [Leader]" 31:56.484 [INFO] TestAgent.server: cluster leadership acquired 31:56.484 [INFO] TestAgent.server: New leader elected: payload=Node-86fbd723-536e-4ad0-b4b8-c9cbca1b6384 31:56.501 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30245 31:56.528 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:56.566 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:56.566 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:56.566 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:56.566 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:56.566 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:56.566 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-86fbd723-536e-4ad0-b4b8-c9cbca1b6384 31:56.566 [INFO] TestAgent.server: member joined, marking health alive: member=Node-86fbd723-536e-4ad0-b4b8-c9cbca1b6384 31:56.594 [DEBUG] TestAgent: Check status updated: check=test status=critical 31:56.618 [INFO] TestAgent: Synced node info 31:56.619 [INFO] TestAgent.server: federation state anti-entropy synced 31:56.652 [INFO] TestAgent: Synced check: check=test 31:56.652 [INFO] TestAgent: Requesting shutdown 31:56.652 [INFO] TestAgent.server: shutting down server 31:56.652 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.652 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.652 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.652 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.652 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.652 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:56.652 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:56.652 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:56.652 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.652 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.652 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.664 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:56.676Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.676Z [INFO] agent.router.manager: shutting down 31:56.676 [INFO] TestAgent: consul server down 31:56.676 [INFO] TestAgent: shutdown complete 31:56.676 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30254 network=tcp 31:56.676 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30254 network=udp 31:56.676 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30255 network=tcp 31:57.176 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.176 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_FailCheck (0.90s) === CONT TestAgent_DeregisterCheckACLDeny 2021-10-05T16:31:56.221Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.221Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:56.232Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.232Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:56.302 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:20354e63-4208-41bd-9d91-d3b51af394ea Address:127.0.0.1:30185}]" 31:56.303 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-20354e63-4208-41bd-9d91-d3b51af394ea.dc1 127.0.0.1 31:56.303 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-20354e63-4208-41bd-9d91-d3b51af394ea 127.0.0.1 2021-10-05T16:31:56.303Z [INFO] agent.router: Initializing LAN area manager 31:56.303 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30180 network=udp 31:56.303 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30185 [Follower]" leader= 31:56.304 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-20354e63-4208-41bd-9d91-d3b51af394ea.dc1 area=wan 31:56.304 [INFO] TestAgent.server: Adding LAN server: server="Node-20354e63-4208-41bd-9d91-d3b51af394ea (Addr: tcp/127.0.0.1:30185) (DC: dc1)" 31:56.304 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30180 network=tcp 31:56.304 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30181 network=tcp 31:56.304 [INFO] TestAgent: started state syncer 31:56.305 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30217 network=tcp 31:56.354 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:56.360 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.360 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30185 [Candidate]" term=2 31:56.380 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.380 [DEBUG] TestAgent.server.raft: vote granted: from=20354e63-4208-41bd-9d91-d3b51af394ea term=2 tally=1 31:56.380 [INFO] TestAgent.server.raft: election won: tally=1 31:56.380 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30185 [Leader]" 31:56.381 [INFO] TestAgent.server: cluster leadership acquired 31:56.381 [INFO] TestAgent.server: New leader elected: payload=Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.406 [INFO] TestAgent.server: initializing acls 31:56.420 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:56.420 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.440 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:56.454 [INFO] TestAgent.server: initializing acls 31:56.454 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.480 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.480 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:56.480 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:56.480 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:56.480 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.480 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-20354e63-4208-41bd-9d91-d3b51af394ea.dc1 31:56.480 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-20354e63-4208-41bd-9d91-d3b51af394ea.dc1 area=wan 31:56.480 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.480 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.481 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-20354e63-4208-41bd-9d91-d3b51af394ea.dc1 31:56.481 [INFO] TestAgent.server: Updating LAN server: server="Node-20354e63-4208-41bd-9d91-d3b51af394ea (Addr: tcp/127.0.0.1:30185) (DC: dc1)" 31:56.481 [INFO] TestAgent.server: Updating LAN server: server="Node-20354e63-4208-41bd-9d91-d3b51af394ea (Addr: tcp/127.0.0.1:30185) (DC: dc1)" 31:56.481 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-20354e63-4208-41bd-9d91-d3b51af394ea.dc1 area=wan 31:56.513 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:56.553 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:56.553 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:56.553 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:56.553 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:56.553 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:56.554 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.554 [INFO] TestAgent.server: member joined, marking health alive: member=Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.560 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.560 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.569 [INFO] TestAgent.server: federation state anti-entropy synced 31:56.645 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:56.662 [INFO] TestAgent: Synced node info 31:56.662 [DEBUG] TestAgent: Node info in sync 31:56.683 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.683 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-20354e63-4208-41bd-9d91-d3b51af394ea 31:56.683 [DEBUG] TestAgent: removed service: service=test 31:56.683 [DEBUG] TestAgent: Node info in sync 31:56.683 [INFO] TestAgent: Deregistered service: service=test 31:56.683 [INFO] TestAgent: Requesting shutdown 31:56.684 [INFO] TestAgent.server: shutting down server 31:56.684 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:56.684 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:56.684 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.684 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.684 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.684 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.684 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.684 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:56.684 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.684 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:56.684 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:56.684 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:56.684 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.684 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.692 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:56.700Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.700Z [INFO] agent.router.manager: shutting down 31:56.700 [INFO] TestAgent: consul server down 31:56.700 [INFO] TestAgent: shutdown complete 31:56.700 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30180 network=tcp 31:56.700 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30180 network=udp 31:56.700 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30181 network=tcp 31:57.200 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.200 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_DeregisterService_ACLDeny (1.03s) --- PASS: TestAgent_DeregisterService_ACLDeny/no_token (0.00s) --- PASS: TestAgent_DeregisterService_ACLDeny/root_token (0.00s) === CONT TestAgent_DeregisterCheck [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:55.169Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:55.169Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:55.226Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:55.226Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:55.328 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 Address:127.0.0.1:30080}]" 31:55.329 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7.dc1 127.0.0.1 31:55.329 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 127.0.0.1 2021-10-05T16:31:55.329Z [INFO] agent.router: Initializing LAN area manager 31:55.329 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30152 network=udp 31:55.329 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30080 [Follower]" leader= 31:55.330 [INFO] TestAgent.server: Adding LAN server: server="Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 (Addr: tcp/127.0.0.1:30080) (DC: dc1)" 31:55.330 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7.dc1 area=wan 31:55.330 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30152 network=tcp 31:55.330 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30153 network=tcp 31:55.330 [INFO] TestAgent: started state syncer 31:55.330 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30050 network=tcp 31:55.380 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:55.388 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:55.388 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30080 [Candidate]" term=2 31:55.457 [DEBUG] TestAgent.server.raft: votes: needed=1 31:55.457 [DEBUG] TestAgent.server.raft: vote granted: from=a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 term=2 tally=1 31:55.457 [INFO] TestAgent.server.raft: election won: tally=1 31:55.457 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30080 [Leader]" 31:55.458 [INFO] TestAgent.server: cluster leadership acquired 31:55.458 [INFO] TestAgent.server: New leader elected: payload=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.480 [INFO] TestAgent.server: initializing acls 31:55.490 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:55.490 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:55.490 [INFO] TestAgent.server: initializing acls 31:55.490 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:55.507 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:55.534 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:55.552 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:55.552 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:55.552 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:55.552 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:55.552 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.552 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7.dc1 31:55.552 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7.dc1 area=wan 31:55.552 [INFO] TestAgent.server: Updating LAN server: server="Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 (Addr: tcp/127.0.0.1:30080) (DC: dc1)" 31:55.568 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:55.568 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.568 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7.dc1 31:55.572 [INFO] TestAgent.server: Updating LAN server: server="Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 (Addr: tcp/127.0.0.1:30080) (DC: dc1)" 31:55.572 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7.dc1 area=wan 31:55.608 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:55.650 [WARN] TestAgent: Node info update blocked by ACLs: node=a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 accessorID=00000000-0000-0000-0000-000000000002 31:55.658 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:55.658 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:55.658 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:55.658 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:55.658 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:55.658 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.658 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.666 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.666 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.678 [INFO] TestAgent.server: federation state anti-entropy synced 31:55.689 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-a0b35e84-c5e9-ef76-efe2-27bb7699e8d7 31:55.709 [INFO] TestAgent: Updated agent's ACL token: token=agent 31:56.860 [DEBUG] TestAgent.acl: dropping service from result due to ACLs: service="{consul {}}" 31:56.860 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:56.880 [INFO] TestAgent: Synced node info 31:56.880 [DEBUG] TestAgent: Node info in sync 31:56.896 [INFO] TestAgent: Requesting shutdown 31:56.896 [INFO] TestAgent.server: shutting down server 31:56.896 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:56.896 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:56.896 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:56.896 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:56.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:56.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:56.896 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:56.896 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:56.896 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:56.896 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:56.896 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:56.896 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:56.896 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:56.896 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:56.902 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:56.903Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:56.903Z [INFO] agent.router.manager: shutting down 31:56.903 [INFO] TestAgent: consul server down 31:56.903 [INFO] TestAgent: shutdown complete 31:56.903 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30152 network=tcp 31:56.903 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30152 network=udp 31:56.903 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30153 network=tcp 31:57.404 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.404 [INFO] TestAgent: Endpoints down === RUN TestAgent_TokenTriggersFullSync/acl_token === RUN TestAgent_PassCheck_ACLDeny/no_token === RUN TestAgent_PassCheck_ACLDeny/root_token [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:56.698Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.698Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:56.723Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.723Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:56.801 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:38d335a2-ac1e-e9f3-8e74-a168b18d575d Address:127.0.0.1:30231}]" 31:56.802 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d.dc1 127.0.0.1 31:56.804 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30231 [Follower]" leader= 31:56.804 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 127.0.0.1 2021-10-05T16:31:56.804Z [INFO] agent.router: Initializing LAN area manager 31:56.804 [INFO] TestAgent.server: Adding LAN server: server="Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d (Addr: tcp/127.0.0.1:30231) (DC: dc1)" 31:56.804 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d.dc1 area=wan 31:56.804 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30247 network=udp 31:56.804 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30247 network=tcp 31:56.805 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30248 network=tcp 31:56.805 [INFO] TestAgent: started state syncer 31:56.805 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30211 network=tcp 31:56.856 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:56.872 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:56.872 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30231 [Candidate]" term=2 31:56.884 [DEBUG] TestAgent.server.raft: votes: needed=1 31:56.884 [DEBUG] TestAgent.server.raft: vote granted: from=38d335a2-ac1e-e9f3-8e74-a168b18d575d term=2 tally=1 31:56.884 [INFO] TestAgent.server.raft: election won: tally=1 31:56.884 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30231 [Leader]" 31:56.884 [INFO] TestAgent.server: cluster leadership acquired 31:56.884 [INFO] TestAgent.server: New leader elected: payload=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 31:56.892 [INFO] TestAgent.server: initializing acls 31:56.901 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:56.901 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:56.916 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:56.940 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:56.940 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:56.940 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:56.940 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 31:56.940 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d.dc1 31:56.941 [INFO] TestAgent.server: Updating LAN server: server="Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d (Addr: tcp/127.0.0.1:30231) (DC: dc1)" 31:56.941 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d.dc1 area=wan 31:56.976 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.017 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.017 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.017 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.017 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.017 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.017 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 31:57.017 [INFO] TestAgent.server: member joined, marking health alive: member=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 31:57.032 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.032 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 31:57.056 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:57.058 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 31:57.058 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-38d335a2-ac1e-e9f3-8e74-a168b18d575d 31:57.064 [INFO] TestAgent: Synced node info 31:57.064 [DEBUG] TestAgent: Check status updated: check=test status=warning 31:57.064 [DEBUG] TestAgent: Node info in sync 31:57.064 [WARN] TestAgent: Check registration blocked by ACLs: check=test accessorID=00000000-0000-0000-0000-000000000002 31:57.064 [INFO] TestAgent: Requesting shutdown 31:57.064 [INFO] TestAgent.server: shutting down server 31:57.064 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.064 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.064 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.064 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.064 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:57.065 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:57.065 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.065 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.065 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.065 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.065 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.065 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.065 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:57.065 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:57.072 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.092Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.092Z [INFO] agent.router.manager: shutting down 31:57.092 [INFO] TestAgent: consul server down 31:57.092 [INFO] TestAgent: shutdown complete 31:57.092 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30247 network=tcp 31:57.092 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30247 network=udp 31:57.092 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30248 network=tcp 31:57.592 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.592 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_WarnCheck_ACLDeny (0.91s) --- PASS: TestAgent_WarnCheck_ACLDeny/no_token (0.00s) --- PASS: TestAgent_WarnCheck_ACLDeny/root_token (0.00s) === CONT TestAgent_RegisterCheck_ACLDeny === RUN TestAgent_DeregisterCheckACLDeny/no_token === RUN TestAgent_DeregisterCheckACLDeny/root_token [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:56.974Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:56.974Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.002Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:57.002Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.034 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:28607d04-31bd-602c-fc15-477c852ba160 Address:127.0.0.1:30192}]" 31:57.035 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-28607d04-31bd-602c-fc15-477c852ba160.dc1 127.0.0.1 31:57.035 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-28607d04-31bd-602c-fc15-477c852ba160 127.0.0.1 2021-10-05T16:31:57.035Z [INFO] agent.router: Initializing LAN area manager 31:57.035 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30226 network=udp 31:57.035 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30192 [Follower]" leader= 31:57.036 [INFO] TestAgent.server: Adding LAN server: server="Node-28607d04-31bd-602c-fc15-477c852ba160 (Addr: tcp/127.0.0.1:30192) (DC: dc1)" 31:57.036 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-28607d04-31bd-602c-fc15-477c852ba160.dc1 area=wan 31:57.036 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30226 network=tcp 31:57.036 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30227 network=tcp 31:57.037 [INFO] TestAgent: started state syncer 31:57.037 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30232 network=tcp 31:57.084 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.084 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30192 [Candidate]" term=2 31:57.088 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:57.119 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.119 [DEBUG] TestAgent.server.raft: vote granted: from=28607d04-31bd-602c-fc15-477c852ba160 term=2 tally=1 31:57.119 [INFO] TestAgent.server.raft: election won: tally=1 31:57.119 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30192 [Leader]" 31:57.119 [INFO] TestAgent.server: cluster leadership acquired 31:57.119 [INFO] TestAgent.server: New leader elected: payload=Node-28607d04-31bd-602c-fc15-477c852ba160 31:57.126 [INFO] TestAgent.server: initializing acls 31:57.131 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:57.131 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:57.141 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:57.158 [INFO] TestAgent: Synced node info 31:57.158 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:57.158 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:57.158 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:57.158 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-28607d04-31bd-602c-fc15-477c852ba160 31:57.158 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-28607d04-31bd-602c-fc15-477c852ba160.dc1 31:57.159 [INFO] TestAgent.server: Updating LAN server: server="Node-28607d04-31bd-602c-fc15-477c852ba160 (Addr: tcp/127.0.0.1:30192) (DC: dc1)" 31:57.159 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-28607d04-31bd-602c-fc15-477c852ba160.dc1 area=wan 31:57.187 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.221 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.221 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.221 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.221 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.221 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.221 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-28607d04-31bd-602c-fc15-477c852ba160 31:57.221 [INFO] TestAgent.server: member joined, marking health alive: member=Node-28607d04-31bd-602c-fc15-477c852ba160 31:57.229 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-28607d04-31bd-602c-fc15-477c852ba160 31:57.237 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.303 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-28607d04-31bd-602c-fc15-477c852ba160 31:57.303 [INFO] TestAgent: Requesting shutdown 31:57.303 [INFO] TestAgent.server: shutting down server 31:57.303 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.303 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.303 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:57.303 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:57.303 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.303 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.303 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.303 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.303 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.303 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.303 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.303 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:57.303 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:57.303 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.312 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.324Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.324Z [INFO] agent.router.manager: shutting down 31:57.325 [INFO] TestAgent: consul server down 31:57.325 [INFO] TestAgent: shutdown complete 31:57.325 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30226 network=tcp 31:57.325 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30226 network=udp 31:57.325 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30227 network=tcp 31:57.825 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.825 [INFO] TestAgent: Endpoints down --- PASS: TestSnapshot_Options (5.88s) --- PASS: TestSnapshot_Options/GET (0.83s) --- PASS: TestSnapshot_Options/GET#01 (1.04s) --- PASS: TestSnapshot_Options/GET#02 (1.23s) --- PASS: TestSnapshot_Options/PUT (1.05s) --- PASS: TestSnapshot_Options/PUT#01 (0.83s) --- PASS: TestSnapshot_Options/PUT#02 (0.89s) === CONT TestAgent_RegisterCheck_BadStatus 2021-10-05T16:31:57.187Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.204Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.239 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:97b791b9-fe6f-1c82-765c-2bb2321f36c3 Address:127.0.0.1:30259}]" 31:57.239 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30259 [Follower]" leader= 31:57.240 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-97b791b9-fe6f-1c82-765c-2bb2321f36c3.dc1 127.0.0.1 31:57.241 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-97b791b9-fe6f-1c82-765c-2bb2321f36c3 127.0.0.1 2021-10-05T16:31:57.241Z [INFO] agent.router: Initializing LAN area manager 31:57.241 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30275 network=udp 31:57.241 [INFO] TestAgent.server: Adding LAN server: server="Node-97b791b9-fe6f-1c82-765c-2bb2321f36c3 (Addr: tcp/127.0.0.1:30259) (DC: dc1)" 31:57.241 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-97b791b9-fe6f-1c82-765c-2bb2321f36c3.dc1 area=wan 31:57.241 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30275 network=tcp 31:57.242 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30276 network=tcp 31:57.242 [INFO] TestAgent: started state syncer 31:57.242 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30193 network=tcp 31:57.280 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.280 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30259 [Candidate]" term=2 31:57.311 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.311 [DEBUG] TestAgent.server.raft: vote granted: from=97b791b9-fe6f-1c82-765c-2bb2321f36c3 term=2 tally=1 31:57.311 [INFO] TestAgent.server.raft: election won: tally=1 31:57.311 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30259 [Leader]" 31:57.312 [INFO] TestAgent.server: cluster leadership acquired 31:57.312 [INFO] TestAgent.server: New leader elected: payload=Node-97b791b9-fe6f-1c82-765c-2bb2321f36c3 31:57.324 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30259 31:57.344 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.398 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.398 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.398 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.398 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.398 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.398 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-97b791b9-fe6f-1c82-765c-2bb2321f36c3 31:57.398 [INFO] TestAgent.server: member joined, marking health alive: member=Node-97b791b9-fe6f-1c82-765c-2bb2321f36c3 31:57.425 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.425 [DEBUG] TestAgent: Check status updated: check=test status=passing 31:57.433 [INFO] TestAgent: Synced node info 31:57.445 [INFO] TestAgent: Synced check: check=test 31:57.445 [INFO] TestAgent: Requesting shutdown 31:57.445 [INFO] TestAgent.server: shutting down server 31:57.445 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.445 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.445 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.445 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.445 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.445 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.445 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.445 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:57.445 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.445 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.445 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.454 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.459Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.460Z [INFO] agent.router.manager: shutting down 31:57.460 [INFO] TestAgent: consul server down 31:57.460 [INFO] TestAgent: shutdown complete 31:57.460 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30275 network=tcp 31:57.460 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30275 network=udp 31:57.460 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30276 network=tcp 31:57.961 [INFO] TestAgent: Waiting for endpoints to shut down 31:57.961 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PassCheck (0.79s) === CONT TestAgent_RegisterCheck_Passing 2021-10-05T16:31:57.227Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.244Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.316 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:733e3b1b-33ff-94e2-2859-c143ee57b607 Address:127.0.0.1:30115}]" 31:57.316 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30115 [Follower]" leader= 31:57.317 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-733e3b1b-33ff-94e2-2859-c143ee57b607.dc1 127.0.0.1 31:57.317 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-733e3b1b-33ff-94e2-2859-c143ee57b607 127.0.0.1 2021-10-05T16:31:57.317Z [INFO] agent.router: Initializing LAN area manager 31:57.317 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30261 network=udp 31:57.317 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-733e3b1b-33ff-94e2-2859-c143ee57b607.dc1 area=wan 31:57.317 [INFO] TestAgent.server: Adding LAN server: server="Node-733e3b1b-33ff-94e2-2859-c143ee57b607 (Addr: tcp/127.0.0.1:30115) (DC: dc1)" 31:57.318 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30261 network=tcp 31:57.318 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30262 network=tcp 31:57.318 [INFO] TestAgent: started state syncer 31:57.318 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30116 network=tcp 31:57.356 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.356 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30115 [Candidate]" term=2 31:57.390 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.390 [DEBUG] TestAgent.server.raft: vote granted: from=733e3b1b-33ff-94e2-2859-c143ee57b607 term=2 tally=1 31:57.390 [INFO] TestAgent.server.raft: election won: tally=1 31:57.390 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30115 [Leader]" 31:57.392 [INFO] TestAgent.server: cluster leadership acquired 31:57.392 [INFO] TestAgent.server: New leader elected: payload=Node-733e3b1b-33ff-94e2-2859-c143ee57b607 31:57.408 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30115 31:57.437 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.476 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.476 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.476 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.476 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.476 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.476 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-733e3b1b-33ff-94e2-2859-c143ee57b607 31:57.476 [INFO] TestAgent.server: member joined, marking health alive: member=Node-733e3b1b-33ff-94e2-2859-c143ee57b607 31:57.486 [INFO] TestAgent: Synced node info 31:57.486 [DEBUG] TestAgent: Node info in sync 31:57.507 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.520 [DEBUG] TestAgent: removed check: check=test 31:57.520 [DEBUG] TestAgent: Node info in sync 31:57.524 [INFO] TestAgent: Deregistered check: check=test 31:57.525 [INFO] TestAgent: Requesting shutdown 31:57.525 [INFO] TestAgent.server: shutting down server 31:57.525 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.525 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.525 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.525 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.525 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.525 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.525 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.525 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.525 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.525 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.536 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.547Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.547Z [INFO] agent.router.manager: shutting down 31:57.547 [INFO] TestAgent: consul server down 31:57.547 [INFO] TestAgent: shutdown complete 31:57.547 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30261 network=tcp 31:57.547 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30261 network=udp 31:57.547 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30262 network=tcp 31:58.048 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.048 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_DeregisterCheck (0.84s) === CONT TestAgent_RegisterCheckScriptsExecRemoteDisable [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_RegisterCheck_ACLDeny/no_token_-_node_check === RUN TestAgent_RegisterCheck_ACLDeny/svc_token_-_node_check === RUN TestAgent_RegisterCheck_ACLDeny/node_token_-_node_check 2021-10-05T16:31:57.194Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:57.194Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.225Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:57.225Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.328 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c44cc17f-67a3-339f-64b7-cf75057356a0 Address:127.0.0.1:30273}]" 31:57.328 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c44cc17f-67a3-339f-64b7-cf75057356a0.dc1 127.0.0.1 31:57.329 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c44cc17f-67a3-339f-64b7-cf75057356a0 127.0.0.1 2021-10-05T16:31:57.329Z [INFO] agent.router: Initializing LAN area manager 31:57.329 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30268 network=udp 31:57.329 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30273 [Follower]" leader= 31:57.330 [INFO] TestAgent.server: Adding LAN server: server="Node-c44cc17f-67a3-339f-64b7-cf75057356a0 (Addr: tcp/127.0.0.1:30273) (DC: dc1)" 31:57.330 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c44cc17f-67a3-339f-64b7-cf75057356a0.dc1 area=wan 31:57.330 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30268 network=tcp 31:57.330 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30269 network=tcp 31:57.331 [INFO] TestAgent: started state syncer 31:57.331 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30274 network=tcp 31:57.384 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:57.392 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.392 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30273 [Candidate]" term=2 31:57.418 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.418 [DEBUG] TestAgent.server.raft: vote granted: from=c44cc17f-67a3-339f-64b7-cf75057356a0 term=2 tally=1 31:57.418 [INFO] TestAgent.server.raft: election won: tally=1 31:57.418 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30273 [Leader]" 31:57.418 [INFO] TestAgent.server: cluster leadership acquired 31:57.418 [INFO] TestAgent.server: New leader elected: payload=Node-c44cc17f-67a3-339f-64b7-cf75057356a0 31:57.430 [INFO] TestAgent.server: initializing acls 31:57.443 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:57.443 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:57.455 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:57.473 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:57.473 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:57.473 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:57.473 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c44cc17f-67a3-339f-64b7-cf75057356a0 31:57.474 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c44cc17f-67a3-339f-64b7-cf75057356a0.dc1 31:57.474 [INFO] TestAgent.server: Updating LAN server: server="Node-c44cc17f-67a3-339f-64b7-cf75057356a0 (Addr: tcp/127.0.0.1:30273) (DC: dc1)" 31:57.474 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c44cc17f-67a3-339f-64b7-cf75057356a0.dc1 area=wan 31:57.491 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.534 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.535 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.535 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.535 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.535 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.535 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c44cc17f-67a3-339f-64b7-cf75057356a0 31:57.535 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c44cc17f-67a3-339f-64b7-cf75057356a0 31:57.544 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c44cc17f-67a3-339f-64b7-cf75057356a0 31:57.551 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.566 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-c44cc17f-67a3-339f-64b7-cf75057356a0 31:57.567 [DEBUG] TestAgent: Check status updated: check=test status=passing 31:57.588 [INFO] TestAgent: Synced node info 31:57.588 [WARN] TestAgent: Check registration blocked by ACLs: check=test accessorID=00000000-0000-0000-0000-000000000002 31:57.588 [INFO] TestAgent: Requesting shutdown 31:57.588 [INFO] TestAgent.server: shutting down server 31:57.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.588 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.588 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.588 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:57.588 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:57.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.588 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.588 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.588 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.588 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:57.588 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.588 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.588 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.588 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:57.588 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:57.600 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.607Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.607Z [INFO] agent.router.manager: shutting down 31:57.607 [INFO] TestAgent: consul server down 31:57.607 [INFO] TestAgent: shutdown complete 31:57.607 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30268 network=tcp 31:57.607 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30268 network=udp 31:57.607 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30269 network=tcp 31:58.108 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.108 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:57.159Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.173Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.221 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e7a4f633-2caf-5992-4c05-6b141ea303a8 Address:127.0.0.1:30199}]" 31:57.222 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e7a4f633-2caf-5992-4c05-6b141ea303a8.dc1 127.0.0.1 31:57.222 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30199 [Follower]" leader= 31:57.223 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e7a4f633-2caf-5992-4c05-6b141ea303a8 127.0.0.1 2021-10-05T16:31:57.223Z [INFO] agent.router: Initializing LAN area manager 31:57.223 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30219 network=udp 31:57.223 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e7a4f633-2caf-5992-4c05-6b141ea303a8.dc1 area=wan 31:57.223 [INFO] TestAgent.server: Adding LAN server: server="Node-e7a4f633-2caf-5992-4c05-6b141ea303a8 (Addr: tcp/127.0.0.1:30199) (DC: dc1)" 31:57.223 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30219 network=tcp 31:57.224 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30220 network=tcp 31:57.224 [INFO] TestAgent: started state syncer 31:57.224 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30267 network=tcp 31:57.280 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.280 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30199 [Candidate]" term=2 31:57.316 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.316 [DEBUG] TestAgent.server.raft: vote granted: from=e7a4f633-2caf-5992-4c05-6b141ea303a8 term=2 tally=1 31:57.316 [INFO] TestAgent.server.raft: election won: tally=1 31:57.316 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30199 [Leader]" 31:57.316 [INFO] TestAgent.server: cluster leadership acquired 31:57.317 [INFO] TestAgent.server: New leader elected: payload=Node-e7a4f633-2caf-5992-4c05-6b141ea303a8 31:57.334 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30199 31:57.353 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.386 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.386 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.386 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.386 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.386 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.386 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e7a4f633-2caf-5992-4c05-6b141ea303a8 31:57.386 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e7a4f633-2caf-5992-4c05-6b141ea303a8 31:57.407 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.412 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:57.421 [INFO] TestAgent: Synced node info 31:57.572 [DEBUG] TestAgent: Check status updated: check=test status=warning 31:57.576 [DEBUG] TestAgent: Node info in sync 31:57.592 [INFO] TestAgent: Synced check: check=test 31:57.592 [INFO] TestAgent: Requesting shutdown 31:57.592 [INFO] TestAgent.server: shutting down server 31:57.592 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.592 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.592 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.592 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.592 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.592 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.592 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.592 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.592 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.592 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.599 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.607Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.607Z [INFO] agent.router.manager: shutting down 31:57.607 [INFO] TestAgent: consul server down 31:57.607 [INFO] TestAgent: shutdown complete 31:57.607 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30219 network=tcp 31:57.607 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30219 network=udp 31:57.607 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30220 network=tcp 31:58.108 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.108 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_PassCheck_ACLDeny (0.94s) --- PASS: TestAgent_PassCheck_ACLDeny/no_token (0.00s) --- PASS: TestAgent_PassCheck_ACLDeny/root_token (0.02s) === CONT TestAgent_RegisterCheckScriptsExecDisable --- PASS: TestAgent_WarnCheck (0.96s) === CONT TestAgent_RegisterCheck_Scripts === RUN TestAgent_RegisterCheck_ACLDeny/no_token_-_svc_check === RUN TestAgent_RegisterCheck_ACLDeny/node_token_-_svc_check === RUN TestAgent_RegisterCheck_ACLDeny/svc_token_-_svc_check 2021-10-05T16:31:57.208Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:57.208Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.231Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:57.231Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.320 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ef5969e6-afe5-6821-3a55-cff78b3b99f1 Address:127.0.0.1:30224}]" 31:57.320 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1.dc1 127.0.0.1 31:57.321 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 127.0.0.1 2021-10-05T16:31:57.321Z [INFO] agent.router: Initializing LAN area manager 31:57.321 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30194 network=udp 31:57.321 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30224 [Follower]" leader= 31:57.322 [INFO] TestAgent.server: Adding LAN server: server="Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 (Addr: tcp/127.0.0.1:30224) (DC: dc1)" 31:57.322 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1.dc1 area=wan 31:57.322 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30194 network=tcp 31:57.322 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30195 network=tcp 31:57.322 [INFO] TestAgent: started state syncer 31:57.322 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30260 network=tcp 31:57.370 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.370 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30224 [Candidate]" term=2 31:57.372 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:57.389 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.389 [DEBUG] TestAgent.server.raft: vote granted: from=ef5969e6-afe5-6821-3a55-cff78b3b99f1 term=2 tally=1 31:57.389 [INFO] TestAgent.server.raft: election won: tally=1 31:57.389 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30224 [Leader]" 31:57.389 [INFO] TestAgent.server: cluster leadership acquired 31:57.389 [INFO] TestAgent.server: New leader elected: payload=Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 31:57.399 [INFO] TestAgent.server: initializing acls 31:57.405 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:57.405 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:57.417 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:57.436 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:57.436 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:57.436 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:57.436 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 31:57.436 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1.dc1 31:57.437 [INFO] TestAgent.server: Updating LAN server: server="Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 (Addr: tcp/127.0.0.1:30224) (DC: dc1)" 31:57.437 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1.dc1 area=wan 31:57.461 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.487 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.487 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.487 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.487 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.487 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.487 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 31:57.487 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 31:57.497 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 31:57.505 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.739 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:57.750 [INFO] TestAgent: Synced node info 31:57.751 [DEBUG] TestAgent: Node info in sync 31:57.759 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-ef5969e6-afe5-6821-3a55-cff78b3b99f1 31:57.759 [DEBUG] TestAgent: removed check: check=test 31:57.759 [DEBUG] TestAgent: Node info in sync 31:57.759 [INFO] TestAgent: Deregistered check: check=test 31:57.759 [INFO] TestAgent: Requesting shutdown 31:57.759 [INFO] TestAgent.server: shutting down server 31:57.759 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:57.759 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.759 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.759 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.759 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.759 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:57.759 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.760 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:57.760 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.760 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.760 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.760 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.760 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:57.760 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.769 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.773Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.773Z [INFO] agent.router.manager: shutting down 31:57.774 [INFO] TestAgent: consul server down 31:57.774 [INFO] TestAgent: shutdown complete 31:57.774 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30194 network=tcp 31:57.774 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30194 network=udp 31:57.774 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30195 network=tcp 31:58.274 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.274 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_DeregisterCheckACLDeny (1.10s) --- PASS: TestAgent_DeregisterCheckACLDeny/no_token (0.00s) --- PASS: TestAgent_DeregisterCheckACLDeny/root_token (0.00s) === CONT TestAgent_ForceLeavePrune [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_RegisterCheck_Scripts/==_Consul_1.0.0_as_node_check [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_RegisterCheck_Scripts/==_Consul_1.0.0_as_top-level_service_check === RUN TestAgent_RegisterCheck_Scripts/==_Consul_1.0.0_as_slice-based_service_check === RUN TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_(fixup)_as_node_check === RUN TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_(fixup)_as_top-level_service_check 2021-10-05T16:31:57.836Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.846Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.897 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3a25b85f-988c-f598-1b2f-dd1f828888b5 Address:127.0.0.1:30294}]" 31:57.898 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3a25b85f-988c-f598-1b2f-dd1f828888b5.dc1 127.0.0.1 31:57.899 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3a25b85f-988c-f598-1b2f-dd1f828888b5 127.0.0.1 2021-10-05T16:31:57.899Z [INFO] agent.router: Initializing LAN area manager 31:57.899 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30289 network=udp 31:57.899 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30294 [Follower]" leader= 31:57.899 [INFO] TestAgent.server: Adding LAN server: server="Node-3a25b85f-988c-f598-1b2f-dd1f828888b5 (Addr: tcp/127.0.0.1:30294) (DC: dc1)" 31:57.899 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3a25b85f-988c-f598-1b2f-dd1f828888b5.dc1 area=wan 31:57.900 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30289 network=tcp 31:57.903 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30290 network=tcp 31:57.903 [INFO] TestAgent: started state syncer 31:57.903 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30316 network=tcp 31:57.959 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.960 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30294 [Candidate]" term=2 31:58.004 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.004 [DEBUG] TestAgent.server.raft: vote granted: from=3a25b85f-988c-f598-1b2f-dd1f828888b5 term=2 tally=1 31:58.004 [INFO] TestAgent.server.raft: election won: tally=1 31:58.004 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30294 [Leader]" 31:58.007 [INFO] TestAgent.server: cluster leadership acquired 31:58.007 [INFO] TestAgent.server: New leader elected: payload=Node-3a25b85f-988c-f598-1b2f-dd1f828888b5 31:58.014 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30294 31:58.036 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.086 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.086 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:58.086 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:58.086 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:58.086 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:58.086 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3a25b85f-988c-f598-1b2f-dd1f828888b5 31:58.087 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3a25b85f-988c-f598-1b2f-dd1f828888b5 31:58.128 [INFO] TestAgent.server: federation state anti-entropy synced 31:58.129 [INFO] TestAgent: Requesting shutdown 31:58.129 [INFO] TestAgent.server: shutting down server 31:58.129 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.129 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.129 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.129 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.129 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.129 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.129 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.129 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:58.129 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.129 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.129 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.144 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.164Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.164Z [INFO] agent.router.manager: shutting down 31:58.166 [INFO] TestAgent: consul server down 31:58.166 [INFO] TestAgent: shutdown complete 31:58.166 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30289 network=tcp 31:58.166 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30289 network=udp 31:58.166 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30290 network=tcp 31:58.667 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.667 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterCheck_BadStatus (0.84s) === CONT TestAgent_ForceLeave_ACLDeny 2021-10-05T16:31:57.616Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.630Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.690 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a71a3f31-e554-22ce-9c9d-a12f2e114b80 Address:127.0.0.1:30301}]" 31:57.690 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30301 [Follower]" leader= 31:57.691 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80.dc1 127.0.0.1 31:57.691 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 127.0.0.1 2021-10-05T16:31:57.691Z [INFO] agent.router: Initializing LAN area manager 31:57.692 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30296 network=udp 31:57.692 [INFO] TestAgent.server: Adding LAN server: server="Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 (Addr: tcp/127.0.0.1:30301) (DC: dc1)" 31:57.692 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30296 network=tcp 31:57.692 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80.dc1 area=wan 31:57.692 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30297 network=tcp 31:57.692 [INFO] TestAgent: started state syncer 31:57.692 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30288 network=tcp 31:57.744 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:57.751 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.751 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30301 [Candidate]" term=2 31:57.765 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.765 [DEBUG] TestAgent.server.raft: vote granted: from=a71a3f31-e554-22ce-9c9d-a12f2e114b80 term=2 tally=1 31:57.765 [INFO] TestAgent.server.raft: election won: tally=1 31:57.765 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30301 [Leader]" 31:57.766 [INFO] TestAgent.server: cluster leadership acquired 31:57.766 [INFO] TestAgent.server: New leader elected: payload=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 31:57.773 [INFO] TestAgent.server: initializing acls 31:57.786 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:57.786 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:57.795 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:57.811 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:57.811 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:57.811 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:57.811 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 31:57.811 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80.dc1 31:57.811 [INFO] TestAgent.server: Updating LAN server: server="Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 (Addr: tcp/127.0.0.1:30301) (DC: dc1)" 31:57.811 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80.dc1 area=wan 31:57.833 [INFO] TestAgent: Synced node info 31:57.833 [DEBUG] TestAgent: Node info in sync 31:57.864 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.932 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.932 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.932 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.932 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.932 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.932 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 31:57.932 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 31:57.954 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.954 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 31:58.017 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 31:58.018 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-a71a3f31-e554-22ce-9c9d-a12f2e114b80 31:58.028 [DEBUG] TestAgent: Node info in sync 31:58.038 [INFO] TestAgent: Synced service: service=foo:1234 31:58.086 [DEBUG] TestAgent: Node info in sync 31:58.086 [DEBUG] TestAgent: Service in sync: service=foo:1234 31:58.110 [INFO] TestAgent: Synced check: check=test 31:58.128 [DEBUG] TestAgent: Node info in sync 31:58.128 [DEBUG] TestAgent: Service in sync: service=foo:1234 31:58.128 [DEBUG] TestAgent: Check in sync: check=test 31:58.148 [INFO] TestAgent: Synced check: check=test2 31:58.148 [INFO] TestAgent: Requesting shutdown 31:58.148 [INFO] TestAgent.server: shutting down server 31:58.148 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:58.148 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:58.148 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.148 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.148 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.148 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.148 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.148 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.148 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.148 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:58.148 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:58.148 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.149 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.149 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.163 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.166Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.166Z [INFO] agent.router.manager: shutting down 31:58.166 [INFO] TestAgent: consul server down 31:58.166 [INFO] TestAgent: shutdown complete 31:58.166 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30296 network=tcp 31:58.166 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30296 network=udp 31:58.166 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30297 network=tcp 31:58.669 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.669 [INFO] TestAgent: Endpoints down === RUN TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_(fixup)_as_slice-based_service_check --- PASS: TestAgent_RegisterCheck_ACLDeny (1.09s) --- PASS: TestAgent_RegisterCheck_ACLDeny/no_token_-_node_check (0.00s) --- PASS: TestAgent_RegisterCheck_ACLDeny/svc_token_-_node_check (0.00s) --- PASS: TestAgent_RegisterCheck_ACLDeny/node_token_-_node_check (0.03s) --- PASS: TestAgent_RegisterCheck_ACLDeny/no_token_-_svc_check (0.00s) --- PASS: TestAgent_RegisterCheck_ACLDeny/node_token_-_svc_check (0.00s) --- PASS: TestAgent_RegisterCheck_ACLDeny/svc_token_-_svc_check (0.04s) === CONT TestOpenMetricsMimeTypeHeaders --- PASS: TestOpenMetricsMimeTypeHeaders (0.00s) === CONT TestAgent_ForceLeave === RUN TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_as_node_check === RUN TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_as_top-level_service_check === RUN TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_as_slice-based_service_check [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:58.177Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.197Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.252 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4b9aa5a8-5458-03e9-2bbf-bf5cf4906463 Address:127.0.0.1:30315}]" 31:58.252 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30315 [Follower]" leader= 31:58.253 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4b9aa5a8-5458-03e9-2bbf-bf5cf4906463.dc1 127.0.0.1 31:58.253 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4b9aa5a8-5458-03e9-2bbf-bf5cf4906463 127.0.0.1 2021-10-05T16:31:58.253Z [INFO] agent.router: Initializing LAN area manager 31:58.253 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30310 network=udp 31:58.254 [INFO] TestAgent.server: Adding LAN server: server="Node-4b9aa5a8-5458-03e9-2bbf-bf5cf4906463 (Addr: tcp/127.0.0.1:30315) (DC: dc1)" 31:58.254 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4b9aa5a8-5458-03e9-2bbf-bf5cf4906463.dc1 area=wan 31:58.254 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30310 network=tcp 31:58.254 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30311 network=tcp 31:58.254 [INFO] TestAgent: started state syncer 31:58.254 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30337 network=tcp 31:58.296 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.296 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30315 [Candidate]" term=2 31:58.339 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.339 [DEBUG] TestAgent.server.raft: vote granted: from=4b9aa5a8-5458-03e9-2bbf-bf5cf4906463 term=2 tally=1 31:58.339 [INFO] TestAgent.server.raft: election won: tally=1 31:58.339 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30315 [Leader]" 31:58.340 [INFO] TestAgent.server: cluster leadership acquired 31:58.340 [INFO] TestAgent.server: New leader elected: payload=Node-4b9aa5a8-5458-03e9-2bbf-bf5cf4906463 31:58.354 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30315 31:58.388 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.431 [INFO] TestAgent: Synced node info 31:58.441 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.441 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:58.441 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:58.441 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:58.441 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:58.441 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4b9aa5a8-5458-03e9-2bbf-bf5cf4906463 31:58.441 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4b9aa5a8-5458-03e9-2bbf-bf5cf4906463 31:58.461 [INFO] TestAgent.server: federation state anti-entropy synced 31:58.479 [INFO] TestAgent: Requesting shutdown 31:58.479 [INFO] TestAgent.server: shutting down server 31:58.479 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.479 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.479 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.479 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.479 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.479 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.479 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.479 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.479 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.479 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.485 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.508Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.508Z [INFO] agent.router.manager: shutting down 31:58.508 [INFO] TestAgent: consul server down 31:58.508 [INFO] TestAgent: shutdown complete 31:58.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30310 network=tcp 31:58.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30310 network=udp 31:58.508 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30311 network=tcp 31:59.012 [INFO] TestAgent: Waiting for endpoints to shut down 31:59.012 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterCheckScriptsExecDisable (0.90s) === CONT TestAgent_Leave_ACLDeny 2021-10-05T16:31:58.003Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.037Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.156 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1177de88-73b4-8f74-a31e-02cf03a12fd2 Address:127.0.0.1:30322}]" 31:58.157 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30322 [Follower]" leader= 31:58.157 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1177de88-73b4-8f74-a31e-02cf03a12fd2.dc1 127.0.0.1 31:58.159 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1177de88-73b4-8f74-a31e-02cf03a12fd2 127.0.0.1 2021-10-05T16:31:58.159Z [INFO] agent.router: Initializing LAN area manager 31:58.159 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30317 network=udp 31:58.159 [INFO] TestAgent.server: Adding LAN server: server="Node-1177de88-73b4-8f74-a31e-02cf03a12fd2 (Addr: tcp/127.0.0.1:30322) (DC: dc1)" 31:58.159 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1177de88-73b4-8f74-a31e-02cf03a12fd2.dc1 area=wan 31:58.159 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30317 network=tcp 31:58.160 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30318 network=tcp 31:58.160 [INFO] TestAgent: started state syncer 31:58.161 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30358 network=tcp 31:58.202 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.202 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30322 [Candidate]" term=2 31:58.220 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.220 [DEBUG] TestAgent.server.raft: vote granted: from=1177de88-73b4-8f74-a31e-02cf03a12fd2 term=2 tally=1 31:58.220 [INFO] TestAgent.server.raft: election won: tally=1 31:58.220 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30322 [Leader]" 31:58.221 [INFO] TestAgent.server: cluster leadership acquired 31:58.221 [INFO] TestAgent.server: New leader elected: payload=Node-1177de88-73b4-8f74-a31e-02cf03a12fd2 31:58.231 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30322 31:58.255 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.296 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.296 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:58.296 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:58.296 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:58.296 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:58.296 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1177de88-73b4-8f74-a31e-02cf03a12fd2 31:58.296 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1177de88-73b4-8f74-a31e-02cf03a12fd2 31:58.324 [INFO] TestAgent.server: federation state anti-entropy synced 31:58.371 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:58.376 [INFO] TestAgent: Synced node info 31:58.376 [DEBUG] TestAgent: Node info in sync 31:58.542 [DEBUG] TestAgent: Node info in sync 31:58.546 [INFO] TestAgent: Synced check: check=test 31:58.546 [INFO] TestAgent: Requesting shutdown 31:58.546 [INFO] TestAgent.server: shutting down server 31:58.546 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.546 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.546 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.546 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.546 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.546 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.546 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.546 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.546 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.546 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.556 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.564Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.564Z [INFO] agent.router.manager: shutting down 31:58.564 [INFO] TestAgent: consul server down 31:58.564 [INFO] TestAgent: shutdown complete 31:58.564 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30317 network=tcp 31:58.564 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30317 network=udp 31:58.564 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30318 network=tcp 31:59.065 [INFO] TestAgent: Waiting for endpoints to shut down 31:59.065 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterCheck_Passing (1.10s) === CONT TestAgent_Leave [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_ForceLeave_ACLDeny/no_token === RUN TestAgent_ForceLeave_ACLDeny/agent_master_token === RUN TestAgent_ForceLeave_ACLDeny/read-only_token 2021-10-05T16:31:58.080Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.141Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.222 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0c233b5c-cfad-0920-e31f-b597c946c0a3 Address:127.0.0.1:30364}]" 31:58.222 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0c233b5c-cfad-0920-e31f-b597c946c0a3.dc1 127.0.0.1 31:58.223 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0c233b5c-cfad-0920-e31f-b597c946c0a3 127.0.0.1 2021-10-05T16:31:58.223Z [INFO] agent.router: Initializing LAN area manager 31:58.223 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30359 network=udp 31:58.223 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30364 [Follower]" leader= 31:58.223 [INFO] TestAgent.server: Adding LAN server: server="Node-0c233b5c-cfad-0920-e31f-b597c946c0a3 (Addr: tcp/127.0.0.1:30364) (DC: dc1)" 31:58.223 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0c233b5c-cfad-0920-e31f-b597c946c0a3.dc1 area=wan 31:58.223 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30359 network=tcp 31:58.224 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30360 network=tcp 31:58.224 [INFO] TestAgent: started state syncer 31:58.224 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30309 network=tcp 31:58.272 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.272 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30364 [Candidate]" term=2 31:58.286 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.286 [DEBUG] TestAgent.server.raft: vote granted: from=0c233b5c-cfad-0920-e31f-b597c946c0a3 term=2 tally=1 31:58.286 [INFO] TestAgent.server.raft: election won: tally=1 31:58.286 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30364 [Leader]" 31:58.287 [INFO] TestAgent.server: cluster leadership acquired 31:58.287 [INFO] TestAgent.server: New leader elected: payload=Node-0c233b5c-cfad-0920-e31f-b597c946c0a3 31:58.297 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30364 31:58.338 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.380 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.380 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:58.380 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:58.380 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:58.380 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:58.380 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0c233b5c-cfad-0920-e31f-b597c946c0a3 31:58.380 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0c233b5c-cfad-0920-e31f-b597c946c0a3 31:58.413 [INFO] TestAgent.server: federation state anti-entropy synced 31:58.436 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:58.442 [INFO] TestAgent: Synced node info 31:58.585 [INFO] TestAgent: Requesting shutdown 31:58.585 [INFO] TestAgent.server: shutting down server 31:58.585 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.585 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.585 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.585 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.585 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.585 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.585 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.585 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.585 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.585 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.591 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.596Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.596Z [INFO] agent.router.manager: shutting down 31:58.596 [INFO] TestAgent: consul server down 31:58.596 [INFO] TestAgent: shutdown complete 31:58.596 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30359 network=tcp 31:58.596 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30359 network=udp 31:58.596 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30360 network=tcp 31:59.097 [INFO] TestAgent: Waiting for endpoints to shut down 31:59.097 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterCheckScriptsExecRemoteDisable (1.05s) === CONT TestAgent_JoinLANNotify === RUN TestAgent_ForceLeave_ACLDeny/operator_write_token 2021-10-05T16:31:58.185Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.185Z [WARN] agent: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 2021-10-05T16:31:58.201Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.201Z [WARN] agent.auto_config: using enable-script-checks without ACLs and without allow_write_http_from is DANGEROUS, use enable-local-script-checks instead, see https://www.hashicorp.com/blog/protecting-consul-from-rce-risk-in-specific-configurations/ 31:58.249 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:545fb5b4-7c96-12b7-cb3b-5f2928b237ac Address:127.0.0.1:30350}]" 31:58.250 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-545fb5b4-7c96-12b7-cb3b-5f2928b237ac.dc1 127.0.0.1 31:58.250 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30350 [Follower]" leader= 31:58.251 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-545fb5b4-7c96-12b7-cb3b-5f2928b237ac 127.0.0.1 2021-10-05T16:31:58.251Z [INFO] agent.router: Initializing LAN area manager 31:58.251 [INFO] TestAgent.server: Adding LAN server: server="Node-545fb5b4-7c96-12b7-cb3b-5f2928b237ac (Addr: tcp/127.0.0.1:30350) (DC: dc1)" 31:58.251 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-545fb5b4-7c96-12b7-cb3b-5f2928b237ac.dc1 area=wan 31:58.251 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30338 network=udp 31:58.251 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30338 network=tcp 31:58.252 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30339 network=tcp 31:58.252 [INFO] TestAgent: started state syncer 31:58.252 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30302 network=tcp 31:58.296 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.296 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30350 [Candidate]" term=2 31:58.324 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.324 [DEBUG] TestAgent.server.raft: vote granted: from=545fb5b4-7c96-12b7-cb3b-5f2928b237ac term=2 tally=1 31:58.324 [INFO] TestAgent.server.raft: election won: tally=1 31:58.324 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30350 [Leader]" 31:58.324 [INFO] TestAgent.server: cluster leadership acquired 31:58.324 [INFO] TestAgent.server: New leader elected: payload=Node-545fb5b4-7c96-12b7-cb3b-5f2928b237ac 31:58.339 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30350 31:58.371 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.438 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.438 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:58.438 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:58.438 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:58.438 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:58.438 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-545fb5b4-7c96-12b7-cb3b-5f2928b237ac 31:58.438 [INFO] TestAgent.server: member joined, marking health alive: member=Node-545fb5b4-7c96-12b7-cb3b-5f2928b237ac 31:58.458 [INFO] TestAgent.server: federation state anti-entropy synced 31:58.477 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:58.483 [INFO] TestAgent: Synced node info 31:58.572 [DEBUG] TestAgent: Node info in sync 31:58.584 [INFO] TestAgent: Synced check: check=test 31:58.598 [DEBUG] TestAgent: Node info in sync 31:58.610 [INFO] TestAgent: Synced service: service=a 31:58.610 [DEBUG] TestAgent: Check in sync: check=test 31:58.610 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.632 [DEBUG] TestAgent: Node info in sync 31:58.637 [INFO] TestAgent: Synced service: service=a 31:58.637 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.637 [DEBUG] TestAgent: Check in sync: check=test 31:58.648 [DEBUG] TestAgent: Node info in sync 31:58.648 [DEBUG] TestAgent: Service in sync: service=a 31:58.658 [INFO] TestAgent: Synced check: check=test 31:58.658 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.667 [DEBUG] TestAgent: Node info in sync 31:58.674 [INFO] TestAgent: Synced service: service=a 31:58.674 [DEBUG] TestAgent: Check in sync: check=test 31:58.674 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.690 [DEBUG] TestAgent: Node info in sync 31:58.708 [INFO] TestAgent: Synced service: service=a 31:58.708 [DEBUG] TestAgent: Check in sync: check=test 31:58.708 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.717 [DEBUG] TestAgent: Node info in sync 31:58.717 [DEBUG] TestAgent: Service in sync: service=a 31:58.724 [INFO] TestAgent: Synced check: check=test 31:58.724 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.743 [DEBUG] TestAgent: Node info in sync 31:58.748 [INFO] TestAgent: Synced service: service=a 31:58.748 [DEBUG] TestAgent: Check in sync: check=test 31:58.748 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.769 [DEBUG] TestAgent: Node info in sync 31:58.779 [INFO] TestAgent: Synced service: service=a 31:58.779 [DEBUG] TestAgent: Check in sync: check=test 31:58.779 [DEBUG] TestAgent: Check in sync: check=service:a 31:58.779 [INFO] TestAgent: Requesting shutdown 31:58.779 [INFO] TestAgent.server: shutting down server 31:58.779 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.779 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.779 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.779 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.779 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.779 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.779 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.779 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.779 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.779 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.786 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.791Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.791Z [INFO] agent.router.manager: shutting down 31:58.791 [INFO] TestAgent: consul server down 31:58.791 [INFO] TestAgent: shutdown complete 31:58.791 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30338 network=tcp 31:58.791 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30338 network=udp 31:58.791 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30339 network=tcp 31:59.292 [INFO] TestAgent: Waiting for endpoints to shut down 31:59.292 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_RegisterCheck_Scripts (1.19s) --- PASS: TestAgent_RegisterCheck_Scripts/==_Consul_1.0.0_as_node_check (0.02s) --- PASS: TestAgent_RegisterCheck_Scripts/==_Consul_1.0.0_as_top-level_service_check (0.03s) --- PASS: TestAgent_RegisterCheck_Scripts/==_Consul_1.0.0_as_slice-based_service_check (0.03s) --- PASS: TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_(fixup)_as_node_check (0.02s) --- PASS: TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_(fixup)_as_top-level_service_check (0.02s) --- PASS: TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_(fixup)_as_slice-based_service_check (0.03s) --- PASS: TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_as_node_check (0.02s) --- PASS: TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_as_top-level_service_check (0.02s) --- PASS: TestAgent_RegisterCheck_Scripts/>_Consul_1.0.0_as_slice-based_service_check (0.03s) === CONT TestAgent_Join_ACLDeny [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:57.451Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:57.451Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.483Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:57.483Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.523 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 Address:127.0.0.1:30280}]" 31:57.524 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30280 [Follower]" leader= 31:57.524 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9.dc1 127.0.0.1 31:57.525 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 127.0.0.1 2021-10-05T16:31:57.525Z [INFO] agent.router: Initializing LAN area manager 31:57.525 [INFO] TestAgent.server: Adding LAN server: server="Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 (Addr: tcp/127.0.0.1:30280) (DC: dc1)" 31:57.525 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9.dc1 area=wan 31:57.525 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30117 network=udp 31:57.526 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30117 network=tcp 31:57.526 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30118 network=tcp 31:57.526 [INFO] TestAgent: started state syncer 31:57.526 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30295 network=tcp 31:57.576 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:57.586 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.586 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30280 [Candidate]" term=2 31:57.627 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.627 [DEBUG] TestAgent.server.raft: vote granted: from=e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 term=2 tally=1 31:57.627 [INFO] TestAgent.server.raft: election won: tally=1 31:57.627 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30280 [Leader]" 31:57.627 [INFO] TestAgent.server: cluster leadership acquired 31:57.627 [INFO] TestAgent.server: New leader elected: payload=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 31:57.638 [INFO] TestAgent.server: initializing acls 31:57.645 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:57.645 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:57.652 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:57.661 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:57.664 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:57.664 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:57.664 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:57.664 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 31:57.664 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9.dc1 31:57.664 [INFO] TestAgent.server: Updating LAN server: server="Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 (Addr: tcp/127.0.0.1:30280) (DC: dc1)" 31:57.665 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9.dc1 area=wan 31:57.687 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.718 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.718 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.718 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.718 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.718 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.718 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 31:57.718 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 31:57.732 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 31:57.741 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.777 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 31:57.777 [WARN] TestAgent: Node info update blocked by ACLs: node=e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 accessorID=00000000-0000-0000-0000-000000000002 31:57.777 [DEBUG] TestAgent: Node info in sync 31:57.786 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 31:57.786 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-e3e6be5f-77af-ef9a-03fc-b5c37d9e6ee9 31:57.810 [INFO] TestAgent: Updated agent's ACL token: token=acl_token 31:58.888 [DEBUG] TestAgent.acl: dropping service from result due to ACLs: service="{consul {}}" 31:58.888 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:58.900 [INFO] TestAgent: Synced node info 31:58.909 [INFO] TestAgent: Requesting shutdown 31:58.909 [INFO] TestAgent.server: shutting down server 31:58.909 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.909 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.909 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.909 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.909 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:58.909 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:58.910 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.910 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.910 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.910 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.910 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.910 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:58.910 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.910 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:58.916 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.920Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.920Z [INFO] agent.router.manager: shutting down 31:58.920 [INFO] TestAgent: consul server down 31:58.920 [INFO] TestAgent: shutdown complete 31:58.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30117 network=tcp 31:58.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30117 network=udp 31:58.920 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30118 network=tcp 31:59.424 [INFO] TestAgent: Waiting for endpoints to shut down 31:59.424 [INFO] TestAgent: Endpoints down === RUN TestAgent_TokenTriggersFullSync/default === RUN TestAgent_Leave_ACLDeny/no_token === RUN TestAgent_Leave_ACLDeny/read-only_token === RUN TestAgent_Leave_ACLDeny/agent_master_token [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:58.682Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:58.682Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.695Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:58.695Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.748 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 Address:127.0.0.1:30336}]" 31:58.748 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30336 [Follower]" leader= 31:58.748 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2.dc1 127.0.0.1 31:58.749 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 127.0.0.1 2021-10-05T16:31:58.749Z [INFO] agent.router: Initializing LAN area manager 31:58.749 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2.dc1 area=wan 31:58.749 [INFO] TestAgent.server: Adding LAN server: server="Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 (Addr: tcp/127.0.0.1:30336) (DC: dc1)" 31:58.749 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30345 network=tcp 31:58.749 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30345 network=udp 31:58.750 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30346 network=tcp 31:58.750 [INFO] TestAgent: started state syncer 31:58.750 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30365 network=tcp 31:58.799 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.799 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30336 [Candidate]" term=2 31:58.799 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:58.832 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.832 [DEBUG] TestAgent.server.raft: vote granted: from=b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 term=2 tally=1 31:58.832 [INFO] TestAgent.server.raft: election won: tally=1 31:58.832 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30336 [Leader]" 31:58.832 [INFO] TestAgent.server: cluster leadership acquired 31:58.832 [INFO] TestAgent.server: New leader elected: payload=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:58.848 [INFO] TestAgent.server: initializing acls 31:58.859 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:58.859 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:58.866 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:58.879 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:58.879 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:58.879 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:58.879 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:58.879 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2.dc1 31:58.879 [INFO] TestAgent.server: Updating LAN server: server="Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 (Addr: tcp/127.0.0.1:30336) (DC: dc1)" 31:58.879 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2.dc1 area=wan 31:58.896 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.948 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.948 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:58.948 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:58.948 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:58.948 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:58.948 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:58.948 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:58.970 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:58.988 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.068 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:59.086 [INFO] TestAgent: Synced node info 31:59.092 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:59.092 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:59.137 [INFO] TestAgent: Force leaving node: node=Node-b43d3f2e-a9b9-cafc-e773-fc053cdddbc2 31:59.137 [DEBUG] TestAgent.server.serf.lan: serf: Refuting an older leave intent 31:59.137 [DEBUG] TestAgent.server.serf.wan: serf: Refuting an older leave intent 31:59.137 [INFO] TestAgent: Requesting shutdown 31:59.137 [INFO] TestAgent.server: shutting down server 31:59.137 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:59.137 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:59.137 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:59.137 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:59.137 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:59.137 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:59.137 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:59.138 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:59.138 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:59.138 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:59.138 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:59.138 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:59.138 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:59.138 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:59.149 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:59.155Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:59.155Z [INFO] agent.router.manager: shutting down 31:59.155 [INFO] TestAgent: consul server down 31:59.155 [INFO] TestAgent: shutdown complete 31:59.155 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30345 network=tcp 31:59.155 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30345 network=udp 31:59.156 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30346 network=tcp 31:59.656 [INFO] TestAgent: Waiting for endpoints to shut down 31:59.656 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ForceLeave_ACLDeny (0.99s) --- PASS: TestAgent_ForceLeave_ACLDeny/no_token (0.00s) --- PASS: TestAgent_ForceLeave_ACLDeny/agent_master_token (0.00s) --- PASS: TestAgent_ForceLeave_ACLDeny/read-only_token (0.01s) --- PASS: TestAgent_ForceLeave_ACLDeny/operator_write_token (0.04s) === CONT TestAgent_Join_WAN [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_Join_ACLDeny/no_token === RUN TestAgent_Join_ACLDeny/agent_master_token === RUN TestAgent_Join_ACLDeny/read-only_token [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:59.445Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:59.445Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.536Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:59.536Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.624 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:60967cc9-5c22-e184-e54e-8fce3542003c Address:127.0.0.1:30406}]" 31:59.625 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30406 [Follower]" leader= 31:59.625 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-60967cc9-5c22-e184-e54e-8fce3542003c.dc1 127.0.0.1 31:59.626 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-60967cc9-5c22-e184-e54e-8fce3542003c 127.0.0.1 2021-10-05T16:31:59.626Z [INFO] agent.router: Initializing LAN area manager 31:59.626 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30394 network=udp 31:59.626 [INFO] TestAgent.server: Adding LAN server: server="Node-60967cc9-5c22-e184-e54e-8fce3542003c (Addr: tcp/127.0.0.1:30406) (DC: dc1)" 31:59.626 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-60967cc9-5c22-e184-e54e-8fce3542003c.dc1 area=wan 31:59.626 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30394 network=tcp 31:59.627 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30395 network=tcp 31:59.627 [INFO] TestAgent: started state syncer 31:59.627 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29478 network=tcp 31:59.675 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.675 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30406 [Candidate]" term=2 31:59.676 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:59.696 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.696 [DEBUG] TestAgent.server.raft: vote granted: from=60967cc9-5c22-e184-e54e-8fce3542003c term=2 tally=1 31:59.696 [INFO] TestAgent.server.raft: election won: tally=1 31:59.696 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30406 [Leader]" 31:59.696 [INFO] TestAgent.server: cluster leadership acquired 31:59.696 [INFO] TestAgent.server: New leader elected: payload=Node-60967cc9-5c22-e184-e54e-8fce3542003c 31:59.705 [INFO] TestAgent.server: initializing acls 31:59.709 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:59.709 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:59.720 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:59.740 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:59.740 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:59.740 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:59.740 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-60967cc9-5c22-e184-e54e-8fce3542003c 31:59.740 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-60967cc9-5c22-e184-e54e-8fce3542003c.dc1 31:59.741 [INFO] TestAgent.server: Updating LAN server: server="Node-60967cc9-5c22-e184-e54e-8fce3542003c (Addr: tcp/127.0.0.1:30406) (DC: dc1)" 31:59.741 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-60967cc9-5c22-e184-e54e-8fce3542003c.dc1 area=wan 31:59.756 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.781 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.781 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.781 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.781 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.781 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.781 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-60967cc9-5c22-e184-e54e-8fce3542003c 31:59.781 [INFO] TestAgent.server: member joined, marking health alive: member=Node-60967cc9-5c22-e184-e54e-8fce3542003c 31:59.789 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-60967cc9-5c22-e184-e54e-8fce3542003c 31:59.797 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.815 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-60967cc9-5c22-e184-e54e-8fce3542003c 31:59.815 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-60967cc9-5c22-e184-e54e-8fce3542003c 31:59.838 [INFO] TestAgent: Updated agent's ACL token: token=default 31:59.930 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 31:59.934 [INFO] TestAgent: Synced node info 31:59.940 [INFO] TestAgent: Requesting shutdown 31:59.940 [INFO] TestAgent.server: shutting down server 31:59.940 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:59.940 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:59.940 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:59.940 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:59.940 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:59.940 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:59.940 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:59.940 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:59.940 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:59.940 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:59.940 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:59.940 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:59.940 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:59.940 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:59.948 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:59.958Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:59.958Z [INFO] agent.router.manager: shutting down 31:59.958 [INFO] TestAgent: consul server down 31:59.958 [INFO] TestAgent: shutdown complete 31:59.958 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30394 network=tcp 31:59.958 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30394 network=udp 31:59.958 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30395 network=tcp 32:00.458 [INFO] TestAgent: Waiting for endpoints to shut down 32:00.458 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_TokenTriggersFullSync (6.63s) --- PASS: TestAgent_TokenTriggersFullSync/acl_agent_token (1.24s) --- PASS: TestAgent_TokenTriggersFullSync/agent (2.34s) --- PASS: TestAgent_TokenTriggersFullSync/acl_token (2.01s) --- PASS: TestAgent_TokenTriggersFullSync/default (1.03s) === CONT TestParseWait_InvalidIndex --- PASS: TestParseWait_InvalidIndex (0.00s) === CONT TestParseConsistency [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 31:59.582 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-92023ef8-08cc-0a76-fce7-139ab9eb93ef 127.0.0.1 2021-10-05T16:31:59.582Z [INFO] agent.router: Initializing LAN area manager 31:59.582 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29444 network=udp 31:59.583 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29444 network=tcp 31:59.583 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29445 network=tcp 31:59.583 [INFO] TestAgent: started state syncer 31:59.585 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Stream connection from=127.0.0.1:35654 31:59.586 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 127.0.0.1 31:59.586 [INFO] TestAgent.client: adding server: server="Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 (Addr: tcp/127.0.0.1:30399) (DC: dc1)" 31:59.586 [INFO] TestAgent.client: New leader elected: payload=Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 31:59.586 [INFO] TestAgent: Requesting shutdown 31:59.586 [INFO] TestAgent.client: shutting down client 31:59.586 [WARN] TestAgent.client.serf.lan: serf: Shutdown without a Leave 31:59.588 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30351 network=tcp 31:59.588 [ERROR] TestAgent: gRPC server failed: error="grpc: the server has been stopped" 31:59.604 [INFO] TestAgent: consul client down 31:59.604 [INFO] TestAgent: shutdown complete 31:59.604 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29444 network=tcp 31:59.604 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29444 network=udp 31:59.604 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29445 network=tcp 31:59.604 [ERROR] TestAgent.client: RPC failed to server: method=Catalog.Register server=127.0.0.1:30399 error="rpc error making call: EOF" 31:59.604 [WARN] TestAgent: Syncing node info failed.: error="rpc error making call: EOF" 31:59.604 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="rpc error making call: EOF" 32:00.104 [INFO] TestAgent: Waiting for endpoints to shut down 32:00.104 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:59.113Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.127Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.183 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:19e3f2f3-509a-82cb-4954-dc738ccf7e93 Address:127.0.0.1:30399}]" 31:59.184 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30399 [Follower]" leader= 31:59.184 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93.dc1 127.0.0.1 31:59.184 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 127.0.0.1 2021-10-05T16:31:59.184Z [INFO] agent.router: Initializing LAN area manager 31:59.185 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30380 network=udp 31:59.185 [INFO] TestAgent.server: Adding LAN server: server="Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 (Addr: tcp/127.0.0.1:30399) (DC: dc1)" 31:59.185 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93.dc1 area=wan 31:59.185 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30380 network=tcp 31:59.185 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30381 network=tcp 31:59.186 [INFO] TestAgent: started state syncer 31:59.186 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30414 network=tcp 31:59.231 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.231 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30399 [Candidate]" term=2 31:59.257 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.257 [DEBUG] TestAgent.server.raft: vote granted: from=19e3f2f3-509a-82cb-4954-dc738ccf7e93 term=2 tally=1 31:59.257 [INFO] TestAgent.server.raft: election won: tally=1 31:59.257 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30399 [Leader]" 31:59.257 [INFO] TestAgent.server: cluster leadership acquired 31:59.257 [INFO] TestAgent.server: New leader elected: payload=Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 31:59.278 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30399 31:59.309 [INFO] TestAgent: Synced node info 31:59.309 [DEBUG] TestAgent: Node info in sync 31:59.334 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.370 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.370 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.370 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.370 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.370 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.370 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 31:59.370 [INFO] TestAgent.server: member joined, marking health alive: member=Node-19e3f2f3-509a-82cb-4954-dc738ccf7e93 31:59.393 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.584 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:29447] 31:59.585 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:29447 31:59.586 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-92023ef8-08cc-0a76-fce7-139ab9eb93ef 127.0.0.1 31:59.586 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 31:59.587 [INFO] TestAgent.server: member joined, marking health alive: member=Node-92023ef8-08cc-0a76-fce7-139ab9eb93ef 32:00.104 [INFO] TestAgent: Requesting shutdown 32:00.104 [INFO] TestAgent.server: shutting down server 32:00.104 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:00.104 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:00.104 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:00.104 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:00.104 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:00.104 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.104 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:00.104 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:00.104 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:00.105 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:00.119 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.125Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.125Z [INFO] agent.router.manager: shutting down 32:00.125 [INFO] TestAgent: consul server down 32:00.125 [INFO] TestAgent: shutdown complete 32:00.125 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30380 network=tcp 32:00.125 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30380 network=udp 32:00.125 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30381 network=tcp 32:00.626 [INFO] TestAgent: Waiting for endpoints to shut down 32:00.626 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_JoinLANNotify (1.53s) === CONT TestOperator_RaftPeer === RUN TestOperator_RaftPeer/#00 [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:59.646Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.673Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.749 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f8426086-03f6-4686-c3c1-8f34bb410155 Address:127.0.0.1:30357}]" 31:59.749 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f8426086-03f6-4686-c3c1-8f34bb410155.dc1 127.0.0.1 31:59.750 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30357 [Follower]" leader= 31:59.750 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f8426086-03f6-4686-c3c1-8f34bb410155 127.0.0.1 2021-10-05T16:31:59.750Z [INFO] agent.router: Initializing LAN area manager 31:59.750 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30352 network=udp 31:59.750 [INFO] TestAgent.server: Adding LAN server: server="Node-f8426086-03f6-4686-c3c1-8f34bb410155 (Addr: tcp/127.0.0.1:30357) (DC: dc1)" 31:59.750 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f8426086-03f6-4686-c3c1-8f34bb410155.dc1 area=wan 31:59.750 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30352 network=tcp 31:59.751 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30353 network=tcp 31:59.751 [INFO] TestAgent: started state syncer 31:59.751 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29408 network=tcp 31:59.816 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.816 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30357 [Candidate]" term=2 31:59.841 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.841 [DEBUG] TestAgent.server.raft: vote granted: from=f8426086-03f6-4686-c3c1-8f34bb410155 term=2 tally=1 31:59.841 [INFO] TestAgent.server.raft: election won: tally=1 31:59.841 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30357 [Leader]" 31:59.841 [INFO] TestAgent.server: cluster leadership acquired 31:59.841 [INFO] TestAgent.server: New leader elected: payload=Node-f8426086-03f6-4686-c3c1-8f34bb410155 31:59.849 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30357 31:59.870 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.898 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.898 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.898 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.898 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.898 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.898 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f8426086-03f6-4686-c3c1-8f34bb410155 31:59.898 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f8426086-03f6-4686-c3c1-8f34bb410155 31:59.922 [INFO] TestAgent.server: federation state anti-entropy synced 32:00.023 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:00.024 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:44992 32:00.025 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-70f24462-3485-00ce-04b3-1596890ad559 127.0.0.1 32:00.025 [INFO] TestAgent.server: Adding LAN server: server="Node-70f24462-3485-00ce-04b3-1596890ad559 (Addr: tcp/127.0.0.1:29400) (DC: dc1)" 32:00.025 [INFO] TestAgent.server: New leader elected: payload=Node-70f24462-3485-00ce-04b3-1596890ad559 32:00.025 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-70f24462-3485-00ce-04b3-1596890ad559 other=Node-f8426086-03f6-4686-c3c1-8f34bb410155 32:00.025 [INFO] TestAgent.server: member joined, marking health alive: member=Node-70f24462-3485-00ce-04b3-1596890ad559 32:00.026 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 127.0.0.1:30412 32:00.027 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 127.0.0.1 32:00.027 [DEBUG] TestAgent.server: Successfully performed flood-join for server at address: server=Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 address=127.0.0.1:30412 32:00.027 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 area=wan 32:00.028 [INFO] TestAgent: Synced node info 32:00.028 [DEBUG] TestAgent: Node info in sync 32:00.046 [INFO] TestAgent: Requesting shutdown 32:00.046 [INFO] TestAgent.server: shutting down server 32:00.046 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:00.046 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:00.046 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:00.046 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:00.046 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:00.046 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.046 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:00.046 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:00.046 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:00.046 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:00.052 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.057Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.058Z [INFO] agent.router.manager: shutting down 32:00.058 [INFO] TestAgent: consul server down 32:00.058 [INFO] TestAgent: shutdown complete 32:00.058 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30352 network=tcp 32:00.058 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30352 network=udp 32:00.058 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30353 network=tcp 32:00.558 [INFO] TestAgent: Waiting for endpoints to shut down 32:00.558 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:59.323Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:59.323Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.343Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:59.343Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.409 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:70f24462-3485-00ce-04b3-1596890ad559 Address:127.0.0.1:29400}]" 31:59.410 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 127.0.0.1 31:59.411 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-70f24462-3485-00ce-04b3-1596890ad559 127.0.0.1 2021-10-05T16:31:59.411Z [INFO] agent.router: Initializing LAN area manager 31:59.411 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30408 network=udp 31:59.411 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29400 [Follower]" leader= 31:59.412 [INFO] TestAgent.server: Adding LAN server: server="Node-70f24462-3485-00ce-04b3-1596890ad559 (Addr: tcp/127.0.0.1:29400) (DC: dc1)" 31:59.412 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 area=wan 31:59.412 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30408 network=tcp 31:59.413 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30409 network=tcp 31:59.413 [INFO] TestAgent: started state syncer 31:59.413 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29401 network=tcp 31:59.463 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:59.484 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.484 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29400 [Candidate]" term=2 31:59.517 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.517 [DEBUG] TestAgent.server.raft: vote granted: from=70f24462-3485-00ce-04b3-1596890ad559 term=2 tally=1 31:59.517 [INFO] TestAgent.server.raft: election won: tally=1 31:59.517 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29400 [Leader]" 31:59.522 [INFO] TestAgent.server: cluster leadership acquired 31:59.527 [INFO] TestAgent.server: initializing acls 31:59.528 [INFO] TestAgent.server: New leader elected: payload=Node-70f24462-3485-00ce-04b3-1596890ad559 31:59.532 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:59.532 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:59.548 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:59.564 [INFO] TestAgent.server: initializing acls 31:59.564 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:59.587 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:59.587 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:59.587 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:59.587 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:59.587 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-70f24462-3485-00ce-04b3-1596890ad559 31:59.588 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 31:59.588 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 area=wan 31:59.588 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:59.588 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-70f24462-3485-00ce-04b3-1596890ad559 31:59.588 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 31:59.589 [INFO] TestAgent.server: Updating LAN server: server="Node-70f24462-3485-00ce-04b3-1596890ad559 (Addr: tcp/127.0.0.1:29400) (DC: dc1)" 31:59.589 [INFO] TestAgent.server: Updating LAN server: server="Node-70f24462-3485-00ce-04b3-1596890ad559 (Addr: tcp/127.0.0.1:29400) (DC: dc1)" 31:59.590 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-70f24462-3485-00ce-04b3-1596890ad559.dc1 area=wan 31:59.627 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.653 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.653 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.653 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.653 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.653 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.653 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-70f24462-3485-00ce-04b3-1596890ad559 31:59.653 [INFO] TestAgent.server: member joined, marking health alive: member=Node-70f24462-3485-00ce-04b3-1596890ad559 31:59.658 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.668 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-70f24462-3485-00ce-04b3-1596890ad559 31:59.668 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-70f24462-3485-00ce-04b3-1596890ad559 31:59.713 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:59.734 [INFO] TestAgent: Synced node info 31:59.734 [DEBUG] TestAgent: Node info in sync 32:00.024 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-70f24462-3485-00ce-04b3-1596890ad559 32:00.024 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:30355] 32:00.024 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:30355 32:00.025 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f8426086-03f6-4686-c3c1-8f34bb410155 127.0.0.1 32:00.026 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 32:00.026 [DEBUG] TestAgent: systemd notify failed: error="No socket" 32:00.026 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:48810 32:00.026 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f8426086-03f6-4686-c3c1-8f34bb410155.dc1 127.0.0.1 32:00.027 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f8426086-03f6-4686-c3c1-8f34bb410155.dc1 area=wan 32:00.027 [INFO] TestAgent.server: Adding LAN server: server="Node-f8426086-03f6-4686-c3c1-8f34bb410155 (Addr: tcp/127.0.0.1:30357) (DC: dc1)" 32:00.027 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-f8426086-03f6-4686-c3c1-8f34bb410155 other=Node-70f24462-3485-00ce-04b3-1596890ad559 32:00.027 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f8426086-03f6-4686-c3c1-8f34bb410155 32:00.558 [INFO] TestAgent: Requesting shutdown 32:00.558 [INFO] TestAgent.server: shutting down server 32:00.558 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:00.558 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:00.558 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:00.558 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:00.558 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:00.558 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:00.558 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:00.558 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.558 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:00.558 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:00.558 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:00.558 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:00.558 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:00.558 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:00.562 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.566Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.566Z [INFO] agent.router.manager: shutting down 32:00.566 [INFO] TestAgent: consul server down 32:00.566 [INFO] TestAgent: shutdown complete 32:00.566 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30408 network=tcp 32:00.566 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30408 network=udp 32:00.566 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30409 network=tcp 32:00.913 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-f8426086-03f6-4686-c3c1-8f34bb410155 (timeout reached) 32:01.068 [INFO] TestAgent: Waiting for endpoints to shut down 32:01.068 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Join_ACLDeny (1.77s) --- PASS: TestAgent_Join_ACLDeny/no_token (0.00s) --- PASS: TestAgent_Join_ACLDeny/agent_master_token (0.00s) --- PASS: TestAgent_Join_ACLDeny/read-only_token (0.02s) === CONT TestOperator_KeyringInstall [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:00.049Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:00.072Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:00.118 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:710b27fc-6301-ef80-4683-c86632fa3f53 Address:127.0.0.1:29435}]" 32:00.118 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-710b27fc-6301-ef80-4683-c86632fa3f53.dc1 127.0.0.1 32:00.119 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-710b27fc-6301-ef80-4683-c86632fa3f53 127.0.0.1 2021-10-05T16:32:00.119Z [INFO] agent.router: Initializing LAN area manager 32:00.119 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29486 network=udp 32:00.119 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29435 [Follower]" leader= 32:00.119 [INFO] TestAgent.server: Adding LAN server: server="Node-710b27fc-6301-ef80-4683-c86632fa3f53 (Addr: tcp/127.0.0.1:29435) (DC: dc1)" 32:00.120 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-710b27fc-6301-ef80-4683-c86632fa3f53.dc1 area=wan 32:00.120 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29486 network=tcp 32:00.120 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29487 network=tcp 32:00.120 [INFO] TestAgent: started state syncer 32:00.120 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29471 network=tcp 32:00.156 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:00.156 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29435 [Candidate]" term=2 32:00.180 [DEBUG] TestAgent.server.raft: votes: needed=1 32:00.180 [DEBUG] TestAgent.server.raft: vote granted: from=710b27fc-6301-ef80-4683-c86632fa3f53 term=2 tally=1 32:00.180 [INFO] TestAgent.server.raft: election won: tally=1 32:00.180 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29435 [Leader]" 32:00.180 [INFO] TestAgent.server: cluster leadership acquired 32:00.180 [INFO] TestAgent.server: New leader elected: payload=Node-710b27fc-6301-ef80-4683-c86632fa3f53 32:00.196 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29435 32:00.223 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:00.267 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:00.268 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:00.268 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:00.268 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:00.268 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:00.268 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-710b27fc-6301-ef80-4683-c86632fa3f53 32:00.268 [INFO] TestAgent.server: member joined, marking health alive: member=Node-710b27fc-6301-ef80-4683-c86632fa3f53 32:00.284 [INFO] TestAgent.server: federation state anti-entropy synced 32:00.304 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:60606 32:00.304 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d1403890-9142-3ca6-025d-6510d2141537.dc1 127.0.0.1 32:00.304 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d1403890-9142-3ca6-025d-6510d2141537.dc1 area=wan 32:00.305 [INFO] TestAgent: Requesting shutdown 32:00.305 [INFO] TestAgent.server: shutting down server 32:00.305 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:00.305 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:00.305 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:00.305 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:00.305 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:00.305 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.305 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:00.305 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:00.305 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:00.305 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:00.305 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:00.313 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.323Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.323Z [INFO] agent.router.manager: shutting down 32:00.323 [INFO] TestAgent: consul server down 32:00.323 [INFO] TestAgent: shutdown complete 32:00.323 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29486 network=tcp 32:00.323 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29486 network=udp 32:00.323 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29487 network=tcp 32:00.823 [INFO] TestAgent: Waiting for endpoints to shut down 32:00.823 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:59.673Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.702Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.788 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d1403890-9142-3ca6-025d-6510d2141537 Address:127.0.0.1:29414}]" 31:59.788 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29414 [Follower]" leader= 31:59.789 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d1403890-9142-3ca6-025d-6510d2141537.dc1 127.0.0.1 31:59.789 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d1403890-9142-3ca6-025d-6510d2141537 127.0.0.1 2021-10-05T16:31:59.789Z [INFO] agent.router: Initializing LAN area manager 31:59.789 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29409 network=udp 31:59.789 [INFO] TestAgent.server: Adding LAN server: server="Node-d1403890-9142-3ca6-025d-6510d2141537 (Addr: tcp/127.0.0.1:29414) (DC: dc1)" 31:59.789 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d1403890-9142-3ca6-025d-6510d2141537.dc1 area=wan 31:59.790 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29409 network=tcp 31:59.790 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29410 network=tcp 31:59.790 [INFO] TestAgent: started state syncer 31:59.790 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29415 network=tcp 31:59.856 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.856 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29414 [Candidate]" term=2 31:59.894 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.894 [DEBUG] TestAgent.server.raft: vote granted: from=d1403890-9142-3ca6-025d-6510d2141537 term=2 tally=1 31:59.894 [INFO] TestAgent.server.raft: election won: tally=1 31:59.894 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29414 [Leader]" 31:59.896 [INFO] TestAgent.server: cluster leadership acquired 31:59.896 [INFO] TestAgent.server: New leader elected: payload=Node-d1403890-9142-3ca6-025d-6510d2141537 31:59.905 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29414 31:59.948 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.986 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.986 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.986 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.986 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.986 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.986 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d1403890-9142-3ca6-025d-6510d2141537 31:59.986 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d1403890-9142-3ca6-025d-6510d2141537 32:00.000 [INFO] TestAgent.server: federation state anti-entropy synced 32:00.204 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:00.209 [INFO] TestAgent: Synced node info 32:00.209 [DEBUG] TestAgent: Node info in sync 32:00.303 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:29490] 32:00.303 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29490 32:00.305 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-710b27fc-6301-ef80-4683-c86632fa3f53.dc1 127.0.0.1 32:00.305 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 32:00.305 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-710b27fc-6301-ef80-4683-c86632fa3f53.dc1 area=wan 32:00.823 [INFO] TestAgent: Requesting shutdown 32:00.823 [INFO] TestAgent.server: shutting down server 32:00.823 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:00.823 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:00.823 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:00.823 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:00.823 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:00.823 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.823 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:00.824 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:00.824 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:00.824 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:00.826 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.831Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.831Z [INFO] agent.router.manager: shutting down 32:00.831 [INFO] TestAgent: consul server down 32:00.831 [INFO] TestAgent: shutdown complete 32:00.831 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29409 network=tcp 32:00.831 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29409 network=udp 32:00.831 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29410 network=tcp 32:01.331 [INFO] TestAgent: Waiting for endpoints to shut down 32:01.331 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Join_WAN (1.68s) === CONT TestParseWait_InvalidTime --- PASS: TestParseWait_InvalidTime (0.00s) === CONT TestACL_filterChecks 2021-10-05T16:32:01.343Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:01.343Z [WARN] agent: bootstrap = true: do not enable unless necessary 32:01.343 [DEBUG] TestACL_filterChecks: dropping check from result due to ACLs: check=my-node 32:01.343 [DEBUG] TestACL_filterChecks: dropping check from result due to ACLs: check=my-other 32:01.343 [DEBUG] TestACL_filterChecks: dropping check from result due to ACLs: check=my-service 32:01.343 [DEBUG] TestACL_filterChecks: dropping check from result due to ACLs: check=my-other --- PASS: TestACL_filterChecks (0.01s) === CONT TestAgent_Members_ACLFilter 2021-10-05T16:32:00.474Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:00.495Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:00.554 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5136b235-46ca-75b6-5a4d-8af0e81182e4 Address:127.0.0.1:29484}]" 32:00.554 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29484 [Follower]" leader= 32:00.555 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5136b235-46ca-75b6-5a4d-8af0e81182e4.dc1 127.0.0.1 32:00.556 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5136b235-46ca-75b6-5a4d-8af0e81182e4 127.0.0.1 2021-10-05T16:32:00.556Z [INFO] agent.router: Initializing LAN area manager 32:00.556 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29423 network=udp 32:00.556 [INFO] TestAgent.server: Adding LAN server: server="Node-5136b235-46ca-75b6-5a4d-8af0e81182e4 (Addr: tcp/127.0.0.1:29484) (DC: dc1)" 32:00.556 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5136b235-46ca-75b6-5a4d-8af0e81182e4.dc1 area=wan 32:00.556 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29423 network=tcp 32:00.557 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29424 network=tcp 32:00.557 [INFO] TestAgent: started state syncer 32:00.557 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29436 network=tcp 32:00.624 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:00.624 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29484 [Candidate]" term=2 32:00.660 [DEBUG] TestAgent.server.raft: votes: needed=1 32:00.660 [DEBUG] TestAgent.server.raft: vote granted: from=5136b235-46ca-75b6-5a4d-8af0e81182e4 term=2 tally=1 32:00.660 [INFO] TestAgent.server.raft: election won: tally=1 32:00.660 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29484 [Leader]" 32:00.660 [INFO] TestAgent.server: cluster leadership acquired 32:00.660 [INFO] TestAgent.server: New leader elected: payload=Node-5136b235-46ca-75b6-5a4d-8af0e81182e4 32:00.688 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29484 32:00.726 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:00.750 [INFO] TestAgent: Synced node info 32:00.750 [DEBUG] TestAgent: Node info in sync 32:00.762 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:00.762 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:00.762 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:00.762 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:00.762 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:00.762 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5136b235-46ca-75b6-5a4d-8af0e81182e4 32:00.762 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5136b235-46ca-75b6-5a4d-8af0e81182e4 32:00.782 [INFO] TestAgent.server: federation state anti-entropy synced 32:00.844 [INFO] TestAgent: Requesting shutdown 32:00.844 [INFO] TestAgent.server: shutting down server 32:00.844 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:00.844 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:00.844 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:00.844 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.844 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:00.844 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:00.844 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:00.844 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:00.844 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:00.844 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:00.849 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.861Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.861Z [INFO] agent.router.manager: shutting down 32:00.861 [INFO] TestAgent: consul server down 32:00.861 [INFO] TestAgent: shutdown complete 32:00.861 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29423 network=tcp 32:00.861 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29423 network=udp 32:00.861 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29424 network=tcp 32:01.364 [INFO] TestAgent: Waiting for endpoints to shut down 32:01.364 [INFO] TestAgent: Endpoints down --- PASS: TestParseConsistency (0.91s) === CONT TestAgent_Members_WAN 2021-10-05T16:31:52.725Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.749Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.832 [INFO] dc2.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d7aa34bd-d7b6-593e-4946-2b559f4b7f99 Address:127.0.0.1:30028}]" 31:52.836 [INFO] dc2.server.raft: entering follower state: follower="Node at 127.0.0.1:30028 [Follower]" leader= 31:52.836 [INFO] dc2.server.serf.wan: serf: EventMemberJoin: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 127.0.0.1 31:52.837 [INFO] dc2.server.serf.lan: serf: EventMemberJoin: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99 127.0.0.1 2021-10-05T16:31:52.837Z [INFO] agent.router: Initializing LAN area manager 31:52.837 [INFO] dc2: Started DNS server: address=127.0.0.1:29967 network=udp 31:52.837 [INFO] dc2.server: Handled event for server in area: event=member-join server=Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 area=wan 31:52.838 [INFO] dc2.server: Adding LAN server: server="Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99 (Addr: tcp/127.0.0.1:30028) (DC: dc2)" 31:52.838 [INFO] dc2: Started DNS server: address=127.0.0.1:29967 network=tcp 31:52.838 [INFO] dc2: Started HTTP server: address=127.0.0.1:30024 network=tcp 31:52.838 [INFO] dc2: started state syncer 31:52.838 [INFO] dc2: Started gRPC server: address=127.0.0.1:30022 network=tcp 31:52.897 [WARN] dc2.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.897 [INFO] dc2.server.raft: entering candidate state: node="Node at 127.0.0.1:30028 [Candidate]" term=2 31:52.918 [DEBUG] dc2.server.raft: votes: needed=1 31:52.918 [DEBUG] dc2.server.raft: vote granted: from=d7aa34bd-d7b6-593e-4946-2b559f4b7f99 term=2 tally=1 31:52.918 [INFO] dc2.server.raft: election won: tally=1 31:52.918 [INFO] dc2.server.raft: entering leader state: leader="Node at 127.0.0.1:30028 [Leader]" 31:52.918 [INFO] dc2.server: cluster leadership acquired 31:52.919 [INFO] dc2.server: New leader elected: payload=Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99 31:52.933 [DEBUG] dc2.server: Cannot upgrade to new ACLs, servers in acl datacenter are not yet upgraded: ACLDatacenter=dc1 mode=1 found=false 31:52.961 [WARN] dc2.server.connect: primary datacenter is configured but unreachable - deferring initialization of the secondary datacenter CA 31:52.961 [INFO] dc2.leader: started routine: routine="config entry replication" 31:52.961 [INFO] dc2.leader: started routine: routine="federation state replication" 31:52.961 [INFO] dc2.leader: started routine: routine="federation state anti-entropy" 31:52.961 [INFO] dc2.leader: started routine: routine="secondary CA roots watch" 31:52.961 [INFO] dc2.leader: started routine: routine="intention replication" 31:52.961 [INFO] dc2.leader: started routine: routine="intermediate cert renew watch" 31:52.961 [INFO] dc2.leader: started routine: routine="CA root pruning" 31:52.961 [DEBUG] dc2.server: Skipping self join check for node since the cluster is too small: node=Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99 31:52.961 [INFO] dc2.server: member joined, marking health alive: member=Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99 31:52.961 [DEBUG] dc2.server.connect: starting Connect CA root replication from primary datacenter: primary=dc1 31:52.961 [WARN] dc2.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ConnectCA.Roots 31:52.961 [ERROR] dc2.server.connect: CA root replication failed, will retry: routine="secondary CA roots watch" error="Error retrieving the primary datacenter's roots: No path to datacenter" 31:52.961 [WARN] dc2.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ConfigEntry.ListAll 31:52.961 [DEBUG] dc2.server: federation states are not enabled in the primary dc 31:52.961 [DEBUG] dc2.server: federation states are not enabled in the primary dc 31:52.961 [DEBUG] dc2.server: federation states are not enabled in the primary dc 31:52.961 [DEBUG] dc2.server: federation states are not enabled in the primary dc 31:52.961 [DEBUG] dc2.server: federation states are not enabled in the primary dc 31:52.961 [DEBUG] dc2.server: federation states are not enabled in the primary dc 31:52.961 [DEBUG] dc2.server.connect: starting Connect intention replication from primary datacenter: primary=dc1 31:52.962 [WARN] dc2.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=Intention.List 31:52.962 [ERROR] dc2.server.connect: error replicating intentions: routine="intention replication" error="No path to datacenter" 31:53.196 [INFO] dc2: (WAN) joining: wan_addresses=[127.0.0.1:29985] 31:53.200 [DEBUG] dc2.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29985 31:53.200 [DEBUG] dc2: Skipping remote check since it is managed automatically: check=serfHealth 31:53.205 [INFO] dc2.server.serf.wan: serf: EventMemberJoin: Node-237d687c-e901-a162-14cc-6108db37e68c.dc1 127.0.0.1 31:53.205 [INFO] dc2: (WAN) joined: number_of_nodes=1 31:53.208 [INFO] dc2.server: Handled event for server in area: event=member-join server=Node-237d687c-e901-a162-14cc-6108db37e68c.dc1 area=wan 31:53.219 [INFO] dc2: Synced node info 31:53.474 [DEBUG] dc2.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 31:53.974 [DEBUG] dc2.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 31:53.982 [DEBUG] dc2.server: finished fetching remote objects: amount=1 31:53.982 [DEBUG] dc2.server: diffing replication state: local_amount=0 remote_amount=1 31:53.982 [DEBUG] dc2.server: diffed replication state: deletions=0 updates=1 31:53.982 [DEBUG] dc2.server: performing updates: updates=1 31:53.994 [DEBUG] dc2.server: finished updates 31:53.994 [DEBUG] dc2.replication.federation_state: replication completed through remote index: index=12 31:54.060 [DEBUG] dc2.server.replication.config_entry: finished fetching config entries: amount=0 31:54.060 [DEBUG] dc2.server.replication.config_entry: Config Entry replication: local=0 remote=0 31:54.060 [DEBUG] dc2.server.replication.config_entry: Config Entry replication: deletions=0 updates=0 31:54.060 [DEBUG] dc2.server.replication.config_entry: replication completed through remote index: index=1 31:54.473 [DEBUG] dc2.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 31:54.966 [DEBUG] connect.ca.consul: consul CA provider configured: id=ad:4a:c6:ab:ef:63:c9:60:1a:51:7f:19:62:e3:e9:d9:0e:76:55:10:6e:74:24:69:28:a1:6c:b8:b9:8f:fd:89 is_primary=false 31:54.976 [DEBUG] dc2.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 31:55.008 [INFO] dc2.server.connect: received new intermediate certificate from primary datacenter 31:55.028 [INFO] dc2.server.connect: updated root certificates from primary datacenter 31:55.072 [DEBUG] dc2: Node info in sync 31:55.097 [INFO] dc2: Synced service: service=foo 31:55.097 [DEBUG] dc2: Check in sync: check=service:foo 31:55.105 [DEBUG] dc2: Skipping remote check since it is managed automatically: check=serfHealth 31:55.105 [DEBUG] dc2: Node info in sync 31:55.105 [DEBUG] dc2: Service in sync: service=foo 31:55.105 [DEBUG] dc2: Check in sync: check=service:foo 31:55.105 [DEBUG] dc2: Node info in sync 31:55.105 [DEBUG] dc2: Service in sync: service=foo 31:55.105 [DEBUG] dc2: Check in sync: check=service:foo 31:57.990 [DEBUG] dc2.server: finished fetching remote objects: amount=2 31:57.990 [DEBUG] dc2.server: diffing replication state: local_amount=1 remote_amount=2 31:57.990 [DEBUG] dc2.server: diffed replication state: deletions=0 updates=1 31:57.990 [DEBUG] dc2.server: performing updates: updates=1 31:57.991 [INFO] dc2.server: federation state anti-entropy synced 31:57.997 [DEBUG] dc2.server: finished updates 31:57.997 [DEBUG] dc2.replication.federation_state: replication completed through remote index: index=19 32:00.309 [INFO] dc2.server.connect: received new intermediate certificate from primary datacenter 32:00.317 [INFO] dc2.server.connect: updated root certificates from primary datacenter 32:00.377 [INFO] dc2: Requesting shutdown 32:00.377 [INFO] dc2.server: shutting down server 32:00.377 [DEBUG] dc2.leader: stopping routine: routine="federation state replication" 32:00.377 [DEBUG] dc2.leader: stopping routine: routine="federation state anti-entropy" 32:00.377 [DEBUG] dc2.leader: stopping routine: routine="secondary CA roots watch" 32:00.377 [DEBUG] dc2.leader: stopping routine: routine="intention replication" 32:00.377 [DEBUG] dc2.leader: stopping routine: routine="intermediate cert renew watch" 32:00.377 [DEBUG] dc2.leader: stopping routine: routine="CA root pruning" 32:00.377 [DEBUG] dc2.leader: stopping routine: routine="config entry replication" 32:00.377 [WARN] dc2.server.serf.lan: serf: Shutdown without a Leave 32:00.377 [DEBUG] dc2.leader: stopped routine: routine="federation state anti-entropy" 32:00.377 [DEBUG] dc2.leader: stopped routine: routine="intermediate cert renew watch" 32:00.377 [DEBUG] dc2.leader: stopped routine: routine="CA root pruning" 32:00.381 [WARN] dc2.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.388Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.388Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.388Z [INFO] agent.router.manager: shutting down 32:00.388 [INFO] dc2: consul server down 32:00.388 [INFO] dc2: shutdown complete 32:00.388 [INFO] dc2: Stopping server: protocol=DNS address=127.0.0.1:29967 network=tcp 32:00.388 [INFO] dc2: Stopping server: protocol=DNS address=127.0.0.1:29967 network=udp 32:00.388 [INFO] dc2: Stopping server: protocol=HTTP address=127.0.0.1:30024 network=tcp 32:00.388 [ERROR] dc2.server.rpc: RPC failed to server in DC: server=127.0.0.1:29986 datacenter=dc1 method=ConnectCA.Roots error="rpc error making call: EOF" 32:00.388 [ERROR] dc2.server.connect: CA root replication failed, will retry: routine="secondary CA roots watch" error="Error retrieving the primary datacenter's roots: rpc error making call: EOF" 32:00.388 [DEBUG] dc2.leader: stopped routine: routine="secondary CA roots watch" 32:00.388 [ERROR] dc2.server.rpc: RPC failed to server in DC: server=127.0.0.1:29986 datacenter=dc1 method=ConfigEntry.ListAll error="rpc error making call: EOF" 32:00.388 [INFO] dc2.server.replication.config_entry: stopped replication 32:00.388 [DEBUG] dc2.leader: stopped routine: routine="config entry replication" 32:00.388 [ERROR] dc2.server.rpc: RPC failed to server in DC: server=127.0.0.1:29986 datacenter=dc1 method=Intention.List error="rpc error making call: EOF" 32:00.388 [ERROR] dc2.server.connect: error replicating intentions: routine="intention replication" error="rpc error making call: EOF" 32:00.388 [DEBUG] dc2.leader: stopped routine: routine="intention replication" 32:00.388 [ERROR] dc2.server.rpc: RPC failed to server in DC: server=127.0.0.1:29986 datacenter=dc1 method=FederationState.List error="rpc error making call: EOF" 32:00.388 [WARN] dc2.replication.federation_state: replication error (will retry if still leader): error="failed to retrieve federation states: rpc error making call: EOF" 32:00.388 [INFO] dc2.replication.federation_state: stopped replication 32:00.388 [DEBUG] dc2.leader: stopped routine: routine="federation state replication" 32:00.890 [INFO] dc2: Waiting for endpoints to shut down 32:00.890 [INFO] dc2: Endpoints down 2021-10-05T16:31:52.367Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:52.387Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:52.472 [INFO] dc1.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:237d687c-e901-a162-14cc-6108db37e68c Address:127.0.0.1:29986}]" 31:52.473 [INFO] dc1.server.serf.wan: serf: EventMemberJoin: Node-237d687c-e901-a162-14cc-6108db37e68c.dc1 127.0.0.1 31:52.473 [INFO] dc1.server.serf.lan: serf: EventMemberJoin: Node-237d687c-e901-a162-14cc-6108db37e68c 127.0.0.1 2021-10-05T16:31:52.473Z [INFO] agent.router: Initializing LAN area manager 31:52.473 [INFO] dc1.server.raft: entering follower state: follower="Node at 127.0.0.1:29986 [Follower]" leader= 31:52.474 [INFO] dc1: Started DNS server: address=127.0.0.1:29981 network=udp 31:52.474 [INFO] dc1.server: Adding LAN server: server="Node-237d687c-e901-a162-14cc-6108db37e68c (Addr: tcp/127.0.0.1:29986) (DC: dc1)" 31:52.474 [INFO] dc1.server: Handled event for server in area: event=member-join server=Node-237d687c-e901-a162-14cc-6108db37e68c.dc1 area=wan 31:52.474 [INFO] dc1: Started DNS server: address=127.0.0.1:29981 network=tcp 31:52.474 [INFO] dc1: Started HTTP server: address=127.0.0.1:29982 network=tcp 31:52.474 [INFO] dc1: started state syncer 31:52.474 [INFO] dc1: Started gRPC server: address=127.0.0.1:29952 network=tcp 31:52.520 [WARN] dc1.server.raft: heartbeat timeout reached, starting election: last-leader= 31:52.520 [INFO] dc1.server.raft: entering candidate state: node="Node at 127.0.0.1:29986 [Candidate]" term=2 31:52.552 [DEBUG] dc1.server.raft: votes: needed=1 31:52.552 [DEBUG] dc1.server.raft: vote granted: from=237d687c-e901-a162-14cc-6108db37e68c term=2 tally=1 31:52.552 [INFO] dc1.server.raft: election won: tally=1 31:52.552 [INFO] dc1.server.raft: entering leader state: leader="Node at 127.0.0.1:29986 [Leader]" 31:52.552 [INFO] dc1.server: cluster leadership acquired 31:52.552 [INFO] dc1.server: New leader elected: payload=Node-237d687c-e901-a162-14cc-6108db37e68c 31:52.576 [DEBUG] dc1.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29986 31:52.624 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:52.654 [INFO] dc1: Synced node info 31:52.670 [INFO] dc1.server.connect: initialized primary datacenter CA with provider: provider=consul 31:52.670 [INFO] dc1.leader: started routine: routine="federation state anti-entropy" 31:52.670 [INFO] dc1.leader: started routine: routine="federation state pruning" 31:52.670 [INFO] dc1.leader: started routine: routine="intermediate cert renew watch" 31:52.670 [INFO] dc1.leader: started routine: routine="CA root pruning" 31:52.670 [DEBUG] dc1.server: Skipping self join check for node since the cluster is too small: node=Node-237d687c-e901-a162-14cc-6108db37e68c 31:52.670 [INFO] dc1.server: member joined, marking health alive: member=Node-237d687c-e901-a162-14cc-6108db37e68c 31:52.698 [INFO] dc1.server: federation state anti-entropy synced 31:53.200 [DEBUG] dc1.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:51444 31:53.204 [INFO] dc1.server.serf.wan: serf: EventMemberJoin: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 127.0.0.1 31:53.205 [INFO] dc1.server: Handled event for server in area: event=member-join server=Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 area=wan 31:53.224 [DEBUG] connect.ca.consul: consul CA provider configured: id=2a:7e:c2:d0:4c:80:37:7f:d8:70:95:ee:9f:f1:13:15:a7:62:26:ce:6a:3d:75:ff:ef:69:bc:fa:a6:14:76:e1 is_primary=true 31:53.312 [INFO] dc1.server.connect: CA rotated to new root under provider: provider=consul 31:53.338 [DEBUG] dc1.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 31:53.840 [DEBUG] dc1.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 31:54.338 [DEBUG] dc1.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 31:54.727 [DEBUG] dc1: Skipping remote check since it is managed automatically: check=serfHealth 31:54.727 [DEBUG] dc1: Node info in sync 31:54.727 [DEBUG] dc1: Node info in sync 31:54.837 [DEBUG] dc1.server.serf.wan: serf: messageJoinType: Node-d7aa34bd-d7b6-593e-4946-2b559f4b7f99.dc2 32:00.241 [DEBUG] connect.ca.consul: consul CA provider configured: id=86:70:a4:f4:88:0f:7e:4b:96:57:dd:24:dd:e4:33:0c:6d:1c:68:76:e1:b2:c0:41:08:60:d5:90:2a:01:ad:ce is_primary=true 32:00.279 [INFO] dc1.server.connect: CA rotated to new root under provider: provider=consul 32:00.890 [INFO] dc1: Requesting shutdown 32:00.890 [INFO] dc1.server: shutting down server 32:00.890 [DEBUG] dc1.leader: stopping routine: routine="federation state anti-entropy" 32:00.890 [DEBUG] dc1.leader: stopping routine: routine="federation state pruning" 32:00.890 [DEBUG] dc1.leader: stopping routine: routine="intermediate cert renew watch" 32:00.890 [DEBUG] dc1.leader: stopping routine: routine="CA root pruning" 32:00.890 [WARN] dc1.server.serf.lan: serf: Shutdown without a Leave 32:00.890 [ERROR] dc1.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.890 [DEBUG] dc1.leader: stopped routine: routine="federation state anti-entropy" 32:00.890 [DEBUG] dc1.leader: stopped routine: routine="federation state pruning" 32:00.890 [DEBUG] dc1.leader: stopped routine: routine="intermediate cert renew watch" 32:00.890 [DEBUG] dc1.leader: stopped routine: routine="CA root pruning" 32:00.893 [WARN] dc1.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.897Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.897Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.897Z [INFO] agent.router.manager: shutting down 32:00.897 [INFO] dc1: consul server down 32:00.897 [INFO] dc1: shutdown complete 32:00.897 [INFO] dc1: Stopping server: protocol=DNS address=127.0.0.1:29981 network=tcp 32:00.897 [INFO] dc1: Stopping server: protocol=DNS address=127.0.0.1:29981 network=udp 32:00.897 [INFO] dc1: Stopping server: protocol=HTTP address=127.0.0.1:29982 network=tcp 32:01.398 [INFO] dc1: Waiting for endpoints to shut down 32:01.398 [INFO] dc1: Endpoints down --- PASS: TestAgentConnectCALeafCert_secondaryDC_good (9.05s) === CONT TestAgent_Members 2021-10-05T16:32:00.646Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:00.663Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:00.692 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bb92c42f-7b75-3425-65ec-6a24ddbbdc7f Address:127.0.0.1:29470}]" 32:00.693 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bb92c42f-7b75-3425-65ec-6a24ddbbdc7f.dc1 127.0.0.1 32:00.693 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bb92c42f-7b75-3425-65ec-6a24ddbbdc7f 127.0.0.1 2021-10-05T16:32:00.694Z [INFO] agent.router: Initializing LAN area manager 32:00.694 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29451 network=udp 32:00.694 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29470 [Follower]" leader= 32:00.694 [INFO] TestAgent.server: Adding LAN server: server="Node-bb92c42f-7b75-3425-65ec-6a24ddbbdc7f (Addr: tcp/127.0.0.1:29470) (DC: dc1)" 32:00.694 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bb92c42f-7b75-3425-65ec-6a24ddbbdc7f.dc1 area=wan 32:00.694 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29451 network=tcp 32:00.695 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29452 network=tcp 32:00.695 [INFO] TestAgent: started state syncer 32:00.695 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29450 network=tcp 32:00.764 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:00.764 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29470 [Candidate]" term=2 32:00.773 [DEBUG] TestAgent.server.raft: votes: needed=1 32:00.773 [DEBUG] TestAgent.server.raft: vote granted: from=bb92c42f-7b75-3425-65ec-6a24ddbbdc7f term=2 tally=1 32:00.773 [INFO] TestAgent.server.raft: election won: tally=1 32:00.773 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29470 [Leader]" 32:00.774 [INFO] TestAgent.server: cluster leadership acquired 32:00.774 [INFO] TestAgent.server: New leader elected: payload=Node-bb92c42f-7b75-3425-65ec-6a24ddbbdc7f 32:00.784 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29470 32:00.797 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:00.842 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:00.842 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:00.842 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:00.842 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:00.842 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:00.842 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bb92c42f-7b75-3425-65ec-6a24ddbbdc7f 32:00.842 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bb92c42f-7b75-3425-65ec-6a24ddbbdc7f 32:00.855 [INFO] TestAgent.server: federation state anti-entropy synced 32:00.888 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:00.908 [INFO] TestAgent: Synced node info 32:00.908 [DEBUG] TestAgent: Node info in sync 32:00.920 [INFO] TestAgent: Requesting shutdown 32:00.920 [INFO] TestAgent.server: shutting down server 32:00.920 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:00.920 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:00.920 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:00.920 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:00.920 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:00.920 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:00.920 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:00.920 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:00.920 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:00.920 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:00.923 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:00.928Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:00.928Z [INFO] agent.router.manager: shutting down 32:00.928 [INFO] TestAgent: consul server down 32:00.928 [INFO] TestAgent: shutdown complete 32:00.928 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29451 network=tcp 32:00.928 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29451 network=udp 32:00.928 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29452 network=tcp 32:01.448 [INFO] TestAgent: Waiting for endpoints to shut down 32:01.448 [INFO] TestAgent: Endpoints down === RUN TestOperator_RaftPeer/#01 [WARN] freeport: 10 out of 52 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_Members_ACLFilter/no_token === RUN TestAgent_Members_ACLFilter/root_token [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:01.088Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:01.103Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:01.180 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:292b5fa1-717a-5ef6-d612-52ec4f6b1055 Address:127.0.0.1:30385}]" 32:01.180 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055.dc1 127.0.0.1 32:01.181 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30385 [Follower]" leader= 32:01.181 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 127.0.0.1 2021-10-05T16:32:01.181Z [INFO] agent.router: Initializing LAN area manager 32:01.181 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29472 network=udp 32:01.181 [INFO] TestAgent.server: Adding LAN server: server="Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 (Addr: tcp/127.0.0.1:30385) (DC: dc1)" 32:01.181 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055.dc1 area=wan 32:01.182 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29472 network=tcp 32:01.182 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29473 network=tcp 32:01.182 [INFO] TestAgent: started state syncer 32:01.182 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29485 network=tcp 32:01.228 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:01.228 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30385 [Candidate]" term=2 32:01.280 [DEBUG] TestAgent.server.raft: votes: needed=1 32:01.280 [DEBUG] TestAgent.server.raft: vote granted: from=292b5fa1-717a-5ef6-d612-52ec4f6b1055 term=2 tally=1 32:01.280 [INFO] TestAgent.server.raft: election won: tally=1 32:01.280 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30385 [Leader]" 32:01.280 [INFO] TestAgent.server: cluster leadership acquired 32:01.280 [INFO] TestAgent.server: New leader elected: payload=Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 32:01.297 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30385 32:01.344 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:01.374 [INFO] TestAgent.server.serf.wan: serf: Received install-key query 32:01.380 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055.dc1 32:01.380 [INFO] TestAgent.server.serf.lan: serf: Received install-key query 32:01.380 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 32:01.381 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 32:01.381 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055.dc1 32:01.381 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 32:01.381 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 32:01.381 [INFO] TestAgent: Requesting shutdown 32:01.381 [INFO] TestAgent.server: shutting down server 32:01.381 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:01.381 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:01.390 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:01.395Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:01.395Z [INFO] agent.router.manager: shutting down 32:01.396 [INFO] TestAgent: consul server down 32:01.396 [INFO] TestAgent: shutdown complete 32:01.396 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29472 network=tcp 32:01.396 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29472 network=udp 32:01.396 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29473 network=tcp 32:01.396 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:01.396 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:01.396 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:01.396 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:01.396 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:01.396 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 32:01.396 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 32:01.396 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 32:01.396 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 32:01.396 [DEBUG] TestAgent.server: federation states are not enabled in this datacenter: datacenter=dc1 32:01.396 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 32:01.396 [INFO] TestAgent.server: member joined, marking health alive: member=Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 32:01.396 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-292b5fa1-717a-5ef6-d612-52ec4f6b1055 127.0.0.1 29475 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:292b5fa1-717a-5ef6-d612-52ec4f6b1055 port:30385 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29476] alive 1 5 2 2 5 4}" error="raft is already shutdown" 32:01.396 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:01.396 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:01.396 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:01.396 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:01.396 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:01.396 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:01.396 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:01.396 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:01.897 [INFO] TestAgent: Waiting for endpoints to shut down 32:01.897 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_KeyringInstall (0.83s) === CONT TestAgent_Reload_ACLDeny [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:01.386Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:01.410Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:01.496 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:46e7f446-ed50-2b5f-b371-45b7b071dc0f Address:127.0.0.1:29442}]" 32:01.499 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-46e7f446-ed50-2b5f-b371-45b7b071dc0f.dc1 127.0.0.1 32:01.500 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29442 [Follower]" leader= 32:01.500 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-46e7f446-ed50-2b5f-b371-45b7b071dc0f 127.0.0.1 2021-10-05T16:32:01.500Z [INFO] agent.router: Initializing LAN area manager 32:01.500 [INFO] TestAgent.server: Adding LAN server: server="Node-46e7f446-ed50-2b5f-b371-45b7b071dc0f (Addr: tcp/127.0.0.1:29442) (DC: dc1)" 32:01.500 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29437 network=udp 32:01.500 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-46e7f446-ed50-2b5f-b371-45b7b071dc0f.dc1 area=wan 32:01.501 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29437 network=tcp 32:01.502 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29438 network=tcp 32:01.502 [INFO] TestAgent: started state syncer 32:01.502 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30330 network=tcp 32:01.557 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:01.557 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29442 [Candidate]" term=2 32:01.589 [DEBUG] TestAgent.server.raft: votes: needed=1 32:01.589 [DEBUG] TestAgent.server.raft: vote granted: from=46e7f446-ed50-2b5f-b371-45b7b071dc0f term=2 tally=1 32:01.589 [INFO] TestAgent.server.raft: election won: tally=1 32:01.589 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29442 [Leader]" 32:01.589 [INFO] TestAgent.server: cluster leadership acquired 32:01.589 [INFO] TestAgent.server: New leader elected: payload=Node-46e7f446-ed50-2b5f-b371-45b7b071dc0f 32:01.612 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29442 32:01.642 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:01.668 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:01.668 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:01.668 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:01.668 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:01.668 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:01.668 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-46e7f446-ed50-2b5f-b371-45b7b071dc0f 32:01.668 [INFO] TestAgent.server: member joined, marking health alive: member=Node-46e7f446-ed50-2b5f-b371-45b7b071dc0f 32:01.684 [INFO] TestAgent.server: federation state anti-entropy synced 32:01.692 [INFO] TestAgent: Requesting shutdown 32:01.692 [INFO] TestAgent.server: shutting down server 32:01.692 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:01.692 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:01.692 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:01.692 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:01.692 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:01.692 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:01.692 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:01.692 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:01.692 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:01.692 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:01.692 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:01.700 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:01.705Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:01.705Z [INFO] agent.router.manager: shutting down 32:01.705 [INFO] TestAgent: consul server down 32:01.705 [INFO] TestAgent: shutdown complete 32:01.705 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29437 network=tcp 32:01.705 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29437 network=udp 32:01.705 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29438 network=tcp 32:02.205 [INFO] TestAgent: Waiting for endpoints to shut down 32:02.205 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Members_WAN (0.84s) === CONT TestAgent_Reload 2021-10-05T16:32:01.502Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:01.558Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:01.635 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1e855136-8c12-7bfc-b7ed-9bd84b93b9c0 Address:127.0.0.1:29449}]" 32:01.636 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29449 [Follower]" leader= 32:01.636 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1e855136-8c12-7bfc-b7ed-9bd84b93b9c0.dc1 127.0.0.1 32:01.637 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1e855136-8c12-7bfc-b7ed-9bd84b93b9c0 127.0.0.1 2021-10-05T16:32:01.637Z [INFO] agent.router: Initializing LAN area manager 32:01.637 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29514 network=udp 32:01.637 [INFO] TestAgent.server: Adding LAN server: server="Node-1e855136-8c12-7bfc-b7ed-9bd84b93b9c0 (Addr: tcp/127.0.0.1:29449) (DC: dc1)" 32:01.637 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1e855136-8c12-7bfc-b7ed-9bd84b93b9c0.dc1 area=wan 32:01.637 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29514 network=tcp 32:01.638 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29515 network=tcp 32:01.638 [INFO] TestAgent: started state syncer 32:01.638 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29492 network=tcp 32:01.701 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:01.701 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29449 [Candidate]" term=2 32:01.736 [DEBUG] TestAgent.server.raft: votes: needed=1 32:01.736 [DEBUG] TestAgent.server.raft: vote granted: from=1e855136-8c12-7bfc-b7ed-9bd84b93b9c0 term=2 tally=1 32:01.736 [INFO] TestAgent.server.raft: election won: tally=1 32:01.736 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29449 [Leader]" 32:01.736 [INFO] TestAgent: Requesting shutdown 32:01.736 [INFO] TestAgent.server: cluster leadership acquired 32:01.736 [INFO] TestAgent.server: shutting down server 32:01.736 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:01.736 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:01.749 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 32:01.754 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29449 2021-10-05T16:32:01.767Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:01.767Z [INFO] agent.router.manager: shutting down 32:01.767 [INFO] TestAgent: consul server down 32:01.767 [INFO] TestAgent: shutdown complete 32:01.767 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29514 network=tcp 32:01.767 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29514 network=udp 32:01.767 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29515 network=tcp 32:01.767 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 32:01.767 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:02.268 [INFO] TestAgent: Waiting for endpoints to shut down 32:02.268 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_RaftPeer (1.64s) --- PASS: TestOperator_RaftPeer/#00 (0.82s) --- PASS: TestOperator_RaftPeer/#01 (0.82s) === CONT TestAgent_Metrics_ACLDeny === RUN TestAgent_Reload_ACLDeny/no_token === RUN TestAgent_Reload_ACLDeny/read-only_token 2021-10-05T16:32:01.357Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:01.357Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:01.387Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:01.387Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:01.504 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5803f1da-ffb7-4398-3db6-9a7b160b7546 Address:127.0.0.1:29463}]" 32:01.510 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29463 [Follower]" leader= 32:01.513 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5803f1da-ffb7-4398-3db6-9a7b160b7546.dc1 127.0.0.1 32:01.515 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 127.0.0.1 2021-10-05T16:32:01.516Z [INFO] agent.router: Initializing LAN area manager 32:01.517 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29465 network=udp 32:01.518 [INFO] TestAgent.server: Adding LAN server: server="Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 (Addr: tcp/127.0.0.1:29463) (DC: dc1)" 32:01.519 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29465 network=tcp 32:01.537 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546.dc1 area=wan 32:01.540 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29466 network=tcp 32:01.540 [INFO] TestAgent: started state syncer 32:01.540 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29457 network=tcp 32:01.560 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:01.560 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29463 [Candidate]" term=2 32:01.568 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:01.591 [DEBUG] TestAgent.server.raft: votes: needed=1 32:01.591 [DEBUG] TestAgent.server.raft: vote granted: from=5803f1da-ffb7-4398-3db6-9a7b160b7546 term=2 tally=1 32:01.591 [INFO] TestAgent.server.raft: election won: tally=1 32:01.591 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29463 [Leader]" 32:01.592 [INFO] TestAgent.server: cluster leadership acquired 32:01.592 [INFO] TestAgent.server: New leader elected: payload=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 32:01.602 [INFO] TestAgent.server: initializing acls 32:01.607 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:01.607 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:01.618 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:01.636 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:01.636 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:01.636 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:01.637 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 32:01.637 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5803f1da-ffb7-4398-3db6-9a7b160b7546.dc1 32:01.638 [INFO] TestAgent.server: Updating LAN server: server="Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 (Addr: tcp/127.0.0.1:29463) (DC: dc1)" 32:01.638 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546.dc1 area=wan 32:01.652 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:01.690 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:01.690 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:01.690 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:01.690 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:01.690 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:01.690 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 32:01.690 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 32:01.712 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 32:01.724 [INFO] TestAgent.server: federation state anti-entropy synced 32:01.754 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:01.762 [INFO] TestAgent: Synced node info 32:01.762 [DEBUG] TestAgent: Node info in sync 32:01.797 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 32:01.797 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 32:01.797 [DEBUG] TestAgent: dropping node from result due to ACLs: node=Node-5803f1da-ffb7-4398-3db6-9a7b160b7546 accessorID=00000000-0000-0000-0000-000000000002 32:01.797 [INFO] TestAgent: Requesting shutdown 32:01.797 [INFO] TestAgent.server: shutting down server 32:01.797 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:01.797 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:01.797 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:01.797 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:01.797 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:01.797 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:01.797 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:01.797 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:01.797 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:01.797 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:01.797 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:01.797 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:01.797 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:01.797 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:01.803 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:01.809Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:01.809Z [INFO] agent.router.manager: shutting down 32:01.809 [INFO] TestAgent: consul server down 32:01.809 [INFO] TestAgent: shutdown complete 32:01.809 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29465 network=tcp 32:01.809 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29465 network=udp 32:01.809 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29466 network=tcp 32:02.310 [INFO] TestAgent: Waiting for endpoints to shut down 32:02.310 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Members_ACLFilter (0.97s) --- PASS: TestAgent_Members_ACLFilter/no_token (0.00s) --- PASS: TestAgent_Members_ACLFilter/root_token (0.00s) === CONT TestAgent_Self_ACLDeny [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:01.414Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:01.504Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:01.595 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c05c83c8-2e72-0291-6a46-994c7056d05d Address:127.0.0.1:29456}]" 32:01.595 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29456 [Follower]" leader= 32:01.596 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c05c83c8-2e72-0291-6a46-994c7056d05d.dc1 127.0.0.1 32:01.597 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c05c83c8-2e72-0291-6a46-994c7056d05d 127.0.0.1 2021-10-05T16:32:01.597Z [INFO] agent.router: Initializing LAN area manager 32:01.597 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30331 network=udp 32:01.597 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c05c83c8-2e72-0291-6a46-994c7056d05d.dc1 area=wan 32:01.597 [INFO] TestAgent.server: Adding LAN server: server="Node-c05c83c8-2e72-0291-6a46-994c7056d05d (Addr: tcp/127.0.0.1:29456) (DC: dc1)" 32:01.597 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30331 network=tcp 32:01.598 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30332 network=tcp 32:01.598 [INFO] TestAgent: started state syncer 32:01.598 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29464 network=tcp 32:01.656 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:01.656 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29456 [Candidate]" term=2 32:01.700 [DEBUG] TestAgent.server.raft: votes: needed=1 32:01.700 [DEBUG] TestAgent.server.raft: vote granted: from=c05c83c8-2e72-0291-6a46-994c7056d05d term=2 tally=1 32:01.700 [INFO] TestAgent.server.raft: election won: tally=1 32:01.700 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29456 [Leader]" 32:01.701 [INFO] TestAgent.server: cluster leadership acquired 32:01.701 [INFO] TestAgent.server: New leader elected: payload=Node-c05c83c8-2e72-0291-6a46-994c7056d05d 32:01.732 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29456 32:01.755 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:01.784 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:01.784 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:01.784 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:01.784 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:01.784 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:01.784 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c05c83c8-2e72-0291-6a46-994c7056d05d 32:01.784 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c05c83c8-2e72-0291-6a46-994c7056d05d 32:01.803 [INFO] TestAgent.server: federation state anti-entropy synced 32:01.972 [INFO] TestAgent: Requesting shutdown 32:01.972 [INFO] TestAgent.server: shutting down server 32:01.972 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:01.972 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:01.972 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:01.972 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:01.972 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:01.972 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:01.972 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:01.972 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:01.972 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:01.972 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:01.972 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:01.975 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:01.979Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:01.979Z [INFO] agent.router.manager: shutting down 32:01.979 [INFO] TestAgent: consul server down 32:01.979 [INFO] TestAgent: shutdown complete 32:01.979 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30331 network=tcp 32:01.979 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30331 network=udp 32:01.979 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30332 network=tcp 32:02.479 [INFO] TestAgent: Waiting for endpoints to shut down 32:02.479 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Members (1.08s) === CONT TestAgent_Self === RUN TestAgent_Self/no_grpc [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_Metrics_ACLDeny/no_token === RUN TestAgent_Metrics_ACLDeny/agent_master_token === RUN TestAgent_Metrics_ACLDeny/read-only_token === RUN TestAgent_Self_ACLDeny/no_token === RUN TestAgent_Self_ACLDeny/agent_master_token === RUN TestAgent_Self_ACLDeny/read-only_token 2021-10-05T16:32:01.918Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:01.918Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:01.946Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:01.946Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:02.028 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4ee380f6-77e8-3944-26d4-e27c28212d61 Address:127.0.0.1:29428}]" 32:02.029 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4ee380f6-77e8-3944-26d4-e27c28212d61.dc1 127.0.0.1 32:02.029 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4ee380f6-77e8-3944-26d4-e27c28212d61 127.0.0.1 2021-10-05T16:32:02.029Z [INFO] agent.router: Initializing LAN area manager 32:02.030 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29428 [Follower]" leader= 32:02.030 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4ee380f6-77e8-3944-26d4-e27c28212d61.dc1 area=wan 32:02.030 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29479 network=tcp 32:02.030 [INFO] TestAgent.server: Adding LAN server: server="Node-4ee380f6-77e8-3944-26d4-e27c28212d61 (Addr: tcp/127.0.0.1:29428) (DC: dc1)" 32:02.030 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29479 network=udp 32:02.031 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29480 network=tcp 32:02.031 [INFO] TestAgent: started state syncer 32:02.031 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30386 network=tcp 32:02.076 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:02.076 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29428 [Candidate]" term=2 32:02.080 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:02.094 [DEBUG] TestAgent.server.raft: votes: needed=1 32:02.094 [DEBUG] TestAgent.server.raft: vote granted: from=4ee380f6-77e8-3944-26d4-e27c28212d61 term=2 tally=1 32:02.094 [INFO] TestAgent.server.raft: election won: tally=1 32:02.094 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29428 [Leader]" 32:02.094 [INFO] TestAgent.server: cluster leadership acquired 32:02.094 [INFO] TestAgent.server: New leader elected: payload=Node-4ee380f6-77e8-3944-26d4-e27c28212d61 32:02.102 [INFO] TestAgent.server: initializing acls 32:02.106 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:02.106 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:02.115 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:02.126 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:02.126 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:02.126 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:02.126 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-4ee380f6-77e8-3944-26d4-e27c28212d61 32:02.126 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-4ee380f6-77e8-3944-26d4-e27c28212d61.dc1 32:02.127 [INFO] TestAgent.server: Updating LAN server: server="Node-4ee380f6-77e8-3944-26d4-e27c28212d61 (Addr: tcp/127.0.0.1:29428) (DC: dc1)" 32:02.127 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-4ee380f6-77e8-3944-26d4-e27c28212d61.dc1 area=wan 32:02.151 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:02.187 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:02.187 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:02.187 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:02.187 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:02.187 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:02.188 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4ee380f6-77e8-3944-26d4-e27c28212d61 32:02.188 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4ee380f6-77e8-3944-26d4-e27c28212d61 32:02.197 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4ee380f6-77e8-3944-26d4-e27c28212d61 32:02.216 [INFO] TestAgent.server: federation state anti-entropy synced 32:02.272 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-4ee380f6-77e8-3944-26d4-e27c28212d61 32:02.272 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-4ee380f6-77e8-3944-26d4-e27c28212d61 32:02.289 [INFO] TestAgent: Requesting shutdown 32:02.289 [INFO] TestAgent.server: shutting down server 32:02.289 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:02.289 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:02.289 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:02.289 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:02.289 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:02.289 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:02.289 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:02.289 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:02.289 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:02.289 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:02.290 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:02.290 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:02.290 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:02.290 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:02.290 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:02.304 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:02.312Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:02.312Z [INFO] agent.router.manager: shutting down 32:02.312 [INFO] TestAgent: consul server down 32:02.312 [INFO] TestAgent: shutdown complete 32:02.312 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29479 network=tcp 32:02.312 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29479 network=udp 32:02.312 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29480 network=tcp 32:02.812 [INFO] TestAgent: Waiting for endpoints to shut down 32:02.812 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Reload_ACLDeny (0.92s) --- PASS: TestAgent_Reload_ACLDeny/no_token (0.00s) --- PASS: TestAgent_Reload_ACLDeny/read-only_token (0.02s) === CONT TestAgent_Checks_ACLFilter [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:02.579Z [WARN] TestAgent_Reload: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:02.229Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:02.250Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:02.303 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:46181440-f24a-82f1-f970-e9952dcff27a Address:127.0.0.1:30329}]" 32:02.303 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30329 [Follower]" leader= 32:02.304 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-46181440-f24a-82f1-f970-e9952dcff27a.dc1 127.0.0.1 32:02.308 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-46181440-f24a-82f1-f970-e9952dcff27a 127.0.0.1 2021-10-05T16:32:02.308Z [INFO] agent.router: Initializing LAN area manager 32:02.309 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30387 network=udp 32:02.309 [INFO] TestAgent.server: Adding LAN server: server="Node-46181440-f24a-82f1-f970-e9952dcff27a (Addr: tcp/127.0.0.1:30329) (DC: dc1)" 32:02.309 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-46181440-f24a-82f1-f970-e9952dcff27a.dc1 area=wan 32:02.309 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30387 network=tcp 32:02.309 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30388 network=tcp 32:02.309 [WARN] TestAgent: The 'handler' field in watches has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/watches.html 32:02.309 [INFO] TestAgent: started state syncer 32:02.310 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29506 network=tcp 32:02.352 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:02.352 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30329 [Candidate]" term=2 32:02.385 [DEBUG] TestAgent.server.raft: votes: needed=1 32:02.385 [DEBUG] TestAgent.server.raft: vote granted: from=46181440-f24a-82f1-f970-e9952dcff27a term=2 tally=1 32:02.385 [INFO] TestAgent.server.raft: election won: tally=1 32:02.385 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30329 [Leader]" 32:02.386 [INFO] TestAgent.server: cluster leadership acquired 32:02.386 [INFO] TestAgent.server: New leader elected: payload=Node-46181440-f24a-82f1-f970-e9952dcff27a 32:02.397 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30329 32:02.416 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:02.442 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:02.442 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:02.442 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:02.442 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:02.442 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:02.442 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-46181440-f24a-82f1-f970-e9952dcff27a 32:02.442 [INFO] TestAgent.server: member joined, marking health alive: member=Node-46181440-f24a-82f1-f970-e9952dcff27a 32:02.446 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test?dc=dc1 from=127.0.0.1:50642 latency=135.370961ms 32:02.475 [DEBUG] TestAgent: watch handler output: watch_handler=true output= 32:02.484 [INFO] TestAgent.server: federation state anti-entropy synced 32:02.500 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:02.507 [INFO] TestAgent: Synced node info 32:02.511 [INFO] TestAgent: Synced service: service=redis 32:02.511 [DEBUG] TestAgent: Node info in sync 32:02.511 [DEBUG] TestAgent: Service in sync: service=redis 32:02.579 [INFO] TestAgent: Requesting shutdown 32:02.579 [INFO] TestAgent.server: shutting down server 32:02.579 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:02.579 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:02.592 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:02.608Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:02.608Z [INFO] agent.router.manager: shutting down 32:02.608 [INFO] TestAgent: consul server down 32:02.608 [INFO] TestAgent: shutdown complete 32:02.608 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30387 network=tcp 32:02.608 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30387 network=udp 32:02.608 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30388 network=tcp 32:03.112 [INFO] TestAgent: Waiting for endpoints to shut down 32:03.112 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Reload (0.91s) === CONT TestAgent_HealthServicesACLEnforcement 2021-10-05T16:32:02.292Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:02.292Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:02.307Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:02.307Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:02.408 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:294860bd-eb30-9223-12cf-5a3862ccbc29 Address:127.0.0.1:29491}]" 32:02.408 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29491 [Follower]" leader= 32:02.412 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-294860bd-eb30-9223-12cf-5a3862ccbc29.dc1 127.0.0.1 32:02.413 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-294860bd-eb30-9223-12cf-5a3862ccbc29 127.0.0.1 2021-10-05T16:32:02.413Z [INFO] agent.router: Initializing LAN area manager 32:02.413 [INFO] TestAgent.server: Adding LAN server: server="Node-294860bd-eb30-9223-12cf-5a3862ccbc29 (Addr: tcp/127.0.0.1:29491) (DC: dc1)" 32:02.413 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-294860bd-eb30-9223-12cf-5a3862ccbc29.dc1 area=wan 32:02.413 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29500 network=udp 32:02.413 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29500 network=tcp 32:02.414 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29501 network=tcp 32:02.414 [INFO] TestAgent: started state syncer 32:02.414 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29429 network=tcp 32:02.465 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:02.465 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29491 [Candidate]" term=2 32:02.467 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:02.489 [DEBUG] TestAgent.server.raft: votes: needed=1 32:02.489 [DEBUG] TestAgent.server.raft: vote granted: from=294860bd-eb30-9223-12cf-5a3862ccbc29 term=2 tally=1 32:02.489 [INFO] TestAgent.server.raft: election won: tally=1 32:02.489 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29491 [Leader]" 32:02.492 [INFO] TestAgent.server: cluster leadership acquired 32:02.492 [INFO] TestAgent.server: New leader elected: payload=Node-294860bd-eb30-9223-12cf-5a3862ccbc29 32:02.506 [INFO] TestAgent.server: initializing acls 32:02.510 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:02.510 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:02.517 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:02.526 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:02.526 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:02.526 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:02.526 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-294860bd-eb30-9223-12cf-5a3862ccbc29 32:02.526 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-294860bd-eb30-9223-12cf-5a3862ccbc29.dc1 32:02.527 [INFO] TestAgent.server: Updating LAN server: server="Node-294860bd-eb30-9223-12cf-5a3862ccbc29 (Addr: tcp/127.0.0.1:29491) (DC: dc1)" 32:02.527 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-294860bd-eb30-9223-12cf-5a3862ccbc29.dc1 area=wan 32:02.541 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:02.579 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:02.579 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:02.579 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:02.579 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:02.579 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:02.579 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-294860bd-eb30-9223-12cf-5a3862ccbc29 32:02.579 [INFO] TestAgent.server: member joined, marking health alive: member=Node-294860bd-eb30-9223-12cf-5a3862ccbc29 32:02.598 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-294860bd-eb30-9223-12cf-5a3862ccbc29 32:02.601 [INFO] TestAgent.server: federation state anti-entropy synced 32:02.632 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:02.635 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-294860bd-eb30-9223-12cf-5a3862ccbc29 32:02.635 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-294860bd-eb30-9223-12cf-5a3862ccbc29 32:02.639 [INFO] TestAgent: Synced node info 32:02.639 [DEBUG] TestAgent: Node info in sync 32:02.672 [INFO] TestAgent: Requesting shutdown 32:02.672 [INFO] TestAgent.server: shutting down server 32:02.672 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:02.672 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:02.672 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:02.672 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:02.672 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:02.672 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:02.673 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:02.673 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:02.673 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:02.673 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:02.673 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:02.673 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:02.673 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:02.673 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:02.688 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:02.695Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:02.695Z [INFO] agent.router.manager: shutting down 32:02.695 [INFO] TestAgent: consul server down 32:02.695 [INFO] TestAgent: shutdown complete 32:02.695 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29500 network=tcp 32:02.695 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29500 network=udp 32:02.695 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29501 network=tcp 32:03.195 [INFO] TestAgent: Waiting for endpoints to shut down 32:03.195 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Metrics_ACLDeny (0.93s) --- PASS: TestAgent_Metrics_ACLDeny/no_token (0.00s) --- PASS: TestAgent_Metrics_ACLDeny/agent_master_token (0.00s) --- PASS: TestAgent_Metrics_ACLDeny/read-only_token (0.04s) === CONT TestAgent_HealthServiceByName === RUN TestAgent_Checks_ACLFilter/no_token === RUN TestAgent_Checks_ACLFilter/root_token 2021-10-05T16:32:02.329Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:02.329Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:02.349Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:02.349Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:02.387 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6df3c29c-18dd-9145-b536-2741856b329a Address:127.0.0.1:29498}]" 32:02.388 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29498 [Follower]" leader= 32:02.388 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6df3c29c-18dd-9145-b536-2741856b329a.dc1 127.0.0.1 32:02.389 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6df3c29c-18dd-9145-b536-2741856b329a 127.0.0.1 2021-10-05T16:32:02.389Z [INFO] agent.router: Initializing LAN area manager 32:02.389 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29458 network=udp 32:02.389 [INFO] TestAgent.server: Adding LAN server: server="Node-6df3c29c-18dd-9145-b536-2741856b329a (Addr: tcp/127.0.0.1:29498) (DC: dc1)" 32:02.389 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6df3c29c-18dd-9145-b536-2741856b329a.dc1 area=wan 32:02.389 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29458 network=tcp 32:02.390 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29459 network=tcp 32:02.390 [INFO] TestAgent: started state syncer 32:02.390 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29499 network=tcp 32:02.427 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:02.427 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29498 [Candidate]" term=2 32:02.440 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:02.441 [DEBUG] TestAgent.server.raft: votes: needed=1 32:02.441 [DEBUG] TestAgent.server.raft: vote granted: from=6df3c29c-18dd-9145-b536-2741856b329a term=2 tally=1 32:02.441 [INFO] TestAgent.server.raft: election won: tally=1 32:02.441 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29498 [Leader]" 32:02.442 [INFO] TestAgent.server: cluster leadership acquired 32:02.442 [INFO] TestAgent.server: New leader elected: payload=Node-6df3c29c-18dd-9145-b536-2741856b329a 32:02.461 [INFO] TestAgent.server: initializing acls 32:02.469 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:02.469 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:02.485 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:02.516 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:02.516 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:02.516 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:02.516 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-6df3c29c-18dd-9145-b536-2741856b329a 32:02.516 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-6df3c29c-18dd-9145-b536-2741856b329a.dc1 32:02.517 [INFO] TestAgent.server: Updating LAN server: server="Node-6df3c29c-18dd-9145-b536-2741856b329a (Addr: tcp/127.0.0.1:29498) (DC: dc1)" 32:02.517 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-6df3c29c-18dd-9145-b536-2741856b329a.dc1 area=wan 32:02.565 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:02.608 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:02.608 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:02.608 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:02.608 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:02.608 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:02.608 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6df3c29c-18dd-9145-b536-2741856b329a 32:02.608 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6df3c29c-18dd-9145-b536-2741856b329a 32:02.621 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6df3c29c-18dd-9145-b536-2741856b329a 32:02.626 [INFO] TestAgent.server: federation state anti-entropy synced 32:02.626 [INFO] TestAgent: Synced node info 32:02.782 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-6df3c29c-18dd-9145-b536-2741856b329a 32:02.782 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-6df3c29c-18dd-9145-b536-2741856b329a 32:02.795 [INFO] TestAgent: Requesting shutdown 32:02.796 [INFO] TestAgent.server: shutting down server 32:02.796 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:02.796 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:02.796 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:02.796 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:02.796 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:02.796 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:02.796 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:02.796 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:02.796 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:02.796 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:02.796 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:02.796 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:02.796 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:02.796 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:02.800 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:02.804Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:02.804Z [INFO] agent.router.manager: shutting down 32:02.804 [INFO] TestAgent: consul server down 32:02.804 [INFO] TestAgent: shutdown complete 32:02.804 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29458 network=tcp 32:02.804 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29458 network=udp 32:02.804 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29459 network=tcp 32:03.308 [INFO] TestAgent: Waiting for endpoints to shut down 32:03.308 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Self_ACLDeny (1.00s) --- PASS: TestAgent_Self_ACLDeny/no_token (0.00s) --- PASS: TestAgent_Self_ACLDeny/agent_master_token (0.00s) --- PASS: TestAgent_Self_ACLDeny/read-only_token (0.01s) === CONT TestAgent_HealthServiceByID [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_HealthServicesACLEnforcement/no-token-health-by-id === RUN TestAgent_HealthServicesACLEnforcement/no-token-health-by-name === RUN TestAgent_HealthServicesACLEnforcement/root-token-health-by-id === RUN TestAgent_HealthServicesACLEnforcement/root-token-health-by-name 2021-10-05T16:32:02.494Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:02.555Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:02.615 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:76b618f1-cff4-b1eb-19f9-ae5f027dc1e6 Address:127.0.0.1:29421}]" 32:02.616 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29421 [Follower]" leader= 32:02.616 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-76b618f1-cff4-b1eb-19f9-ae5f027dc1e6.dc1 127.0.0.1 32:02.617 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-76b618f1-cff4-b1eb-19f9-ae5f027dc1e6 127.0.0.1 2021-10-05T16:32:02.617Z [INFO] agent.router: Initializing LAN area manager 32:02.617 [INFO] TestAgent.server: Adding LAN server: server="Node-76b618f1-cff4-b1eb-19f9-ae5f027dc1e6 (Addr: tcp/127.0.0.1:29421) (DC: dc1)" 32:02.617 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-76b618f1-cff4-b1eb-19f9-ae5f027dc1e6.dc1 area=wan 32:02.618 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29535 network=udp 32:02.618 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29535 network=tcp 32:02.618 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29536 network=tcp 32:02.618 [INFO] TestAgent: started state syncer 32:02.671 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:02.671 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29421 [Candidate]" term=2 32:02.696 [DEBUG] TestAgent.server.raft: votes: needed=1 32:02.696 [DEBUG] TestAgent.server.raft: vote granted: from=76b618f1-cff4-b1eb-19f9-ae5f027dc1e6 term=2 tally=1 32:02.696 [INFO] TestAgent.server.raft: election won: tally=1 32:02.696 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29421 [Leader]" 32:02.697 [INFO] TestAgent.server: cluster leadership acquired 32:02.697 [INFO] TestAgent.server: New leader elected: payload=Node-76b618f1-cff4-b1eb-19f9-ae5f027dc1e6 32:02.724 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29421 32:02.772 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:02.832 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:02.832 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:02.832 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:02.832 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:02.832 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:02.832 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-76b618f1-cff4-b1eb-19f9-ae5f027dc1e6 32:02.832 [INFO] TestAgent.server: member joined, marking health alive: member=Node-76b618f1-cff4-b1eb-19f9-ae5f027dc1e6 32:02.855 [INFO] TestAgent.server: federation state anti-entropy synced 32:02.879 [INFO] TestAgent: Requesting shutdown 32:02.879 [INFO] TestAgent.server: shutting down server 32:02.879 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:02.879 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:02.879 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:02.879 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:02.879 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:02.879 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:02.879 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:02.879 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:02.879 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:02.879 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:02.879 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:02.884 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:02.892Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:02.892Z [INFO] agent.router.manager: shutting down 32:02.892 [INFO] TestAgent: consul server down 32:02.892 [INFO] TestAgent: shutdown complete 32:02.892 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29535 network=tcp 32:02.892 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29535 network=udp 32:02.892 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29536 network=tcp 32:03.393 [INFO] TestAgent: Waiting for endpoints to shut down 32:03.393 [INFO] TestAgent: Endpoints down === RUN TestAgent_Self/normal === RUN TestAgent_HealthServiceByName/passing_checks === RUN TestAgent_HealthServiceByName/passing_checks/format=text === RUN TestAgent_HealthServiceByName/passing_checks/format=json === RUN TestAgent_HealthServiceByName/warning_checks === RUN TestAgent_HealthServiceByName/warning_checks/format=text === RUN TestAgent_HealthServiceByName/warning_checks/format=json === RUN TestAgent_HealthServiceByName/critical_checks === RUN TestAgent_HealthServiceByName/critical_checks/format=text === RUN TestAgent_HealthServiceByName/critical_checks/format=json === RUN TestAgent_HealthServiceByName/unknown_serviceName === RUN TestAgent_HealthServiceByName/unknown_serviceName/format=text === RUN TestAgent_HealthServiceByName/unknown_serviceName/format=json === RUN TestAgent_HealthServiceByName/critical_check_on_node === RUN TestAgent_HealthServiceByName/critical_check_on_node/format=text === RUN TestAgent_HealthServiceByName/critical_check_on_node/format=json === RUN TestAgent_HealthServiceByName/maintenance_check_on_node === RUN TestAgent_HealthServiceByName/maintenance_check_on_node/format=text === RUN TestAgent_HealthServiceByName/maintenance_check_on_node/format=json [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestAgent_HealthServiceByID/passing_checks === RUN TestAgent_HealthServiceByID/passing_checks/format=text === RUN TestAgent_HealthServiceByID/passing_checks/format=json === RUN TestAgent_HealthServiceByID/warning_checks === RUN TestAgent_HealthServiceByID/warning_checks/format=text === RUN TestAgent_HealthServiceByID/warning_checks/format=json === RUN TestAgent_HealthServiceByID/critical_checks === RUN TestAgent_HealthServiceByID/critical_checks/format=text === RUN TestAgent_HealthServiceByID/critical_checks/format=json === RUN TestAgent_HealthServiceByID/unknown_serviceid === RUN TestAgent_HealthServiceByID/unknown_serviceid/format=text === RUN TestAgent_HealthServiceByID/unknown_serviceid/format=json === RUN TestAgent_HealthServiceByID/critical_check_on_node === RUN TestAgent_HealthServiceByID/critical_check_on_node/format=text === RUN TestAgent_HealthServiceByID/critical_check_on_node/format=json === RUN TestAgent_HealthServiceByID/maintenance_check_on_node === RUN TestAgent_HealthServiceByID/maintenance_check_on_node/format=text === RUN TestAgent_HealthServiceByID/maintenance_check_on_node/format=json 2021-10-05T16:32:02.830Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:02.830Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:02.847Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:02.847Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:02.943 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:60ea4d12-b9dd-11e5-d413-9054ad23f46a Address:127.0.0.1:29540}]" 32:02.943 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29540 [Follower]" leader= 32:02.945 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a.dc1 127.0.0.1 32:02.946 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 127.0.0.1 2021-10-05T16:32:02.946Z [INFO] agent.router: Initializing LAN area manager 32:02.946 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29416 network=udp 32:02.946 [INFO] TestAgent.server: Adding LAN server: server="Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a (Addr: tcp/127.0.0.1:29540) (DC: dc1)" 32:02.947 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a.dc1 area=wan 32:02.947 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29416 network=tcp 32:02.947 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29417 network=tcp 32:02.947 [INFO] TestAgent: started state syncer 32:02.947 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29541 network=tcp 32:02.985 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:02.985 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29540 [Candidate]" term=2 32:03.000 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:03.048 [DEBUG] TestAgent.server.raft: votes: needed=1 32:03.048 [DEBUG] TestAgent.server.raft: vote granted: from=60ea4d12-b9dd-11e5-d413-9054ad23f46a term=2 tally=1 32:03.048 [INFO] TestAgent.server.raft: election won: tally=1 32:03.048 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29540 [Leader]" 32:03.052 [INFO] TestAgent.server: cluster leadership acquired 32:03.052 [INFO] TestAgent.server: New leader elected: payload=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.070 [INFO] TestAgent.server: initializing acls 32:03.075 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:03.075 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:03.092 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:03.100 [INFO] TestAgent.server: initializing acls 32:03.100 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:03.124 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:03.124 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:03.125 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:03.125 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:03.125 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:03.125 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.125 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a.dc1 32:03.125 [INFO] TestAgent.server: Updating LAN server: server="Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a (Addr: tcp/127.0.0.1:29540) (DC: dc1)" 32:03.125 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a.dc1 area=wan 32:03.125 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.125 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a.dc1 32:03.128 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a.dc1 area=wan 32:03.128 [INFO] TestAgent.server: Updating LAN server: server="Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a (Addr: tcp/127.0.0.1:29540) (DC: dc1)" 32:03.155 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:03.192 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:03.192 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:03.192 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:03.192 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:03.192 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:03.192 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.192 [INFO] TestAgent.server: member joined, marking health alive: member=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.207 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.207 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.212 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-60ea4d12-b9dd-11e5-d413-9054ad23f46a 32:03.212 [DEBUG] TestAgent: dropping check from result due to ACLs: check=mysql 32:03.213 [INFO] TestAgent: Requesting shutdown 32:03.213 [INFO] TestAgent.server: shutting down server 32:03.213 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:03.213 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:03.213 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:03.213 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:03.213 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:03.213 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:03.213 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:03.213 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:03.213 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:03.213 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:03.213 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:03.213 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:03.213 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:03.217 [INFO] TestAgent.server: federation state anti-entropy synced 32:03.217 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:03.218 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:03.222Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:03.222Z [INFO] agent.router.manager: shutting down 32:03.222 [INFO] TestAgent: consul server down 32:03.222 [INFO] TestAgent: shutdown complete 32:03.222 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29416 network=tcp 32:03.222 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29416 network=udp 32:03.222 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29417 network=tcp 32:03.728 [INFO] TestAgent: Waiting for endpoints to shut down 32:03.728 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Checks_ACLFilter (0.92s) --- PASS: TestAgent_Checks_ACLFilter/no_token (0.00s) --- PASS: TestAgent_Checks_ACLFilter/root_token (0.00s) === CONT TestAgent_ChecksWithFilter [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:03.130Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:03.155Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:03.228 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7bd5f1c2-efe8-14ef-fb65-40feb274349c Address:127.0.0.1:29512}]" 32:03.230 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c.dc1 127.0.0.1 32:03.230 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c 127.0.0.1 2021-10-05T16:32:03.230Z [INFO] agent.router: Initializing LAN area manager 32:03.231 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29493 network=udp 32:03.231 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29512 [Follower]" leader= 32:03.232 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c.dc1 area=wan 32:03.236 [INFO] TestAgent.server: Adding LAN server: server="Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c (Addr: tcp/127.0.0.1:29512) (DC: dc1)" 32:03.236 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29493 network=tcp 32:03.237 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29494 network=tcp 32:03.237 [INFO] TestAgent: started state syncer 32:03.238 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29534 network=tcp 32:03.284 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:03.286 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:03.286 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29512 [Candidate]" term=2 32:03.297 [DEBUG] TestAgent.server.raft: votes: needed=1 32:03.297 [DEBUG] TestAgent.server.raft: vote granted: from=7bd5f1c2-efe8-14ef-fb65-40feb274349c term=2 tally=1 32:03.297 [INFO] TestAgent.server.raft: election won: tally=1 32:03.297 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29512 [Leader]" 32:03.300 [INFO] TestAgent.server: cluster leadership acquired 32:03.300 [INFO] TestAgent.server: New leader elected: payload=Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c 32:03.306 [INFO] TestAgent.server: initializing acls 32:03.310 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:03.320 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 32:03.338 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:03.352 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:03.352 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:03.352 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:03.352 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c 32:03.352 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c.dc1 32:03.353 [INFO] TestAgent.server: Updating LAN server: server="Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c (Addr: tcp/127.0.0.1:29512) (DC: dc1)" 32:03.353 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7bd5f1c2-efe8-14ef-fb65-40feb274349c.dc1 area=wan 32:03.377 [INFO] TestAgent: Requesting shutdown 32:03.377 [INFO] TestAgent.server: shutting down server 32:03.377 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:03.377 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:03.377 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:03.377 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:03.377 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:03.377 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:03.384 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:03.389Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:03.389Z [INFO] agent.router.manager: shutting down 32:03.409 [INFO] TestAgent: consul server down 32:03.409 [INFO] TestAgent: shutdown complete 32:03.409 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29493 network=tcp 32:03.409 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29493 network=udp 32:03.409 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29494 network=tcp 32:03.409 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 32:03.409 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:03.409 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 32:03.409 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 32:03.409 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 32:03.911 [INFO] TestAgent: Waiting for endpoints to shut down 32:03.911 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_HealthServicesACLEnforcement (0.80s) --- PASS: TestAgent_HealthServicesACLEnforcement/no-token-health-by-id (0.00s) --- PASS: TestAgent_HealthServicesACLEnforcement/no-token-health-by-name (0.00s) --- PASS: TestAgent_HealthServicesACLEnforcement/root-token-health-by-id (0.00s) --- PASS: TestAgent_HealthServicesACLEnforcement/root-token-health-by-name (0.00s) === CONT TestAgent_Checks 2021-10-05T16:32:03.213Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:03.230Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:03.268 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:74640e3f-b3cd-5625-9fff-ace66d0540a7 Address:127.0.0.1:29526}]" 32:03.269 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-74640e3f-b3cd-5625-9fff-ace66d0540a7.dc1 127.0.0.1 32:03.269 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-74640e3f-b3cd-5625-9fff-ace66d0540a7 127.0.0.1 2021-10-05T16:32:03.269Z [INFO] agent.router: Initializing LAN area manager 32:03.270 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29526 [Follower]" leader= 32:03.270 [INFO] TestAgent.server: Adding LAN server: server="Node-74640e3f-b3cd-5625-9fff-ace66d0540a7 (Addr: tcp/127.0.0.1:29526) (DC: dc1)" 32:03.270 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-74640e3f-b3cd-5625-9fff-ace66d0540a7.dc1 area=wan 32:03.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29521 network=tcp 32:03.271 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29521 network=udp 32:03.271 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29522 network=tcp 32:03.271 [INFO] TestAgent: started state syncer 32:03.271 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29527 network=tcp 32:03.322 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:03.322 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29526 [Candidate]" term=2 32:03.344 [DEBUG] TestAgent.server.raft: votes: needed=1 32:03.344 [DEBUG] TestAgent.server.raft: vote granted: from=74640e3f-b3cd-5625-9fff-ace66d0540a7 term=2 tally=1 32:03.344 [INFO] TestAgent.server.raft: election won: tally=1 32:03.344 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29526 [Leader]" 32:03.344 [INFO] TestAgent.server: cluster leadership acquired 32:03.344 [INFO] TestAgent.server: New leader elected: payload=Node-74640e3f-b3cd-5625-9fff-ace66d0540a7 32:03.354 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29526 32:03.371 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:03.434 [INFO] TestAgent: Requesting shutdown 32:03.434 [INFO] TestAgent.server: shutting down server 32:03.434 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:03.434 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:03.436 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:03.436 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:03.436 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:03.436 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:03.436 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:03.436 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-74640e3f-b3cd-5625-9fff-ace66d0540a7 32:03.437 [INFO] TestAgent.server: member joined, marking health alive: member=Node-74640e3f-b3cd-5625-9fff-ace66d0540a7 32:03.438 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:03.442Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:03.442Z [INFO] agent.router.manager: shutting down 32:03.452 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-74640e3f-b3cd-5625-9fff-ace66d0540a7 127.0.0.1 29524 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:74640e3f-b3cd-5625-9fff-ace66d0540a7 port:29526 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:29525] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 32:03.452 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:03.452 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:03.452 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:03.452 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:03.452 [INFO] TestAgent: consul server down 32:03.452 [INFO] TestAgent: shutdown complete 32:03.452 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29521 network=tcp 32:03.452 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29521 network=udp 32:03.452 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29522 network=tcp 32:03.452 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:03.452 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:03.452 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:03.955 [INFO] TestAgent: Waiting for endpoints to shut down 32:03.955 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_HealthServiceByName (0.76s) --- PASS: TestAgent_HealthServiceByName/passing_checks (0.00s) --- PASS: TestAgent_HealthServiceByName/passing_checks/format=text (0.00s) --- PASS: TestAgent_HealthServiceByName/passing_checks/format=json (0.00s) --- PASS: TestAgent_HealthServiceByName/warning_checks (0.00s) --- PASS: TestAgent_HealthServiceByName/warning_checks/format=text (0.00s) --- PASS: TestAgent_HealthServiceByName/warning_checks/format=json (0.00s) --- PASS: TestAgent_HealthServiceByName/critical_checks (0.00s) --- PASS: TestAgent_HealthServiceByName/critical_checks/format=text (0.00s) --- PASS: TestAgent_HealthServiceByName/critical_checks/format=json (0.00s) --- PASS: TestAgent_HealthServiceByName/unknown_serviceName (0.00s) --- PASS: TestAgent_HealthServiceByName/unknown_serviceName/format=text (0.00s) --- PASS: TestAgent_HealthServiceByName/unknown_serviceName/format=json (0.00s) --- PASS: TestAgent_HealthServiceByName/critical_check_on_node (0.00s) --- PASS: TestAgent_HealthServiceByName/critical_check_on_node/format=text (0.00s) --- PASS: TestAgent_HealthServiceByName/critical_check_on_node/format=json (0.00s) --- PASS: TestAgent_HealthServiceByName/maintenance_check_on_node (0.00s) --- PASS: TestAgent_HealthServiceByName/maintenance_check_on_node/format=text (0.00s) --- PASS: TestAgent_HealthServiceByName/maintenance_check_on_node/format=json (0.00s) === CONT TestAgent_Services_ACLFilter [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:03.330Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:03.359Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:03.452 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:83df522b-37a4-e6aa-3d56-e22f02bbfa5c Address:127.0.0.1:29547}]" 32:03.452 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29547 [Follower]" leader= 32:03.453 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-83df522b-37a4-e6aa-3d56-e22f02bbfa5c.dc1 127.0.0.1 32:03.460 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-83df522b-37a4-e6aa-3d56-e22f02bbfa5c 127.0.0.1 2021-10-05T16:32:03.460Z [INFO] agent.router: Initializing LAN area manager 32:03.461 [INFO] TestAgent.server: Adding LAN server: server="Node-83df522b-37a4-e6aa-3d56-e22f02bbfa5c (Addr: tcp/127.0.0.1:29547) (DC: dc1)" 32:03.461 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29542 network=udp 32:03.461 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-83df522b-37a4-e6aa-3d56-e22f02bbfa5c.dc1 area=wan 32:03.461 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29542 network=tcp 32:03.461 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29543 network=tcp 32:03.462 [INFO] TestAgent: started state syncer 32:03.462 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29590 network=tcp 32:03.522 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:03.522 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29547 [Candidate]" term=2 32:03.576 [DEBUG] TestAgent.server.raft: votes: needed=1 32:03.576 [DEBUG] TestAgent.server.raft: vote granted: from=83df522b-37a4-e6aa-3d56-e22f02bbfa5c term=2 tally=1 32:03.576 [INFO] TestAgent.server.raft: election won: tally=1 32:03.576 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29547 [Leader]" 32:03.576 [INFO] TestAgent.server: cluster leadership acquired 32:03.576 [INFO] TestAgent.server: New leader elected: payload=Node-83df522b-37a4-e6aa-3d56-e22f02bbfa5c 32:03.592 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29547 32:03.618 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:03.660 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:03.660 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:03.660 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:03.660 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:03.660 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:03.660 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-83df522b-37a4-e6aa-3d56-e22f02bbfa5c 32:03.660 [INFO] TestAgent.server: member joined, marking health alive: member=Node-83df522b-37a4-e6aa-3d56-e22f02bbfa5c 32:03.689 [INFO] TestAgent: Requesting shutdown 32:03.689 [INFO] TestAgent.server: shutting down server 32:03.689 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:03.689 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:03.689 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:03.689 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:03.689 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:03.689 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:03.689 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:03.689 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:03.689 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:03.693 [INFO] TestAgent.server: federation state anti-entropy synced 32:03.693 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:03.696 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:03.700Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:03.700Z [INFO] agent.router.manager: shutting down 32:03.701 [INFO] TestAgent: consul server down 32:03.701 [INFO] TestAgent: shutdown complete 32:03.701 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29542 network=tcp 32:03.701 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29542 network=udp 32:03.701 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29543 network=tcp 32:04.201 [INFO] TestAgent: Waiting for endpoints to shut down 32:04.201 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_HealthServiceByID (0.89s) --- PASS: TestAgent_HealthServiceByID/passing_checks (0.00s) --- PASS: TestAgent_HealthServiceByID/passing_checks/format=text (0.00s) --- PASS: TestAgent_HealthServiceByID/passing_checks/format=json (0.00s) --- PASS: TestAgent_HealthServiceByID/warning_checks (0.00s) --- PASS: TestAgent_HealthServiceByID/warning_checks/format=text (0.00s) --- PASS: TestAgent_HealthServiceByID/warning_checks/format=json (0.00s) --- PASS: TestAgent_HealthServiceByID/critical_checks (0.00s) --- PASS: TestAgent_HealthServiceByID/critical_checks/format=text (0.00s) --- PASS: TestAgent_HealthServiceByID/critical_checks/format=json (0.00s) --- PASS: TestAgent_HealthServiceByID/unknown_serviceid (0.00s) --- PASS: TestAgent_HealthServiceByID/unknown_serviceid/format=text (0.00s) --- PASS: TestAgent_HealthServiceByID/unknown_serviceid/format=json (0.00s) --- PASS: TestAgent_HealthServiceByID/critical_check_on_node (0.00s) --- PASS: TestAgent_HealthServiceByID/critical_check_on_node/format=text (0.00s) --- PASS: TestAgent_HealthServiceByID/critical_check_on_node/format=json (0.00s) --- PASS: TestAgent_HealthServiceByID/maintenance_check_on_node (0.00s) --- PASS: TestAgent_HealthServiceByID/maintenance_check_on_node/format=text (0.00s) --- PASS: TestAgent_HealthServiceByID/maintenance_check_on_node/format=json (0.00s) === CONT TestAgent_Services_TerminatingGateway [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:03.432Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:03.451Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:03.500 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8aa3c885-2b56-af35-559e-aec3111b1e73 Address:127.0.0.1:29561}]" 32:03.500 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29561 [Follower]" leader= 32:03.501 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8aa3c885-2b56-af35-559e-aec3111b1e73.dc1 127.0.0.1 32:03.501 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8aa3c885-2b56-af35-559e-aec3111b1e73 127.0.0.1 2021-10-05T16:32:03.502Z [INFO] agent.router: Initializing LAN area manager 32:03.502 [INFO] TestAgent.server: Adding LAN server: server="Node-8aa3c885-2b56-af35-559e-aec3111b1e73 (Addr: tcp/127.0.0.1:29561) (DC: dc1)" 32:03.502 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29570 network=udp 32:03.502 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8aa3c885-2b56-af35-559e-aec3111b1e73.dc1 area=wan 32:03.502 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29570 network=tcp 32:03.503 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29571 network=tcp 32:03.503 [INFO] TestAgent: started state syncer 32:03.503 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29513 network=tcp 32:03.556 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:03.556 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29561 [Candidate]" term=2 32:03.597 [DEBUG] TestAgent.server.raft: votes: needed=1 32:03.597 [DEBUG] TestAgent.server.raft: vote granted: from=8aa3c885-2b56-af35-559e-aec3111b1e73 term=2 tally=1 32:03.597 [INFO] TestAgent.server.raft: election won: tally=1 32:03.597 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29561 [Leader]" 32:03.597 [INFO] TestAgent.server: cluster leadership acquired 32:03.598 [INFO] TestAgent.server: New leader elected: payload=Node-8aa3c885-2b56-af35-559e-aec3111b1e73 32:03.606 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29561 32:03.631 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:03.669 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:03.669 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:03.669 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:03.669 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:03.669 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:03.669 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8aa3c885-2b56-af35-559e-aec3111b1e73 32:03.669 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8aa3c885-2b56-af35-559e-aec3111b1e73 32:03.691 [INFO] TestAgent: Synced node info 32:03.691 [DEBUG] TestAgent: Node info in sync 32:03.698 [INFO] TestAgent.server: federation state anti-entropy synced 32:03.857 [INFO] TestAgent: Requesting shutdown 32:03.857 [INFO] TestAgent.server: shutting down server 32:03.857 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:03.857 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:03.857 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:03.857 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:03.857 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:03.857 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:03.857 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:03.857 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:03.857 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:03.857 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:03.862 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:03.865Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:03.865Z [INFO] agent.router.manager: shutting down 32:03.865 [INFO] TestAgent: consul server down 32:03.865 [INFO] TestAgent: shutdown complete 32:03.865 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29570 network=tcp 32:03.865 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29570 network=udp 32:03.865 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29571 network=tcp 32:04.368 [INFO] TestAgent: Waiting for endpoints to shut down 32:04.368 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Self (1.89s) --- PASS: TestAgent_Self/no_grpc (0.92s) --- PASS: TestAgent_Self/normal (0.97s) === CONT TestAgent_Services_MeshGateway === RUN TestAgent_Services_ACLFilter/no_token === RUN TestAgent_Services_ACLFilter/root_token [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:03.759Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:03.791Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:03.866 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1829a01e-b86f-9be0-beb2-a6f07ab295f0 Address:127.0.0.1:29533}]" 32:03.867 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29533 [Follower]" leader= 32:03.867 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1829a01e-b86f-9be0-beb2-a6f07ab295f0.dc1 127.0.0.1 32:03.868 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1829a01e-b86f-9be0-beb2-a6f07ab295f0 127.0.0.1 2021-10-05T16:32:03.868Z [INFO] agent.router: Initializing LAN area manager 32:03.868 [INFO] TestAgent.server: Adding LAN server: server="Node-1829a01e-b86f-9be0-beb2-a6f07ab295f0 (Addr: tcp/127.0.0.1:29533) (DC: dc1)" 32:03.868 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1829a01e-b86f-9be0-beb2-a6f07ab295f0.dc1 area=wan 32:03.868 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29528 network=udp 32:03.868 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29528 network=tcp 32:03.869 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29529 network=tcp 32:03.869 [INFO] TestAgent: started state syncer 32:03.869 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29555 network=tcp 32:03.913 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:03.913 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29533 [Candidate]" term=2 32:03.928 [DEBUG] TestAgent.server.raft: votes: needed=1 32:03.928 [DEBUG] TestAgent.server.raft: vote granted: from=1829a01e-b86f-9be0-beb2-a6f07ab295f0 term=2 tally=1 32:03.928 [INFO] TestAgent.server.raft: election won: tally=1 32:03.928 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29533 [Leader]" 32:03.932 [INFO] TestAgent.server: cluster leadership acquired 32:03.932 [INFO] TestAgent.server: New leader elected: payload=Node-1829a01e-b86f-9be0-beb2-a6f07ab295f0 32:03.936 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29533 32:03.973 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:04.032 [INFO] TestAgent: Synced node info 32:04.032 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:04.032 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:04.032 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:04.032 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:04.032 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:04.032 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1829a01e-b86f-9be0-beb2-a6f07ab295f0 32:04.032 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1829a01e-b86f-9be0-beb2-a6f07ab295f0 32:04.044 [INFO] TestAgent.server: federation state anti-entropy synced 32:04.056 [INFO] TestAgent: Requesting shutdown 32:04.056 [INFO] TestAgent.server: shutting down server 32:04.056 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:04.056 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:04.056 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:04.056 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:04.056 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:04.057 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:04.057 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:04.057 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:04.057 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:04.057 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:04.068 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:04.076Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:04.076Z [INFO] agent.router.manager: shutting down 32:04.076 [INFO] TestAgent: consul server down 32:04.076 [INFO] TestAgent: shutdown complete 32:04.076 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29528 network=tcp 32:04.076 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29528 network=udp 32:04.076 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29529 network=tcp 32:04.576 [INFO] TestAgent: Waiting for endpoints to shut down 32:04.576 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ChecksWithFilter (0.85s) === CONT TestAgent_Services_Sidecar 2021-10-05T16:32:03.935Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:03.952Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:04.008 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3df6b201-5a33-f64d-f0ac-3bf28b897b9f Address:127.0.0.1:29568}]" 32:04.009 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29568 [Follower]" leader= 32:04.012 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3df6b201-5a33-f64d-f0ac-3bf28b897b9f.dc1 127.0.0.1 32:04.013 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3df6b201-5a33-f64d-f0ac-3bf28b897b9f 127.0.0.1 2021-10-05T16:32:04.014Z [INFO] agent.router: Initializing LAN area manager 32:04.014 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29563 network=udp 32:04.014 [INFO] TestAgent.server: Adding LAN server: server="Node-3df6b201-5a33-f64d-f0ac-3bf28b897b9f (Addr: tcp/127.0.0.1:29568) (DC: dc1)" 32:04.014 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3df6b201-5a33-f64d-f0ac-3bf28b897b9f.dc1 area=wan 32:04.014 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29563 network=tcp 32:04.017 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29564 network=tcp 32:04.017 [INFO] TestAgent: started state syncer 32:04.017 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29548 network=tcp 32:04.075 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:04.075 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29568 [Candidate]" term=2 32:04.085 [DEBUG] TestAgent.server.raft: votes: needed=1 32:04.085 [DEBUG] TestAgent.server.raft: vote granted: from=3df6b201-5a33-f64d-f0ac-3bf28b897b9f term=2 tally=1 32:04.085 [INFO] TestAgent.server.raft: election won: tally=1 32:04.085 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29568 [Leader]" 32:04.085 [INFO] TestAgent.server: cluster leadership acquired 32:04.085 [INFO] TestAgent.server: New leader elected: payload=Node-3df6b201-5a33-f64d-f0ac-3bf28b897b9f 32:04.095 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29568 32:04.116 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:04.169 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:04.169 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:04.169 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:04.169 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:04.169 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:04.169 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3df6b201-5a33-f64d-f0ac-3bf28b897b9f 32:04.169 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3df6b201-5a33-f64d-f0ac-3bf28b897b9f 32:04.183 [INFO] TestAgent.server: federation state anti-entropy synced 32:04.216 [INFO] TestAgent: Requesting shutdown 32:04.216 [INFO] TestAgent.server: shutting down server 32:04.216 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:04.216 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:04.216 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:04.216 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:04.217 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:04.217 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:04.217 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:04.217 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:04.217 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:04.217 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:04.217 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:04.236 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:04.241Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:04.241Z [INFO] agent.router.manager: shutting down 32:04.242 [INFO] TestAgent: consul server down 32:04.242 [INFO] TestAgent: shutdown complete 32:04.242 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29563 network=tcp 32:04.242 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29563 network=udp 32:04.242 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29564 network=tcp 32:04.742 [INFO] TestAgent: Waiting for endpoints to shut down 32:04.742 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Checks (0.83s) === CONT TestAgent_Services_ExternalConnectProxy [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 31:59.541 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 127.0.0.1 2021-10-05T16:31:59.542Z [INFO] agent.router: Initializing LAN area manager 31:59.552 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29402 network=udp 31:59.553 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29402 network=tcp 31:59.554 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29403 network=tcp 31:59.554 [INFO] TestAgent: started state syncer 31:59.555 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30393 network=tcp 2021-10-05T16:31:59.555Z [WARN] agent.router.manager: No servers available 31:59.555 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No known Consul servers" 31:59.555 [DEBUG] TestAgent.client.memberlist.lan: memberlist: Stream connection from=127.0.0.1:41480 31:59.582 [INFO] TestAgent.client.serf.lan: serf: EventMemberJoin: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 127.0.0.1 31:59.583 [INFO] TestAgent.client: adding server: server="Node-6705c28c-b7e5-7057-b4ae-cea124813a6f (Addr: tcp/127.0.0.1:30378) (DC: dc1)" 31:59.583 [INFO] TestAgent.client: New leader elected: payload=Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 31:59.585 [INFO] TestAgent.client: client starting leave 31:59.761 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 31:59.761 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 31:59.761 [DEBUG] TestAgent.client.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 31:59.960 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 31:59.960 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 31:59.960 [DEBUG] TestAgent.client.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 32:00.159 [INFO] TestAgent.client.serf.lan: serf: EventMemberLeave: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 127.0.0.1 32:00.159 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 32:00.159 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 32:00.159 [DEBUG] TestAgent.client.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 32:00.159 [DEBUG] TestAgent.client.serf.lan: serf: messageUserEventType: consul:new-leader 32:00.159 [DEBUG] TestAgent.client.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 32:00.159 [DEBUG] TestAgent.client.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 32:00.823 [INFO] TestAgent: Synced node info 32:00.823 [DEBUG] TestAgent: Node info in sync 32:00.845 [DEBUG] TestAgent: Node info in sync 32:03.744 [INFO] TestAgent: Requesting shutdown 32:03.744 [INFO] TestAgent.client: shutting down client 32:03.752 [INFO] TestAgent: consul client down 32:03.752 [INFO] TestAgent: shutdown complete 32:03.832 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29402 network=tcp 32:03.832 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29402 network=udp 32:03.832 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29403 network=tcp 32:04.332 [INFO] TestAgent: Waiting for endpoints to shut down 32:04.332 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:59.080Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.094Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.156 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6705c28c-b7e5-7057-b4ae-cea124813a6f Address:127.0.0.1:30378}]" 31:59.156 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30378 [Follower]" leader= 31:59.157 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f.dc1 127.0.0.1 31:59.158 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 127.0.0.1 2021-10-05T16:31:59.158Z [INFO] agent.router: Initializing LAN area manager 31:59.158 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30373 network=udp 31:59.158 [INFO] TestAgent.server: Adding LAN server: server="Node-6705c28c-b7e5-7057-b4ae-cea124813a6f (Addr: tcp/127.0.0.1:30378) (DC: dc1)" 31:59.158 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6705c28c-b7e5-7057-b4ae-cea124813a6f.dc1 area=wan 31:59.159 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30373 network=tcp 31:59.159 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30374 network=tcp 31:59.159 [INFO] TestAgent: started state syncer 31:59.159 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30379 network=tcp 31:59.215 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.215 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30378 [Candidate]" term=2 31:59.240 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.240 [DEBUG] TestAgent.server.raft: vote granted: from=6705c28c-b7e5-7057-b4ae-cea124813a6f term=2 tally=1 31:59.240 [INFO] TestAgent.server.raft: election won: tally=1 31:59.240 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30378 [Leader]" 31:59.240 [INFO] TestAgent.server: cluster leadership acquired 31:59.240 [INFO] TestAgent.server: New leader elected: payload=Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 31:59.264 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30378 31:59.296 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.360 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.360 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.360 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.360 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.360 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.360 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 31:59.360 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 31:59.380 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.505 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:59.513 [INFO] TestAgent: Synced node info 31:59.513 [DEBUG] TestAgent: Node info in sync 31:59.555 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:29405] 31:59.555 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:29405 31:59.572 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:59.572 [DEBUG] TestAgent: Node info in sync 31:59.585 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 127.0.0.1 31:59.585 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 31:59.585 [DEBUG] TestAgent: systemd notify failed: error="No socket" 31:59.585 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 31:59.742 [DEBUG] TestAgent.server.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 31:59.944 [DEBUG] TestAgent.server.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 31:59.944 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 32:00.144 [DEBUG] TestAgent.server.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 32:00.144 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 32:00.159 [DEBUG] TestAgent.server.serf.lan: serf: messageLeaveType: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 32:00.159 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 32:00.348 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-6705c28c-b7e5-7057-b4ae-cea124813a6f 32:00.348 [INFO] TestAgent.server.serf.lan: serf: EventMemberLeave: Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 127.0.0.1 32:00.348 [INFO] TestAgent.server: deregistering member: member=Node-ec53038e-320b-6dcb-eb3f-58a03068e7d6 reason=left 32:04.332 [INFO] TestAgent: Requesting shutdown 32:04.332 [INFO] TestAgent.server: shutting down server 32:04.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:04.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:04.332 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:04.332 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:04.332 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:04.333 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:04.333 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:04.333 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:04.333 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:04.333 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:04.336 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:04.340Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:04.340Z [INFO] agent.router.manager: shutting down 32:04.340 [INFO] TestAgent: consul server down 32:04.340 [INFO] TestAgent: shutdown complete 32:04.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30373 network=tcp 32:04.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30373 network=udp 32:04.340 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30374 network=tcp 32:04.844 [INFO] TestAgent: Waiting for endpoints to shut down 32:04.844 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Leave (5.78s) === CONT TestAgent_ServicesFiltered 2021-10-05T16:32:03.978Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:03.978Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:03.995Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:03.995Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:04.055 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4b4dea1e-3765-371b-2554-49efacbd6e93 Address:127.0.0.1:29554}]" 32:04.056 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29554 [Follower]" leader= 32:04.056 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4b4dea1e-3765-371b-2554-49efacbd6e93.dc1 127.0.0.1 32:04.057 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4b4dea1e-3765-371b-2554-49efacbd6e93 127.0.0.1 2021-10-05T16:32:04.057Z [INFO] agent.router: Initializing LAN area manager 32:04.058 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29549 network=udp 32:04.058 [INFO] TestAgent.server: Adding LAN server: server="Node-4b4dea1e-3765-371b-2554-49efacbd6e93 (Addr: tcp/127.0.0.1:29554) (DC: dc1)" 32:04.058 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4b4dea1e-3765-371b-2554-49efacbd6e93.dc1 area=wan 32:04.058 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29549 network=tcp 32:04.059 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29550 network=tcp 32:04.059 [INFO] TestAgent: started state syncer 32:04.059 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29569 network=tcp 32:04.108 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:04.116 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:04.116 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29554 [Candidate]" term=2 32:04.143 [DEBUG] TestAgent.server.raft: votes: needed=1 32:04.143 [DEBUG] TestAgent.server.raft: vote granted: from=4b4dea1e-3765-371b-2554-49efacbd6e93 term=2 tally=1 32:04.143 [INFO] TestAgent.server.raft: election won: tally=1 32:04.143 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29554 [Leader]" 32:04.143 [INFO] TestAgent.server: cluster leadership acquired 32:04.143 [INFO] TestAgent.server: New leader elected: payload=Node-4b4dea1e-3765-371b-2554-49efacbd6e93 32:04.151 [INFO] TestAgent.server: initializing acls 32:04.156 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:04.156 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:04.162 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:04.172 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:04.172 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:04.172 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:04.173 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-4b4dea1e-3765-371b-2554-49efacbd6e93 32:04.173 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-4b4dea1e-3765-371b-2554-49efacbd6e93.dc1 32:04.173 [INFO] TestAgent.server: Updating LAN server: server="Node-4b4dea1e-3765-371b-2554-49efacbd6e93 (Addr: tcp/127.0.0.1:29554) (DC: dc1)" 32:04.173 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-4b4dea1e-3765-371b-2554-49efacbd6e93.dc1 area=wan 32:04.204 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:04.247 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:04.247 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:04.247 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:04.247 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:04.247 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:04.248 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4b4dea1e-3765-371b-2554-49efacbd6e93 32:04.248 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4b4dea1e-3765-371b-2554-49efacbd6e93 32:04.266 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4b4dea1e-3765-371b-2554-49efacbd6e93 32:04.284 [INFO] TestAgent.server: federation state anti-entropy synced 32:04.460 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:04.476 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-4b4dea1e-3765-371b-2554-49efacbd6e93 32:04.476 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-4b4dea1e-3765-371b-2554-49efacbd6e93 32:04.480 [INFO] TestAgent: Synced node info 32:04.480 [DEBUG] TestAgent: Node info in sync 32:04.480 [DEBUG] TestAgent: dropping service from result due to ACLs: service=mysql 32:04.480 [INFO] TestAgent: Requesting shutdown 32:04.480 [INFO] TestAgent.server: shutting down server 32:04.480 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:04.480 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:04.480 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:04.480 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:04.480 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:04.480 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:04.480 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:04.480 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:04.480 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:04.481 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:04.481 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:04.481 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:04.481 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:04.481 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:04.489 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:04.504Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:04.504Z [INFO] agent.router.manager: shutting down 32:04.504 [INFO] TestAgent: consul server down 32:04.504 [INFO] TestAgent: shutdown complete 32:04.504 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29549 network=tcp 32:04.504 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29549 network=udp 32:04.504 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29550 network=tcp 32:05.005 [INFO] TestAgent: Waiting for endpoints to shut down 32:05.005 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Services_ACLFilter (1.05s) --- PASS: TestAgent_Services_ACLFilter/no_token (0.00s) --- PASS: TestAgent_Services_ACLFilter/root_token (0.00s) === CONT TestAgent_Services [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:04.216Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:04.239Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:04.324 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b2ae965c-63ed-6775-4934-589c37452e54 Address:127.0.0.1:29589}]" 32:04.325 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b2ae965c-63ed-6775-4934-589c37452e54.dc1 127.0.0.1 32:04.325 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29589 [Follower]" leader= 32:04.325 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b2ae965c-63ed-6775-4934-589c37452e54 127.0.0.1 2021-10-05T16:32:04.325Z [INFO] agent.router: Initializing LAN area manager 32:04.325 [INFO] TestAgent.server: Adding LAN server: server="Node-b2ae965c-63ed-6775-4934-589c37452e54 (Addr: tcp/127.0.0.1:29589) (DC: dc1)" 32:04.325 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b2ae965c-63ed-6775-4934-589c37452e54.dc1 area=wan 32:04.325 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29556 network=udp 32:04.326 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29556 network=tcp 32:04.326 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29557 network=tcp 32:04.326 [INFO] TestAgent: started state syncer 32:04.326 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29520 network=tcp 32:04.393 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:04.393 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29589 [Candidate]" term=2 32:04.411 [DEBUG] TestAgent.server.raft: votes: needed=1 32:04.411 [DEBUG] TestAgent.server.raft: vote granted: from=b2ae965c-63ed-6775-4934-589c37452e54 term=2 tally=1 32:04.411 [INFO] TestAgent.server.raft: election won: tally=1 32:04.411 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29589 [Leader]" 32:04.411 [INFO] TestAgent.server: cluster leadership acquired 32:04.411 [INFO] TestAgent.server: New leader elected: payload=Node-b2ae965c-63ed-6775-4934-589c37452e54 32:04.420 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29589 32:04.446 [INFO] TestAgent: Synced node info 32:04.446 [DEBUG] TestAgent: Node info in sync 32:04.466 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:04.521 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:04.521 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:04.521 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:04.521 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:04.521 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:04.521 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b2ae965c-63ed-6775-4934-589c37452e54 32:04.521 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b2ae965c-63ed-6775-4934-589c37452e54 32:04.552 [INFO] TestAgent.server: federation state anti-entropy synced 32:04.611 [INFO] TestAgent: Requesting shutdown 32:04.611 [INFO] TestAgent.server: shutting down server 32:04.611 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:04.611 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:04.611 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:04.611 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:04.611 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:04.611 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:04.611 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:04.611 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:04.611 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:04.611 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:04.620 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:04.626Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:04.626Z [INFO] agent.router.manager: shutting down 32:04.626 [INFO] TestAgent: consul server down 32:04.626 [INFO] TestAgent: shutdown complete 32:04.626 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29556 network=tcp 32:04.626 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29556 network=udp 32:04.626 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29557 network=tcp 32:05.128 [INFO] TestAgent: Waiting for endpoints to shut down 32:05.128 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Services_TerminatingGateway (0.93s) === CONT TestACL_ResolveIdentity 2021-10-05T16:32:05.149Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.149Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_ResolveIdentity (0.02s) === CONT TestACLEndpoint_LoginLogout_jwt [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:59.248Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.261Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.311 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c9ca824e-8c15-6620-55bf-2184b91721fb Address:127.0.0.1:29477}]" 31:59.312 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c9ca824e-8c15-6620-55bf-2184b91721fb.dc1 127.0.0.1 31:59.312 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c9ca824e-8c15-6620-55bf-2184b91721fb 127.0.0.1 2021-10-05T16:31:59.312Z [INFO] agent.router: Initializing LAN area manager 31:59.313 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30415 network=udp 31:59.313 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29477 [Follower]" leader= 31:59.313 [INFO] TestAgent.server: Adding LAN server: server="Node-c9ca824e-8c15-6620-55bf-2184b91721fb (Addr: tcp/127.0.0.1:29477) (DC: dc1)" 31:59.313 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c9ca824e-8c15-6620-55bf-2184b91721fb.dc1 area=wan 31:59.313 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30415 network=tcp 31:59.314 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30416 network=tcp 31:59.314 [INFO] TestAgent: started state syncer 31:59.314 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30407 network=tcp 31:59.354 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.354 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29477 [Candidate]" term=2 31:59.403 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.403 [DEBUG] TestAgent.server.raft: vote granted: from=c9ca824e-8c15-6620-55bf-2184b91721fb term=2 tally=1 31:59.403 [INFO] TestAgent.server.raft: election won: tally=1 31:59.403 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29477 [Leader]" 31:59.404 [INFO] TestAgent.server: cluster leadership acquired 31:59.404 [INFO] TestAgent.server: New leader elected: payload=Node-c9ca824e-8c15-6620-55bf-2184b91721fb 31:59.415 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29477 31:59.456 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.528 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.528 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.528 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.528 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.528 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.529 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c9ca824e-8c15-6620-55bf-2184b91721fb 31:59.529 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c9ca824e-8c15-6620-55bf-2184b91721fb 31:59.568 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.585 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:33324 31:59.586 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 127.0.0.1 31:59.587 [INFO] TestAgent.server: Adding LAN server: server="Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a (Addr: tcp/127.0.0.1:30371) (DC: dc1)" 31:59.587 [INFO] TestAgent.server: New leader elected: payload=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 31:59.587 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a other=Node-c9ca824e-8c15-6620-55bf-2184b91721fb 31:59.587 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 31:59.588 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a.dc1 127.0.0.1:30370 31:59.589 [INFO] TestAgent: Requesting shutdown 31:59.589 [INFO] TestAgent.server: shutting down server 31:59.589 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:59.589 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:59.589 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:59.589 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:59.589 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:59.589 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a.dc1 127.0.0.1 31:59.589 [DEBUG] TestAgent.server: Successfully performed flood-join for server at address: server=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a.dc1 address=127.0.0.1:30370 31:59.589 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a.dc1 area=wan 31:59.592 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:59.592 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:59.592 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:59.592 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:59.592 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:59.592 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:59.616 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:59.622Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:59.622Z [INFO] agent.router.manager: shutting down 31:59.622 [INFO] TestAgent: consul server down 31:59.622 [INFO] TestAgent: shutdown complete 31:59.622 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30415 network=tcp 31:59.622 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30415 network=udp 31:59.622 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30416 network=tcp 32:00.124 [INFO] TestAgent: Waiting for endpoints to shut down 32:00.124 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:58.716Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.752Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.822 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b60fa6ee-8db1-f548-5f43-eb11fb71f15a Address:127.0.0.1:30371}]" 31:58.822 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30371 [Follower]" leader= 31:58.822 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a.dc1 127.0.0.1 31:58.823 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 127.0.0.1 2021-10-05T16:31:58.823Z [INFO] agent.router: Initializing LAN area manager 31:58.823 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30366 network=udp 31:58.824 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a.dc1 area=wan 31:58.824 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30366 network=tcp 31:58.824 [INFO] TestAgent.server: Adding LAN server: server="Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a (Addr: tcp/127.0.0.1:30371) (DC: dc1)" 31:58.824 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30367 network=tcp 31:58.824 [INFO] TestAgent: started state syncer 31:58.824 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30323 network=tcp 31:58.862 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.862 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30371 [Candidate]" term=2 31:58.900 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.900 [DEBUG] TestAgent.server.raft: vote granted: from=b60fa6ee-8db1-f548-5f43-eb11fb71f15a term=2 tally=1 31:58.900 [INFO] TestAgent.server.raft: election won: tally=1 31:58.900 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30371 [Leader]" 31:58.900 [INFO] TestAgent.server: cluster leadership acquired 31:58.900 [INFO] TestAgent.server: New leader elected: payload=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 31:58.933 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30371 31:58.964 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.026 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.026 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.026 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.026 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.026 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.026 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 31:59.026 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 31:59.040 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.221 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:59.235 [INFO] TestAgent: Synced node info 31:59.585 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:30418] 31:59.585 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:59.585 [DEBUG] TestAgent: Node info in sync 31:59.585 [DEBUG] TestAgent: Node info in sync 31:59.585 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:30418 31:59.588 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c9ca824e-8c15-6620-55bf-2184b91721fb 127.0.0.1 31:59.588 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 31:59.589 [DEBUG] TestAgent: systemd notify failed: error="No socket" 31:59.589 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:60968 31:59.589 [INFO] TestAgent.server: Adding LAN server: server="Node-c9ca824e-8c15-6620-55bf-2184b91721fb (Addr: tcp/127.0.0.1:29477) (DC: dc1)" 31:59.589 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-c9ca824e-8c15-6620-55bf-2184b91721fb other=Node-b60fa6ee-8db1-f548-5f43-eb11fb71f15a 31:59.589 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c9ca824e-8c15-6620-55bf-2184b91721fb 31:59.589 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c9ca824e-8c15-6620-55bf-2184b91721fb.dc1 127.0.0.1 31:59.589 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c9ca824e-8c15-6620-55bf-2184b91721fb.dc1 area=wan 32:00.324 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-c9ca824e-8c15-6620-55bf-2184b91721fb (timeout reached) 32:00.825 [INFO] TestAgent.server.memberlist.lan: memberlist: Suspect Node-c9ca824e-8c15-6620-55bf-2184b91721fb has failed, no acks received 32:00.941 [WARN] TestAgent: error getting server health from server: server=Node-c9ca824e-8c15-6620-55bf-2184b91721fb error="rpc error getting client: failed to get conn: dial tcp 127.0.0.1:0->127.0.0.1:29477: connect: connection refused" 32:01.940 [WARN] TestAgent: error getting server health from server: server=Node-c9ca824e-8c15-6620-55bf-2184b91721fb error="context deadline exceeded" 32:02.324 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-c9ca824e-8c15-6620-55bf-2184b91721fb (timeout reached) 32:02.944 [WARN] TestAgent: error getting server health from server: server=Node-c9ca824e-8c15-6620-55bf-2184b91721fb error="rpc error getting client: failed to get conn: dial tcp 127.0.0.1:0->127.0.0.1:29477: connect: connection refused" 32:03.824 [INFO] TestAgent.server.memberlist.lan: memberlist: Suspect Node-c9ca824e-8c15-6620-55bf-2184b91721fb has failed, no acks received 32:03.944 [WARN] TestAgent: error getting server health from server: server=Node-c9ca824e-8c15-6620-55bf-2184b91721fb error="context deadline exceeded" 32:04.826 [INFO] TestAgent.server.memberlist.lan: memberlist: Marking Node-c9ca824e-8c15-6620-55bf-2184b91721fb as failed, suspect timeout reached (0 peer confirmations) 32:04.826 [INFO] TestAgent.server.serf.lan: serf: EventMemberFailed: Node-c9ca824e-8c15-6620-55bf-2184b91721fb 127.0.0.1 32:04.826 [INFO] TestAgent.server: Removing LAN server: server="Node-c9ca824e-8c15-6620-55bf-2184b91721fb (Addr: tcp/127.0.0.1:29477) (DC: dc1)" 32:04.826 [INFO] TestAgent.server: member failed, marking health critical: member=Node-c9ca824e-8c15-6620-55bf-2184b91721fb 32:04.839 [INFO] TestAgent: Force leaving node: node=Node-c9ca824e-8c15-6620-55bf-2184b91721fb 32:04.839 [INFO] TestAgent.server.serf.lan: serf: EventMemberLeave (forced): Node-c9ca824e-8c15-6620-55bf-2184b91721fb 127.0.0.1 32:04.839 [INFO] TestAgent.server: Removing LAN server: server="Node-c9ca824e-8c15-6620-55bf-2184b91721fb (Addr: tcp/127.0.0.1:29477) (DC: dc1)" 32:04.839 [INFO] TestAgent.server: deregistering member: member=Node-c9ca824e-8c15-6620-55bf-2184b91721fb reason=left 32:04.864 [INFO] TestAgent: Requesting shutdown 32:04.865 [INFO] TestAgent.server: shutting down server 32:04.865 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:04.865 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:04.865 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:04.865 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:04.865 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:04.865 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:04.865 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:04.865 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:04.865 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:04.865 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:04.869 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:04.878Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:04.878Z [INFO] agent.router.manager: shutting down 32:04.878 [INFO] TestAgent: consul server down 32:04.878 [INFO] TestAgent: shutdown complete 32:04.878 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30366 network=tcp 32:04.878 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30366 network=udp 32:04.878 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30367 network=tcp 32:05.324 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-c9ca824e-8c15-6620-55bf-2184b91721fb (timeout reached) 32:05.380 [INFO] TestAgent: Waiting for endpoints to shut down 32:05.380 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ForceLeave (6.70s) === CONT TestACL_filterServices 2021-10-05T16:32:04.412Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:04.439Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:04.516 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:32c2aa7d-6e57-7c10-2545-881e7462a3e4 Address:127.0.0.1:29610}]" 32:04.517 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-32c2aa7d-6e57-7c10-2545-881e7462a3e4.dc1 127.0.0.1 32:04.517 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-32c2aa7d-6e57-7c10-2545-881e7462a3e4 127.0.0.1 2021-10-05T16:32:04.517Z [INFO] agent.router: Initializing LAN area manager 32:04.518 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29605 network=udp 32:04.518 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29610 [Follower]" leader= 32:04.518 [INFO] TestAgent.server: Adding LAN server: server="Node-32c2aa7d-6e57-7c10-2545-881e7462a3e4 (Addr: tcp/127.0.0.1:29610) (DC: dc1)" 32:04.518 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-32c2aa7d-6e57-7c10-2545-881e7462a3e4.dc1 area=wan 32:04.518 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29605 network=tcp 32:04.519 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29606 network=tcp 32:04.519 [INFO] TestAgent: started state syncer 32:04.519 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29562 network=tcp 32:04.584 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:04.584 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29610 [Candidate]" term=2 32:04.606 [DEBUG] TestAgent.server.raft: votes: needed=1 32:04.606 [DEBUG] TestAgent.server.raft: vote granted: from=32c2aa7d-6e57-7c10-2545-881e7462a3e4 term=2 tally=1 32:04.606 [INFO] TestAgent.server.raft: election won: tally=1 32:04.606 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29610 [Leader]" 32:04.607 [INFO] TestAgent.server: cluster leadership acquired 32:04.607 [INFO] TestAgent.server: New leader elected: payload=Node-32c2aa7d-6e57-7c10-2545-881e7462a3e4 32:04.633 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29610 32:04.655 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:04.688 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:04.688 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:04.688 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:04.688 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:04.688 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:04.688 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-32c2aa7d-6e57-7c10-2545-881e7462a3e4 32:04.688 [INFO] TestAgent.server: member joined, marking health alive: member=Node-32c2aa7d-6e57-7c10-2545-881e7462a3e4 32:04.707 [INFO] TestAgent.server: federation state anti-entropy synced 32:04.869 [INFO] TestAgent: Requesting shutdown 32:04.869 [INFO] TestAgent.server: shutting down server 32:04.869 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:04.869 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:04.869 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:04.869 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:04.869 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:04.869 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:04.869 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:04.869 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:04.869 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:04.869 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:04.869 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:04.874 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:04.890Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:04.890Z [INFO] agent.router.manager: shutting down 32:04.890 [INFO] TestAgent: consul server down 32:04.890 [INFO] TestAgent: shutdown complete 32:04.890 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29605 network=tcp 32:04.890 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29605 network=udp 32:04.890 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29606 network=tcp 32:05.396 [INFO] TestAgent: Waiting for endpoints to shut down 32:05.396 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Services_MeshGateway (1.03s) === CONT TestACL_filterMembers 2021-10-05T16:32:05.404Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.404Z [WARN] agent: bootstrap = true: do not enable unless necessary 32:05.404 [DEBUG] TestACL_filterServices: dropping service from result due to ACLs: service=my-other --- PASS: TestACL_filterServices (0.02s) === CONT TestACL_vetCheckUpdate 2021-10-05T16:32:05.431Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.431Z [WARN] agent: bootstrap = true: do not enable unless necessary 32:05.431 [DEBUG] TestACL_filterMembers: dropping node from result due to ACLs: node=Nope accessorID=9df2d1a4-2d07-414e-8ead-6053f56ed2eb --- PASS: TestACL_filterMembers (0.03s) === CONT TestACL_vetCheckRegister 2021-10-05T16:32:05.434Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.434Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_vetCheckUpdate (0.03s) === CONT TestACL_vetServiceUpdate 2021-10-05T16:32:05.471Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.471Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_vetServiceUpdate (0.04s) === CONT TestACL_vetServiceRegister 2021-10-05T16:32:05.490Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.490Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_vetCheckRegister (0.06s) === CONT TestACL_RootAuthorizersDenied 2021-10-05T16:32:05.518Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.518Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_vetServiceRegister (0.04s) === CONT TestACL_AgentMasterToken 2021-10-05T16:32:05.534Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.535Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_RootAuthorizersDenied (0.04s) === CONT TestACL_Version8EnabledByDefault 2021-10-05T16:32:04.601Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:04.629Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:04.716 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:647aad21-ca57-dc22-13a3-e7243e81c60e Address:127.0.0.1:29582}]" 32:04.716 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29582 [Follower]" leader= 32:04.717 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-647aad21-ca57-dc22-13a3-e7243e81c60e.dc1 127.0.0.1 32:04.717 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-647aad21-ca57-dc22-13a3-e7243e81c60e 127.0.0.1 2021-10-05T16:32:04.717Z [INFO] agent.router: Initializing LAN area manager 32:04.717 [INFO] TestAgent.server: Adding LAN server: server="Node-647aad21-ca57-dc22-13a3-e7243e81c60e (Addr: tcp/127.0.0.1:29582) (DC: dc1)" 32:04.718 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-647aad21-ca57-dc22-13a3-e7243e81c60e.dc1 area=wan 32:04.718 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29584 network=udp 32:04.718 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29584 network=tcp 32:04.718 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29585 network=tcp 32:04.718 [INFO] TestAgent: started state syncer 32:04.718 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29625 network=tcp 32:04.774 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:04.774 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29582 [Candidate]" term=2 32:04.787 [DEBUG] TestAgent.server.raft: votes: needed=1 32:04.787 [DEBUG] TestAgent.server.raft: vote granted: from=647aad21-ca57-dc22-13a3-e7243e81c60e term=2 tally=1 32:04.787 [INFO] TestAgent.server.raft: election won: tally=1 32:04.787 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29582 [Leader]" 32:04.787 [INFO] TestAgent.server: cluster leadership acquired 32:04.787 [INFO] TestAgent.server: New leader elected: payload=Node-647aad21-ca57-dc22-13a3-e7243e81c60e 32:04.795 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29582 32:04.816 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:04.844 [INFO] TestAgent: Synced node info 32:04.854 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:04.854 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:04.854 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:04.854 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:04.854 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:04.855 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-647aad21-ca57-dc22-13a3-e7243e81c60e 32:04.855 [INFO] TestAgent.server: member joined, marking health alive: member=Node-647aad21-ca57-dc22-13a3-e7243e81c60e 32:04.867 [INFO] TestAgent.server: federation state anti-entropy synced 32:05.025 [INFO] TestAgent: Requesting shutdown 32:05.025 [INFO] TestAgent.server: shutting down server 32:05.025 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:05.025 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:05.025 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:05.025 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:05.025 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:05.025 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:05.025 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:05.026 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:05.026 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:05.026 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:05.031 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:05.038Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:05.038Z [INFO] agent.router.manager: shutting down 32:05.038 [INFO] TestAgent: consul server down 32:05.038 [INFO] TestAgent: shutdown complete 32:05.038 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29584 network=tcp 32:05.038 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29584 network=udp 32:05.038 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29585 network=tcp 32:05.540 [INFO] TestAgent: Waiting for endpoints to shut down 32:05.540 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Services_Sidecar (0.96s) === CONT TestACL_Authorize [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:05.574Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.574Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_Version8EnabledByDefault (0.04s) === CONT TestACL_Legacy_List 2021-10-05T16:32:05.589Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.589Z [WARN] agent: bootstrap = true: do not enable unless necessary --- PASS: TestACL_AgentMasterToken (0.07s) === CONT TestACL_LoginProcedure_HTTP === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys/invalid_bearer_token === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys/valid_bearer_token_no_bindings === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys/valid_bearer_token_1_service_binding === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks/invalid_bearer_token === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks/valid_bearer_token_no_bindings === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks/valid_bearer_token_1_service_binding === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery/invalid_bearer_token 2021-10-05T16:32:04.773Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:04.788Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:04.883 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ef94035a-dbe9-7ccc-0f9e-1b0dfa913565 Address:127.0.0.1:29617}]" 32:04.883 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ef94035a-dbe9-7ccc-0f9e-1b0dfa913565.dc1 127.0.0.1 32:04.884 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29617 [Follower]" leader= 32:04.884 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ef94035a-dbe9-7ccc-0f9e-1b0dfa913565 127.0.0.1 2021-10-05T16:32:04.884Z [INFO] agent.router: Initializing LAN area manager 32:04.885 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29626 network=udp 32:04.885 [INFO] TestAgent.server: Adding LAN server: server="Node-ef94035a-dbe9-7ccc-0f9e-1b0dfa913565 (Addr: tcp/127.0.0.1:29617) (DC: dc1)" 32:04.885 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ef94035a-dbe9-7ccc-0f9e-1b0dfa913565.dc1 area=wan 32:04.885 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29626 network=tcp 32:04.885 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29627 network=tcp 32:04.885 [INFO] TestAgent: started state syncer 32:04.885 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29618 network=tcp 32:04.954 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:04.954 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29617 [Candidate]" term=2 32:04.981 [DEBUG] TestAgent.server.raft: votes: needed=1 32:04.981 [DEBUG] TestAgent.server.raft: vote granted: from=ef94035a-dbe9-7ccc-0f9e-1b0dfa913565 term=2 tally=1 32:04.981 [INFO] TestAgent.server.raft: election won: tally=1 32:04.981 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29617 [Leader]" 32:04.981 [INFO] TestAgent.server: cluster leadership acquired 32:04.982 [INFO] TestAgent.server: New leader elected: payload=Node-ef94035a-dbe9-7ccc-0f9e-1b0dfa913565 32:04.993 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29617 32:05.010 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:05.051 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:05.051 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:05.051 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:05.051 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:05.051 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:05.051 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ef94035a-dbe9-7ccc-0f9e-1b0dfa913565 32:05.051 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ef94035a-dbe9-7ccc-0f9e-1b0dfa913565 32:05.078 [INFO] TestAgent.server: federation state anti-entropy synced 32:05.110 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:05.115 [INFO] TestAgent: Synced node info 32:05.335 [INFO] TestAgent: Requesting shutdown 32:05.335 [INFO] TestAgent.server: shutting down server 32:05.335 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:05.335 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:05.335 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:05.335 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:05.335 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:05.336 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:05.336 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:05.336 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:05.336 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:05.336 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:05.344 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:05.356Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:05.356Z [INFO] agent.router.manager: shutting down 32:05.356 [INFO] TestAgent: consul server down 32:05.356 [INFO] TestAgent: shutdown complete 32:05.356 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29626 network=tcp 32:05.356 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29626 network=udp 32:05.356 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29627 network=tcp 32:05.857 [INFO] TestAgent: Waiting for endpoints to shut down 32:05.857 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Services_ExternalConnectProxy (1.11s) === CONT TestACL_HTTP 2021-10-05T16:32:04.873Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:04.929Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:04.985 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:92cb5a03-db02-a5e9-b82a-900fe9379e47 Address:127.0.0.1:29575}]" 32:04.986 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-92cb5a03-db02-a5e9-b82a-900fe9379e47.dc1 127.0.0.1 32:04.987 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-92cb5a03-db02-a5e9-b82a-900fe9379e47 127.0.0.1 2021-10-05T16:32:04.987Z [INFO] agent.router: Initializing LAN area manager 32:04.987 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29575 [Follower]" leader= 32:04.987 [INFO] TestAgent.server: Adding LAN server: server="Node-92cb5a03-db02-a5e9-b82a-900fe9379e47 (Addr: tcp/127.0.0.1:29575) (DC: dc1)" 32:04.987 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-92cb5a03-db02-a5e9-b82a-900fe9379e47.dc1 area=wan 32:04.987 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29598 network=tcp 32:04.987 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29598 network=udp 32:04.988 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29599 network=tcp 32:04.988 [INFO] TestAgent: started state syncer 32:04.988 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29611 network=tcp 32:05.033 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:05.033 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29575 [Candidate]" term=2 32:05.060 [DEBUG] TestAgent.server.raft: votes: needed=1 32:05.060 [DEBUG] TestAgent.server.raft: vote granted: from=92cb5a03-db02-a5e9-b82a-900fe9379e47 term=2 tally=1 32:05.060 [INFO] TestAgent.server.raft: election won: tally=1 32:05.060 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29575 [Leader]" 32:05.061 [INFO] TestAgent.server: cluster leadership acquired 32:05.061 [INFO] TestAgent.server: New leader elected: payload=Node-92cb5a03-db02-a5e9-b82a-900fe9379e47 32:05.074 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29575 32:05.094 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:05.160 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:05.160 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:05.160 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:05.160 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:05.160 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:05.160 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-92cb5a03-db02-a5e9-b82a-900fe9379e47 32:05.160 [INFO] TestAgent.server: member joined, marking health alive: member=Node-92cb5a03-db02-a5e9-b82a-900fe9379e47 32:05.200 [INFO] TestAgent.server: federation state anti-entropy synced 32:05.335 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:05.343 [INFO] TestAgent: Synced node info 32:05.345 [INFO] TestAgent: Requesting shutdown 32:05.345 [INFO] TestAgent.server: shutting down server 32:05.345 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:05.345 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:05.345 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:05.345 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:05.345 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:05.346 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:05.346 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:05.346 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:05.346 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:05.346 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:05.351 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:05.356Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:05.356Z [INFO] agent.router.manager: shutting down 32:05.357 [INFO] TestAgent: consul server down 32:05.357 [INFO] TestAgent: shutdown complete 32:05.357 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29598 network=tcp 32:05.357 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29598 network=udp 32:05.357 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29599 network=tcp 32:05.858 [INFO] TestAgent: Waiting for endpoints to shut down 32:05.858 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ServicesFiltered (1.02s) === CONT TestACL_Bootstrap === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery/valid_bearer_token_no_bindings === RUN TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery/valid_bearer_token_1_service_binding 2021-10-05T16:32:05.025Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:05.047Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:05.085 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a Address:127.0.0.1:29624}]" 32:05.086 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a.dc1 127.0.0.1 32:05.087 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29624 [Follower]" leader= 32:05.089 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a 127.0.0.1 2021-10-05T16:32:05.089Z [INFO] agent.router: Initializing LAN area manager 32:05.089 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29612 network=udp 32:05.089 [INFO] TestAgent.server: Adding LAN server: server="Node-38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a (Addr: tcp/127.0.0.1:29624) (DC: dc1)" 32:05.089 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a.dc1 area=wan 32:05.089 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29612 network=tcp 32:05.092 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29613 network=tcp 32:05.092 [INFO] TestAgent: started state syncer 32:05.092 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29583 network=tcp 32:05.160 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:05.160 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29624 [Candidate]" term=2 32:05.196 [DEBUG] TestAgent.server.raft: votes: needed=1 32:05.196 [DEBUG] TestAgent.server.raft: vote granted: from=38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a term=2 tally=1 32:05.196 [INFO] TestAgent.server.raft: election won: tally=1 32:05.196 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29624 [Leader]" 32:05.197 [INFO] TestAgent.server: cluster leadership acquired 32:05.197 [INFO] TestAgent.server: New leader elected: payload=Node-38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a 32:05.224 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29624 32:05.248 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:05.270 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:05.270 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:05.270 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:05.270 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:05.270 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:05.270 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a 32:05.270 [INFO] TestAgent.server: member joined, marking health alive: member=Node-38a6fd4f-2cc5-755b-d68f-9dd9a8472f8a 32:05.284 [INFO] TestAgent.server: federation state anti-entropy synced 32:05.537 [INFO] TestAgent: Requesting shutdown 32:05.537 [INFO] TestAgent.server: shutting down server 32:05.537 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:05.537 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:05.537 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:05.537 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:05.537 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:05.537 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:05.537 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:05.538 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:05.538 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:05.538 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:05.538 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:05.552 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:05.564Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:05.564Z [INFO] agent.router.manager: shutting down 32:05.564 [INFO] TestAgent: consul server down 32:05.564 [INFO] TestAgent: shutdown complete 32:05.564 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29612 network=tcp 32:05.564 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29612 network=udp 32:05.564 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29613 network=tcp 32:06.064 [INFO] TestAgent: Waiting for endpoints to shut down 32:06.064 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Services (1.06s) === CONT TestACL_Disabled_Response [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestACL_LoginProcedure_HTTP/AuthMethod === RUN TestACL_LoginProcedure_HTTP/AuthMethod/Create === RUN TestACL_LoginProcedure_HTTP/AuthMethod/Create_other === RUN TestACL_LoginProcedure_HTTP/AuthMethod/Update_Name_URL_Mismatch === RUN TestACL_LoginProcedure_HTTP/AuthMethod/Update === RUN TestACL_LoginProcedure_HTTP/AuthMethod/Invalid_payload === RUN TestACL_LoginProcedure_HTTP/AuthMethod/List === RUN TestACL_LoginProcedure_HTTP/AuthMethod/Delete === RUN TestACL_LoginProcedure_HTTP/AuthMethod/Read === RUN TestACL_LoginProcedure_HTTP/BindingRule === RUN TestACL_LoginProcedure_HTTP/BindingRule/Create === RUN TestACL_LoginProcedure_HTTP/BindingRule/Create_other === RUN TestACL_LoginProcedure_HTTP/BindingRule/BindingRule_CRUD_Missing_ID_in_URL === RUN TestACL_LoginProcedure_HTTP/BindingRule/Update === RUN TestACL_LoginProcedure_HTTP/BindingRule/ID_Supplied === RUN TestACL_LoginProcedure_HTTP/BindingRule/Invalid_payload === RUN TestACL_LoginProcedure_HTTP/BindingRule/List === RUN TestACL_LoginProcedure_HTTP/BindingRule/Delete === RUN TestACL_LoginProcedure_HTTP/BindingRule/Read === RUN TestACL_LoginProcedure_HTTP/Login === RUN TestACL_LoginProcedure_HTTP/Login/Create_Token_1 === RUN TestACL_LoginProcedure_HTTP/Login/Create_Token_2 === RUN TestACL_LoginProcedure_HTTP/Login/List_Tokens_by_(incorrect)_Method === RUN TestACL_LoginProcedure_HTTP/Login/List_Tokens_by_(correct)_Method === RUN TestACL_LoginProcedure_HTTP/Login/Logout === RUN TestACL_LoginProcedure_HTTP/Login/Token_is_gone_after_Logout [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestACL_Bootstrap/bootstrap === RUN TestACL_HTTP/Policy === RUN TestACL_HTTP/Policy/Create === RUN TestACL_Bootstrap/not_again === RUN TestACL_HTTP/Policy/Minimal === RUN TestACL_HTTP/Policy/Name_Chars === RUN TestACL_HTTP/Policy/Update_Name_ID_Mismatch === RUN TestACL_HTTP/Policy/Policy_CRUD_Missing_ID_in_URL === RUN TestACL_HTTP/Policy/Update === RUN TestACL_HTTP/Policy/ID_Supplied === RUN TestACL_HTTP/Policy/Invalid_payload === RUN TestACL_HTTP/Policy/Delete === RUN TestACL_HTTP/Policy/List === RUN TestACL_HTTP/Policy/Read === RUN TestACL_HTTP/Policy/Read_Name === RUN TestACL_HTTP/Role === RUN TestACL_HTTP/Role/Create === RUN TestACL_HTTP/Role/Name_Chars 2021-10-05T16:32:05.189Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:05.216Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:05.264 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fa9efb1a-3167-e449-6859-3040570ced53 Address:127.0.0.1:29519}]" 32:05.264 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29519 [Follower]" leader= 32:05.265 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fa9efb1a-3167-e449-6859-3040570ced53.dc1 127.0.0.1 32:05.272 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fa9efb1a-3167-e449-6859-3040570ced53 127.0.0.1 2021-10-05T16:32:05.272Z [INFO] agent.router: Initializing LAN area manager 32:05.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29507 network=udp 32:05.273 [INFO] TestAgent.server: Adding LAN server: server="Node-fa9efb1a-3167-e449-6859-3040570ced53 (Addr: tcp/127.0.0.1:29519) (DC: dc1)" 32:05.273 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fa9efb1a-3167-e449-6859-3040570ced53.dc1 area=wan 32:05.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29507 network=tcp 32:05.273 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29508 network=tcp 32:05.273 [INFO] TestAgent: started state syncer 32:05.273 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29576 network=tcp 32:05.324 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:05.332 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:05.332 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29519 [Candidate]" term=2 32:05.352 [DEBUG] TestAgent.server.raft: votes: needed=1 32:05.352 [DEBUG] TestAgent.server.raft: vote granted: from=fa9efb1a-3167-e449-6859-3040570ced53 term=2 tally=1 32:05.352 [INFO] TestAgent.server.raft: election won: tally=1 32:05.352 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29519 [Leader]" 32:05.353 [INFO] TestAgent.server: cluster leadership acquired 32:05.353 [INFO] TestAgent.server: New leader elected: payload=Node-fa9efb1a-3167-e449-6859-3040570ced53 32:05.360 [INFO] TestAgent.server: initializing acls 32:05.363 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:05.384 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:05.412 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:05.412 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:05.412 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:05.412 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-fa9efb1a-3167-e449-6859-3040570ced53 32:05.412 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-fa9efb1a-3167-e449-6859-3040570ced53.dc1 32:05.416 [INFO] TestAgent.server: Updating LAN server: server="Node-fa9efb1a-3167-e449-6859-3040570ced53 (Addr: tcp/127.0.0.1:29519) (DC: dc1)" 32:05.416 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-fa9efb1a-3167-e449-6859-3040570ced53.dc1 area=wan 32:05.468 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:05.545 [INFO] TestAgent: Synced node info 32:05.545 [DEBUG] TestAgent: Node info in sync 32:05.568 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:05.568 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:05.568 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:05.568 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:05.568 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:05.568 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fa9efb1a-3167-e449-6859-3040570ced53 32:05.568 [INFO] TestAgent.server: member joined, marking health alive: member=Node-fa9efb1a-3167-e449-6859-3040570ced53 32:05.597 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-fa9efb1a-3167-e449-6859-3040570ced53 32:05.616 [INFO] TestAgent.server: federation state anti-entropy synced 32:05.640 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-fa9efb1a-3167-e449-6859-3040570ced53 32:05.640 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-fa9efb1a-3167-e449-6859-3040570ced53 32:06.021 [INFO] TestAgent: Requesting shutdown 32:06.021 [INFO] TestAgent.server: shutting down server 32:06.021 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:06.021 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:06.021 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:06.021 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:06.021 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:06.021 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:06.021 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:06.021 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:06.021 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:06.021 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:06.021 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:06.021 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:06.021 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:06.021 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:06.035 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:06.036Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.036Z [INFO] agent.router.manager: shutting down 32:06.036 [INFO] TestAgent: consul server down 32:06.036 [INFO] TestAgent: shutdown complete 32:06.036 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29507 network=tcp 32:06.036 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29507 network=udp 32:06.036 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29508 network=tcp 32:06.536 [INFO] TestAgent: Waiting for endpoints to shut down 32:06.536 [INFO] TestAgent: Endpoints down --- PASS: TestACLEndpoint_LoginLogout_jwt (1.39s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys (0.06s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys/invalid_bearer_token (0.00s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys/valid_bearer_token_no_bindings (0.01s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_static_keys/valid_bearer_token_1_service_binding (0.02s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks (0.10s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks/invalid_bearer_token (0.01s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks/valid_bearer_token_no_bindings (0.03s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_jwks/valid_bearer_token_1_service_binding (0.02s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery (0.21s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery/invalid_bearer_token (0.04s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery/valid_bearer_token_no_bindings (0.01s) --- PASS: TestACLEndpoint_LoginLogout_jwt/success_-_jwt_oidc_discovery/valid_bearer_token_1_service_binding (0.10s) === CONT TestACLReplicationStatus === RUN TestACL_HTTP/Role/Update_Name_ID_Mismatch === RUN TestACL_HTTP/Role/Role_CRUD_Missing_ID_in_URL === RUN TestACL_HTTP/Role/Update === RUN TestACL_HTTP/Role/ID_Supplied === RUN TestACL_HTTP/Role/Invalid_payload === RUN TestACL_HTTP/Role/Delete [WARN] freeport: 10 out of 18 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestACL_HTTP/Role/List === RUN TestACL_HTTP/Role/Read === RUN TestACL_HTTP/Token === RUN TestACL_HTTP/Token/Create === RUN TestACL_HTTP/Token/Create_Local === RUN TestACL_HTTP/Token/Read === RUN TestACL_HTTP/Token/Self === RUN TestACL_HTTP/Token/Clone === RUN TestACL_HTTP/Token/Update === RUN TestACL_Authorize/master-token === RUN TestACL_Authorize/master-token/dc1 === RUN TestACL_Authorize/master-token/dc2 === RUN TestACL_Authorize/custom-token === RUN TestACL_Authorize/custom-token/dc1 === RUN TestACL_Authorize/custom-token/dc2 === RUN TestACL_Authorize/too-many-requests === RUN TestACL_Authorize/decode-failure === RUN TestACL_Authorize/acl-not-found === RUN TestACL_Authorize/local-token-in-secondary-dc === RUN TestACL_Authorize/local-token-wrong-dc === RUN TestACL_HTTP/Token/CRUD_Missing_Token_Accessor_ID === RUN TestACL_HTTP/Token/Update_Accessor_Mismatch === RUN TestACL_HTTP/Token/Delete === RUN TestACL_Disabled_Response/ACLBootstrap === RUN TestACL_Disabled_Response/ACLReplicationStatus === RUN TestACL_Disabled_Response/AgentToken === RUN TestACL_Disabled_Response/ACLRulesTranslate === RUN TestACL_Disabled_Response/ACLRulesTranslateLegacyToken === RUN TestACL_Disabled_Response/ACLPolicyList === RUN TestACL_Disabled_Response/ACLPolicyCRUD === RUN TestACL_Disabled_Response/ACLPolicyCreate === RUN TestACL_Disabled_Response/ACLTokenList === RUN TestACL_Disabled_Response/ACLTokenCreate === RUN TestACL_Disabled_Response/ACLTokenSelf === RUN TestACL_Disabled_Response/ACLTokenCRUD === RUN TestACL_Disabled_Response/ACLRoleList === RUN TestACL_Disabled_Response/ACLRoleCreate === RUN TestACL_Disabled_Response/ACLRoleCRUD === RUN TestACL_Disabled_Response/ACLBindingRuleList === RUN TestACL_Disabled_Response/ACLBindingRuleCreate === RUN TestACL_Disabled_Response/ACLBindingRuleCRUD === RUN TestACL_Disabled_Response/ACLAuthMethodList === RUN TestACL_Disabled_Response/ACLAuthMethodCreate === RUN TestACL_Disabled_Response/ACLAuthMethodCRUD === RUN TestACL_Disabled_Response/ACLLogin === RUN TestACL_Disabled_Response/ACLLogout === RUN TestACL_Disabled_Response/ACLAuthorize === RUN TestACL_HTTP/Token/List === RUN TestACL_HTTP/Token/List_by_Policy === RUN TestACL_HTTP/Token/Create_with_Accessor === RUN TestACL_HTTP/Token/Create_with_Secret === RUN TestACL_HTTP/Token/Create_with_Accessor_and_Secret === RUN TestACL_HTTP/Token/Create_with_Accessor_Dup === RUN TestACL_HTTP/Token/Create_with_Secret_as_Accessor_Dup === RUN TestACL_HTTP/Token/Create_with_Secret_Dup === RUN TestACL_HTTP/Token/Create_with_Accessor_as_Secret_Dup === RUN TestACL_HTTP/Token/Create_with_Reserved_Accessor === RUN TestACL_HTTP/Token/Create_with_Reserved_Secret 2021-10-05T16:32:05.623Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.623Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:05.661Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.661Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:05.740 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 Address:127.0.0.1:30284}]" 32:05.741 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49.dc1 127.0.0.1 32:05.741 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 127.0.0.1 2021-10-05T16:32:05.741Z [INFO] agent.router: Initializing LAN area manager 32:05.742 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30129 network=udp 32:05.742 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30284 [Follower]" leader= 32:05.742 [INFO] TestAgent.server: Adding LAN server: server="Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 (Addr: tcp/127.0.0.1:30284) (DC: dc1)" 32:05.742 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49.dc1 area=wan 32:05.742 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30129 network=tcp 32:05.743 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30127 network=tcp 32:05.743 [INFO] TestAgent: started state syncer 32:05.743 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30285 network=tcp 32:05.792 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:05.811 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:05.811 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30284 [Candidate]" term=2 32:05.853 [DEBUG] TestAgent.server.raft: votes: needed=1 32:05.853 [DEBUG] TestAgent.server.raft: vote granted: from=7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 term=2 tally=1 32:05.853 [INFO] TestAgent.server.raft: election won: tally=1 32:05.853 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30284 [Leader]" 32:05.854 [INFO] TestAgent.server: cluster leadership acquired 32:05.854 [INFO] TestAgent.server: New leader elected: payload=Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 32:05.867 [INFO] TestAgent.server: initializing acls 32:05.873 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:05.873 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:05.881 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:05.890 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:05.890 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:05.890 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:05.891 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 32:05.891 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49.dc1 32:05.892 [INFO] TestAgent.server: Updating LAN server: server="Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 (Addr: tcp/127.0.0.1:30284) (DC: dc1)" 32:05.892 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49.dc1 area=wan 32:05.902 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:05.956 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:05.956 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:05.956 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:05.956 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:05.956 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:05.956 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 32:05.956 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 32:05.992 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 32:05.993 [INFO] TestAgent.server: federation state anti-entropy synced 32:06.012 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-7cfc1a3c-57ba-caee-b10b-9a5dbac97f49 32:06.096 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:06.151 [INFO] TestAgent: Synced node info 32:06.151 [DEBUG] TestAgent: Node info in sync 32:06.218 [INFO] TestAgent: Requesting shutdown 32:06.218 [INFO] TestAgent.server: shutting down server 32:06.218 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:06.218 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:06.218 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:06.218 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:06.218 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:06.218 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:06.218 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:06.218 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:06.218 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:06.218 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:06.218 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:06.218 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:06.218 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:06.218 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:06.224 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:06.225Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.225Z [INFO] agent.router.manager: shutting down 32:06.225 [INFO] TestAgent: consul server down 32:06.225 [INFO] TestAgent: shutdown complete 32:06.225 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30129 network=tcp 32:06.225 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30129 network=udp 32:06.226 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30127 network=tcp 32:06.728 [INFO] TestAgent: Waiting for endpoints to shut down 32:06.728 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Legacy_List (1.16s) === CONT TestRemoteExecGetSpec_ACLAgentToken 2021-10-05T16:32:05.634Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.634Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:05.681Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.681Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:05.772 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3f4a91e3-7919-4e5b-59b8-74aa805862c5 Address:127.0.0.1:30203}]" 32:05.772 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30203 [Follower]" leader= 32:05.773 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5.dc1 127.0.0.1 32:05.773 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 127.0.0.1 2021-10-05T16:32:05.773Z [INFO] agent.router: Initializing LAN area manager 32:05.774 [INFO] TestAgent.server: Adding LAN server: server="Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 (Addr: tcp/127.0.0.1:30203) (DC: dc1)" 32:05.774 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5.dc1 area=wan 32:05.774 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30286 network=udp 32:05.774 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30286 network=tcp 32:05.774 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30287 network=tcp 32:05.774 [INFO] TestAgent: started state syncer 32:05.774 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30204 network=tcp 32:05.820 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:05.820 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30203 [Candidate]" term=2 32:05.824 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:05.860 [DEBUG] TestAgent.server.raft: votes: needed=1 32:05.860 [DEBUG] TestAgent.server.raft: vote granted: from=3f4a91e3-7919-4e5b-59b8-74aa805862c5 term=2 tally=1 32:05.860 [INFO] TestAgent.server.raft: election won: tally=1 32:05.860 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30203 [Leader]" 32:05.864 [INFO] TestAgent.server: cluster leadership acquired 32:05.864 [INFO] TestAgent.server: New leader elected: payload=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 32:05.876 [INFO] TestAgent.server: initializing acls 32:05.880 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:05.880 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:05.894 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 32:05.894 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:05.901 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:05.901 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:05.901 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:05.901 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 32:05.902 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5.dc1 32:05.902 [INFO] TestAgent.server: Updating LAN server: server="Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 (Addr: tcp/127.0.0.1:30203) (DC: dc1)" 32:05.902 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5.dc1 area=wan 32:05.976 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:06.043 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:06.043 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:06.043 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:06.043 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:06.043 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:06.043 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 32:06.043 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 32:06.053 [INFO] TestAgent.server: federation state anti-entropy synced 32:06.068 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 32:06.081 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 32:06.081 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-3f4a91e3-7919-4e5b-59b8-74aa805862c5 32:06.231 [INFO] TestAgent: Requesting shutdown 32:06.231 [INFO] TestAgent.server: shutting down server 32:06.231 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:06.231 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:06.231 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:06.231 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:06.231 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:06.231 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:06.231 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:06.231 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:06.231 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:06.231 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:06.231 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:06.231 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:06.232 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:06.232 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:06.248 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:06.248Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.248Z [INFO] agent.router.manager: shutting down 32:06.248 [INFO] TestAgent: consul server down 32:06.248 [INFO] TestAgent: shutdown complete 32:06.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30286 network=tcp 32:06.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30286 network=udp 32:06.248 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30287 network=tcp 32:06.749 [INFO] TestAgent: Waiting for endpoints to shut down 32:06.749 [INFO] TestAgent: Endpoints down --- PASS: TestACL_LoginProcedure_HTTP (1.16s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod (0.07s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/Create (0.02s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/Create_other (0.01s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/Update_Name_URL_Mismatch (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/Update (0.01s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/Invalid_payload (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/List (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/Delete (0.03s) --- PASS: TestACL_LoginProcedure_HTTP/AuthMethod/Read (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule (0.05s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/Create (0.03s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/Create_other (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/BindingRule_CRUD_Missing_ID_in_URL (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/Update (0.01s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/ID_Supplied (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/Invalid_payload (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/List (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/Delete (0.01s) --- PASS: TestACL_LoginProcedure_HTTP/BindingRule/Read (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/Login (0.03s) --- PASS: TestACL_LoginProcedure_HTTP/Login/Create_Token_1 (0.01s) --- PASS: TestACL_LoginProcedure_HTTP/Login/Create_Token_2 (0.01s) --- PASS: TestACL_LoginProcedure_HTTP/Login/List_Tokens_by_(incorrect)_Method (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/Login/List_Tokens_by_(correct)_Method (0.00s) --- PASS: TestACL_LoginProcedure_HTTP/Login/Logout (0.01s) --- PASS: TestACL_LoginProcedure_HTTP/Login/Token_is_gone_after_Logout (0.00s) === CONT TestRemoteExecWrites_ACLAgentToken [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:05.894Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.895Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:05.944Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.944Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:06.052 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b0f9b12d-57be-cfbd-341f-9a291380d84d Address:127.0.0.1:29636}]" 32:06.053 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29636 [Follower]" leader= 32:06.053 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b0f9b12d-57be-cfbd-341f-9a291380d84d.dc1 127.0.0.1 32:06.054 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 127.0.0.1 2021-10-05T16:32:06.054Z [INFO] agent.router: Initializing LAN area manager 32:06.054 [INFO] TestAgent.server: Adding LAN server: server="Node-b0f9b12d-57be-cfbd-341f-9a291380d84d (Addr: tcp/127.0.0.1:29636) (DC: dc1)" 32:06.054 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d.dc1 area=wan 32:06.055 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30073 network=udp 32:06.055 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30073 network=tcp 32:06.055 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29639 network=tcp 32:06.055 [INFO] TestAgent: started state syncer 32:06.055 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29637 network=tcp 32:06.105 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:06.108 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:06.108 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29636 [Candidate]" term=2 32:06.176 [DEBUG] TestAgent.server.raft: votes: needed=1 32:06.176 [DEBUG] TestAgent.server.raft: vote granted: from=b0f9b12d-57be-cfbd-341f-9a291380d84d term=2 tally=1 32:06.176 [INFO] TestAgent.server.raft: election won: tally=1 32:06.176 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29636 [Leader]" 32:06.177 [INFO] TestAgent.server: cluster leadership acquired 32:06.177 [INFO] TestAgent.server: New leader elected: payload=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.188 [INFO] TestAgent.server: initializing acls 32:06.196 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:06.205 [INFO] TestAgent.server: initializing acls 32:06.218 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:06.218 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:06.218 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:06.218 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.218 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-b0f9b12d-57be-cfbd-341f-9a291380d84d.dc1 32:06.218 [INFO] TestAgent.server: Updating LAN server: server="Node-b0f9b12d-57be-cfbd-341f-9a291380d84d (Addr: tcp/127.0.0.1:29636) (DC: dc1)" 32:06.218 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d.dc1 area=wan 32:06.249 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:06.249 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:06.249 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.249 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-b0f9b12d-57be-cfbd-341f-9a291380d84d.dc1 32:06.249 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d.dc1 area=wan 32:06.249 [INFO] TestAgent.server: Updating LAN server: server="Node-b0f9b12d-57be-cfbd-341f-9a291380d84d (Addr: tcp/127.0.0.1:29636) (DC: dc1)" 32:06.283 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:06.388 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:06.388 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:06.388 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:06.388 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:06.388 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:06.388 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.388 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.413 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.413 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.425 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-b0f9b12d-57be-cfbd-341f-9a291380d84d 32:06.425 [WARN] TestAgent.server.acl: failed to remove bootstrap file: error="remove /tmp/consul-test/TestACL_Bootstrap-TestAgent-agent274675526/acl-bootstrap-reset: no such file or directory" 32:06.438 [INFO] TestAgent.server: federation state anti-entropy synced 32:06.449 [INFO] TestAgent.server.acl: ACL bootstrap completed 32:06.449 [INFO] TestAgent: Requesting shutdown 32:06.449 [INFO] TestAgent.server: shutting down server 32:06.449 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:06.449 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:06.449 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:06.449 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:06.449 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:06.449 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:06.449 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:06.449 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:06.450 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:06.450 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:06.450 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:06.450 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:06.450 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:06.450 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:06.450 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:06.457 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:06.458Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.458Z [INFO] agent.router.manager: shutting down 32:06.458 [INFO] TestAgent: consul server down 32:06.458 [INFO] TestAgent: shutdown complete 32:06.458 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30073 network=tcp 32:06.458 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30073 network=udp 32:06.458 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29639 network=tcp 32:06.958 [INFO] TestAgent: Waiting for endpoints to shut down 32:06.958 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Bootstrap (1.10s) --- PASS: TestACL_Bootstrap/bootstrap (0.02s) --- PASS: TestACL_Bootstrap/not_again (0.00s) === CONT TestPreparedQuery_parseLimit --- PASS: TestPreparedQuery_parseLimit (0.00s) === CONT TestRemoteExecWrites_ACLToken [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:06.090Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:06.113Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:06.219 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5a632a31-706d-cb2d-4f06-c46ce620da50 Address:127.0.0.1:29594}]" 32:06.219 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29594 [Follower]" leader= 32:06.221 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5a632a31-706d-cb2d-4f06-c46ce620da50.dc1 127.0.0.1 32:06.223 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5a632a31-706d-cb2d-4f06-c46ce620da50 127.0.0.1 2021-10-05T16:32:06.223Z [INFO] agent.router: Initializing LAN area manager 32:06.223 [INFO] TestAgent.server: Adding LAN server: server="Node-5a632a31-706d-cb2d-4f06-c46ce620da50 (Addr: tcp/127.0.0.1:29594) (DC: dc1)" 32:06.223 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29645 network=udp 32:06.223 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5a632a31-706d-cb2d-4f06-c46ce620da50.dc1 area=wan 32:06.223 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29645 network=tcp 32:06.224 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29632 network=tcp 32:06.224 [INFO] TestAgent: started state syncer 32:06.224 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29595 network=tcp 32:06.272 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:06.272 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29594 [Candidate]" term=2 32:06.388 [DEBUG] TestAgent.server.raft: votes: needed=1 32:06.388 [DEBUG] TestAgent.server.raft: vote granted: from=5a632a31-706d-cb2d-4f06-c46ce620da50 term=2 tally=1 32:06.388 [INFO] TestAgent.server.raft: election won: tally=1 32:06.388 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29594 [Leader]" 32:06.388 [INFO] TestAgent.server: cluster leadership acquired 32:06.389 [INFO] TestAgent.server: New leader elected: payload=Node-5a632a31-706d-cb2d-4f06-c46ce620da50 32:06.413 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29594 32:06.447 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:06.517 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:06.517 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:06.517 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:06.517 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:06.517 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:06.517 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5a632a31-706d-cb2d-4f06-c46ce620da50 32:06.517 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5a632a31-706d-cb2d-4f06-c46ce620da50 32:06.538 [INFO] TestAgent.server: federation state anti-entropy synced 32:06.620 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:06.640 [INFO] TestAgent: Synced node info 32:06.640 [DEBUG] TestAgent: Node info in sync 32:06.653 [INFO] TestAgent: Requesting shutdown 32:06.653 [INFO] TestAgent.server: shutting down server 32:06.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:06.653 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:06.653 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:06.653 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:06.653 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:06.653 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:06.653 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:06.653 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:06.653 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:06.653 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:06.680 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:06.685Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.685Z [INFO] agent.router.manager: shutting down 32:06.685 [INFO] TestAgent: consul server down 32:06.685 [INFO] TestAgent: shutdown complete 32:06.685 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29645 network=tcp 32:06.685 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29645 network=udp 32:06.685 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29632 network=tcp 32:07.185 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.185 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Disabled_Response (1.12s) --- PASS: TestACL_Disabled_Response/ACLBootstrap (0.00s) --- PASS: TestACL_Disabled_Response/ACLReplicationStatus (0.00s) --- PASS: TestACL_Disabled_Response/AgentToken (0.00s) --- PASS: TestACL_Disabled_Response/ACLRulesTranslate (0.00s) --- PASS: TestACL_Disabled_Response/ACLRulesTranslateLegacyToken (0.00s) --- PASS: TestACL_Disabled_Response/ACLPolicyList (0.00s) --- PASS: TestACL_Disabled_Response/ACLPolicyCRUD (0.00s) --- PASS: TestACL_Disabled_Response/ACLPolicyCreate (0.00s) --- PASS: TestACL_Disabled_Response/ACLTokenList (0.00s) --- PASS: TestACL_Disabled_Response/ACLTokenCreate (0.00s) --- PASS: TestACL_Disabled_Response/ACLTokenSelf (0.00s) --- PASS: TestACL_Disabled_Response/ACLTokenCRUD (0.00s) --- PASS: TestACL_Disabled_Response/ACLRoleList (0.00s) --- PASS: TestACL_Disabled_Response/ACLRoleCreate (0.00s) --- PASS: TestACL_Disabled_Response/ACLRoleCRUD (0.00s) --- PASS: TestACL_Disabled_Response/ACLBindingRuleList (0.00s) --- PASS: TestACL_Disabled_Response/ACLBindingRuleCreate (0.00s) --- PASS: TestACL_Disabled_Response/ACLBindingRuleCRUD (0.00s) --- PASS: TestACL_Disabled_Response/ACLAuthMethodList (0.00s) --- PASS: TestACL_Disabled_Response/ACLAuthMethodCreate (0.00s) --- PASS: TestACL_Disabled_Response/ACLAuthMethodCRUD (0.00s) --- PASS: TestACL_Disabled_Response/ACLLogin (0.00s) --- PASS: TestACL_Disabled_Response/ACLLogout (0.00s) --- PASS: TestACL_Disabled_Response/ACLAuthorize (0.00s) === CONT TestRemoteExecWrites 2021-10-05T16:32:05.870Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.870Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:05.944Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:05.944Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:06.045 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:88c46067-cf27-844d-8bc4-9749c86f9935 Address:127.0.0.1:30134}]" 32:06.045 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-88c46067-cf27-844d-8bc4-9749c86f9935.dc1 127.0.0.1 32:06.046 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-88c46067-cf27-844d-8bc4-9749c86f9935 127.0.0.1 2021-10-05T16:32:06.046Z [INFO] agent.router: Initializing LAN area manager 32:06.046 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30266 network=udp 32:06.046 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30134 [Follower]" leader= 32:06.047 [INFO] TestAgent.server: Adding LAN server: server="Node-88c46067-cf27-844d-8bc4-9749c86f9935 (Addr: tcp/127.0.0.1:30134) (DC: dc1)" 32:06.047 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-88c46067-cf27-844d-8bc4-9749c86f9935.dc1 area=wan 32:06.047 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30266 network=tcp 32:06.048 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30130 network=tcp 32:06.048 [INFO] TestAgent: started state syncer 32:06.048 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30142 network=tcp 32:06.098 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:06.108 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:06.108 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30134 [Candidate]" term=2 32:06.178 [DEBUG] TestAgent.server.raft: votes: needed=1 32:06.178 [DEBUG] TestAgent.server.raft: vote granted: from=88c46067-cf27-844d-8bc4-9749c86f9935 term=2 tally=1 32:06.178 [INFO] TestAgent.server.raft: election won: tally=1 32:06.178 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30134 [Leader]" 32:06.179 [INFO] TestAgent.server: cluster leadership acquired 32:06.179 [INFO] TestAgent.server: New leader elected: payload=Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.188 [INFO] TestAgent.server: initializing acls 32:06.193 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:06.193 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:06.199 [INFO] TestAgent.server: initializing acls 32:06.199 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:06.238 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:06.238 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:06.265 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:06.265 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:06.265 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:06.266 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.266 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-88c46067-cf27-844d-8bc4-9749c86f9935.dc1 32:06.268 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:06.268 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:06.268 [INFO] TestAgent.server: Updating LAN server: server="Node-88c46067-cf27-844d-8bc4-9749c86f9935 (Addr: tcp/127.0.0.1:30134) (DC: dc1)" 32:06.268 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.268 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-88c46067-cf27-844d-8bc4-9749c86f9935.dc1 32:06.268 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-88c46067-cf27-844d-8bc4-9749c86f9935.dc1 area=wan 32:06.268 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-88c46067-cf27-844d-8bc4-9749c86f9935.dc1 area=wan 32:06.268 [INFO] TestAgent.server: Updating LAN server: server="Node-88c46067-cf27-844d-8bc4-9749c86f9935 (Addr: tcp/127.0.0.1:30134) (DC: dc1)" 32:06.302 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:06.408 [INFO] TestAgent: Synced node info 32:06.408 [DEBUG] TestAgent: Node info in sync 32:06.424 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:06.424 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:06.424 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:06.424 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:06.424 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:06.424 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.424 [INFO] TestAgent.server: member joined, marking health alive: member=Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.428 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.498 [INFO] TestAgent.server: federation state anti-entropy synced 32:06.498 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.498 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-88c46067-cf27-844d-8bc4-9749c86f9935 32:06.718 [INFO] TestAgent: Requesting shutdown 32:06.718 [INFO] TestAgent.server: shutting down server 32:06.718 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:06.718 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:06.718 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:06.718 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:06.718 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:06.718 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:06.718 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:06.718 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:06.718 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:06.718 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:06.718 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:06.718 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:06.718 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:06.718 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:06.732 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:06.740Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.740Z [INFO] agent.router.manager: shutting down 32:06.740 [INFO] TestAgent: consul server down 32:06.740 [INFO] TestAgent: shutdown complete 32:06.740 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30266 network=tcp 32:06.740 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30266 network=udp 32:06.740 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30130 network=tcp 32:07.244 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.244 [INFO] TestAgent: Endpoints down --- PASS: TestACL_HTTP (1.39s) --- PASS: TestACL_HTTP/Policy (0.10s) --- PASS: TestACL_HTTP/Policy/Create (0.07s) --- PASS: TestACL_HTTP/Policy/Minimal (0.01s) --- PASS: TestACL_HTTP/Policy/Name_Chars (0.01s) --- PASS: TestACL_HTTP/Policy/Update_Name_ID_Mismatch (0.00s) --- PASS: TestACL_HTTP/Policy/Policy_CRUD_Missing_ID_in_URL (0.00s) --- PASS: TestACL_HTTP/Policy/Update (0.01s) --- PASS: TestACL_HTTP/Policy/ID_Supplied (0.00s) --- PASS: TestACL_HTTP/Policy/Invalid_payload (0.00s) --- PASS: TestACL_HTTP/Policy/Delete (0.00s) --- PASS: TestACL_HTTP/Policy/List (0.00s) --- PASS: TestACL_HTTP/Policy/Read (0.00s) --- PASS: TestACL_HTTP/Policy/Read_Name (0.00s) --- PASS: TestACL_HTTP/Role (0.06s) --- PASS: TestACL_HTTP/Role/Create (0.01s) --- PASS: TestACL_HTTP/Role/Name_Chars (0.01s) --- PASS: TestACL_HTTP/Role/Update_Name_ID_Mismatch (0.00s) --- PASS: TestACL_HTTP/Role/Role_CRUD_Missing_ID_in_URL (0.00s) --- PASS: TestACL_HTTP/Role/Update (0.02s) --- PASS: TestACL_HTTP/Role/ID_Supplied (0.00s) --- PASS: TestACL_HTTP/Role/Invalid_payload (0.00s) --- PASS: TestACL_HTTP/Role/Delete (0.02s) --- PASS: TestACL_HTTP/Role/List (0.00s) --- PASS: TestACL_HTTP/Role/Read (0.00s) --- PASS: TestACL_HTTP/Token (0.13s) --- PASS: TestACL_HTTP/Token/Create (0.01s) --- PASS: TestACL_HTTP/Token/Create_Local (0.01s) --- PASS: TestACL_HTTP/Token/Read (0.00s) --- PASS: TestACL_HTTP/Token/Self (0.00s) --- PASS: TestACL_HTTP/Token/Clone (0.03s) --- PASS: TestACL_HTTP/Token/Update (0.02s) --- PASS: TestACL_HTTP/Token/CRUD_Missing_Token_Accessor_ID (0.00s) --- PASS: TestACL_HTTP/Token/Update_Accessor_Mismatch (0.00s) --- PASS: TestACL_HTTP/Token/Delete (0.03s) --- PASS: TestACL_HTTP/Token/List (0.00s) --- PASS: TestACL_HTTP/Token/List_by_Policy (0.00s) --- PASS: TestACL_HTTP/Token/Create_with_Accessor (0.01s) --- PASS: TestACL_HTTP/Token/Create_with_Secret (0.03s) --- PASS: TestACL_HTTP/Token/Create_with_Accessor_and_Secret (0.01s) --- PASS: TestACL_HTTP/Token/Create_with_Accessor_Dup (0.00s) --- PASS: TestACL_HTTP/Token/Create_with_Secret_as_Accessor_Dup (0.00s) --- PASS: TestACL_HTTP/Token/Create_with_Secret_Dup (0.00s) --- PASS: TestACL_HTTP/Token/Create_with_Accessor_as_Secret_Dup (0.00s) --- PASS: TestACL_HTTP/Token/Create_with_Reserved_Accessor (0.00s) --- PASS: TestACL_HTTP/Token/Create_with_Reserved_Secret (0.00s) === CONT TestRemoteExecGetSpec_ACLDeny [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:06.053Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:06.088Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:06.220 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:143f3d21-1b65-f04c-7a23-9829293f5345 Address:127.0.0.1:29622}]" 32:06.220 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29622 [Follower]" leader= 32:06.221 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-143f3d21-1b65-f04c-7a23-9829293f5345.dc2 127.0.0.1 32:06.221 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-143f3d21-1b65-f04c-7a23-9829293f5345 127.0.0.1 2021-10-05T16:32:06.221Z [INFO] agent.router: Initializing LAN area manager 32:06.221 [INFO] TestAgent.server: Adding LAN server: server="Node-143f3d21-1b65-f04c-7a23-9829293f5345 (Addr: tcp/127.0.0.1:29622) (DC: dc2)" 32:06.221 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-143f3d21-1b65-f04c-7a23-9829293f5345.dc2 area=wan 32:06.222 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29603 network=udp 32:06.222 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29603 network=tcp 32:06.223 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29604 network=tcp 32:06.223 [INFO] TestAgent: started state syncer 32:06.223 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29623 network=tcp 32:06.264 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:06.264 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29622 [Candidate]" term=2 32:06.272 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs, servers in acl datacenter are not yet upgraded: ACLDatacenter=dc1 mode=1 found=false 32:06.300 [DEBUG] TestAgent.server.raft: votes: needed=1 32:06.300 [DEBUG] TestAgent.server.raft: vote granted: from=143f3d21-1b65-f04c-7a23-9829293f5345 term=2 tally=1 32:06.300 [INFO] TestAgent.server.raft: election won: tally=1 32:06.300 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29622 [Leader]" 32:06.300 [INFO] TestAgent.server: cluster leadership acquired 32:06.301 [INFO] TestAgent.server: New leader elected: payload=Node-143f3d21-1b65-f04c-7a23-9829293f5345 32:06.368 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs, servers in acl datacenter are not yet upgraded: ACLDatacenter=dc1 mode=1 found=false 32:06.368 [INFO] TestAgent.leader: started routine: routine="legacy ACL replication" 32:06.368 [INFO] TestAgent.server: started legacy ACL replication 32:06.371 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ACL.List 32:06.371 [WARN] TestAgent.server.replication.acl.legacy: Legacy ACL replication error (will retry if still leader): error="failed to retrieve remote ACLs: No path to datacenter" 32:06.371 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ACL.List 32:06.371 [WARN] TestAgent.server.replication.acl.legacy: Legacy ACL replication error (will retry if still leader): error="failed to retrieve remote ACLs: No path to datacenter" 32:06.371 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ACL.List 32:06.371 [WARN] TestAgent.server.replication.acl.legacy: Legacy ACL replication error (will retry if still leader): error="failed to retrieve remote ACLs: No path to datacenter" 32:06.371 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ACL.List 32:06.372 [WARN] TestAgent.server.replication.acl.legacy: Legacy ACL replication error (will retry if still leader): error="failed to retrieve remote ACLs: No path to datacenter" 32:06.372 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ACL.List 32:06.372 [WARN] TestAgent.server.replication.acl.legacy: Legacy ACL replication error (will retry if still leader): error="failed to retrieve remote ACLs: No path to datacenter" 32:06.372 [WARN] TestAgent.server.rpc: RPC request for DC is currently failing as no path was found: datacenter=dc1 method=ACL.GetPolicy 32:06.372 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:29581] 32:06.372 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs, servers in acl datacenter are not yet upgraded: ACLDatacenter=dc1 mode=1 found=false 32:06.372 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:29581 32:06.374 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-73f30748-39f8-9ff3-06be-96a612992e72.dc1 127.0.0.1 32:06.374 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 32:06.374 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-73f30748-39f8-9ff3-06be-96a612992e72.dc1 area=wan 32:06.410 [DEBUG] connect.ca.consul: consul CA provider configured: id=ad:4a:c6:ab:ef:63:c9:60:1a:51:7f:19:62:e3:e9:d9:0e:76:55:10:6e:74:24:69:28:a1:6c:b8:b9:8f:fd:89 is_primary=false 32:06.492 [INFO] TestAgent.server.connect: received new intermediate certificate from primary datacenter 32:06.503 [INFO] TestAgent.server.connect: updated root certificates from primary datacenter 32:06.503 [INFO] TestAgent.server.connect: initialized secondary datacenter CA with provider: provider=consul 32:06.503 [INFO] TestAgent.leader: started routine: routine="config entry replication" 32:06.503 [INFO] TestAgent.leader: started routine: routine="federation state replication" 32:06.503 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:06.503 [INFO] TestAgent.leader: started routine: routine="secondary CA roots watch" 32:06.503 [INFO] TestAgent.leader: started routine: routine="intention replication" 32:06.503 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:06.503 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:06.504 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-143f3d21-1b65-f04c-7a23-9829293f5345 32:06.504 [INFO] TestAgent.server: member joined, marking health alive: member=Node-143f3d21-1b65-f04c-7a23-9829293f5345 32:06.504 [DEBUG] TestAgent.server.connect: starting Connect intention replication from primary datacenter: primary=dc1 32:06.504 [DEBUG] TestAgent.server.connect: starting Connect CA root replication from primary datacenter: primary=dc1 32:06.505 [DEBUG] TestAgent.server.replication.config_entry: finished fetching config entries: amount=0 32:06.505 [DEBUG] TestAgent.server.replication.config_entry: Config Entry replication: local=0 remote=0 32:06.505 [DEBUG] TestAgent.server.replication.config_entry: Config Entry replication: deletions=0 updates=0 32:06.505 [DEBUG] TestAgent.server.replication.config_entry: replication completed through remote index: index=1 32:06.505 [DEBUG] TestAgent.server: finished fetching remote objects: amount=1 32:06.505 [DEBUG] TestAgent.server: diffing replication state: local_amount=0 remote_amount=1 32:06.505 [DEBUG] TestAgent.server: diffed replication state: deletions=0 updates=1 32:06.505 [DEBUG] TestAgent.server: performing updates: updates=1 32:06.572 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL replication" 32:06.572 [INFO] TestAgent.leader: started routine: routine="ACL policy replication" 32:06.572 [INFO] TestAgent.leader: started routine: routine="ACL role replication" 32:06.572 [INFO] TestAgent.leader: started routine: routine="ACL token replication" 32:06.572 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:06.572 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:06.572 [INFO] TestAgent.server.replication.acl.policy: started ACL Policy replication 32:06.572 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-143f3d21-1b65-f04c-7a23-9829293f5345 32:06.572 [INFO] TestAgent.server: Updating LAN server: server="Node-143f3d21-1b65-f04c-7a23-9829293f5345 (Addr: tcp/127.0.0.1:29622) (DC: dc2)" 32:06.573 [INFO] TestAgent.server.replication.acl.role: started ACL Role replication 32:06.573 [INFO] TestAgent.server.replication.acl.token: started ACL Token replication 32:06.573 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL replication" 32:06.573 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-143f3d21-1b65-f04c-7a23-9829293f5345.dc2 32:06.573 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-143f3d21-1b65-f04c-7a23-9829293f5345.dc2 area=wan 32:06.573 [DEBUG] TestAgent.server.replication.acl.policy: finished fetching acls: amount=2 32:06.573 [DEBUG] TestAgent.server.replication.acl.policy: acl replication: local=0 remote=2 32:06.573 [DEBUG] TestAgent.server.replication.acl.policy: acl replication: deletions=0 updates=2 32:06.574 [DEBUG] TestAgent.server.replication.acl.role: finished fetching acls: amount=0 32:06.574 [DEBUG] TestAgent.server.replication.acl.role: acl replication: local=0 remote=0 32:06.574 [DEBUG] TestAgent.server.replication.acl.role: acl replication: deletions=0 updates=0 32:06.574 [DEBUG] TestAgent.server.replication.acl.role: ACL replication completed through remote index: index=1 32:06.574 [DEBUG] TestAgent.server.replication.acl.token: finished fetching acls: amount=3 32:06.574 [DEBUG] TestAgent.server.replication.acl.token: acl replication: local=0 remote=3 32:06.574 [DEBUG] TestAgent.server.replication.acl.token: acl replication: deletions=0 updates=3 32:06.574 [DEBUG] TestAgent.server.replication.acl.policy: acl replication - downloaded updates: amount=2 32:06.574 [DEBUG] TestAgent.server.replication.acl.policy: acl replication - performing updates 32:06.575 [DEBUG] TestAgent.server.replication.acl.token: acl replication - downloaded updates: amount=3 32:06.575 [DEBUG] TestAgent.server.replication.acl.token: acl replication - performing updates 32:06.631 [DEBUG] TestAgent.server: finished updates 32:06.631 [DEBUG] TestAgent.replication.federation_state: replication completed through remote index: index=14 32:06.631 [INFO] TestAgent.server.connect: updated root certificates from primary datacenter 32:06.632 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-143f3d21-1b65-f04c-7a23-9829293f5345 32:06.632 [INFO] TestAgent: Synced node info 32:06.632 [DEBUG] TestAgent.server.replication.acl.policy: acl replication - upserted batch: number_upserted=2 batch_size=675 32:06.632 [DEBUG] TestAgent.server.replication.acl.policy: acl replication - finished updates 32:06.632 [DEBUG] TestAgent.server.replication.acl.policy: ACL replication completed through remote index: index=15 32:06.632 [DEBUG] TestAgent.server.replication.acl.token: acl replication - upserted batch: number_upserted=3 batch_size=442 32:06.632 [DEBUG] TestAgent.server.replication.acl.token: acl replication - finished updates 32:06.632 [DEBUG] TestAgent.server.replication.acl.token: ACL replication completed through remote index: index=16 32:06.647 [INFO] TestAgent: Requesting shutdown 32:06.647 [INFO] TestAgent.server: shutting down server 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="intention replication" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="ACL role replication" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="ACL policy replication" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="config entry replication" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="federation state replication" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="secondary CA roots watch" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="ACL token replication" 32:06.648 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:06.648 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:06.648 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:06.648 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:06.648 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:06.656 [INFO] TestAgent.server: federation state anti-entropy synced 32:06.656 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:06.656 [DEBUG] TestAgent.server: finished fetching remote objects: amount=2 32:06.656 [INFO] TestAgent.replication.federation_state: stopped replication 32:06.656 [DEBUG] TestAgent.leader: stopped routine: routine="federation state replication" 32:06.676 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:06.684Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.684Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:06.684Z [INFO] agent.router.manager: shutting down 32:06.684 [INFO] TestAgent: consul server down 32:06.684 [INFO] TestAgent: shutdown complete 32:06.684 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29603 network=tcp 32:06.684 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29603 network=udp 32:06.684 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29604 network=tcp 32:06.684 [ERROR] TestAgent.server.rpc: RPC failed to server in DC: server=127.0.0.1:29638 datacenter=dc1 method=Intention.List error="rpc error making call: EOF" 32:06.684 [ERROR] TestAgent.server.connect: error replicating intentions: routine="intention replication" error="rpc error making call: EOF" 32:06.684 [DEBUG] TestAgent.leader: stopped routine: routine="intention replication" 32:06.684 [ERROR] TestAgent.server.rpc: RPC failed to server in DC: server=127.0.0.1:29638 datacenter=dc1 method=ConfigEntry.ListAll error="rpc error making call: EOF" 32:06.684 [INFO] TestAgent.server.replication.config_entry: stopped replication 32:06.684 [DEBUG] TestAgent.leader: stopped routine: routine="config entry replication" 32:06.684 [ERROR] TestAgent.server.rpc: RPC failed to server in DC: server=127.0.0.1:29638 datacenter=dc1 method=ACL.RoleList error="rpc error making call: EOF" 32:06.684 [WARN] TestAgent.server.replication.acl.role: ACL replication error (will retry if still leader): error="failed to retrieve remote ACL roles: rpc error making call: EOF" 32:06.684 [DEBUG] TestAgent.leader: stopped routine: routine="ACL role replication" 32:06.684 [ERROR] TestAgent.server.rpc: RPC failed to server in DC: server=127.0.0.1:29638 datacenter=dc1 method=ConnectCA.Roots error="rpc error making call: EOF" 32:06.684 [ERROR] TestAgent.server.connect: CA root replication failed, will retry: routine="secondary CA roots watch" error="Error retrieving the primary datacenter's roots: rpc error making call: EOF" 32:06.684 [DEBUG] TestAgent.leader: stopped routine: routine="secondary CA roots watch" 32:06.684 [ERROR] TestAgent.server.rpc: RPC failed to server in DC: server=127.0.0.1:29638 datacenter=dc1 method=ACL.PolicyList error="rpc error making call: EOF" 32:06.684 [WARN] TestAgent.server.replication.acl.policy: ACL replication error (will retry if still leader): error="failed to retrieve remote ACL policies: rpc error making call: EOF" 32:06.684 [DEBUG] TestAgent.leader: stopped routine: routine="ACL policy replication" 32:06.684 [ERROR] TestAgent.server.rpc: RPC failed to server in DC: server=127.0.0.1:29638 datacenter=dc1 method=ACL.TokenList error="rpc error making call: EOF" 32:06.684 [WARN] TestAgent.server.replication.acl.token: ACL replication error (will retry if still leader): error="failed to retrieve remote ACL tokens: rpc error making call: EOF" 32:06.684 [DEBUG] TestAgent.leader: stopped routine: routine="ACL token replication" 32:07.184 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.184 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:05.601Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:05.633Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:05.697 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:73f30748-39f8-9ff3-06be-96a612992e72 Address:127.0.0.1:29638}]" 32:05.698 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-73f30748-39f8-9ff3-06be-96a612992e72.dc1 127.0.0.1 32:05.699 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-73f30748-39f8-9ff3-06be-96a612992e72 127.0.0.1 2021-10-05T16:32:05.699Z [INFO] agent.router: Initializing LAN area manager 32:05.699 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29577 network=udp 32:05.699 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29638 [Follower]" leader= 32:05.699 [INFO] TestAgent.server: Adding LAN server: server="Node-73f30748-39f8-9ff3-06be-96a612992e72 (Addr: tcp/127.0.0.1:29638) (DC: dc1)" 32:05.699 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-73f30748-39f8-9ff3-06be-96a612992e72.dc1 area=wan 32:05.700 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29577 network=tcp 32:05.700 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29578 network=tcp 32:05.700 [INFO] TestAgent: started state syncer 32:05.700 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30128 network=tcp 32:05.751 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:05.764 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:05.764 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29638 [Candidate]" term=2 32:05.788 [DEBUG] TestAgent.server.raft: votes: needed=1 32:05.788 [DEBUG] TestAgent.server.raft: vote granted: from=73f30748-39f8-9ff3-06be-96a612992e72 term=2 tally=1 32:05.788 [INFO] TestAgent.server.raft: election won: tally=1 32:05.788 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29638 [Leader]" 32:05.788 [INFO] TestAgent.server: cluster leadership acquired 32:05.788 [INFO] TestAgent.server: New leader elected: payload=Node-73f30748-39f8-9ff3-06be-96a612992e72 32:05.797 [INFO] TestAgent.server: initializing acls 32:05.803 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:05.820 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:05.844 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:05.844 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:05.844 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:05.844 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-73f30748-39f8-9ff3-06be-96a612992e72 32:05.844 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-73f30748-39f8-9ff3-06be-96a612992e72.dc1 32:05.845 [INFO] TestAgent.server: Updating LAN server: server="Node-73f30748-39f8-9ff3-06be-96a612992e72 (Addr: tcp/127.0.0.1:29638) (DC: dc1)" 32:05.845 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-73f30748-39f8-9ff3-06be-96a612992e72.dc1 area=wan 32:05.855 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:05.882 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:05.882 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:05.882 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:05.882 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:05.882 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:05.882 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-73f30748-39f8-9ff3-06be-96a612992e72 32:05.882 [INFO] TestAgent.server: member joined, marking health alive: member=Node-73f30748-39f8-9ff3-06be-96a612992e72 32:05.889 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-73f30748-39f8-9ff3-06be-96a612992e72 32:05.895 [INFO] TestAgent.server: federation state anti-entropy synced 32:05.964 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-73f30748-39f8-9ff3-06be-96a612992e72 32:06.106 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:06.114 [INFO] TestAgent: Synced node info 32:06.372 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:49552 32:06.373 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-143f3d21-1b65-f04c-7a23-9829293f5345.dc2 127.0.0.1 32:06.373 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-143f3d21-1b65-f04c-7a23-9829293f5345.dc2 area=wan 32:06.831 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:06.831 [DEBUG] TestAgent: Node info in sync 32:06.831 [DEBUG] TestAgent: Node info in sync 32:07.184 [INFO] TestAgent: Requesting shutdown 32:07.184 [INFO] TestAgent.server: shutting down server 32:07.184 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:07.184 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:07.184 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:07.184 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:07.184 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:07.184 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:07.184 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:07.185 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:07.185 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:07.185 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:07.185 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:07.185 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:07.185 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:07.185 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:07.200 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:07.200Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.200Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.200Z [INFO] agent.router.manager: shutting down 32:07.200 [INFO] TestAgent: consul server down 32:07.200 [INFO] TestAgent: shutdown complete 32:07.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29577 network=tcp 32:07.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29577 network=udp 32:07.200 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29578 network=tcp 32:07.701 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.701 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Authorize (2.16s) --- PASS: TestACL_Authorize/master-token (0.01s) --- PASS: TestACL_Authorize/master-token/dc1 (0.00s) --- PASS: TestACL_Authorize/master-token/dc2 (0.01s) --- PASS: TestACL_Authorize/custom-token (0.00s) --- PASS: TestACL_Authorize/custom-token/dc1 (0.00s) --- PASS: TestACL_Authorize/custom-token/dc2 (0.00s) --- PASS: TestACL_Authorize/too-many-requests (0.00s) --- PASS: TestACL_Authorize/decode-failure (0.00s) --- PASS: TestACL_Authorize/acl-not-found (0.00s) --- PASS: TestACL_Authorize/local-token-in-secondary-dc (0.00s) --- PASS: TestACL_Authorize/local-token-wrong-dc (0.00s) === CONT TestPProfHandlers_ACLs 2021-10-05T16:32:06.551Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:06.551Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:06.565Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:06.565Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:06.684 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e127a0a0-e28a-c9ca-9414-5420b5ceeee5 Address:127.0.0.1:29664}]" 32:06.684 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29664 [Follower]" leader= 32:06.685 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5.dc1 127.0.0.1 32:06.692 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 127.0.0.1 2021-10-05T16:32:06.692Z [INFO] agent.router: Initializing LAN area manager 32:06.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29680 network=udp 32:06.693 [INFO] TestAgent.server: Adding LAN server: server="Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 (Addr: tcp/127.0.0.1:29664) (DC: dc1)" 32:06.693 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5.dc1 area=wan 32:06.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29680 network=tcp 32:06.694 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29681 network=tcp 32:06.694 [INFO] TestAgent: started state syncer 32:06.694 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29665 network=tcp 32:06.744 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:06.744 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29664 [Candidate]" term=2 32:06.745 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:06.846 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:06.957 [DEBUG] TestAgent.server.raft: votes: needed=1 32:06.957 [DEBUG] TestAgent.server.raft: vote granted: from=e127a0a0-e28a-c9ca-9414-5420b5ceeee5 term=2 tally=1 32:06.957 [INFO] TestAgent.server.raft: election won: tally=1 32:06.957 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29664 [Leader]" 32:06.958 [INFO] TestAgent.server: cluster leadership acquired 32:06.958 [INFO] TestAgent.server: New leader elected: payload=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 32:06.979 [INFO] TestAgent.server: initializing acls 32:06.996 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:06.996 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.007 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.017 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.017 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:07.017 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:07.017 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 32:07.017 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5.dc1 32:07.018 [INFO] TestAgent.server: Updating LAN server: server="Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 (Addr: tcp/127.0.0.1:29664) (DC: dc1)" 32:07.018 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5.dc1 area=wan 32:07.035 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:07.076 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:07.076 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:07.076 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:07.076 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:07.076 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:07.076 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 32:07.076 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 32:07.090 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 32:07.112 [INFO] TestAgent.server: federation state anti-entropy synced 32:07.214 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 32:07.214 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-e127a0a0-e28a-c9ca-9414-5420b5ceeee5 32:07.214 [INFO] TestAgent: Requesting shutdown 32:07.214 [INFO] TestAgent.server: shutting down server 32:07.214 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:07.214 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:07.214 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:07.214 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:07.214 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:07.214 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:07.214 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:07.215 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:07.215 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:07.215 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:07.215 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:07.215 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:07.215 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:07.215 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:07.215 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:07.220 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:07.220Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.220Z [INFO] agent.router.manager: shutting down 32:07.220 [INFO] TestAgent: consul server down 32:07.220 [INFO] TestAgent: shutdown complete 32:07.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29680 network=tcp 32:07.221 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29680 network=udp 32:07.221 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29681 network=tcp 32:07.721 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.721 [INFO] TestAgent: Endpoints down --- PASS: TestACLReplicationStatus (1.18s) === CONT TestACL_Legacy_Destroy [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:06.769Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:06.769Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:06.789Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:06.789Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:06.981 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:032756d7-8b7c-48e5-0526-1d346e53a8ab Address:127.0.0.1:29678}]" 32:06.981 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-032756d7-8b7c-48e5-0526-1d346e53a8ab.dc1 127.0.0.1 32:06.982 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-032756d7-8b7c-48e5-0526-1d346e53a8ab 127.0.0.1 2021-10-05T16:32:06.982Z [INFO] agent.router: Initializing LAN area manager 32:06.982 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29652 network=udp 32:06.982 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29678 [Follower]" leader= 32:06.983 [INFO] TestAgent.server: Adding LAN server: server="Node-032756d7-8b7c-48e5-0526-1d346e53a8ab (Addr: tcp/127.0.0.1:29678) (DC: dc1)" 32:06.983 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-032756d7-8b7c-48e5-0526-1d346e53a8ab.dc1 area=wan 32:06.983 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29652 network=tcp 32:06.984 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29653 network=tcp 32:06.984 [INFO] TestAgent: started state syncer 32:06.984 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29679 network=tcp 32:07.023 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:07.023 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29678 [Candidate]" term=2 32:07.033 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:07.038 [DEBUG] TestAgent.server.raft: votes: needed=1 32:07.038 [DEBUG] TestAgent.server.raft: vote granted: from=032756d7-8b7c-48e5-0526-1d346e53a8ab term=2 tally=1 32:07.038 [INFO] TestAgent.server.raft: election won: tally=1 32:07.038 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29678 [Leader]" 32:07.038 [INFO] TestAgent.server: cluster leadership acquired 32:07.038 [INFO] TestAgent.server: New leader elected: payload=Node-032756d7-8b7c-48e5-0526-1d346e53a8ab 32:07.051 [INFO] TestAgent.server: initializing acls 32:07.054 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:07.054 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.070 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.086 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.086 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:07.086 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:07.086 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-032756d7-8b7c-48e5-0526-1d346e53a8ab 32:07.086 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-032756d7-8b7c-48e5-0526-1d346e53a8ab.dc1 32:07.087 [INFO] TestAgent.server: Updating LAN server: server="Node-032756d7-8b7c-48e5-0526-1d346e53a8ab (Addr: tcp/127.0.0.1:29678) (DC: dc1)" 32:07.087 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-032756d7-8b7c-48e5-0526-1d346e53a8ab.dc1 area=wan 32:07.120 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:07.182 [INFO] TestAgent: Synced node info 32:07.182 [DEBUG] TestAgent: Node info in sync 32:07.182 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:07.182 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:07.182 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:07.182 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:07.182 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:07.182 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-032756d7-8b7c-48e5-0526-1d346e53a8ab 32:07.182 [INFO] TestAgent.server: member joined, marking health alive: member=Node-032756d7-8b7c-48e5-0526-1d346e53a8ab 32:07.196 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-032756d7-8b7c-48e5-0526-1d346e53a8ab 32:07.233 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-032756d7-8b7c-48e5-0526-1d346e53a8ab 32:07.280 [INFO] TestAgent.server: federation state anti-entropy synced 32:07.343 [INFO] TestAgent: Requesting shutdown 32:07.343 [INFO] TestAgent.server: shutting down server 32:07.343 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:07.343 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:07.343 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:07.343 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:07.343 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:07.343 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:07.343 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:07.343 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:07.343 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:07.343 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:07.343 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:07.343 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:07.343 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:07.343 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:07.349 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:07.355Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.355Z [INFO] agent.router.manager: shutting down 32:07.355 [INFO] TestAgent: consul server down 32:07.355 [INFO] TestAgent: shutdown complete 32:07.355 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29652 network=tcp 32:07.355 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29652 network=udp 32:07.355 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29653 network=tcp 32:07.855 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.855 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecWrites_ACLAgentToken (1.11s) === CONT TestACL_Legacy_Get === RUN TestACL_Legacy_Get/wrong_id 2021-10-05T16:32:06.990Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:06.990Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:07.007Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.008Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:07.042 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:209ddb91-a166-c1f9-90fb-a5d4444c859f Address:127.0.0.1:29643}]" 32:07.043 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-209ddb91-a166-c1f9-90fb-a5d4444c859f.dc1 127.0.0.1 32:07.043 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 127.0.0.1 2021-10-05T16:32:07.043Z [INFO] agent.router: Initializing LAN area manager 32:07.044 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29631 network=udp 32:07.044 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29643 [Follower]" leader= 32:07.044 [INFO] TestAgent.server: Adding LAN server: server="Node-209ddb91-a166-c1f9-90fb-a5d4444c859f (Addr: tcp/127.0.0.1:29643) (DC: dc1)" 32:07.044 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f.dc1 area=wan 32:07.044 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29631 network=tcp 32:07.045 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29688 network=tcp 32:07.045 [INFO] TestAgent: started state syncer 32:07.045 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29644 network=tcp 32:07.094 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:07.104 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:07.104 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29643 [Candidate]" term=2 32:07.148 [DEBUG] TestAgent.server.raft: votes: needed=1 32:07.148 [DEBUG] TestAgent.server.raft: vote granted: from=209ddb91-a166-c1f9-90fb-a5d4444c859f term=2 tally=1 32:07.148 [INFO] TestAgent.server.raft: election won: tally=1 32:07.148 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29643 [Leader]" 32:07.152 [INFO] TestAgent.server: cluster leadership acquired 32:07.152 [INFO] TestAgent.server: New leader elected: payload=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.180 [INFO] TestAgent.server: initializing acls 32:07.196 [INFO] TestAgent.server: initializing acls 32:07.199 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:07.199 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.212 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:07.212 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.225 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.230 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.230 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:07.230 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:07.230 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.230 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-209ddb91-a166-c1f9-90fb-a5d4444c859f.dc1 32:07.231 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.231 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:07.232 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.232 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-209ddb91-a166-c1f9-90fb-a5d4444c859f.dc1 32:07.232 [INFO] TestAgent.server: Updating LAN server: server="Node-209ddb91-a166-c1f9-90fb-a5d4444c859f (Addr: tcp/127.0.0.1:29643) (DC: dc1)" 32:07.232 [INFO] TestAgent.server: Updating LAN server: server="Node-209ddb91-a166-c1f9-90fb-a5d4444c859f (Addr: tcp/127.0.0.1:29643) (DC: dc1)" 32:07.232 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f.dc1 area=wan 32:07.232 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f.dc1 area=wan 32:07.284 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:07.341 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:07.341 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:07.341 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:07.341 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:07.341 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:07.342 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.342 [INFO] TestAgent.server: member joined, marking health alive: member=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.352 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.352 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.361 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-209ddb91-a166-c1f9-90fb-a5d4444c859f 32:07.368 [INFO] TestAgent.server: federation state anti-entropy synced 32:07.405 [INFO] TestAgent: Requesting shutdown 32:07.405 [INFO] TestAgent.server: shutting down server 32:07.405 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:07.405 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:07.405 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:07.405 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:07.405 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:07.405 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:07.405 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:07.405 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:07.405 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:07.405 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:07.405 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:07.405 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:07.405 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:07.405 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:07.405 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:07.408 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:07.417Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.417Z [INFO] agent.router.manager: shutting down 32:07.418 [INFO] TestAgent: consul server down 32:07.418 [INFO] TestAgent: shutdown complete 32:07.418 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29631 network=tcp 32:07.418 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29631 network=udp 32:07.418 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29688 network=tcp 32:07.918 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.918 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecWrites_ACLToken (0.95s) === CONT TestACL_Legacy_Clone 2021-10-05T16:32:06.758Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:06.758Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:06.789Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:06.789Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:06.993 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c727f468-e518-4048-8b1e-6871f96b6250 Address:127.0.0.1:29657}]" 32:06.993 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29657 [Follower]" leader= 32:06.994 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c727f468-e518-4048-8b1e-6871f96b6250.dc1 127.0.0.1 32:06.995 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c727f468-e518-4048-8b1e-6871f96b6250 127.0.0.1 2021-10-05T16:32:06.995Z [INFO] agent.router: Initializing LAN area manager 32:06.995 [INFO] TestAgent.server: Adding LAN server: server="Node-c727f468-e518-4048-8b1e-6871f96b6250 (Addr: tcp/127.0.0.1:29657) (DC: dc1)" 32:06.995 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c727f468-e518-4048-8b1e-6871f96b6250.dc1 area=wan 32:06.995 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29687 network=udp 32:06.995 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29687 network=tcp 32:06.996 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29646 network=tcp 32:06.996 [INFO] TestAgent: started state syncer 32:06.996 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29658 network=tcp 32:07.047 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:07.056 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:07.056 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29657 [Candidate]" term=2 32:07.079 [DEBUG] TestAgent.server.raft: votes: needed=1 32:07.079 [DEBUG] TestAgent.server.raft: vote granted: from=c727f468-e518-4048-8b1e-6871f96b6250 term=2 tally=1 32:07.079 [INFO] TestAgent.server.raft: election won: tally=1 32:07.079 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29657 [Leader]" 32:07.079 [INFO] TestAgent.server: cluster leadership acquired 32:07.080 [INFO] TestAgent.server: New leader elected: payload=Node-c727f468-e518-4048-8b1e-6871f96b6250 32:07.088 [INFO] TestAgent.server: initializing acls 32:07.093 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:07.093 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.104 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.134 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.134 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:07.134 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:07.134 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c727f468-e518-4048-8b1e-6871f96b6250 32:07.134 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c727f468-e518-4048-8b1e-6871f96b6250.dc1 32:07.136 [INFO] TestAgent.server: Updating LAN server: server="Node-c727f468-e518-4048-8b1e-6871f96b6250 (Addr: tcp/127.0.0.1:29657) (DC: dc1)" 32:07.136 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c727f468-e518-4048-8b1e-6871f96b6250.dc1 area=wan 32:07.157 [INFO] TestAgent: Synced node info 32:07.157 [DEBUG] TestAgent: Node info in sync 32:07.157 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:07.192 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:07.192 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:07.192 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:07.192 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:07.192 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:07.192 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c727f468-e518-4048-8b1e-6871f96b6250 32:07.192 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c727f468-e518-4048-8b1e-6871f96b6250 32:07.207 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c727f468-e518-4048-8b1e-6871f96b6250 32:07.217 [INFO] TestAgent.server: federation state anti-entropy synced 32:07.432 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-c727f468-e518-4048-8b1e-6871f96b6250 32:07.432 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-c727f468-e518-4048-8b1e-6871f96b6250 32:07.460 [INFO] TestAgent: Requesting shutdown 32:07.460 [INFO] TestAgent.server: shutting down server 32:07.460 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:07.460 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:07.460 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:07.460 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:07.460 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:07.460 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:07.460 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:07.460 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:07.460 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:07.460 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:07.460 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:07.460 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:07.460 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:07.460 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:07.467 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:07.479Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.479Z [INFO] agent.router.manager: shutting down 32:07.479 [INFO] TestAgent: consul server down 32:07.479 [INFO] TestAgent: shutdown complete 32:07.479 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29687 network=tcp 32:07.479 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29687 network=udp 32:07.479 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29646 network=tcp 32:07.980 [INFO] TestAgent: Waiting for endpoints to shut down 32:07.980 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecGetSpec_ACLAgentToken (1.26s) === CONT TestPreparedQuery_Integration [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestPProfHandlers_ACLs/case_0_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:200,_token:"master",_endpoint:"/debug/pprof/heap",_nilResponse:false}) === RUN TestPProfHandlers_ACLs/case_1_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"agent",_endpoint:"/debug/pprof/heap",_nilResponse:true}) === RUN TestPProfHandlers_ACLs/case_2_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"agent",_endpoint:"/debug/pprof/",_nilResponse:true}) === RUN TestPProfHandlers_ACLs/case_3_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"",_endpoint:"/debug/pprof/",_nilResponse:true}) === RUN TestPProfHandlers_ACLs/case_4_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:200,_token:"master",_endpoint:"/debug/pprof/heap",_nilResponse:false}) 2021-10-05T16:32:07.299Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.299Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:07.356Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.356Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:07.401 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0f1d3741-9147-1f69-7b43-1db6650245ee Address:127.0.0.1:29727}]" 32:07.402 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0f1d3741-9147-1f69-7b43-1db6650245ee.dc1 127.0.0.1 32:07.403 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0f1d3741-9147-1f69-7b43-1db6650245ee 127.0.0.1 2021-10-05T16:32:07.403Z [INFO] agent.router: Initializing LAN area manager 32:07.403 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29727 [Follower]" leader= 32:07.403 [INFO] TestAgent.server: Adding LAN server: server="Node-0f1d3741-9147-1f69-7b43-1db6650245ee (Addr: tcp/127.0.0.1:29727) (DC: dc1)" 32:07.403 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0f1d3741-9147-1f69-7b43-1db6650245ee.dc1 area=wan 32:07.403 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29701 network=udp 32:07.403 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29701 network=tcp 32:07.404 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29702 network=tcp 32:07.404 [INFO] TestAgent: started state syncer 32:07.404 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29728 network=tcp 32:07.456 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:07.468 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:07.468 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29727 [Candidate]" term=2 32:07.501 [DEBUG] TestAgent.server.raft: votes: needed=1 32:07.501 [DEBUG] TestAgent.server.raft: vote granted: from=0f1d3741-9147-1f69-7b43-1db6650245ee term=2 tally=1 32:07.501 [INFO] TestAgent.server.raft: election won: tally=1 32:07.501 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29727 [Leader]" 32:07.503 [INFO] TestAgent.server: cluster leadership acquired 32:07.503 [INFO] TestAgent.server: New leader elected: payload=Node-0f1d3741-9147-1f69-7b43-1db6650245ee 32:07.511 [INFO] TestAgent.server: initializing acls 32:07.516 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:07.516 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.528 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.541 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.541 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:07.541 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:07.542 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-0f1d3741-9147-1f69-7b43-1db6650245ee 32:07.542 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-0f1d3741-9147-1f69-7b43-1db6650245ee.dc1 32:07.542 [INFO] TestAgent.server: Updating LAN server: server="Node-0f1d3741-9147-1f69-7b43-1db6650245ee (Addr: tcp/127.0.0.1:29727) (DC: dc1)" 32:07.542 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-0f1d3741-9147-1f69-7b43-1db6650245ee.dc1 area=wan 32:07.558 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:07.578 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:07.578 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:07.578 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:07.578 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:07.578 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:07.578 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0f1d3741-9147-1f69-7b43-1db6650245ee 32:07.578 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0f1d3741-9147-1f69-7b43-1db6650245ee 32:07.585 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0f1d3741-9147-1f69-7b43-1db6650245ee 32:07.594 [INFO] TestAgent.server: federation state anti-entropy synced 32:07.594 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-0f1d3741-9147-1f69-7b43-1db6650245ee 32:07.606 [ERROR] TestAgent: failed to get remote exec job: error="Permission denied" 32:07.610 [INFO] TestAgent: Requesting shutdown 32:07.610 [INFO] TestAgent.server: shutting down server 32:07.610 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:07.610 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:07.610 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:07.610 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:07.610 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:07.610 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:07.610 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:07.610 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:07.610 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:07.610 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:07.610 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:07.610 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:07.610 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:07.610 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:07.610 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:07.615 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:07.621Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.621Z [INFO] agent.router.manager: shutting down 32:07.621 [INFO] TestAgent: consul server down 32:07.621 [INFO] TestAgent: shutdown complete 32:07.621 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29701 network=tcp 32:07.621 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29701 network=udp 32:07.621 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29702 network=tcp 32:08.124 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.124 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecGetSpec_ACLDeny (0.88s) === CONT TestRemoteExecGetSpec_ACLToken 2021-10-05T16:32:07.237Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:07.256Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:07.357 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:379b6c11-e4e8-21a2-0133-827c134161a3 Address:127.0.0.1:29699}]" 32:07.358 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-379b6c11-e4e8-21a2-0133-827c134161a3.dc1 127.0.0.1 32:07.358 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29699 [Follower]" leader= 32:07.359 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-379b6c11-e4e8-21a2-0133-827c134161a3 127.0.0.1 2021-10-05T16:32:07.359Z [INFO] agent.router: Initializing LAN area manager 32:07.359 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-379b6c11-e4e8-21a2-0133-827c134161a3.dc1 area=wan 32:07.359 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29694 network=udp 32:07.359 [INFO] TestAgent.server: Adding LAN server: server="Node-379b6c11-e4e8-21a2-0133-827c134161a3 (Addr: tcp/127.0.0.1:29699) (DC: dc1)" 32:07.359 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29694 network=tcp 32:07.360 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29695 network=tcp 32:07.360 [INFO] TestAgent: started state syncer 32:07.360 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29700 network=tcp 32:07.404 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:07.404 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29699 [Candidate]" term=2 32:07.452 [DEBUG] TestAgent.server.raft: votes: needed=1 32:07.452 [DEBUG] TestAgent.server.raft: vote granted: from=379b6c11-e4e8-21a2-0133-827c134161a3 term=2 tally=1 32:07.452 [INFO] TestAgent.server.raft: election won: tally=1 32:07.452 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29699 [Leader]" 32:07.452 [INFO] TestAgent.server: cluster leadership acquired 32:07.452 [INFO] TestAgent.server: New leader elected: payload=Node-379b6c11-e4e8-21a2-0133-827c134161a3 32:07.479 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29699 32:07.506 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:07.536 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:07.536 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:07.536 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:07.536 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:07.536 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:07.536 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-379b6c11-e4e8-21a2-0133-827c134161a3 32:07.536 [INFO] TestAgent.server: member joined, marking health alive: member=Node-379b6c11-e4e8-21a2-0133-827c134161a3 32:07.554 [INFO] TestAgent.server: federation state anti-entropy synced 32:07.586 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:07.591 [INFO] TestAgent: Synced node info 32:07.591 [DEBUG] TestAgent: Node info in sync 32:07.641 [INFO] TestAgent: Requesting shutdown 32:07.641 [INFO] TestAgent.server: shutting down server 32:07.641 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:07.641 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:07.641 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:07.641 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:07.641 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:07.641 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:07.641 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:07.641 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:07.641 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:07.641 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:07.645 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:07.649Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:07.649Z [INFO] agent.router.manager: shutting down 32:07.649 [INFO] TestAgent: consul server down 32:07.649 [INFO] TestAgent: shutdown complete 32:07.649 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29694 network=tcp 32:07.649 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29694 network=udp 32:07.649 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29695 network=tcp 32:08.149 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.149 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecWrites (0.96s) === CONT TestRemoteExecGetSpec === RUN TestPProfHandlers_ACLs/case_5_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"towel",_endpoint:"/debug/pprof/heap",_nilResponse:true}) [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:07.881Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.881Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:07.911Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.911Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:07.970 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:72e17581-ebfa-46f3-a382-5fb1c49046a6 Address:127.0.0.1:29692}]" 32:07.970 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-72e17581-ebfa-46f3-a382-5fb1c49046a6.dc1 127.0.0.1 32:07.971 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 127.0.0.1 2021-10-05T16:32:07.971Z [INFO] agent.router: Initializing LAN area manager 32:07.971 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29692 [Follower]" leader= 32:07.972 [INFO] TestAgent.server: Adding LAN server: server="Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 (Addr: tcp/127.0.0.1:29692) (DC: dc1)" 32:07.973 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29715 network=tcp 32:07.973 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29715 network=udp 32:07.974 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29597 network=tcp 32:07.974 [INFO] TestAgent: started state syncer 32:07.974 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29693 network=tcp 32:07.974 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-72e17581-ebfa-46f3-a382-5fb1c49046a6.dc1 area=wan 32:08.025 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:08.030 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:08.030 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29692 [Candidate]" term=2 32:08.064 [DEBUG] TestAgent.server.raft: votes: needed=1 32:08.064 [DEBUG] TestAgent.server.raft: vote granted: from=72e17581-ebfa-46f3-a382-5fb1c49046a6 term=2 tally=1 32:08.064 [INFO] TestAgent.server.raft: election won: tally=1 32:08.064 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29692 [Leader]" 32:08.064 [INFO] TestAgent.server: cluster leadership acquired 32:08.064 [INFO] TestAgent.server: New leader elected: payload=Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 32:08.096 [INFO] TestAgent.server: initializing acls 32:08.108 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:08.108 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:08.119 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:08.125 [INFO] TestAgent.server: initializing acls 32:08.125 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:08.133 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:08.133 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:08.133 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:08.133 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 32:08.133 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-72e17581-ebfa-46f3-a382-5fb1c49046a6.dc1 32:08.134 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-72e17581-ebfa-46f3-a382-5fb1c49046a6.dc1 area=wan 32:08.134 [INFO] TestAgent.server: Updating LAN server: server="Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 (Addr: tcp/127.0.0.1:29692) (DC: dc1)" 32:08.138 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:08.138 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:08.139 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 32:08.139 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-72e17581-ebfa-46f3-a382-5fb1c49046a6.dc1 32:08.139 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-72e17581-ebfa-46f3-a382-5fb1c49046a6.dc1 area=wan 32:08.139 [INFO] TestAgent.server: Updating LAN server: server="Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 (Addr: tcp/127.0.0.1:29692) (DC: dc1)" 32:08.163 [INFO] TestAgent: Synced node info 32:08.163 [DEBUG] TestAgent: Node info in sync 32:08.163 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:08.175 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-72e17581-ebfa-46f3-a382-5fb1c49046a6 32:08.175 [INFO] TestAgent: Requesting shutdown 32:08.175 [INFO] TestAgent.server: shutting down server 32:08.175 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:08.175 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:08.175 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:08.176 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:08.176 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:08.181 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:08.188Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:08.188Z [INFO] agent.router.manager: shutting down 32:08.192 [INFO] TestAgent: consul server down 32:08.192 [INFO] TestAgent: shutdown complete 32:08.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29715 network=tcp 32:08.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29715 network=udp 32:08.192 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29597 network=tcp 32:08.192 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 32:08.192 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 32:08.696 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.696 [INFO] TestAgent: Endpoints down === RUN TestACL_Legacy_Get/right_id 2021-10-05T16:32:07.719Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.719Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:07.757Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.757Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:07.822 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c23bcce3-d141-7f24-3254-70af31166101 Address:127.0.0.1:29720}]" 32:07.822 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29720 [Follower]" leader= 32:07.822 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c23bcce3-d141-7f24-3254-70af31166101.dc1 127.0.0.1 32:07.823 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c23bcce3-d141-7f24-3254-70af31166101 127.0.0.1 2021-10-05T16:32:07.823Z [INFO] agent.router: Initializing LAN area manager 32:07.823 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29596 network=udp 32:07.823 [INFO] TestAgent.server: Adding LAN server: server="Node-c23bcce3-d141-7f24-3254-70af31166101 (Addr: tcp/127.0.0.1:29720) (DC: dc1)" 32:07.823 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c23bcce3-d141-7f24-3254-70af31166101.dc1 area=wan 32:07.824 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29596 network=tcp 32:07.824 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29716 network=tcp 32:07.824 [INFO] TestAgent: started state syncer 32:07.825 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29721 network=tcp 32:07.872 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:07.872 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29720 [Candidate]" term=2 32:07.875 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:07.920 [DEBUG] TestAgent.server.raft: votes: needed=1 32:07.920 [DEBUG] TestAgent.server.raft: vote granted: from=c23bcce3-d141-7f24-3254-70af31166101 term=2 tally=1 32:07.920 [INFO] TestAgent.server.raft: election won: tally=1 32:07.920 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29720 [Leader]" 32:07.920 [INFO] TestAgent.server: cluster leadership acquired 32:07.920 [INFO] TestAgent.server: New leader elected: payload=Node-c23bcce3-d141-7f24-3254-70af31166101 32:07.944 [INFO] TestAgent.server: initializing acls 32:07.958 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:07.958 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.972 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.975 [INFO] TestAgent.server: initializing acls 32:07.975 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.996 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.996 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:07.996 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:07.996 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:07.996 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.996 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c23bcce3-d141-7f24-3254-70af31166101 32:07.996 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c23bcce3-d141-7f24-3254-70af31166101.dc1 32:07.996 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c23bcce3-d141-7f24-3254-70af31166101.dc1 area=wan 32:07.996 [INFO] TestAgent.server: Updating LAN server: server="Node-c23bcce3-d141-7f24-3254-70af31166101 (Addr: tcp/127.0.0.1:29720) (DC: dc1)" 32:07.997 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c23bcce3-d141-7f24-3254-70af31166101 32:07.997 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c23bcce3-d141-7f24-3254-70af31166101.dc1 32:07.997 [INFO] TestAgent.server: Updating LAN server: server="Node-c23bcce3-d141-7f24-3254-70af31166101 (Addr: tcp/127.0.0.1:29720) (DC: dc1)" 32:07.997 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c23bcce3-d141-7f24-3254-70af31166101.dc1 area=wan 32:08.020 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 32:08.021 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:08.066 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:08.066 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:08.066 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:08.066 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:08.066 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:08.066 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c23bcce3-d141-7f24-3254-70af31166101 32:08.066 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c23bcce3-d141-7f24-3254-70af31166101 32:08.072 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c23bcce3-d141-7f24-3254-70af31166101 32:08.073 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c23bcce3-d141-7f24-3254-70af31166101 32:08.081 [INFO] TestAgent.server: federation state anti-entropy synced 32:08.089 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-c23bcce3-d141-7f24-3254-70af31166101 32:08.189 [INFO] TestAgent: Requesting shutdown 32:08.189 [INFO] TestAgent.server: shutting down server 32:08.189 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:08.189 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:08.189 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:08.189 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:08.189 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:08.189 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:08.189 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:08.189 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:08.189 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:08.189 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:08.189 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:08.189 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:08.189 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:08.189 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:08.196 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:08.200Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:08.200Z [INFO] agent.router.manager: shutting down 32:08.200 [INFO] TestAgent: consul server down 32:08.200 [INFO] TestAgent: shutdown complete 32:08.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29596 network=tcp 32:08.200 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29596 network=udp 32:08.200 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29716 network=tcp 32:08.704 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.704 [INFO] TestAgent: Endpoints down --- PASS: TestPProfHandlers_ACLs (1.00s) --- PASS: TestPProfHandlers_ACLs/case_0_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:200,_token:"master",_endpoint:"/debug/pprof/heap",_nilResponse:false}) (0.03s) --- PASS: TestPProfHandlers_ACLs/case_1_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"agent",_endpoint:"/debug/pprof/heap",_nilResponse:true}) (0.00s) --- PASS: TestPProfHandlers_ACLs/case_2_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"agent",_endpoint:"/debug/pprof/",_nilResponse:true}) (0.00s) --- PASS: TestPProfHandlers_ACLs/case_3_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"",_endpoint:"/debug/pprof/",_nilResponse:true}) (0.00s) --- PASS: TestPProfHandlers_ACLs/case_4_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:200,_token:"master",_endpoint:"/debug/pprof/heap",_nilResponse:false}) (0.07s) --- PASS: TestPProfHandlers_ACLs/case_5_(struct_{_code_int;_token_string;_endpoint_string;_nilResponse_bool_}{code:403,_token:"towel",_endpoint:"/debug/pprof/heap",_nilResponse:true}) (0.00s) === CONT TestOperator_RaftConfiguration 2021-10-05T16:32:07.736Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.736Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:07.751Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.751Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:07.787 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bcd6577b-b23f-0971-79ce-50199002d9e5 Address:127.0.0.1:29713}]" 32:07.788 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29713 [Follower]" leader= 32:07.788 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bcd6577b-b23f-0971-79ce-50199002d9e5.dc1 127.0.0.1 32:07.789 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bcd6577b-b23f-0971-79ce-50199002d9e5 127.0.0.1 2021-10-05T16:32:07.789Z [INFO] agent.router: Initializing LAN area manager 32:07.789 [INFO] TestAgent.server: Adding LAN server: server="Node-bcd6577b-b23f-0971-79ce-50199002d9e5 (Addr: tcp/127.0.0.1:29713) (DC: dc1)" 32:07.789 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bcd6577b-b23f-0971-79ce-50199002d9e5.dc1 area=wan 32:07.789 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29743 network=udp 32:07.789 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29743 network=tcp 32:07.790 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29737 network=tcp 32:07.790 [INFO] TestAgent: started state syncer 32:07.790 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29714 network=tcp 32:07.825 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:07.825 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29713 [Candidate]" term=2 32:07.837 [DEBUG] TestAgent.server.raft: votes: needed=1 32:07.837 [DEBUG] TestAgent.server.raft: vote granted: from=bcd6577b-b23f-0971-79ce-50199002d9e5 term=2 tally=1 32:07.837 [INFO] TestAgent.server.raft: election won: tally=1 32:07.837 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29713 [Leader]" 32:07.837 [INFO] TestAgent.server: cluster leadership acquired 32:07.838 [INFO] TestAgent.server: New leader elected: payload=Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:07.840 [INFO] TestAgent.server: initializing acls 32:07.842 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 32:07.844 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:07.844 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.845 [INFO] TestAgent.server: initializing acls 32:07.845 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:07.851 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.867 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:07.872 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.872 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:07.872 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:07.872 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:07.872 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:07.872 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-bcd6577b-b23f-0971-79ce-50199002d9e5.dc1 32:07.872 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-bcd6577b-b23f-0971-79ce-50199002d9e5.dc1 area=wan 32:07.872 [INFO] TestAgent.server: Updating LAN server: server="Node-bcd6577b-b23f-0971-79ce-50199002d9e5 (Addr: tcp/127.0.0.1:29713) (DC: dc1)" 32:07.877 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:07.877 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:07.877 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-bcd6577b-b23f-0971-79ce-50199002d9e5.dc1 32:07.877 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-bcd6577b-b23f-0971-79ce-50199002d9e5.dc1 area=wan 32:07.877 [INFO] TestAgent.server: Updating LAN server: server="Node-bcd6577b-b23f-0971-79ce-50199002d9e5 (Addr: tcp/127.0.0.1:29713) (DC: dc1)" 32:07.880 [INFO] TestAgent: Synced node info 32:07.880 [DEBUG] TestAgent: Node info in sync 32:07.904 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:07.956 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:07.956 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:07.956 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:07.956 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:07.956 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:07.956 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:07.956 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:07.976 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:07.976 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:07.985 [INFO] TestAgent.server: federation state anti-entropy synced 32:08.228 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:08.228 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-bcd6577b-b23f-0971-79ce-50199002d9e5 32:08.264 [INFO] TestAgent: Requesting shutdown 32:08.264 [INFO] TestAgent.server: shutting down server 32:08.264 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:08.264 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:08.264 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:08.264 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:08.264 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:08.264 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:08.264 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:08.264 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:08.264 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:08.264 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:08.264 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:08.264 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:08.264 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:08.264 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:08.271 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:08.275Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:08.275Z [INFO] agent.router.manager: shutting down 32:08.275 [INFO] TestAgent: consul server down 32:08.275 [INFO] TestAgent: shutdown complete 32:08.275 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29743 network=tcp 32:08.275 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29743 network=udp 32:08.275 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29737 network=tcp 32:08.776 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.776 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Legacy_Destroy (1.06s) === CONT TestACL_Legacy_UpdateUpsert [WARN] freeport: 10 out of 31 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:07.937Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.937Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:07.952Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:07.952Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:08.045 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8f9171f1-1169-b416-19fe-baaf29ee5728 Address:127.0.0.1:29748}]" 32:08.046 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8f9171f1-1169-b416-19fe-baaf29ee5728.dc1 127.0.0.1 32:08.046 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29748 [Follower]" leader= 32:08.047 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8f9171f1-1169-b416-19fe-baaf29ee5728 127.0.0.1 2021-10-05T16:32:08.047Z [INFO] agent.router: Initializing LAN area manager 32:08.048 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29736 network=udp 32:08.048 [INFO] TestAgent.server: Adding LAN server: server="Node-8f9171f1-1169-b416-19fe-baaf29ee5728 (Addr: tcp/127.0.0.1:29748) (DC: dc1)" 32:08.048 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8f9171f1-1169-b416-19fe-baaf29ee5728.dc1 area=wan 32:08.048 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29736 network=tcp 32:08.049 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29730 network=tcp 32:08.049 [INFO] TestAgent: started state syncer 32:08.049 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29749 network=tcp 32:08.098 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:08.107 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:08.107 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29748 [Candidate]" term=2 32:08.125 [DEBUG] TestAgent.server.raft: votes: needed=1 32:08.125 [DEBUG] TestAgent.server.raft: vote granted: from=8f9171f1-1169-b416-19fe-baaf29ee5728 term=2 tally=1 32:08.125 [INFO] TestAgent.server.raft: election won: tally=1 32:08.125 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29748 [Leader]" 32:08.125 [INFO] TestAgent.server: cluster leadership acquired 32:08.125 [INFO] TestAgent.server: New leader elected: payload=Node-8f9171f1-1169-b416-19fe-baaf29ee5728 32:08.132 [INFO] TestAgent.server: initializing acls 32:08.136 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:08.136 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:08.144 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:08.164 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:08.164 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:08.164 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:08.164 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8f9171f1-1169-b416-19fe-baaf29ee5728 32:08.164 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8f9171f1-1169-b416-19fe-baaf29ee5728.dc1 32:08.165 [INFO] TestAgent.server: Updating LAN server: server="Node-8f9171f1-1169-b416-19fe-baaf29ee5728 (Addr: tcp/127.0.0.1:29748) (DC: dc1)" 32:08.165 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8f9171f1-1169-b416-19fe-baaf29ee5728.dc1 area=wan 32:08.178 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:08.215 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:08.215 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:08.215 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:08.215 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:08.215 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:08.215 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f9171f1-1169-b416-19fe-baaf29ee5728 32:08.215 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8f9171f1-1169-b416-19fe-baaf29ee5728 32:08.223 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f9171f1-1169-b416-19fe-baaf29ee5728 32:08.230 [INFO] TestAgent.server: federation state anti-entropy synced 32:08.281 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:08.289 [INFO] TestAgent: Synced node info 32:08.289 [DEBUG] TestAgent: Node info in sync 32:08.344 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:08.344 [DEBUG] TestAgent: Node info in sync 32:08.384 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8f9171f1-1169-b416-19fe-baaf29ee5728 32:08.384 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-8f9171f1-1169-b416-19fe-baaf29ee5728 32:08.416 [INFO] TestAgent: Requesting shutdown 32:08.416 [INFO] TestAgent.server: shutting down server 32:08.416 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:08.416 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:08.416 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:08.416 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:08.416 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:08.416 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:08.416 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:08.416 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:08.416 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:08.416 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:08.416 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:08.416 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:08.416 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:08.416 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:08.424 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:08.436Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:08.436Z [INFO] agent.router.manager: shutting down 32:08.436 [INFO] TestAgent: consul server down 32:08.436 [INFO] TestAgent: shutdown complete 32:08.436 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29736 network=tcp 32:08.436 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29736 network=udp 32:08.436 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29730 network=tcp 32:08.940 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.940 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Legacy_Clone (1.02s) === CONT TestPreparedQuery_Delete 2021-10-05T16:32:08.018Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:08.057Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:08.144 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:818e7689-26da-a4f9-f658-958765f80de5 Address:127.0.0.1:29755}]" 32:08.144 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29755 [Follower]" leader= 32:08.145 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-818e7689-26da-a4f9-f658-958765f80de5.dc1 127.0.0.1 32:08.150 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-818e7689-26da-a4f9-f658-958765f80de5 127.0.0.1 2021-10-05T16:32:08.150Z [INFO] agent.router: Initializing LAN area manager 32:08.151 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29757 network=udp 32:08.151 [INFO] TestAgent.server: Adding LAN server: server="Node-818e7689-26da-a4f9-f658-958765f80de5 (Addr: tcp/127.0.0.1:29755) (DC: dc1)" 32:08.151 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-818e7689-26da-a4f9-f658-958765f80de5.dc1 area=wan 32:08.151 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29757 network=tcp 32:08.152 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29744 network=tcp 32:08.152 [INFO] TestAgent: started state syncer 32:08.152 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29756 network=tcp 32:08.209 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:08.209 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29755 [Candidate]" term=2 32:08.240 [DEBUG] TestAgent.server.raft: votes: needed=1 32:08.240 [DEBUG] TestAgent.server.raft: vote granted: from=818e7689-26da-a4f9-f658-958765f80de5 term=2 tally=1 32:08.240 [INFO] TestAgent.server.raft: election won: tally=1 32:08.240 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29755 [Leader]" 32:08.240 [INFO] TestAgent.server: cluster leadership acquired 32:08.240 [INFO] TestAgent.server: New leader elected: payload=Node-818e7689-26da-a4f9-f658-958765f80de5 32:08.261 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29755 32:08.280 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:08.302 [INFO] TestAgent: Synced node info 32:08.356 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:08.356 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:08.356 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:08.356 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:08.356 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:08.356 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-818e7689-26da-a4f9-f658-958765f80de5 32:08.357 [INFO] TestAgent.server: member joined, marking health alive: member=Node-818e7689-26da-a4f9-f658-958765f80de5 32:08.374 [INFO] TestAgent.server: federation state anti-entropy synced 32:08.431 [INFO] TestAgent: Requesting shutdown 32:08.431 [INFO] TestAgent.server: shutting down server 32:08.431 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:08.431 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:08.431 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:08.431 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:08.431 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:08.432 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:08.432 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:08.432 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:08.432 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:08.432 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:08.437 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:08.445Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:08.446Z [INFO] agent.router.manager: shutting down 32:08.446 [INFO] TestAgent: consul server down 32:08.446 [INFO] TestAgent: shutdown complete 32:08.446 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29757 network=tcp 32:08.446 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29757 network=udp 32:08.446 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29744 network=tcp 32:08.946 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.946 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_Integration (0.95s) === CONT TestPreparedQuery_Update 2021-10-05T16:32:08.164Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:08.176Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:08.220 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ab950b36-f231-5237-e588-0c8ce728aefc Address:127.0.0.1:29762}]" 32:08.221 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29762 [Follower]" leader= 32:08.221 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ab950b36-f231-5237-e588-0c8ce728aefc.dc1 127.0.0.1 32:08.222 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ab950b36-f231-5237-e588-0c8ce728aefc 127.0.0.1 2021-10-05T16:32:08.222Z [INFO] agent.router: Initializing LAN area manager 32:08.222 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29673 network=udp 32:08.222 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ab950b36-f231-5237-e588-0c8ce728aefc.dc1 area=wan 32:08.223 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29673 network=tcp 32:08.223 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29751 network=tcp 32:08.223 [INFO] TestAgent: started state syncer 32:08.223 [INFO] TestAgent.server: Adding LAN server: server="Node-ab950b36-f231-5237-e588-0c8ce728aefc (Addr: tcp/127.0.0.1:29762) (DC: dc1)" 32:08.223 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29763 network=tcp 32:08.285 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:08.285 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29762 [Candidate]" term=2 32:08.298 [DEBUG] TestAgent.server.raft: votes: needed=1 32:08.298 [DEBUG] TestAgent.server.raft: vote granted: from=ab950b36-f231-5237-e588-0c8ce728aefc term=2 tally=1 32:08.298 [INFO] TestAgent.server.raft: election won: tally=1 32:08.298 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29762 [Leader]" 32:08.298 [INFO] TestAgent.server: cluster leadership acquired 32:08.299 [INFO] TestAgent.server: New leader elected: payload=Node-ab950b36-f231-5237-e588-0c8ce728aefc 32:08.308 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29762 32:08.327 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:08.360 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:08.360 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:08.360 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:08.360 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:08.360 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:08.360 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ab950b36-f231-5237-e588-0c8ce728aefc 32:08.360 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ab950b36-f231-5237-e588-0c8ce728aefc 32:08.377 [INFO] TestAgent.server: federation state anti-entropy synced 32:08.436 [INFO] TestAgent: Requesting shutdown 32:08.436 [INFO] TestAgent.server: shutting down server 32:08.436 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:08.436 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:08.436 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:08.436 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:08.436 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:08.436 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:08.436 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:08.436 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:08.436 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:08.436 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:08.436 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:08.442 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:08.451Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:08.451Z [INFO] agent.router.manager: shutting down 32:08.451 [INFO] TestAgent: consul server down 32:08.451 [INFO] TestAgent: shutdown complete 32:08.451 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29673 network=tcp 32:08.451 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29673 network=udp 32:08.451 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29751 network=tcp 32:08.952 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.952 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecGetSpec (0.80s) === CONT TestKVSEndpoint_DELETE_ConflictingFlags 2021-10-05T16:32:08.151Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:08.151Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:08.183Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:08.183Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:08.261 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:232038f4-31b5-46aa-fe80-0df225aaaa7f Address:127.0.0.1:29706}]" 32:08.261 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29706 [Follower]" leader= 32:08.262 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-232038f4-31b5-46aa-fe80-0df225aaaa7f.dc1 127.0.0.1 32:08.263 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 127.0.0.1 2021-10-05T16:32:08.263Z [INFO] agent.router: Initializing LAN area manager 32:08.263 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29729 network=udp 32:08.263 [INFO] TestAgent.server: Adding LAN server: server="Node-232038f4-31b5-46aa-fe80-0df225aaaa7f (Addr: tcp/127.0.0.1:29706) (DC: dc1)" 32:08.263 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29729 network=tcp 32:08.263 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f.dc1 area=wan 32:08.264 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29758 network=tcp 32:08.264 [INFO] TestAgent: started state syncer 32:08.264 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29707 network=tcp 32:08.297 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:08.297 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29706 [Candidate]" term=2 32:08.312 [DEBUG] TestAgent.server.raft: votes: needed=1 32:08.312 [DEBUG] TestAgent.server.raft: vote granted: from=232038f4-31b5-46aa-fe80-0df225aaaa7f term=2 tally=1 32:08.312 [INFO] TestAgent.server.raft: election won: tally=1 32:08.312 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29706 [Leader]" 32:08.313 [INFO] TestAgent.server: cluster leadership acquired 32:08.313 [INFO] TestAgent.server: New leader elected: payload=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.314 [INFO] TestAgent.server: initializing acls 32:08.322 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:08.322 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:08.323 [INFO] TestAgent.server: initializing acls 32:08.323 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:08.349 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:08.351 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:08.352 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:08.352 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:08.352 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:08.352 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:08.352 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.352 [INFO] TestAgent.server: Updating LAN server: server="Node-232038f4-31b5-46aa-fe80-0df225aaaa7f (Addr: tcp/127.0.0.1:29706) (DC: dc1)" 32:08.352 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-232038f4-31b5-46aa-fe80-0df225aaaa7f.dc1 32:08.352 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.352 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-232038f4-31b5-46aa-fe80-0df225aaaa7f.dc1 32:08.352 [INFO] TestAgent.server: Updating LAN server: server="Node-232038f4-31b5-46aa-fe80-0df225aaaa7f (Addr: tcp/127.0.0.1:29706) (DC: dc1)" 32:08.352 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f.dc1 area=wan 32:08.352 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f.dc1 area=wan 32:08.370 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:08.408 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:08.408 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:08.408 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:08.408 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:08.408 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:08.408 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.408 [INFO] TestAgent.server: member joined, marking health alive: member=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.425 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.425 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.426 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-232038f4-31b5-46aa-fe80-0df225aaaa7f 32:08.432 [INFO] TestAgent.server: federation state anti-entropy synced 32:08.444 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:08.454 [INFO] TestAgent: Synced node info 32:08.454 [DEBUG] TestAgent: Node info in sync 32:08.454 [INFO] TestAgent: Requesting shutdown 32:08.454 [INFO] TestAgent.server: shutting down server 32:08.454 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:08.454 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:08.454 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:08.454 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:08.454 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:08.454 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:08.454 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:08.455 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:08.455 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:08.455 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:08.455 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:08.455 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:08.455 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:08.455 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:08.465 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:08.474Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:08.474Z [INFO] agent.router.manager: shutting down 32:08.474 [INFO] TestAgent: consul server down 32:08.474 [INFO] TestAgent: shutdown complete 32:08.474 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29729 network=tcp 32:08.474 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29729 network=udp 32:08.474 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29758 network=tcp 32:08.976 [INFO] TestAgent: Waiting for endpoints to shut down 32:08.976 [INFO] TestAgent: Endpoints down --- PASS: TestRemoteExecGetSpec_ACLToken (0.85s) === CONT TestACL_Legacy_Update [WARN] freeport: 10 out of 38 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:08.733Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:08.764Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:08.845 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:579ad28a-3123-d5b0-a2c9-940e4f055ef1 Address:127.0.0.1:29741}]" 32:08.846 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-579ad28a-3123-d5b0-a2c9-940e4f055ef1.dc1 127.0.0.1 32:08.846 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29741 [Follower]" leader= 32:08.847 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-579ad28a-3123-d5b0-a2c9-940e4f055ef1 127.0.0.1 2021-10-05T16:32:08.847Z [INFO] agent.router: Initializing LAN area manager 32:08.847 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29764 network=udp 32:08.847 [INFO] TestAgent.server: Adding LAN server: server="Node-579ad28a-3123-d5b0-a2c9-940e4f055ef1 (Addr: tcp/127.0.0.1:29741) (DC: dc1)" 32:08.847 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-579ad28a-3123-d5b0-a2c9-940e4f055ef1.dc1 area=wan 32:08.847 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29764 network=tcp 32:08.848 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29674 network=tcp 32:08.848 [INFO] TestAgent: started state syncer 32:08.848 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29742 network=tcp 32:08.904 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:08.904 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29741 [Candidate]" term=2 32:08.955 [DEBUG] TestAgent.server.raft: votes: needed=1 32:08.955 [DEBUG] TestAgent.server.raft: vote granted: from=579ad28a-3123-d5b0-a2c9-940e4f055ef1 term=2 tally=1 32:08.955 [INFO] TestAgent.server.raft: election won: tally=1 32:08.955 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29741 [Leader]" 32:08.956 [INFO] TestAgent.server: cluster leadership acquired 32:08.956 [INFO] TestAgent.server: New leader elected: payload=Node-579ad28a-3123-d5b0-a2c9-940e4f055ef1 32:08.977 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29741 32:09.028 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.048 [INFO] TestAgent: Requesting shutdown 32:09.048 [INFO] TestAgent.server: shutting down server 32:09.048 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.048 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:09.056 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.068Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.068Z [INFO] agent.router.manager: shutting down 32:09.080 [INFO] TestAgent: consul server down 32:09.080 [INFO] TestAgent: shutdown complete 32:09.080 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29764 network=tcp 32:09.080 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29764 network=udp 32:09.080 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29674 network=tcp 32:09.080 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 32:09.080 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:09.080 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 32:09.580 [INFO] TestAgent: Waiting for endpoints to shut down 32:09.580 [INFO] TestAgent: Endpoints down --- PASS: TestOperator_RaftConfiguration (0.88s) === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{0_0_0_0_0_0_0_0_0_0_0} 2021-10-05T16:32:09.025Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.055Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.124 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e5df06b5-a50a-a754-cae8-f7fc12124ec7 Address:127.0.0.1:29839}]" 32:09.125 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e5df06b5-a50a-a754-cae8-f7fc12124ec7.dc1 127.0.0.1 32:09.125 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e5df06b5-a50a-a754-cae8-f7fc12124ec7 127.0.0.1 2021-10-05T16:32:09.125Z [INFO] agent.router: Initializing LAN area manager 32:09.125 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29750 network=udp 32:09.125 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29839 [Follower]" leader= 32:09.126 [INFO] TestAgent.server: Adding LAN server: server="Node-e5df06b5-a50a-a754-cae8-f7fc12124ec7 (Addr: tcp/127.0.0.1:29839) (DC: dc1)" 32:09.126 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e5df06b5-a50a-a754-cae8-f7fc12124ec7.dc1 area=wan 32:09.126 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29750 network=tcp 32:09.126 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29779 network=tcp 32:09.126 [INFO] TestAgent: started state syncer 32:09.126 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29840 network=tcp 32:09.164 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.164 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29839 [Candidate]" term=2 32:09.198 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.198 [DEBUG] TestAgent.server.raft: vote granted: from=e5df06b5-a50a-a754-cae8-f7fc12124ec7 term=2 tally=1 32:09.198 [INFO] TestAgent.server.raft: election won: tally=1 32:09.198 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29839 [Leader]" 32:09.198 [INFO] TestAgent.server: cluster leadership acquired 32:09.198 [INFO] TestAgent.server: New leader elected: payload=Node-e5df06b5-a50a-a754-cae8-f7fc12124ec7 32:09.232 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29839 32:09.261 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.278 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 32:09.278 [INFO] TestAgent: Requesting shutdown 32:09.278 [INFO] TestAgent.server: shutting down server 32:09.278 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.279 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:09.285 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.298Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.298Z [INFO] agent.router.manager: shutting down 32:09.300 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 32:09.300 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:09.300 [INFO] TestAgent: consul server down 32:09.300 [INFO] TestAgent: shutdown complete 32:09.300 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29750 network=tcp 32:09.300 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29750 network=udp 32:09.300 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29779 network=tcp 32:09.800 [INFO] TestAgent: Waiting for endpoints to shut down 32:09.800 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_Update (0.85s) === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{6_6_6_6_6_6_6_5_6_6_-5} [WARN] freeport: 10 out of 24 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:08.729Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:08.729Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:08.769Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:08.769Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:08.856 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:461e0e0a-d543-8c01-6e2c-05dcfb9818af Address:127.0.0.1:29671}]" 32:08.856 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29671 [Follower]" leader= 32:08.857 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af.dc1 127.0.0.1 32:08.857 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 127.0.0.1 2021-10-05T16:32:08.857Z [INFO] agent.router: Initializing LAN area manager 32:08.857 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29785 network=udp 32:08.858 [INFO] TestAgent.server: Adding LAN server: server="Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af (Addr: tcp/127.0.0.1:29671) (DC: dc1)" 32:08.858 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af.dc1 area=wan 32:08.858 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29785 network=tcp 32:08.858 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29709 network=tcp 32:08.859 [INFO] TestAgent: started state syncer 32:08.859 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29672 network=tcp 32:08.920 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:08.924 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:08.924 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29671 [Candidate]" term=2 32:08.980 [DEBUG] TestAgent.server.raft: votes: needed=1 32:08.980 [DEBUG] TestAgent.server.raft: vote granted: from=461e0e0a-d543-8c01-6e2c-05dcfb9818af term=2 tally=1 32:08.980 [INFO] TestAgent.server.raft: election won: tally=1 32:08.980 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29671 [Leader]" 32:08.984 [INFO] TestAgent.server: cluster leadership acquired 32:08.984 [INFO] TestAgent.server: New leader elected: payload=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.016 [INFO] TestAgent.server: initializing acls 32:09.028 [INFO] TestAgent.server: initializing acls 32:09.040 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:09.040 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:09.056 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:09.056 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:09.092 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:09.112 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:09.112 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:09.112 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:09.112 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.113 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af.dc1 32:09.113 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:09.113 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:09.113 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.113 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af.dc1 32:09.113 [INFO] TestAgent.server: Updating LAN server: server="Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af (Addr: tcp/127.0.0.1:29671) (DC: dc1)" 32:09.113 [INFO] TestAgent.server: Updating LAN server: server="Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af (Addr: tcp/127.0.0.1:29671) (DC: dc1)" 32:09.113 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af.dc1 area=wan 32:09.113 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af.dc1 area=wan 32:09.140 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.168 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:09.168 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:09.168 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:09.168 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:09.168 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:09.168 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.168 [INFO] TestAgent.server: member joined, marking health alive: member=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.176 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.177 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.183 [INFO] TestAgent.server: federation state anti-entropy synced 32:09.238 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:09.247 [INFO] TestAgent: Synced node info 32:09.247 [DEBUG] TestAgent: Node info in sync 32:09.309 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.309 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-461e0e0a-d543-8c01-6e2c-05dcfb9818af 32:09.320 [INFO] TestAgent: Requesting shutdown 32:09.320 [INFO] TestAgent.server: shutting down server 32:09.320 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:09.320 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:09.320 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:09.320 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:09.320 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:09.320 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:09.320 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.320 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:09.320 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:09.320 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:09.320 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:09.320 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:09.320 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:09.320 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:09.332 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.344Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.344Z [INFO] agent.router.manager: shutting down 32:09.344 [INFO] TestAgent: consul server down 32:09.344 [INFO] TestAgent: shutdown complete 32:09.344 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29785 network=tcp 32:09.344 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29785 network=udp 32:09.344 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29709 network=tcp 32:09.847 [INFO] TestAgent: Waiting for endpoints to shut down 32:09.847 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:09.008Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.046Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.120 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:80f88e1b-b70e-43cb-844d-00e0c3db5a80 Address:127.0.0.1:29783}]" 32:09.121 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-80f88e1b-b70e-43cb-844d-00e0c3db5a80.dc1 127.0.0.1 32:09.121 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-80f88e1b-b70e-43cb-844d-00e0c3db5a80 127.0.0.1 2021-10-05T16:32:09.121Z [INFO] agent.router: Initializing LAN area manager 32:09.121 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29778 network=udp 32:09.121 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29783 [Follower]" leader= 32:09.122 [INFO] TestAgent.server: Adding LAN server: server="Node-80f88e1b-b70e-43cb-844d-00e0c3db5a80 (Addr: tcp/127.0.0.1:29783) (DC: dc1)" 32:09.122 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-80f88e1b-b70e-43cb-844d-00e0c3db5a80.dc1 area=wan 32:09.122 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29778 network=tcp 32:09.122 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29765 network=tcp 32:09.122 [INFO] TestAgent: started state syncer 32:09.122 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29784 network=tcp 32:09.175 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.175 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29783 [Candidate]" term=2 32:09.204 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.204 [DEBUG] TestAgent.server.raft: vote granted: from=80f88e1b-b70e-43cb-844d-00e0c3db5a80 term=2 tally=1 32:09.204 [INFO] TestAgent.server.raft: election won: tally=1 32:09.204 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29783 [Leader]" 32:09.205 [INFO] TestAgent.server: cluster leadership acquired 32:09.205 [INFO] TestAgent.server: New leader elected: payload=Node-80f88e1b-b70e-43cb-844d-00e0c3db5a80 32:09.238 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29783 32:09.288 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.308 [WARN] TestAgent.server: endpoint injected; this should only be used for testing 32:09.308 [INFO] TestAgent: Requesting shutdown 32:09.308 [INFO] TestAgent.server: shutting down server 32:09.308 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.308 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:09.320 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.332Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.332Z [INFO] agent.router.manager: shutting down 32:09.342 [INFO] TestAgent: consul server down 32:09.342 [INFO] TestAgent: shutdown complete 32:09.342 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29778 network=tcp 32:09.342 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29778 network=udp 32:09.342 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29765 network=tcp 32:09.343 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 32:09.343 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:09.343 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 32:09.343 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 32:09.343 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 32:09.848 [INFO] TestAgent: Waiting for endpoints to shut down 32:09.848 [INFO] TestAgent: Endpoints down --- PASS: TestPreparedQuery_Delete (0.91s) === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} 2021-10-05T16:32:08.801Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:08.801Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:08.828Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:08.828Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:08.928 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ced2f13c-0306-051e-7660-2c74d1fc2449 Address:127.0.0.1:29790}]" 32:08.929 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ced2f13c-0306-051e-7660-2c74d1fc2449.dc1 127.0.0.1 32:08.929 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ced2f13c-0306-051e-7660-2c74d1fc2449 127.0.0.1 2021-10-05T16:32:08.930Z [INFO] agent.router: Initializing LAN area manager 32:08.930 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29708 network=udp 32:08.930 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29790 [Follower]" leader= 32:08.930 [INFO] TestAgent.server: Adding LAN server: server="Node-ced2f13c-0306-051e-7660-2c74d1fc2449 (Addr: tcp/127.0.0.1:29790) (DC: dc1)" 32:08.930 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ced2f13c-0306-051e-7660-2c74d1fc2449.dc1 area=wan 32:08.931 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29708 network=tcp 32:08.940 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29786 network=tcp 32:08.940 [INFO] TestAgent: started state syncer 32:08.940 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29791 network=tcp 32:08.984 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:09.004 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.004 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29790 [Candidate]" term=2 32:09.055 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.055 [DEBUG] TestAgent.server.raft: vote granted: from=ced2f13c-0306-051e-7660-2c74d1fc2449 term=2 tally=1 32:09.055 [INFO] TestAgent.server.raft: election won: tally=1 32:09.055 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29790 [Leader]" 32:09.056 [INFO] TestAgent.server: cluster leadership acquired 32:09.056 [INFO] TestAgent.server: New leader elected: payload=Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.080 [INFO] TestAgent.server: initializing acls 32:09.084 [INFO] TestAgent.server: initializing acls 32:09.092 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:09.092 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:09.106 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:09.106 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:09.133 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:09.134 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:09.145 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:09.145 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:09.145 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:09.146 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.146 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ced2f13c-0306-051e-7660-2c74d1fc2449.dc1 32:09.146 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:09.146 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 32:09.147 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.147 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ced2f13c-0306-051e-7660-2c74d1fc2449.dc1 32:09.147 [INFO] TestAgent.server: Updating LAN server: server="Node-ced2f13c-0306-051e-7660-2c74d1fc2449 (Addr: tcp/127.0.0.1:29790) (DC: dc1)" 32:09.147 [INFO] TestAgent.server: Updating LAN server: server="Node-ced2f13c-0306-051e-7660-2c74d1fc2449 (Addr: tcp/127.0.0.1:29790) (DC: dc1)" 32:09.147 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ced2f13c-0306-051e-7660-2c74d1fc2449.dc1 area=wan 32:09.147 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ced2f13c-0306-051e-7660-2c74d1fc2449.dc1 area=wan 32:09.163 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.192 [INFO] TestAgent: Synced node info 32:09.192 [DEBUG] TestAgent: Node info in sync 32:09.192 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:09.192 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:09.192 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:09.192 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:09.192 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:09.192 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.192 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.202 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.202 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.207 [INFO] TestAgent.server: federation state anti-entropy synced 32:09.320 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.320 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-ced2f13c-0306-051e-7660-2c74d1fc2449 32:09.332 [INFO] TestAgent: Requesting shutdown 32:09.332 [INFO] TestAgent.server: shutting down server 32:09.332 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:09.332 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:09.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:09.332 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:09.332 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:09.332 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:09.332 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:09.332 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:09.332 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.332 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:09.332 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:09.332 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:09.332 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:09.332 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:09.343 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.352Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.352Z [INFO] agent.router.manager: shutting down 32:09.352 [INFO] TestAgent: consul server down 32:09.352 [INFO] TestAgent: shutdown complete 32:09.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29708 network=tcp 32:09.352 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29708 network=udp 32:09.352 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29786 network=tcp 32:09.853 [INFO] TestAgent: Waiting for endpoints to shut down 32:09.853 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Legacy_UpdateUpsert (1.08s) === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} --- PASS: TestACL_Legacy_Get (2.00s) --- PASS: TestACL_Legacy_Get/wrong_id (0.84s) --- PASS: TestACL_Legacy_Get/right_id (1.16s) === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} 2021-10-05T16:32:09.005Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.051Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.135 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d447744d-30ed-f8d8-f095-53557f56407b Address:127.0.0.1:29825}]" 32:09.135 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d447744d-30ed-f8d8-f095-53557f56407b.dc1 127.0.0.1 32:09.136 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29825 [Follower]" leader= 32:09.136 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d447744d-30ed-f8d8-f095-53557f56407b 127.0.0.1 2021-10-05T16:32:09.136Z [INFO] agent.router: Initializing LAN area manager 32:09.137 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29820 network=udp 32:09.137 [INFO] TestAgent.server: Adding LAN server: server="Node-d447744d-30ed-f8d8-f095-53557f56407b (Addr: tcp/127.0.0.1:29825) (DC: dc1)" 32:09.137 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d447744d-30ed-f8d8-f095-53557f56407b.dc1 area=wan 32:09.137 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29820 network=tcp 32:09.137 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29821 network=tcp 32:09.138 [INFO] TestAgent: started state syncer 32:09.138 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29826 network=tcp 32:09.198 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.198 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29825 [Candidate]" term=2 32:09.218 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.218 [DEBUG] TestAgent.server.raft: vote granted: from=d447744d-30ed-f8d8-f095-53557f56407b term=2 tally=1 32:09.218 [INFO] TestAgent.server.raft: election won: tally=1 32:09.218 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29825 [Leader]" 32:09.218 [INFO] TestAgent.server: cluster leadership acquired 32:09.218 [INFO] TestAgent.server: New leader elected: payload=Node-d447744d-30ed-f8d8-f095-53557f56407b 32:09.228 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29825 32:09.288 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.345 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:09.345 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:09.345 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:09.345 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:09.345 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:09.345 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d447744d-30ed-f8d8-f095-53557f56407b 32:09.345 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d447744d-30ed-f8d8-f095-53557f56407b 32:09.372 [INFO] TestAgent.server: federation state anti-entropy synced 32:09.376 [INFO] TestAgent: Requesting shutdown 32:09.376 [INFO] TestAgent.server: shutting down server 32:09.376 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:09.376 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:09.376 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:09.376 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:09.376 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.376 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:09.376 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:09.376 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:09.376 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:09.376 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:09.376 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:09.388 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.400Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.400Z [INFO] agent.router.manager: shutting down 32:09.400 [INFO] TestAgent: consul server down 32:09.400 [INFO] TestAgent: shutdown complete 32:09.400 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29820 network=tcp 32:09.400 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29820 network=udp 32:09.400 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29821 network=tcp 32:09.900 [INFO] TestAgent: Waiting for endpoints to shut down 32:09.900 [INFO] TestAgent: Endpoints down --- PASS: TestKVSEndpoint_DELETE_ConflictingFlags (0.95s) === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} 2021-10-05T16:32:09.021Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:09.021Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.041Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:32:09.041Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.107 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 Address:127.0.0.1:29818}]" 32:09.107 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2.dc1 127.0.0.1 32:09.108 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29818 [Follower]" leader= 32:09.108 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 127.0.0.1 2021-10-05T16:32:09.108Z [INFO] agent.router: Initializing LAN area manager 32:09.108 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29813 network=udp 32:09.108 [INFO] TestAgent.server: Adding LAN server: server="Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 (Addr: tcp/127.0.0.1:29818) (DC: dc1)" 32:09.108 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2.dc1 area=wan 32:09.108 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29813 network=tcp 32:09.109 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29814 network=tcp 32:09.109 [INFO] TestAgent: started state syncer 32:09.109 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29819 network=tcp 32:09.158 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 32:09.171 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.171 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29818 [Candidate]" term=2 32:09.186 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.186 [DEBUG] TestAgent.server.raft: vote granted: from=0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 term=2 tally=1 32:09.186 [INFO] TestAgent.server.raft: election won: tally=1 32:09.186 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29818 [Leader]" 32:09.186 [INFO] TestAgent.server: cluster leadership acquired 32:09.186 [INFO] TestAgent.server: New leader elected: payload=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 32:09.187 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 32:09.196 [INFO] TestAgent.server: initializing acls 32:09.201 [INFO] TestAgent.server: Created ACL 'global-management' policy 32:09.201 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 32:09.212 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 32:09.224 [INFO] TestAgent.server: Created ACL anonymous token from configuration 32:09.224 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 32:09.224 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 32:09.224 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 32:09.224 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2.dc1 32:09.224 [INFO] TestAgent.server: Updating LAN server: server="Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 (Addr: tcp/127.0.0.1:29818) (DC: dc1)" 32:09.224 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2.dc1 area=wan 32:09.260 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.303 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:09.303 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:09.303 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:09.303 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:09.303 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:09.304 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 32:09.304 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 32:09.314 [INFO] TestAgent.server: federation state anti-entropy synced 32:09.327 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 32:09.480 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 32:09.480 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-0682fda9-f8c3-cdd3-439e-fe47bfec3ef2 32:09.524 [INFO] TestAgent: Requesting shutdown 32:09.524 [INFO] TestAgent.server: shutting down server 32:09.524 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:09.524 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:09.524 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:09.524 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:09.524 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:09.524 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:09.524 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.524 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:09.524 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:09.524 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:09.524 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:09.524 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:09.524 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:09.524 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:09.530 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.538Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.538Z [INFO] agent.router.manager: shutting down 32:09.538 [INFO] TestAgent: consul server down 32:09.538 [INFO] TestAgent: shutdown complete 32:09.538 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29813 network=tcp 32:09.538 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29813 network=udp 32:09.538 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29814 network=tcp 32:10.038 [INFO] TestAgent: Waiting for endpoints to shut down 32:10.038 [INFO] TestAgent: Endpoints down --- PASS: TestACL_Legacy_Update (1.06s) === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} [WARN] freeport: 10 out of 45 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:59.045Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:59.045Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:59.080Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:31:59.080Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:59.156 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:72f1e40f-8238-5d7a-d13a-113a42c0f84a Address:127.0.0.1:30392}]" 31:59.156 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30392 [Follower]" leader= 31:59.160 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 127.0.0.1 31:59.161 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 127.0.0.1 2021-10-05T16:31:59.161Z [INFO] agent.router: Initializing LAN area manager 31:59.161 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30401 network=udp 31:59.161 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 area=wan 31:59.161 [INFO] TestAgent.server: Adding LAN server: server="Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a (Addr: tcp/127.0.0.1:30392) (DC: dc1)" 31:59.161 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30401 network=tcp 31:59.162 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30402 network=tcp 31:59.162 [INFO] TestAgent: started state syncer 31:59.162 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30372 network=tcp 31:59.211 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:59.216 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:59.216 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30392 [Candidate]" term=2 31:59.260 [DEBUG] TestAgent.server.raft: votes: needed=1 31:59.260 [DEBUG] TestAgent.server.raft: vote granted: from=72f1e40f-8238-5d7a-d13a-113a42c0f84a term=2 tally=1 31:59.261 [INFO] TestAgent.server.raft: election won: tally=1 31:59.261 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30392 [Leader]" 31:59.264 [INFO] TestAgent.server: cluster leadership acquired 31:59.264 [INFO] TestAgent.server: New leader elected: payload=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.286 [INFO] TestAgent.server: initializing acls 31:59.290 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:59.290 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:59.297 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:59.314 [INFO] TestAgent.server: initializing acls 31:59.314 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:59.330 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:59.330 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:59.330 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:59.330 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.330 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 31:59.330 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 area=wan 31:59.331 [INFO] TestAgent.server: Updating LAN server: server="Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a (Addr: tcp/127.0.0.1:30392) (DC: dc1)" 31:59.345 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:59.345 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:59.345 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.346 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 31:59.346 [INFO] TestAgent.server: Updating LAN server: server="Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a (Addr: tcp/127.0.0.1:30392) (DC: dc1)" 31:59.346 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 area=wan 31:59.377 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.428 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.428 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:59.428 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:59.428 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:59.428 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:59.428 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.428 [INFO] TestAgent.server: member joined, marking health alive: member=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.432 [INFO] TestAgent.server: federation state anti-entropy synced 31:59.448 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.448 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.470 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.470 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 31:59.508 [INFO] TestAgent.server: server starting leave 31:59.508 [INFO] TestAgent.server.serf.wan: serf: EventMemberLeave: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 127.0.0.1 31:59.508 [INFO] TestAgent.server: Handled event for server in area: event=member-leave server=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a.dc1 area=wan 2021-10-05T16:31:59.508Z [INFO] agent.router.manager: shutting down 31:59.543 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:59.552 [INFO] TestAgent: Synced node info 32:01.538 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:01.538 [DEBUG] TestAgent: Node info in sync 32:01.538 [DEBUG] TestAgent: Node info in sync 32:02.508 [INFO] TestAgent.server.serf.lan: serf: EventMemberLeave: Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 127.0.0.1 32:02.508 [INFO] TestAgent.server: Removing LAN server: server="Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a (Addr: tcp/127.0.0.1:30392) (DC: dc1)" 32:02.508 [WARN] TestAgent.server: deregistering self should be done by follower: name=Node-72f1e40f-8238-5d7a-d13a-113a42c0f84a 32:03.355 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 32:05.354 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 32:05.512 [INFO] TestAgent.server: Waiting to drain RPC traffic: drain_time=5s 32:07.354 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 32:09.355 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 32:09.356 [ERROR] TestAgent.server.autopilot: Error promoting servers: error="error getting server raft protocol versions: No servers found" 32:10.512 [INFO] TestAgent: Requesting shutdown 32:10.512 [INFO] TestAgent.server: shutting down server 32:10.512 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:10.512 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 32:10.512 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 32:10.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:10.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:10.512 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:10.512 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:10.512 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:10.512 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:10.512 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 32:10.512 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 32:10.512 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:10.512 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 2021-10-05T16:32:10.532Z [INFO] agent.router.manager: shutting down 32:10.532 [INFO] TestAgent: consul server down 32:10.532 [INFO] TestAgent: shutdown complete 32:10.532 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30401 network=tcp 32:10.532 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30401 network=udp 32:10.532 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30402 network=tcp 32:11.033 [INFO] TestAgent: Waiting for endpoints to shut down 32:11.033 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_Leave_ACLDeny (12.02s) --- PASS: TestAgent_Leave_ACLDeny/no_token (0.00s) --- PASS: TestAgent_Leave_ACLDeny/read-only_token (0.03s) --- PASS: TestAgent_Leave_ACLDeny/agent_master_token (11.02s) === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:09.593Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.610Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.665 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:435df1fc-d44d-76f6-9450-876cbad61828 Address:127.0.0.1:29797}]" 32:09.666 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:09.666 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:09.666Z [INFO] agent.router: Initializing LAN area manager 32:09.667 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29827 network=udp 32:09.667 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29797 [Follower]" leader= 32:09.667 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29797) (DC: dc1)" 32:09.667 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:09.667 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29827 network=tcp 32:09.668 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29828 network=tcp 32:09.668 [INFO] TestAgent: started state syncer 32:09.668 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29798 network=tcp 32:09.710 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.710 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29797 [Candidate]" term=2 32:09.727 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.727 [DEBUG] TestAgent.server.raft: vote granted: from=435df1fc-d44d-76f6-9450-876cbad61828 term=2 tally=1 32:09.727 [INFO] TestAgent.server.raft: election won: tally=1 32:09.727 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29797 [Leader]" 32:09.728 [INFO] TestAgent.server: cluster leadership acquired 32:09.729 [INFO] TestAgent.server: New leader elected: payload=test-node 32:09.758 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29797 32:09.769 [INFO] TestAgent: Synced node info 32:09.769 [DEBUG] TestAgent: Node info in sync 32:09.828 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.888 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:09.888 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:09.888 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:09.888 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:09.888 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:09.888 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:09.888 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:09.949 [INFO] TestAgent.server: federation state anti-entropy synced 32:11.217 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.333058ms client=127.0.0.1:49790 client_network=udp 32:11.219 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.03074ms client=127.0.0.1:48581 client_network=udp 32:11.225 [DEBUG] TestAgent.dns: request served from client: name=e9417644-4402-1eee-2351-e49b722d86f0.query.consul. type=A class=IN latency=1.169031ms client=127.0.0.1:48806 client_network=udp 32:11.228 [INFO] TestAgent: Requesting shutdown 32:11.228 [INFO] TestAgent.server: shutting down server 32:11.228 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:11.228 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:11.228 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:11.228 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:11.228 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:11.228 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:11.228 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:11.228 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:11.228 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:11.228 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:11.240 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:11.248Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:11.248Z [INFO] agent.router.manager: shutting down 32:11.248 [INFO] TestAgent: consul server down 32:11.248 [INFO] TestAgent: shutdown complete 32:11.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29827 network=tcp 32:11.248 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29827 network=udp 32:11.248 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29828 network=tcp 32:11.748 [INFO] TestAgent: Waiting for endpoints to shut down 32:11.748 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{9_9_8_8_6_8_8_5_8_8_-5} [WARN] freeport: 10 out of 17 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 10 out of 10 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:09.874Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.889Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.954 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8a181f1a-2ff9-617e-2090-1aae51266786 Address:127.0.0.1:29811}]" 32:09.955 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:09.955 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29811 [Follower]" leader= 32:09.955 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:09.955Z [INFO] agent.router: Initializing LAN area manager 32:09.955 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29806 network=udp 32:09.956 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29811) (DC: dc1)" 32:09.956 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:09.956 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29806 network=tcp 32:09.956 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29807 network=tcp 32:09.956 [INFO] TestAgent: started state syncer 32:09.956 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29812 network=tcp 32:10.020 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:10.020 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29811 [Candidate]" term=2 32:10.041 [DEBUG] TestAgent.server.raft: votes: needed=1 32:10.041 [DEBUG] TestAgent.server.raft: vote granted: from=8a181f1a-2ff9-617e-2090-1aae51266786 term=2 tally=1 32:10.041 [INFO] TestAgent.server.raft: election won: tally=1 32:10.041 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29811 [Leader]" 32:10.041 [INFO] TestAgent.server: cluster leadership acquired 32:10.041 [INFO] TestAgent.server: New leader elected: payload=test-node 32:10.058 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29811 32:10.101 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:10.168 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:10.168 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:10.168 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:10.168 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:10.168 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:10.168 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:10.168 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:10.204 [INFO] TestAgent.server: federation state anti-entropy synced 32:10.204 [INFO] TestAgent: Synced node info 32:11.232 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:11.232 [DEBUG] TestAgent: Node info in sync 32:11.232 [DEBUG] TestAgent: Node info in sync 32:11.611 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.043441ms client=127.0.0.1:53527 client_network=udp 32:11.617 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.395899ms client=127.0.0.1:38375 client_network=udp 32:11.619 [DEBUG] TestAgent.dns: request served from client: name=f4643f1a-530b-0154-7e95-634304823ed1.query.consul. type=A class=IN latency=1.266307ms client=127.0.0.1:60357 client_network=udp 32:11.619 [INFO] TestAgent: Requesting shutdown 32:11.619 [INFO] TestAgent.server: shutting down server 32:11.619 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:11.619 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:11.619 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:11.619 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:11.619 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:11.619 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:11.619 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:11.619 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:11.619 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:11.619 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:11.628 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:11.633Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:11.633Z [INFO] agent.router.manager: shutting down 32:11.633 [INFO] TestAgent: consul server down 32:11.633 [INFO] TestAgent: shutdown complete 32:11.633 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29806 network=tcp 32:11.633 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29806 network=udp 32:11.633 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29807 network=tcp 32:12.136 [INFO] TestAgent: Waiting for endpoints to shut down 32:12.136 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{9_9_8_8_6_8_8_5_8_8_-5} 2021-10-05T16:32:10.080Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:10.104Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:10.180 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:acd0c60f-0b7b-302e-da0f-8c1e269bbe98 Address:127.0.0.1:29888}]" 32:10.181 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:10.181 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:10.181Z [INFO] agent.router: Initializing LAN area manager 32:10.182 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29841 network=udp 32:10.182 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29888 [Follower]" leader= 32:10.182 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29888) (DC: dc1)" 32:10.182 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:10.182 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29841 network=tcp 32:10.183 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29884 network=tcp 32:10.183 [INFO] TestAgent: started state syncer 32:10.183 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29889 network=tcp 32:10.252 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:10.252 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29888 [Candidate]" term=2 32:10.292 [DEBUG] TestAgent.server.raft: votes: needed=1 32:10.292 [DEBUG] TestAgent.server.raft: vote granted: from=acd0c60f-0b7b-302e-da0f-8c1e269bbe98 term=2 tally=1 32:10.292 [INFO] TestAgent.server.raft: election won: tally=1 32:10.292 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29888 [Leader]" 32:10.292 [INFO] TestAgent.server: cluster leadership acquired 32:10.292 [INFO] TestAgent.server: New leader elected: payload=test-node 32:10.300 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29888 32:10.323 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:10.389 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:10.389 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:10.389 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:10.389 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:10.389 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:10.389 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:10.389 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:10.417 [INFO] TestAgent.server: federation state anti-entropy synced 32:10.488 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:10.511 [INFO] TestAgent: Synced node info 32:10.511 [DEBUG] TestAgent: Node info in sync 32:10.816 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:10.816 [DEBUG] TestAgent: Node info in sync 32:11.653 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.242055ms client=127.0.0.1:58647 client_network=udp 32:11.655 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.07404ms client=127.0.0.1:41831 client_network=udp 32:11.659 [DEBUG] TestAgent.dns: request served from client: name=6adac4ef-b8df-28c5-f149-bf1060361d50.query.consul. type=AAAA class=IN latency=3.583158ms client=127.0.0.1:46248 client_network=udp 32:11.659 [INFO] TestAgent: Requesting shutdown 32:11.659 [INFO] TestAgent.server: shutting down server 32:11.659 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:11.659 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:11.659 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:11.659 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:11.659 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:11.659 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:11.659 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:11.659 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:11.659 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:11.659 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:11.667 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:11.667Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:11.667Z [INFO] agent.router.manager: shutting down 32:11.667 [INFO] TestAgent: consul server down 32:11.667 [INFO] TestAgent: shutdown complete 32:11.667 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29841 network=tcp 32:11.667 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29841 network=udp 32:11.667 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29884 network=tcp 32:12.167 [INFO] TestAgent: Waiting for endpoints to shut down 32:12.167 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{9_9_8_8_6_8_8_5_8_8_-5} 2021-10-05T16:32:09.929Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.946Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:10.000 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:44ef99ee-8f13-4dff-fc27-a868c4c400dc Address:127.0.0.1:29650}]" 32:10.001 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:10.001 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:10.002Z [INFO] agent.router: Initializing LAN area manager 32:10.002 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29855 network=udp 32:10.002 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29650 [Follower]" leader= 32:10.002 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:10.002 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29650) (DC: dc1)" 32:10.002 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29855 network=tcp 32:10.003 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29660 network=tcp 32:10.003 [INFO] TestAgent: started state syncer 32:10.003 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29651 network=tcp 32:10.043 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:10.043 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29650 [Candidate]" term=2 32:10.064 [DEBUG] TestAgent.server.raft: votes: needed=1 32:10.064 [DEBUG] TestAgent.server.raft: vote granted: from=44ef99ee-8f13-4dff-fc27-a868c4c400dc term=2 tally=1 32:10.064 [INFO] TestAgent.server.raft: election won: tally=1 32:10.064 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29650 [Leader]" 32:10.064 [INFO] TestAgent.server: cluster leadership acquired 32:10.064 [INFO] TestAgent.server: New leader elected: payload=test-node 32:10.090 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29650 32:10.133 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:10.184 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:10.184 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:10.184 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:10.184 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:10.184 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:10.184 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:10.184 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:10.217 [INFO] TestAgent: Synced node info 32:10.234 [INFO] TestAgent.server: federation state anti-entropy synced 32:10.538 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:10.538 [DEBUG] TestAgent: Node info in sync 32:10.538 [DEBUG] TestAgent: Node info in sync 32:11.682 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.702217ms client=127.0.0.1:41722 client_network=udp 32:11.684 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.609524ms client=127.0.0.1:44058 client_network=udp 32:11.687 [DEBUG] TestAgent.dns: request served from client: name=3b2bf2e8-ade3-1aa3-a0dd-ab15a6d7990d.query.consul. type=ANY class=IN latency=2.134685ms client=127.0.0.1:38729 client_network=udp 32:11.687 [INFO] TestAgent: Requesting shutdown 32:11.687 [INFO] TestAgent.server: shutting down server 32:11.687 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:11.687 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:11.687 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:11.687 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:11.687 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:11.687 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:11.687 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:11.687 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:11.687 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:11.687 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:11.694 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:11.694Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:11.694Z [INFO] agent.router.manager: shutting down 32:11.695 [INFO] TestAgent: consul server down 32:11.695 [INFO] TestAgent: shutdown complete 32:11.695 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29855 network=tcp 32:11.695 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29855 network=udp 32:11.695 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29660 network=tcp 32:12.195 [INFO] TestAgent: Waiting for endpoints to shut down 32:12.195 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{8_8_8_8_6_8_8_5_8_8_-5} 2021-10-05T16:32:09.871Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.887Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.986 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:938a4845-9f08-a28c-a826-8feae8d9ca9b Address:127.0.0.1:29769}]" 32:09.986 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29769 [Follower]" leader= 32:09.987 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:09.987 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:09.987Z [INFO] agent.router: Initializing LAN area manager 32:09.988 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29792 network=udp 32:09.988 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29769) (DC: dc1)" 32:09.988 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:09.988 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29792 network=tcp 32:09.988 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29835 network=tcp 32:09.988 [INFO] TestAgent: started state syncer 32:09.988 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29770 network=tcp 32:10.035 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:10.035 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29769 [Candidate]" term=2 32:10.056 [DEBUG] TestAgent.server.raft: votes: needed=1 32:10.056 [DEBUG] TestAgent.server.raft: vote granted: from=938a4845-9f08-a28c-a826-8feae8d9ca9b term=2 tally=1 32:10.056 [INFO] TestAgent.server.raft: election won: tally=1 32:10.056 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29769 [Leader]" 32:10.057 [INFO] TestAgent.server: cluster leadership acquired 32:10.057 [INFO] TestAgent.server: New leader elected: payload=test-node 32:10.076 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29769 32:10.124 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:10.184 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:10.184 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:10.184 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:10.184 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:10.184 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:10.184 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:10.184 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:10.212 [INFO] TestAgent.server: federation state anti-entropy synced 32:10.216 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:10.235 [INFO] TestAgent: Synced node info 32:10.918 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:10.918 [DEBUG] TestAgent: Node info in sync 32:10.918 [DEBUG] TestAgent: Node info in sync 32:11.720 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.633738ms client=127.0.0.1:49042 client_network=udp 32:11.723 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.801938ms client=127.0.0.1:49642 client_network=udp 32:11.725 [DEBUG] TestAgent.dns: request served from client: name=04a9419d-5744-f194-deb3-893e80d0fe34.query.consul. type=ANY class=IN latency=2.420013ms client=127.0.0.1:46032 client_network=udp 32:11.726 [INFO] TestAgent: Requesting shutdown 32:11.726 [INFO] TestAgent.server: shutting down server 32:11.726 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:11.726 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:11.726 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:11.726 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:11.726 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:11.726 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:11.726 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:11.726 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:11.726 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:11.726 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:11.736 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:11.739Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:11.739Z [INFO] agent.router.manager: shutting down 32:11.739 [INFO] TestAgent: consul server down 32:11.739 [INFO] TestAgent: shutdown complete 32:11.739 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29792 network=tcp 32:11.739 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29792 network=udp 32:11.739 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29835 network=tcp 32:12.241 [INFO] TestAgent: Waiting for endpoints to shut down 32:12.241 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{8_8_8_8_6_8_8_5_8_8_-5} 2021-10-05T16:32:09.869Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.886Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.966 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ebdec16b-61fe-0466-e1fc-9df672542fd6 Address:127.0.0.1:29804}]" 32:09.966 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29804 [Follower]" leader= 32:09.967 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:09.967 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:09.967Z [INFO] agent.router: Initializing LAN area manager 32:09.968 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29804) (DC: dc1)" 32:09.968 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:09.968 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29799 network=udp 32:09.968 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29799 network=tcp 32:09.968 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29793 network=tcp 32:09.968 [INFO] TestAgent: started state syncer 32:09.968 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29805 network=tcp 32:10.021 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:10.021 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29804 [Candidate]" term=2 32:10.040 [DEBUG] TestAgent.server.raft: votes: needed=1 32:10.040 [DEBUG] TestAgent.server.raft: vote granted: from=ebdec16b-61fe-0466-e1fc-9df672542fd6 term=2 tally=1 32:10.041 [INFO] TestAgent.server.raft: election won: tally=1 32:10.041 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29804 [Leader]" 32:10.041 [INFO] TestAgent.server: cluster leadership acquired 32:10.041 [INFO] TestAgent.server: New leader elected: payload=test-node 32:10.058 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29804 32:10.100 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:10.156 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:10.156 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:10.156 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:10.156 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:10.156 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:10.156 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:10.156 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:10.180 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:10.185 [INFO] TestAgent.server: federation state anti-entropy synced 32:10.198 [INFO] TestAgent: Synced node info 32:11.789 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.425113ms client=127.0.0.1:39495 client_network=udp 32:11.802 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.387482ms client=127.0.0.1:51549 client_network=udp 32:11.804 [DEBUG] TestAgent.dns: request served from client: name=b0d0bc6a-65e9-3913-d4a1-4ca8a878ae7b.query.consul. type=AAAA class=IN latency=1.054105ms client=127.0.0.1:59924 client_network=udp 32:11.804 [INFO] TestAgent: Requesting shutdown 32:11.804 [INFO] TestAgent.server: shutting down server 32:11.804 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:11.804 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:11.804 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:11.804 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:11.804 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:11.804 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:11.804 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:11.804 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:11.804 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:11.805 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:11.810 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:11.811Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:11.811Z [INFO] agent.router.manager: shutting down 32:11.811 [INFO] TestAgent: consul server down 32:11.811 [INFO] TestAgent: shutdown complete 32:11.811 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29799 network=tcp 32:11.811 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29799 network=udp 32:11.811 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29793 network=tcp 32:12.312 [INFO] TestAgent: Waiting for endpoints to shut down 32:12.312 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{8_8_8_8_6_8_8_5_8_8_-5} 2021-10-05T16:32:09.849Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.873Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.961 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8955620f-91be-d49f-2706-0fda4e8af10d Address:127.0.0.1:29832}]" 32:09.961 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29832 [Follower]" leader= 32:09.964 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:09.965 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:09.965Z [INFO] agent.router: Initializing LAN area manager 32:09.965 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29834 network=udp 32:09.965 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29832) (DC: dc1)" 32:09.965 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:09.965 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29834 network=tcp 32:09.966 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29800 network=tcp 32:09.966 [INFO] TestAgent: started state syncer 32:09.966 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29833 network=tcp 32:10.014 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:10.014 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29832 [Candidate]" term=2 32:10.036 [DEBUG] TestAgent.server.raft: votes: needed=1 32:10.036 [DEBUG] TestAgent.server.raft: vote granted: from=8955620f-91be-d49f-2706-0fda4e8af10d term=2 tally=1 32:10.036 [INFO] TestAgent.server.raft: election won: tally=1 32:10.036 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29832 [Leader]" 32:10.036 [INFO] TestAgent.server: cluster leadership acquired 32:10.036 [INFO] TestAgent.server: New leader elected: payload=test-node 32:10.054 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29832 32:10.088 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:10.152 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:10.152 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:10.152 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:10.152 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:10.152 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:10.152 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:10.152 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:10.188 [INFO] TestAgent.server: federation state anti-entropy synced 32:10.300 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:10.318 [INFO] TestAgent: Synced node info 32:10.318 [DEBUG] TestAgent: Node info in sync 32:11.802 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.218891ms client=127.0.0.1:58838 client_network=udp 32:11.804 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=986.331µs client=127.0.0.1:52722 client_network=udp 32:11.806 [DEBUG] TestAgent.dns: request served from client: name=a139e3ae-81f6-108e-bb8c-173eb6291863.query.consul. type=A class=IN latency=1.479758ms client=127.0.0.1:52264 client_network=udp 32:11.808 [INFO] TestAgent: Requesting shutdown 32:11.808 [INFO] TestAgent.server: shutting down server 32:11.808 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:11.808 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:11.808 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:11.808 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:11.808 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:11.808 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:11.808 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:11.808 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:11.808 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:11.808 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:11.814 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:11.815Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:11.815Z [INFO] agent.router.manager: shutting down 32:11.815 [INFO] TestAgent: consul server down 32:11.815 [INFO] TestAgent: shutdown complete 32:11.815 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29834 network=tcp 32:11.815 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29834 network=udp 32:11.815 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29800 network=tcp 32:12.316 [INFO] TestAgent: Waiting for endpoints to shut down 32:12.316 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{7_7_7_7_6_7_7_5_7_7_-5} [WARN] freeport: 4 out of 52 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:58.809Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.853Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.906 [INFO] Agent2.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:af776d73-a83f-1d79-6f88-a8045824d8e4 Address:127.0.0.1:30343}]" 31:58.906 [INFO] Agent2.server.raft: entering follower state: follower="Node at 127.0.0.1:30343 [Follower]" leader= 31:58.907 [INFO] Agent2.server.serf.wan: serf: EventMemberJoin: Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 127.0.0.1 31:58.907 [INFO] Agent2.server.serf.lan: serf: EventMemberJoin: Node-af776d73-a83f-1d79-6f88-a8045824d8e4 127.0.0.1 2021-10-05T16:31:58.907Z [INFO] agent.router: Initializing LAN area manager 31:58.907 [INFO] Agent2: Started DNS server: address=127.0.0.1:30324 network=udp 31:58.908 [INFO] Agent2.server: Adding LAN server: server="Node-af776d73-a83f-1d79-6f88-a8045824d8e4 (Addr: tcp/127.0.0.1:30343) (DC: dc1)" 31:58.908 [INFO] Agent2.server: Handled event for server in area: event=member-join server=Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 area=wan 31:58.908 [INFO] Agent2: Started DNS server: address=127.0.0.1:30324 network=tcp 31:58.908 [INFO] Agent2: Started HTTP server: address=127.0.0.1:30325 network=tcp 31:58.908 [INFO] Agent2: started state syncer 31:58.908 [INFO] Agent2: Started gRPC server: address=127.0.0.1:30400 network=tcp 31:58.965 [WARN] Agent2.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.965 [INFO] Agent2.server.raft: entering candidate state: node="Node at 127.0.0.1:30343 [Candidate]" term=2 31:58.993 [DEBUG] Agent2.server.raft: votes: needed=1 31:58.993 [DEBUG] Agent2.server.raft: vote granted: from=af776d73-a83f-1d79-6f88-a8045824d8e4 term=2 tally=1 31:58.993 [INFO] Agent2.server.raft: election won: tally=1 31:58.993 [INFO] Agent2.server.raft: entering leader state: leader="Node at 127.0.0.1:30343 [Leader]" 31:58.993 [INFO] Agent2.server: cluster leadership acquired 31:58.993 [INFO] Agent2.server: New leader elected: payload=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 31:59.032 [DEBUG] Agent2.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30343 31:59.059 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:59.122 [INFO] Agent2: Synced node info 31:59.144 [INFO] Agent2.server.connect: initialized primary datacenter CA with provider: provider=consul 31:59.144 [INFO] Agent2.leader: started routine: routine="federation state anti-entropy" 31:59.144 [INFO] Agent2.leader: started routine: routine="federation state pruning" 31:59.144 [INFO] Agent2.leader: started routine: routine="intermediate cert renew watch" 31:59.144 [INFO] Agent2.leader: started routine: routine="CA root pruning" 31:59.144 [DEBUG] Agent2.server: Skipping self join check for node since the cluster is too small: node=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 31:59.144 [INFO] Agent2.server: member joined, marking health alive: member=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 31:59.167 [INFO] Agent2.server: federation state anti-entropy synced 31:59.317 [DEBUG] Agent2.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:44506 31:59.318 [INFO] Agent2.server.serf.lan: serf: EventMemberJoin: Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 127.0.0.1 31:59.318 [INFO] Agent2.server: Adding LAN server: server="Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d (Addr: tcp/127.0.0.1:30308) (DC: dc1)" 31:59.318 [INFO] Agent2.server: New leader elected: payload=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 31:59.318 [ERROR] Agent2.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d other=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 31:59.318 [INFO] Agent2.server: member joined, marking health alive: member=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 31:59.318 [INFO] Agent2: Requesting shutdown 31:59.318 [INFO] Agent2.server: shutting down server 31:59.318 [DEBUG] Agent2.leader: stopping routine: routine="CA root pruning" 31:59.318 [DEBUG] Agent2.leader: stopping routine: routine="federation state anti-entropy" 31:59.318 [DEBUG] Agent2.leader: stopping routine: routine="federation state pruning" 31:59.318 [DEBUG] Agent2.leader: stopping routine: routine="intermediate cert renew watch" 31:59.318 [WARN] Agent2.server.serf.lan: serf: Shutdown without a Leave 31:59.319 [DEBUG] Agent2.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d.dc1 127.0.0.1:30307 31:59.319 [ERROR] Agent2.server: error performing anti-entropy sync of federation state: error="context canceled" 31:59.319 [DEBUG] Agent2.leader: stopped routine: routine="federation state anti-entropy" 31:59.319 [DEBUG] Agent2.leader: stopped routine: routine="CA root pruning" 31:59.319 [DEBUG] Agent2.leader: stopped routine: routine="federation state pruning" 31:59.319 [DEBUG] Agent2.leader: stopped routine: routine="intermediate cert renew watch" 31:59.320 [INFO] Agent2.server.serf.wan: serf: EventMemberJoin: Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d.dc1 127.0.0.1 31:59.320 [DEBUG] Agent2.server: Successfully performed flood-join for server at address: server=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d.dc1 address=127.0.0.1:30307 31:59.320 [INFO] Agent2.server: Handled event for server in area: event=member-join server=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d.dc1 area=wan 31:59.328 [WARN] Agent2.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:59.336Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:59.336Z [INFO] agent.router.manager: shutting down 31:59.336 [INFO] Agent2: consul server down 31:59.336 [INFO] Agent2: shutdown complete 31:59.336 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30324 network=tcp 31:59.336 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:30324 network=udp 31:59.336 [INFO] Agent2: Stopping server: protocol=HTTP address=127.0.0.1:30325 network=tcp 31:59.836 [INFO] Agent2: Waiting for endpoints to shut down 31:59.836 [INFO] Agent2: Endpoints down 2021-10-05T16:31:58.290Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.311Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.372 [INFO] Agent1.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e16b1ca7-ac90-850e-14c8-07e1e08b8f4d Address:127.0.0.1:30308}]" 31:58.372 [INFO] Agent1.server.raft: entering follower state: follower="Node at 127.0.0.1:30308 [Follower]" leader= 31:58.373 [INFO] Agent1.server.serf.wan: serf: EventMemberJoin: Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d.dc1 127.0.0.1 31:58.374 [INFO] Agent1.server.serf.lan: serf: EventMemberJoin: Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 127.0.0.1 2021-10-05T16:31:58.374Z [INFO] agent.router: Initializing LAN area manager 31:58.374 [INFO] Agent1: Started DNS server: address=127.0.0.1:30303 network=udp 31:58.374 [INFO] Agent1.server: Adding LAN server: server="Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d (Addr: tcp/127.0.0.1:30308) (DC: dc1)" 31:58.374 [INFO] Agent1.server: Handled event for server in area: event=member-join server=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d.dc1 area=wan 31:58.374 [INFO] Agent1: Started DNS server: address=127.0.0.1:30303 network=tcp 31:58.375 [INFO] Agent1: Started HTTP server: address=127.0.0.1:30304 network=tcp 31:58.375 [INFO] Agent1: started state syncer 31:58.375 [INFO] Agent1: Started gRPC server: address=127.0.0.1:30344 network=tcp 31:58.434 [WARN] Agent1.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.434 [INFO] Agent1.server.raft: entering candidate state: node="Node at 127.0.0.1:30308 [Candidate]" term=2 31:58.456 [DEBUG] Agent1.server.raft: votes: needed=1 31:58.456 [DEBUG] Agent1.server.raft: vote granted: from=e16b1ca7-ac90-850e-14c8-07e1e08b8f4d term=2 tally=1 31:58.456 [INFO] Agent1.server.raft: election won: tally=1 31:58.456 [INFO] Agent1.server.raft: entering leader state: leader="Node at 127.0.0.1:30308 [Leader]" 31:58.456 [INFO] Agent1.server: cluster leadership acquired 31:58.456 [INFO] Agent1.server: New leader elected: payload=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 31:58.471 [DEBUG] Agent1.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30308 31:58.505 [INFO] Agent1: Synced node info 31:58.505 [DEBUG] Agent1: Node info in sync 31:58.521 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.547 [DEBUG] Agent1: Node info in sync 31:58.551 [INFO] Agent1.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.551 [INFO] Agent1.leader: started routine: routine="federation state anti-entropy" 31:58.551 [INFO] Agent1.leader: started routine: routine="federation state pruning" 31:58.551 [INFO] Agent1.leader: started routine: routine="intermediate cert renew watch" 31:58.551 [INFO] Agent1.leader: started routine: routine="CA root pruning" 31:58.551 [DEBUG] Agent1.server: Skipping self join check for node since the cluster is too small: node=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 31:58.551 [INFO] Agent1.server: member joined, marking health alive: member=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 31:58.581 [INFO] Agent1.server: federation state anti-entropy synced 31:59.310 [INFO] Agent1: (LAN) joining: lan_addresses=[127.0.0.1:30327] 31:59.317 [DEBUG] Agent1.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:30327 31:59.318 [INFO] Agent1.server.serf.lan: serf: EventMemberJoin: Node-af776d73-a83f-1d79-6f88-a8045824d8e4 127.0.0.1 31:59.318 [INFO] Agent1: (LAN) joined: number_of_nodes=1 31:59.318 [DEBUG] Agent1: systemd notify failed: error="No socket" 31:59.319 [INFO] Agent1.server: Adding LAN server: server="Node-af776d73-a83f-1d79-6f88-a8045824d8e4 (Addr: tcp/127.0.0.1:30343) (DC: dc1)" 31:59.319 [ERROR] Agent1.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 other=Node-e16b1ca7-ac90-850e-14c8-07e1e08b8f4d 31:59.319 [INFO] Agent1.server: member joined, marking health alive: member=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 31:59.319 [DEBUG] Agent1.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:33316 31:59.319 [INFO] Agent1.server.serf.wan: serf: EventMemberJoin: Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 127.0.0.1 31:59.320 [INFO] Agent1.server: Handled event for server in area: event=member-join server=Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 area=wan 31:59.875 [DEBUG] Agent1.server.memberlist.lan: memberlist: Failed ping: Node-af776d73-a83f-1d79-6f88-a8045824d8e4 (timeout reached) 32:00.376 [INFO] Agent1.server.memberlist.lan: memberlist: Suspect Node-af776d73-a83f-1d79-6f88-a8045824d8e4 has failed, no acks received 32:00.482 [WARN] Agent1: error getting server health from server: server=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 error="rpc error getting client: failed to get conn: dial tcp 127.0.0.1:0->127.0.0.1:30343: connect: connection refused" 32:01.485 [WARN] Agent1: error getting server health from server: server=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 error="context deadline exceeded" 32:01.876 [DEBUG] Agent1.server.memberlist.lan: memberlist: Failed ping: Node-af776d73-a83f-1d79-6f88-a8045824d8e4 (timeout reached) 32:02.484 [WARN] Agent1: error getting server health from server: server=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 error="rpc error getting client: failed to get conn: dial tcp 127.0.0.1:0->127.0.0.1:30343: connect: connection refused" 32:03.375 [INFO] Agent1.server.memberlist.lan: memberlist: Suspect Node-af776d73-a83f-1d79-6f88-a8045824d8e4 has failed, no acks received 32:03.484 [WARN] Agent1: error getting server health from server: server=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 error="context deadline exceeded" 32:04.376 [INFO] Agent1.server.memberlist.lan: memberlist: Marking Node-af776d73-a83f-1d79-6f88-a8045824d8e4 as failed, suspect timeout reached (0 peer confirmations) 32:04.376 [INFO] Agent1.server.serf.lan: serf: EventMemberFailed: Node-af776d73-a83f-1d79-6f88-a8045824d8e4 127.0.0.1 32:04.376 [INFO] Agent1.server: Removing LAN server: server="Node-af776d73-a83f-1d79-6f88-a8045824d8e4 (Addr: tcp/127.0.0.1:30343) (DC: dc1)" 32:04.376 [INFO] Agent1.server: member failed, marking health critical: member=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 32:04.388 [INFO] Agent1: Force leaving node: node=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 32:04.388 [INFO] Agent1.server.serf.lan: serf: EventMemberLeave (forced): Node-af776d73-a83f-1d79-6f88-a8045824d8e4 127.0.0.1 32:04.388 [INFO] Agent1.server.serf.lan: serf: EventMemberReap (forced): Node-af776d73-a83f-1d79-6f88-a8045824d8e4 127.0.0.1 32:04.388 [INFO] Agent1.server: Removing LAN server: server="Node-af776d73-a83f-1d79-6f88-a8045824d8e4 (Addr: tcp/127.0.0.1:30343) (DC: dc1)" 32:04.388 [INFO] Agent1.server: Removing LAN server: server="Node-af776d73-a83f-1d79-6f88-a8045824d8e4 (Addr: tcp/127.0.0.1:30343) (DC: dc1)" 32:04.393 [INFO] Agent1.server: deregistering member: member=Node-af776d73-a83f-1d79-6f88-a8045824d8e4 reason=left 32:06.374 [DEBUG] Agent1.server.memberlist.wan: memberlist: Failed ping: Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 (timeout reached) 32:08.374 [INFO] Agent1.server.memberlist.wan: memberlist: Suspect Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 has failed, no acks received 32:12.389 [INFO] Agent1.server.serf.wan: serf: EventMemberReap (forced): Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 127.0.0.1 32:12.389 [INFO] Agent1: Requesting shutdown 32:12.389 [INFO] Agent1.server: shutting down server 32:12.389 [DEBUG] Agent1.leader: stopping routine: routine="CA root pruning" 32:12.389 [DEBUG] Agent1.leader: stopping routine: routine="federation state anti-entropy" 32:12.389 [DEBUG] Agent1.leader: stopping routine: routine="federation state pruning" 32:12.389 [DEBUG] Agent1.leader: stopping routine: routine="intermediate cert renew watch" 32:12.389 [WARN] Agent1.server.serf.lan: serf: Shutdown without a Leave 32:12.389 [INFO] Agent1.server: Handled event for server in area: event=member-reap server=Node-af776d73-a83f-1d79-6f88-a8045824d8e4.dc1 area=wan 32:12.389 [ERROR] Agent1.server: error performing anti-entropy sync of federation state: error="context canceled" 32:12.389 [DEBUG] Agent1.leader: stopped routine: routine="federation state anti-entropy" 32:12.389 [DEBUG] Agent1.leader: stopped routine: routine="CA root pruning" 32:12.389 [DEBUG] Agent1.leader: stopped routine: routine="federation state pruning" 32:12.389 [DEBUG] Agent1.leader: stopped routine: routine="intermediate cert renew watch" 32:12.404 [WARN] Agent1.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:12.408Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:12.408Z [INFO] agent.router.manager: shutting down 32:12.408 [INFO] Agent1: consul server down 32:12.408 [INFO] Agent1: shutdown complete 32:12.408 [INFO] Agent1: Stopping server: protocol=DNS address=127.0.0.1:30303 network=tcp 32:12.408 [INFO] Agent1: Stopping server: protocol=DNS address=127.0.0.1:30303 network=udp 32:12.408 [INFO] Agent1: Stopping server: protocol=HTTP address=127.0.0.1:30304 network=tcp 32:12.909 [INFO] Agent1: Waiting for endpoints to shut down 32:12.909 [INFO] Agent1: Endpoints down --- PASS: TestAgent_ForceLeavePrune (14.64s) === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{7_7_7_7_6_7_7_5_7_7_-5} [WARN] freeport: 4 out of 18 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:11.058Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:11.075Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:11.161 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:46936632-ada5-d417-9778-644d40cef753 Address:127.0.0.1:29685}]" 32:11.162 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:11.162 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29685 [Follower]" leader= 32:11.162 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:11.162Z [INFO] agent.router: Initializing LAN area manager 32:11.163 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29685) (DC: dc1)" 32:11.163 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:11.163 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29666 network=udp 32:11.163 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29666 network=tcp 32:11.163 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29667 network=tcp 32:11.163 [INFO] TestAgent: started state syncer 32:11.163 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29686 network=tcp 32:11.222 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:11.222 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29685 [Candidate]" term=2 32:11.245 [DEBUG] TestAgent.server.raft: votes: needed=1 32:11.245 [DEBUG] TestAgent.server.raft: vote granted: from=46936632-ada5-d417-9778-644d40cef753 term=2 tally=1 32:11.245 [INFO] TestAgent.server.raft: election won: tally=1 32:11.245 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29685 [Leader]" 32:11.246 [INFO] TestAgent.server: cluster leadership acquired 32:11.246 [INFO] TestAgent.server: New leader elected: payload=test-node 32:11.272 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29685 32:11.321 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:11.384 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:11.384 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:11.384 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:11.384 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:11.384 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:11.384 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:11.384 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:11.422 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:11.426 [INFO] TestAgent.server: federation state anti-entropy synced 32:11.443 [INFO] TestAgent: Synced node info 32:12.637 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.346548ms client=127.0.0.1:41746 client_network=udp 32:12.639 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.16473ms client=127.0.0.1:36221 client_network=udp 32:12.644 [DEBUG] TestAgent.dns: request served from client: name=c1a8195a-a211-a1ca-01c0-5ab3e7fd1dd1.query.consul. type=A class=IN latency=5.134808ms client=127.0.0.1:43533 client_network=udp 32:12.644 [INFO] TestAgent: Requesting shutdown 32:12.644 [INFO] TestAgent.server: shutting down server 32:12.644 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:12.644 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:12.644 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:12.644 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:12.644 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:12.644 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:12.644 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:12.644 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:12.644 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:12.644 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:12.652 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:12.664Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:12.664Z [INFO] agent.router.manager: shutting down 32:12.664 [INFO] TestAgent: consul server down 32:12.664 [INFO] TestAgent: shutdown complete 32:12.664 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29666 network=tcp 32:12.664 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29666 network=udp 32:12.664 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29667 network=tcp 32:13.168 [INFO] TestAgent: Waiting for endpoints to shut down 32:13.168 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{7_7_7_7_6_7_7_5_7_7_-5} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:11.763Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:11.774Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:11.811 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:22e9c10e-851c-c653-92f0-34186264c685 Address:127.0.0.1:29908}]" 32:11.812 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:11.813 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:11.813Z [INFO] agent.router: Initializing LAN area manager 32:11.813 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29908 [Follower]" leader= 32:11.813 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29908) (DC: dc1)" 32:11.813 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:11.813 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29659 network=tcp 32:11.814 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29659 network=udp 32:11.814 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29877 network=tcp 32:11.814 [INFO] TestAgent: started state syncer 32:11.814 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29909 network=tcp 32:11.872 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:11.872 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29908 [Candidate]" term=2 32:11.920 [DEBUG] TestAgent.server.raft: votes: needed=1 32:11.920 [DEBUG] TestAgent.server.raft: vote granted: from=22e9c10e-851c-c653-92f0-34186264c685 term=2 tally=1 32:11.920 [INFO] TestAgent.server.raft: election won: tally=1 32:11.920 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29908 [Leader]" 32:11.920 [INFO] TestAgent.server: cluster leadership acquired 32:11.920 [INFO] TestAgent.server: New leader elected: payload=test-node 32:11.937 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29908 32:11.959 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.005 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.005 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.005 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.005 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.005 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.005 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:12.005 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:12.030 [INFO] TestAgent.server: federation state anti-entropy synced 32:12.296 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:12.321 [INFO] TestAgent: Synced node info 32:13.462 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.663146ms client=127.0.0.1:46822 client_network=udp 32:13.464 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.615623ms client=127.0.0.1:54420 client_network=udp 32:13.466 [DEBUG] TestAgent.dns: request served from client: name=2f84cda9-d847-47c6-48ae-0494c02f597d.query.consul. type=ANY class=IN latency=1.774814ms client=127.0.0.1:58431 client_network=udp 32:13.468 [INFO] TestAgent: Requesting shutdown 32:13.468 [INFO] TestAgent.server: shutting down server 32:13.468 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:13.468 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:13.468 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:13.468 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:13.468 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:13.468 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:13.468 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:13.468 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:13.468 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:13.468 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:13.477 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:13.485Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:13.485Z [INFO] agent.router.manager: shutting down 32:13.485 [INFO] TestAgent: consul server down 32:13.485 [INFO] TestAgent: shutdown complete 32:13.485 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29659 network=tcp 32:13.485 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29659 network=udp 32:13.485 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29877 network=tcp 32:13.988 [INFO] TestAgent: Waiting for endpoints to shut down 32:13.988 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{6_6_6_6_6_6_6_5_6_6_-5} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:12.185Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.202Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:12.252 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d156f2f7-912e-0ac6-b1f1-15dd9a9411f6 Address:127.0.0.1:29846}]" 32:12.253 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29846 [Follower]" leader= 32:12.256 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:12.257 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:12.257Z [INFO] agent.router: Initializing LAN area manager 32:12.257 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29876 network=udp 32:12.257 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29846) (DC: dc1)" 32:12.257 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:12.258 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29876 network=tcp 32:12.258 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29842 network=tcp 32:12.258 [INFO] TestAgent: started state syncer 32:12.258 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29847 network=tcp 32:12.311 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:12.311 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29846 [Candidate]" term=2 32:12.330 [DEBUG] TestAgent.server.raft: votes: needed=1 32:12.330 [DEBUG] TestAgent.server.raft: vote granted: from=d156f2f7-912e-0ac6-b1f1-15dd9a9411f6 term=2 tally=1 32:12.330 [INFO] TestAgent.server.raft: election won: tally=1 32:12.330 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29846 [Leader]" 32:12.331 [INFO] TestAgent.server: cluster leadership acquired 32:12.331 [INFO] TestAgent.server: New leader elected: payload=test-node 32:12.344 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29846 32:12.380 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.448 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.448 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.448 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.448 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.448 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.448 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:12.448 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:12.509 [INFO] TestAgent.server: federation state anti-entropy synced 32:12.716 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:12.752 [INFO] TestAgent: Synced node info 32:12.752 [DEBUG] TestAgent: Node info in sync 32:13.989 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.1817ms client=127.0.0.1:45325 client_network=udp 32:13.990 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=790.349µs client=127.0.0.1:48856 client_network=udp 32:13.991 [DEBUG] TestAgent.dns: request served from client: name=efb32b00-d931-2761-fb05-1a8aa48f0b3b.query.consul. type=A class=IN latency=771.724µs client=127.0.0.1:45621 client_network=udp 32:13.991 [INFO] TestAgent: Requesting shutdown 32:13.991 [INFO] TestAgent.server: shutting down server 32:13.991 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:13.991 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:13.991 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:13.991 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:13.991 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:13.991 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:13.991 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:13.991 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:13.991 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:13.991 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.004 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.017Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.017Z [INFO] agent.router.manager: shutting down 32:14.017 [INFO] TestAgent: consul server down 32:14.017 [INFO] TestAgent: shutdown complete 32:14.017 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29876 network=tcp 32:14.017 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29876 network=udp 32:14.017 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29842 network=tcp 32:14.520 [INFO] TestAgent: Waiting for endpoints to shut down 32:14.520 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{6_6_6_6_6_6_6_5_6_6_-5} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:12.214Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.248Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:12.322 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a96080b8-b8a7-dc99-76d2-827d344e157c Address:127.0.0.1:29860}]" 32:12.322 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:12.323 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:12.323Z [INFO] agent.router: Initializing LAN area manager 32:12.323 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29848 network=udp 32:12.323 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29860 [Follower]" leader= 32:12.323 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29860) (DC: dc1)" 32:12.324 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:12.324 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29848 network=tcp 32:12.324 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29863 network=tcp 32:12.324 [INFO] TestAgent: started state syncer 32:12.324 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29861 network=tcp 32:12.379 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:12.379 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29860 [Candidate]" term=2 32:12.399 [DEBUG] TestAgent.server.raft: votes: needed=1 32:12.399 [DEBUG] TestAgent.server.raft: vote granted: from=a96080b8-b8a7-dc99-76d2-827d344e157c term=2 tally=1 32:12.400 [INFO] TestAgent.server.raft: election won: tally=1 32:12.400 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29860 [Leader]" 32:12.400 [INFO] TestAgent.server: cluster leadership acquired 32:12.400 [INFO] TestAgent.server: New leader elected: payload=test-node 32:12.425 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29860 32:12.497 [INFO] TestAgent: Synced node info 32:12.497 [DEBUG] TestAgent: Node info in sync 32:12.524 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.612 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.612 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.612 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.612 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.612 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.612 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:12.612 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:12.635 [INFO] TestAgent.server: federation state anti-entropy synced 32:12.814 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:12.814 [DEBUG] TestAgent: Node info in sync 32:14.093 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.367755ms client=127.0.0.1:59925 client_network=udp 32:14.094 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=976.731µs client=127.0.0.1:50797 client_network=udp 32:14.103 [DEBUG] TestAgent.dns: request served from client: name=51c88945-2d99-b943-48be-978d1be197ac.query.consul. type=ANY class=IN latency=8.38332ms client=127.0.0.1:39380 client_network=udp 32:14.104 [INFO] TestAgent: Requesting shutdown 32:14.104 [INFO] TestAgent.server: shutting down server 32:14.104 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:14.104 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:14.104 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:14.104 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:14.104 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:14.104 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:14.104 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:14.104 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:14.104 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:14.104 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.124 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.132Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.132Z [INFO] agent.router.manager: shutting down 32:14.132 [INFO] TestAgent: consul server down 32:14.132 [INFO] TestAgent: shutdown complete 32:14.132 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29848 network=tcp 32:14.132 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29848 network=udp 32:14.132 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29863 network=tcp 32:14.635 [INFO] TestAgent: Waiting for endpoints to shut down 32:14.635 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{3_3_3_3_3_3_3_3_3_3_3} 2021-10-05T16:32:12.165Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.202Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:12.304 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f900f1d7-b0ed-9f01-6b98-db0d4a671bff Address:127.0.0.1:29874}]" 32:12.304 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29874 [Follower]" leader= 32:12.305 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:12.305 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:12.305Z [INFO] agent.router: Initializing LAN area manager 32:12.305 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29862 network=udp 32:12.306 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29874) (DC: dc1)" 32:12.306 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:12.306 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29862 network=tcp 32:12.306 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29849 network=tcp 32:12.306 [INFO] TestAgent: started state syncer 32:12.307 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29875 network=tcp 32:12.358 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:12.358 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29874 [Candidate]" term=2 32:12.396 [DEBUG] TestAgent.server.raft: votes: needed=1 32:12.396 [DEBUG] TestAgent.server.raft: vote granted: from=f900f1d7-b0ed-9f01-6b98-db0d4a671bff term=2 tally=1 32:12.396 [INFO] TestAgent.server.raft: election won: tally=1 32:12.396 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29874 [Leader]" 32:12.396 [INFO] TestAgent.server: cluster leadership acquired 32:12.396 [INFO] TestAgent.server: New leader elected: payload=test-node 32:12.432 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29874 32:12.485 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.553 [INFO] TestAgent: Synced node info 32:12.553 [DEBUG] TestAgent: Node info in sync 32:12.583 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.583 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.583 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.583 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.583 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.584 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:12.584 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:12.644 [INFO] TestAgent.server: federation state anti-entropy synced 32:14.149 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.248728ms client=127.0.0.1:40241 client_network=udp 32:14.154 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=3.375777ms client=127.0.0.1:54675 client_network=udp 32:14.156 [DEBUG] TestAgent.dns: request served from client: name=40ce07fa-b11b-908e-aae8-6c5afe6fa609.query.consul. type=AAAA class=IN latency=1.140205ms client=127.0.0.1:47397 client_network=udp 32:14.160 [INFO] TestAgent: Requesting shutdown 32:14.160 [INFO] TestAgent.server: shutting down server 32:14.160 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:14.160 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:14.160 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:14.160 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:14.160 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:14.160 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:14.160 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:14.160 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:14.160 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:14.160 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.168 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.184Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.184Z [INFO] agent.router.manager: shutting down 32:14.184 [INFO] TestAgent: consul server down 32:14.184 [INFO] TestAgent: shutdown complete 32:14.184 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29862 network=tcp 32:14.184 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29862 network=udp 32:14.184 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29849 network=tcp 32:14.685 [INFO] TestAgent: Waiting for endpoints to shut down 32:14.685 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{5_5_5_5_5_5_5_5_5_5_5} 2021-10-05T16:32:12.277Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.331Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:12.404 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:812ad947-98f4-8cf9-0486-35c089118cc9 Address:127.0.0.1:29929}]" 32:12.405 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:12.405 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:12.405Z [INFO] agent.router: Initializing LAN area manager 32:12.406 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29929 [Follower]" leader= 32:12.406 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29929) (DC: dc1)" 32:12.406 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:12.406 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29910 network=tcp 32:12.406 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29910 network=udp 32:12.407 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29904 network=tcp 32:12.407 [INFO] TestAgent: started state syncer 32:12.407 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29930 network=tcp 32:12.448 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:12.448 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29929 [Candidate]" term=2 32:12.514 [DEBUG] TestAgent.server.raft: votes: needed=1 32:12.514 [DEBUG] TestAgent.server.raft: vote granted: from=812ad947-98f4-8cf9-0486-35c089118cc9 term=2 tally=1 32:12.514 [INFO] TestAgent.server.raft: election won: tally=1 32:12.514 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29929 [Leader]" 32:12.515 [INFO] TestAgent.server: cluster leadership acquired 32:12.515 [INFO] TestAgent.server: New leader elected: payload=test-node 32:12.547 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29929 32:12.550 [INFO] TestAgent: Synced node info 32:12.625 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.672 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.672 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.672 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.672 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.672 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.672 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:12.672 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:12.717 [INFO] TestAgent.server: federation state anti-entropy synced 32:12.830 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:12.830 [DEBUG] TestAgent: Node info in sync 32:12.830 [DEBUG] TestAgent: Node info in sync 32:14.151 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.090703ms client=127.0.0.1:56342 client_network=udp 32:14.161 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=8.618013ms client=127.0.0.1:47250 client_network=udp 32:14.165 [DEBUG] TestAgent.dns: request served from client: name=0b03ec22-b255-5c41-eb34-d8839b98faa2.query.consul. type=AAAA class=IN latency=1.157133ms client=127.0.0.1:53681 client_network=udp 32:14.165 [INFO] TestAgent: Requesting shutdown 32:14.165 [INFO] TestAgent.server: shutting down server 32:14.165 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:14.165 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:14.165 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:14.165 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:14.165 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:14.165 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:14.165 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:14.165 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:14.165 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:14.165 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.180 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.192Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.192Z [INFO] agent.router.manager: shutting down 32:14.192 [INFO] TestAgent: consul server down 32:14.192 [INFO] TestAgent: shutdown complete 32:14.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29910 network=tcp 32:14.192 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29910 network=udp 32:14.192 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29904 network=tcp 32:14.692 [INFO] TestAgent: Waiting for endpoints to shut down 32:14.692 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{5_5_5_5_5_5_5_5_5_5_5} 2021-10-05T16:32:12.337Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.353Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:12.415 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2dccd0b7-5b1f-22d0-0649-4f2057510ab2 Address:127.0.0.1:29901}]" 32:12.416 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:12.416 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29901 [Follower]" leader= 32:12.417 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:12.417Z [INFO] agent.router: Initializing LAN area manager 32:12.417 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29892 network=udp 32:12.418 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29901) (DC: dc1)" 32:12.418 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:12.418 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29892 network=tcp 32:12.418 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29918 network=tcp 32:12.418 [INFO] TestAgent: started state syncer 32:12.418 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29902 network=tcp 32:12.476 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:12.476 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29901 [Candidate]" term=2 32:12.548 [DEBUG] TestAgent.server.raft: votes: needed=1 32:12.548 [DEBUG] TestAgent.server.raft: vote granted: from=2dccd0b7-5b1f-22d0-0649-4f2057510ab2 term=2 tally=1 32:12.548 [INFO] TestAgent.server.raft: election won: tally=1 32:12.548 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29901 [Leader]" 32:12.554 [INFO] TestAgent.server: cluster leadership acquired 32:12.555 [INFO] TestAgent.server: New leader elected: payload=test-node 32:12.570 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29901 32:12.613 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.672 [INFO] TestAgent: Synced node info 32:12.672 [DEBUG] TestAgent: Node info in sync 32:12.700 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.700 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.700 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.700 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.700 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.700 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:12.700 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:12.733 [INFO] TestAgent.server: federation state anti-entropy synced 32:14.201 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.531299ms client=127.0.0.1:40045 client_network=udp 32:14.205 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.503931ms client=127.0.0.1:60527 client_network=udp 32:14.214 [DEBUG] TestAgent.dns: request served from client: name=4351701f-0b0d-6a24-fc67-b6da30ef485e.query.consul. type=ANY class=IN latency=1.553124ms client=127.0.0.1:42120 client_network=udp 32:14.220 [INFO] TestAgent: Requesting shutdown 32:14.220 [INFO] TestAgent.server: shutting down server 32:14.220 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:14.220 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:14.220 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:14.220 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:14.220 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:14.220 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:14.220 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:14.220 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:14.220 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.220 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:14.228 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.238Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.238Z [INFO] agent.router.manager: shutting down 32:14.238 [INFO] TestAgent: consul server down 32:14.238 [INFO] TestAgent: shutdown complete 32:14.238 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29892 network=tcp 32:14.238 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29892 network=udp 32:14.239 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29918 network=tcp 32:14.741 [INFO] TestAgent: Waiting for endpoints to shut down 32:14.741 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{5_5_5_5_5_5_5_5_5_5_5} 2021-10-05T16:32:12.356Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.419Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:12.549 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f176c4ef-6c47-d4a7-cabe-fca688767be5 Address:127.0.0.1:29922}]" 32:12.549 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:12.552 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:12.552Z [INFO] agent.router: Initializing LAN area manager 32:12.553 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29917 network=udp 32:12.553 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29917 network=tcp 32:12.554 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29897 network=tcp 32:12.554 [INFO] TestAgent: started state syncer 32:12.554 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29923 network=tcp 32:12.555 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29922 [Follower]" leader= 32:12.555 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:12.555 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29922) (DC: dc1)" 32:12.592 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:12.592 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29922 [Candidate]" term=2 32:12.640 [DEBUG] TestAgent.server.raft: votes: needed=1 32:12.640 [DEBUG] TestAgent.server.raft: vote granted: from=f176c4ef-6c47-d4a7-cabe-fca688767be5 term=2 tally=1 32:12.640 [INFO] TestAgent.server.raft: election won: tally=1 32:12.640 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29922 [Leader]" 32:12.641 [INFO] TestAgent.server: cluster leadership acquired 32:12.641 [INFO] TestAgent.server: New leader elected: payload=test-node 32:12.680 [INFO] TestAgent: Synced node info 32:12.680 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29922 32:12.756 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.815 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.815 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.815 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.815 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.815 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.815 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:12.815 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:12.847 [INFO] TestAgent.server: federation state anti-entropy synced 32:14.088 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:14.088 [DEBUG] TestAgent: Node info in sync 32:14.088 [DEBUG] TestAgent: Node info in sync 32:14.196 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.111388ms client=127.0.0.1:55895 client_network=udp 32:14.205 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.454029ms client=127.0.0.1:48970 client_network=udp 32:14.213 [DEBUG] TestAgent.dns: request served from client: name=b6af46ea-6f30-fcc3-03d6-fcf21948717e.query.consul. type=A class=IN latency=1.175914ms client=127.0.0.1:60791 client_network=udp 32:14.222 [INFO] TestAgent: Requesting shutdown 32:14.222 [INFO] TestAgent.server: shutting down server 32:14.222 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:14.222 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:14.222 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:14.222 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:14.222 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:14.222 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:14.222 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:14.222 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:14.222 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.222 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:14.229 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.242Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.242Z [INFO] agent.router.manager: shutting down 32:14.242 [INFO] TestAgent: consul server down 32:14.242 [INFO] TestAgent: shutdown complete 32:14.242 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29917 network=tcp 32:14.242 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29917 network=udp 32:14.242 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29897 network=tcp 32:14.744 [INFO] TestAgent: Waiting for endpoints to shut down 32:14.744 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{4_4_4_4_4_4_4_4_4_4_4} [WARN] freeport: 4 out of 39 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:12.930Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.965Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:13.038 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fc27fb0a-754f-a611-5fb9-829c50000f0e Address:127.0.0.1:29915}]" 32:13.039 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:13.039 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:13.039Z [INFO] agent.router: Initializing LAN area manager 32:13.040 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29915 [Follower]" leader= 32:13.040 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29931 network=udp 32:13.040 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:13.040 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29931 network=tcp 32:13.040 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29915) (DC: dc1)" 32:13.041 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29932 network=tcp 32:13.041 [INFO] TestAgent: started state syncer 32:13.041 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29916 network=tcp 32:13.099 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:13.099 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29915 [Candidate]" term=2 32:13.128 [DEBUG] TestAgent.server.raft: votes: needed=1 32:13.128 [DEBUG] TestAgent.server.raft: vote granted: from=fc27fb0a-754f-a611-5fb9-829c50000f0e term=2 tally=1 32:13.128 [INFO] TestAgent.server.raft: election won: tally=1 32:13.128 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29915 [Leader]" 32:13.129 [INFO] TestAgent.server: cluster leadership acquired 32:13.129 [INFO] TestAgent.server: New leader elected: payload=test-node 32:13.152 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29915 32:13.195 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:13.219 [INFO] TestAgent: Synced node info 32:13.219 [DEBUG] TestAgent: Node info in sync 32:13.252 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:13.252 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:13.252 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:13.252 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:13.252 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:13.252 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:13.252 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:13.292 [INFO] TestAgent.server: federation state anti-entropy synced 32:14.566 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.761884ms client=127.0.0.1:49828 client_network=udp 32:14.569 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=2.063275ms client=127.0.0.1:42799 client_network=udp 32:14.574 [DEBUG] TestAgent.dns: request served from client: name=14769b1b-ebb4-0ff2-1e73-46ec6ad4c0d7.query.consul. type=AAAA class=IN latency=1.451783ms client=127.0.0.1:57728 client_network=udp 32:14.574 [INFO] TestAgent: Requesting shutdown 32:14.574 [INFO] TestAgent.server: shutting down server 32:14.574 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:14.574 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:14.574 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:14.574 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:14.574 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:14.574 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:14.574 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:14.574 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:14.574 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:14.574 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.588 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.600Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.600Z [INFO] agent.router.manager: shutting down 32:14.600 [INFO] TestAgent: consul server down 32:14.600 [INFO] TestAgent: shutdown complete 32:14.600 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29931 network=tcp 32:14.600 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29931 network=udp 32:14.600 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29932 network=tcp 32:15.103 [INFO] TestAgent: Waiting for endpoints to shut down 32:15.103 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{4_4_4_4_4_4_4_4_4_4_4} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:13.182Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:13.193Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:13.267 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:595b2589-0f2d-9905-983e-d7fce6ad807c Address:127.0.0.1:29776}]" 32:13.267 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29776 [Follower]" leader= 32:13.268 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:13.270 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:13.270Z [INFO] agent.router: Initializing LAN area manager 32:13.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29903 network=udp 32:13.270 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29776) (DC: dc1)" 32:13.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29903 network=tcp 32:13.270 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:13.271 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29856 network=tcp 32:13.271 [INFO] TestAgent: started state syncer 32:13.271 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29777 network=tcp 32:13.308 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:13.308 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29776 [Candidate]" term=2 32:13.338 [DEBUG] TestAgent.server.raft: votes: needed=1 32:13.338 [DEBUG] TestAgent.server.raft: vote granted: from=595b2589-0f2d-9905-983e-d7fce6ad807c term=2 tally=1 32:13.338 [INFO] TestAgent.server.raft: election won: tally=1 32:13.338 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29776 [Leader]" 32:13.338 [INFO] TestAgent.server: cluster leadership acquired 32:13.338 [INFO] TestAgent.server: New leader elected: payload=test-node 32:13.350 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29776 32:13.382 [INFO] TestAgent: Synced node info 32:13.429 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:13.468 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:13.468 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:13.468 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:13.468 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:13.468 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:13.468 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:13.468 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:13.501 [INFO] TestAgent.server: federation state anti-entropy synced 32:14.785 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.418159ms client=127.0.0.1:49112 client_network=udp 32:14.797 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.341018ms client=127.0.0.1:38483 client_network=udp 32:14.804 [DEBUG] TestAgent.dns: request served from client: name=145a9a47-aeb0-6cee-058a-33b71ef1a236.query.consul. type=A class=IN latency=1.559004ms client=127.0.0.1:55122 client_network=udp 32:14.804 [INFO] TestAgent: Requesting shutdown 32:14.804 [INFO] TestAgent.server: shutting down server 32:14.804 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:14.804 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:14.804 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:14.804 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:14.804 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:14.804 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:14.804 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:14.804 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:14.804 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:14.804 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:14.816 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:14.828Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:14.828Z [INFO] agent.router.manager: shutting down 32:14.828 [INFO] TestAgent: consul server down 32:14.828 [INFO] TestAgent: shutdown complete 32:14.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29903 network=tcp 32:14.828 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29903 network=udp 32:14.828 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29856 network=tcp 32:15.330 [INFO] TestAgent: Waiting for endpoints to shut down 32:15.330 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{4_4_4_4_4_4_4_4_4_4_4} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:14.015Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:14.053Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:14.150 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4d736316-38e1-97c6-ae4f-891f660a617f Address:127.0.0.1:29853}]" 32:14.151 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:14.151 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:14.151Z [INFO] agent.router: Initializing LAN area manager 32:14.152 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29853 [Follower]" leader= 32:14.152 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:14.152 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29853) (DC: dc1)" 32:14.152 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29771 network=udp 32:14.152 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29771 network=tcp 32:14.153 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29772 network=tcp 32:14.153 [INFO] TestAgent: started state syncer 32:14.153 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29854 network=tcp 32:14.194 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:14.194 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29853 [Candidate]" term=2 32:14.237 [DEBUG] TestAgent.server.raft: votes: needed=1 32:14.237 [DEBUG] TestAgent.server.raft: vote granted: from=4d736316-38e1-97c6-ae4f-891f660a617f term=2 tally=1 32:14.237 [INFO] TestAgent.server.raft: election won: tally=1 32:14.237 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29853 [Leader]" 32:14.238 [INFO] TestAgent.server: cluster leadership acquired 32:14.238 [INFO] TestAgent.server: New leader elected: payload=test-node 32:14.255 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29853 32:14.287 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:14.321 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:14.321 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:14.321 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:14.321 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:14.321 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:14.321 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:14.321 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:14.355 [INFO] TestAgent.server: federation state anti-entropy synced 32:14.423 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:14.432 [INFO] TestAgent: Synced node info 32:14.432 [DEBUG] TestAgent: Node info in sync 32:15.375 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:15.375 [DEBUG] TestAgent: Node info in sync 32:15.759 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.724372ms client=127.0.0.1:57722 client_network=udp 32:15.761 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.411364ms client=127.0.0.1:37651 client_network=udp 32:15.764 [INFO] TestAgent: Requesting shutdown 32:15.764 [INFO] TestAgent.server: shutting down server 32:15.764 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:15.764 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:15.764 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:15.764 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:15.764 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:15.764 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:15.764 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:15.764 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:15.764 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:15.764 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:15.768 [DEBUG] TestAgent.dns: request served from client: name=30719926-fd3f-1c03-2b0c-4c6730d98947.query.consul. type=ANY class=IN latency=6.138561ms client=127.0.0.1:49862 client_network=udp 32:15.776 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:15.792Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:15.792Z [INFO] agent.router.manager: shutting down 32:15.792 [INFO] TestAgent: consul server down 32:15.792 [INFO] TestAgent: shutdown complete 32:15.792 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29771 network=tcp 32:15.792 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29771 network=udp 32:15.792 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29772 network=tcp 32:16.292 [INFO] TestAgent: Waiting for endpoints to shut down 32:16.292 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{3_3_3_3_3_3_3_3_3_3_3} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:14.542Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:14.561Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:14.607 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:87611214-fcf5-0929-67d3-32cc7d0e96f8 Address:127.0.0.1:29950}]" 32:14.608 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29950 [Follower]" leader= 32:14.608 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:14.608 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:14.608Z [INFO] agent.router: Initializing LAN area manager 32:14.609 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29883 network=udp 32:14.609 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29950) (DC: dc1)" 32:14.609 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:14.609 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29883 network=tcp 32:14.609 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29946 network=tcp 32:14.617 [INFO] TestAgent: started state syncer 32:14.631 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29951 network=tcp 32:14.656 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:14.656 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29950 [Candidate]" term=2 32:14.686 [DEBUG] TestAgent.server.raft: votes: needed=1 32:14.686 [DEBUG] TestAgent.server.raft: vote granted: from=87611214-fcf5-0929-67d3-32cc7d0e96f8 term=2 tally=1 32:14.686 [INFO] TestAgent.server.raft: election won: tally=1 32:14.686 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29950 [Leader]" 32:14.692 [INFO] TestAgent.server: cluster leadership acquired 32:14.692 [INFO] TestAgent.server: New leader elected: payload=test-node 32:14.708 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29950 32:14.784 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:14.840 [INFO] TestAgent: Synced node info 32:14.888 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:14.888 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:14.888 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:14.888 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:14.888 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:14.888 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:14.888 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:14.903 [INFO] TestAgent.server: federation state anti-entropy synced 32:15.380 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:15.380 [DEBUG] TestAgent: Node info in sync 32:15.380 [DEBUG] TestAgent: Node info in sync 32:16.255 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.066848ms client=127.0.0.1:36720 client_network=udp 32:16.256 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=874.752µs client=127.0.0.1:54590 client_network=udp 32:16.265 [DEBUG] TestAgent.dns: request served from client: name=115efb03-010d-3d05-781f-48e53b1e4154.query.consul. type=AAAA class=IN latency=1.275155ms client=127.0.0.1:54996 client_network=udp 32:16.268 [INFO] TestAgent: Requesting shutdown 32:16.268 [INFO] TestAgent.server: shutting down server 32:16.268 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.268 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.268 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.268 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.268 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.268 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.268 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.268 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.268 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.268 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.280 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.296Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.296Z [INFO] agent.router.manager: shutting down 32:16.296 [INFO] TestAgent: consul server down 32:16.296 [INFO] TestAgent: shutdown complete 32:16.296 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29883 network=tcp 32:16.296 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29883 network=udp 32:16.296 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29946 network=tcp 32:16.798 [INFO] TestAgent: Waiting for endpoints to shut down 32:16.799 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{3_3_3_3_3_3_3_3_3_3_3} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:14.711Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:14.768Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:14.836 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:276bb40c-4842-d9f4-b7db-a31ac0161835 Address:127.0.0.1:29999}]" 32:14.837 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:14.837 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:14.837Z [INFO] agent.router: Initializing LAN area manager 32:14.838 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29987 network=udp 32:14.838 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29999 [Follower]" leader= 32:14.838 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:14.838 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29999) (DC: dc1)" 32:14.838 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29987 network=tcp 32:14.839 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29974 network=tcp 32:14.839 [INFO] TestAgent: started state syncer 32:14.839 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30000 network=tcp 32:14.888 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:14.888 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29999 [Candidate]" term=2 32:14.917 [DEBUG] TestAgent.server.raft: votes: needed=1 32:14.917 [DEBUG] TestAgent.server.raft: vote granted: from=276bb40c-4842-d9f4-b7db-a31ac0161835 term=2 tally=1 32:14.917 [INFO] TestAgent.server.raft: election won: tally=1 32:14.917 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29999 [Leader]" 32:14.918 [INFO] TestAgent.server: cluster leadership acquired 32:14.918 [INFO] TestAgent.server: New leader elected: payload=test-node 32:14.927 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29999 32:14.943 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:14.988 [INFO] TestAgent: Synced node info 32:14.988 [DEBUG] TestAgent: Node info in sync 32:15.007 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:15.007 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:15.007 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:15.007 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:15.007 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:15.007 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:15.007 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:15.031 [INFO] TestAgent.server: federation state anti-entropy synced 32:16.455 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.083823ms client=127.0.0.1:41193 client_network=udp 32:16.457 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.104075ms client=127.0.0.1:60812 client_network=udp 32:16.458 [DEBUG] TestAgent.dns: request served from client: name=2697a9d8-278e-9174-7fc5-c5535ea650a5.query.consul. type=AAAA class=IN latency=962.206µs client=127.0.0.1:35781 client_network=udp 32:16.458 [INFO] TestAgent: Requesting shutdown 32:16.459 [INFO] TestAgent.server: shutting down server 32:16.459 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.459 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.459 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.459 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.459 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.459 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.459 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.459 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.459 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.459 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.468 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.480Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.480Z [INFO] agent.router.manager: shutting down 32:16.480 [INFO] TestAgent: consul server down 32:16.480 [INFO] TestAgent: shutdown complete 32:16.480 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29987 network=tcp 32:16.480 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29987 network=udp 32:16.480 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29974 network=tcp 32:16.980 [INFO] TestAgent: Waiting for endpoints to shut down 32:16.980 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{1_1_1_1_1_1_1_1_1_1_1} 2021-10-05T16:32:14.797Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:14.827Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:14.912 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:58cfc978-1b4f-8bcd-b175-a71b0f45517f Address:127.0.0.1:29867}]" 32:14.913 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:14.913 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:14.913Z [INFO] agent.router: Initializing LAN area manager 32:14.913 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29980 network=udp 32:14.913 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29867 [Follower]" leader= 32:14.914 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29867) (DC: dc1)" 32:14.914 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:14.914 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29980 network=tcp 32:14.914 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29870 network=tcp 32:14.914 [INFO] TestAgent: started state syncer 32:14.914 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29868 network=tcp 32:14.964 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:14.964 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29867 [Candidate]" term=2 32:15.011 [DEBUG] TestAgent.server.raft: votes: needed=1 32:15.011 [DEBUG] TestAgent.server.raft: vote granted: from=58cfc978-1b4f-8bcd-b175-a71b0f45517f term=2 tally=1 32:15.011 [INFO] TestAgent.server.raft: election won: tally=1 32:15.011 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29867 [Leader]" 32:15.012 [INFO] TestAgent.server: cluster leadership acquired 32:15.012 [INFO] TestAgent.server: New leader elected: payload=test-node 32:15.029 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29867 32:15.072 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:15.125 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:15.125 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:15.125 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:15.125 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:15.125 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:15.125 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:15.125 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:15.148 [INFO] TestAgent: Synced node info 32:15.148 [INFO] TestAgent.server: federation state anti-entropy synced 32:16.469 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.055423ms client=127.0.0.1:56284 client_network=udp 32:16.470 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=923.538µs client=127.0.0.1:34679 client_network=udp 32:16.471 [DEBUG] TestAgent.dns: request served from client: name=b6ac13bc-ae5e-a421-451a-29b84e555dde.query.consul. type=A class=IN latency=1.145076ms client=127.0.0.1:34717 client_network=udp 32:16.471 [INFO] TestAgent: Requesting shutdown 32:16.471 [INFO] TestAgent.server: shutting down server 32:16.471 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.471 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.471 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.471 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.471 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.472 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.472 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.472 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.472 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.472 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.499 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.512Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.512Z [INFO] agent.router.manager: shutting down 32:16.516 [INFO] TestAgent: consul server down 32:16.516 [INFO] TestAgent: shutdown complete 32:16.516 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29980 network=tcp 32:16.516 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29980 network=udp 32:16.516 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29870 network=tcp 32:17.016 [INFO] TestAgent: Waiting for endpoints to shut down 32:17.016 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{2_2_2_2_2_2_2_2_2_2_2} 2021-10-05T16:32:14.809Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:14.829Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:14.893 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:118c1451-7e1a-5d03-e923-5817562f8476 Address:127.0.0.1:29936}]" 32:14.893 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29936 [Follower]" leader= 32:14.894 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:14.894 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:14.894Z [INFO] agent.router: Initializing LAN area manager 32:14.894 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29938 network=udp 32:14.894 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29936) (DC: dc1)" 32:14.895 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:14.895 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29938 network=tcp 32:14.895 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29911 network=tcp 32:14.895 [INFO] TestAgent: started state syncer 32:14.895 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29937 network=tcp 32:14.937 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:14.937 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29936 [Candidate]" term=2 32:14.974 [DEBUG] TestAgent.server.raft: votes: needed=1 32:14.974 [DEBUG] TestAgent.server.raft: vote granted: from=118c1451-7e1a-5d03-e923-5817562f8476 term=2 tally=1 32:14.974 [INFO] TestAgent.server.raft: election won: tally=1 32:14.974 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29936 [Leader]" 32:14.974 [INFO] TestAgent.server: cluster leadership acquired 32:14.974 [INFO] TestAgent.server: New leader elected: payload=test-node 32:15.000 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29936 32:15.048 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:15.100 [INFO] TestAgent: Synced node info 32:15.130 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:15.130 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:15.130 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:15.130 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:15.130 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:15.130 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:15.130 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:15.169 [INFO] TestAgent.server: federation state anti-entropy synced 32:15.343 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:15.343 [DEBUG] TestAgent: Node info in sync 32:15.344 [DEBUG] TestAgent: Node info in sync 32:16.482 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.337747ms client=127.0.0.1:47543 client_network=udp 32:16.490 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=7.516085ms client=127.0.0.1:35653 client_network=udp 32:16.494 [DEBUG] TestAgent.dns: request served from client: name=4897ab98-4081-6c3a-ad8d-1e8cbaf238b1.query.consul. type=ANY class=IN latency=1.632019ms client=127.0.0.1:35542 client_network=udp 32:16.494 [INFO] TestAgent: Requesting shutdown 32:16.494 [INFO] TestAgent.server: shutting down server 32:16.494 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.494 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.494 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.494 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.494 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.494 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.494 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.494 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.494 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.494 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.520 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.533Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.533Z [INFO] agent.router.manager: shutting down 32:16.533 [INFO] TestAgent: consul server down 32:16.533 [INFO] TestAgent: shutdown complete 32:16.533 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29938 network=tcp 32:16.533 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29938 network=udp 32:16.533 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29911 network=tcp 32:17.036 [INFO] TestAgent: Waiting for endpoints to shut down 32:17.036 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{2_2_2_2_2_2_2_2_2_2_2} [WARN] freeport: 4 out of 25 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:14.737Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:14.801Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:14.888 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:33b2fc2e-f3c7-fca2-3e17-12d467f25935 Address:127.0.0.1:30020}]" 32:14.888 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30020 [Follower]" leader= 32:14.889 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:14.889 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:14.889Z [INFO] agent.router: Initializing LAN area manager 32:14.890 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29973 network=udp 32:14.890 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30020) (DC: dc1)" 32:14.890 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:14.890 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29973 network=tcp 32:14.891 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29995 network=tcp 32:14.891 [INFO] TestAgent: started state syncer 32:14.891 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30021 network=tcp 32:14.957 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:14.957 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30020 [Candidate]" term=2 32:14.994 [DEBUG] TestAgent.server.raft: votes: needed=1 32:14.994 [DEBUG] TestAgent.server.raft: vote granted: from=33b2fc2e-f3c7-fca2-3e17-12d467f25935 term=2 tally=1 32:14.994 [INFO] TestAgent.server.raft: election won: tally=1 32:14.994 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30020 [Leader]" 32:14.995 [INFO] TestAgent.server: cluster leadership acquired 32:14.995 [INFO] TestAgent.server: New leader elected: payload=test-node 32:15.016 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30020 32:15.060 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:15.115 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:15.115 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:15.115 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:15.115 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:15.115 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:15.115 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:15.115 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:15.133 [INFO] TestAgent.server: federation state anti-entropy synced 32:15.235 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:15.267 [INFO] TestAgent: Synced node info 32:15.267 [DEBUG] TestAgent: Node info in sync 32:16.546 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=2.185742ms client=127.0.0.1:43828 client_network=udp 32:16.548 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.854749ms client=127.0.0.1:37316 client_network=udp 32:16.550 [DEBUG] TestAgent.dns: request served from client: name=3433b252-39d9-957d-6881-be39d0d8b3f0.query.consul. type=ANY class=IN latency=2.307615ms client=127.0.0.1:43135 client_network=udp 32:16.568 [INFO] TestAgent: Requesting shutdown 32:16.568 [INFO] TestAgent.server: shutting down server 32:16.568 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.568 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.568 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.568 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.568 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.568 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.568 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.568 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.568 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.568 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.581 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.589Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.589Z [INFO] agent.router.manager: shutting down 32:16.589 [INFO] TestAgent: consul server down 32:16.589 [INFO] TestAgent: shutdown complete 32:16.589 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29973 network=tcp 32:16.589 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29973 network=udp 32:16.589 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29995 network=tcp 32:17.092 [INFO] TestAgent: Waiting for endpoints to shut down 32:17.092 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:14.687Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:14.737Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:14.820 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:410cd9ac-392f-c83d-9526-c0fe3ac02176 Address:127.0.0.1:29992}]" 32:14.821 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:14.821 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:14.821Z [INFO] agent.router: Initializing LAN area manager 32:14.822 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30001 network=udp 32:14.822 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29992 [Follower]" leader= 32:14.822 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29992) (DC: dc1)" 32:14.822 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:14.822 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30001 network=tcp 32:14.823 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29988 network=tcp 32:14.823 [INFO] TestAgent: started state syncer 32:14.823 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29993 network=tcp 32:14.868 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:14.868 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29992 [Candidate]" term=2 32:14.916 [DEBUG] TestAgent.server.raft: votes: needed=1 32:14.916 [DEBUG] TestAgent.server.raft: vote granted: from=410cd9ac-392f-c83d-9526-c0fe3ac02176 term=2 tally=1 32:14.916 [INFO] TestAgent.server.raft: election won: tally=1 32:14.916 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29992 [Leader]" 32:14.916 [INFO] TestAgent.server: cluster leadership acquired 32:14.916 [INFO] TestAgent.server: New leader elected: payload=test-node 32:14.927 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29992 32:14.968 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:15.017 [INFO] TestAgent: Synced node info 32:15.017 [DEBUG] TestAgent: Node info in sync 32:15.036 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:15.036 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:15.036 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:15.036 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:15.036 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:15.036 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:15.036 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:15.053 [INFO] TestAgent.server: federation state anti-entropy synced 32:16.550 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.716814ms client=127.0.0.1:44797 client_network=udp 32:16.570 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.706194ms client=127.0.0.1:55587 client_network=udp 32:16.574 [DEBUG] TestAgent.dns: request served from client: name=a0391276-e198-5a0b-c074-564559fedf7c.query.consul. type=A class=IN latency=1.715594ms client=127.0.0.1:44274 client_network=udp 32:16.574 [INFO] TestAgent: Requesting shutdown 32:16.574 [INFO] TestAgent.server: shutting down server 32:16.574 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.574 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.574 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.574 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.574 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.574 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.574 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.574 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.574 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.574 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.587 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.595Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.595Z [INFO] agent.router.manager: shutting down 32:16.595 [INFO] TestAgent: consul server down 32:16.595 [INFO] TestAgent: shutdown complete 32:16.595 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30001 network=tcp 32:16.595 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30001 network=udp 32:16.595 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29988 network=tcp 32:17.096 [INFO] TestAgent: Waiting for endpoints to shut down 32:17.096 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{2_2_2_2_2_2_2_2_2_2_2} === CONT TestDNS_ServiceLookup_AnswerLimits/A_lookup_{1_1_1_1_1_1_1_1_1_1_1} 2021-10-05T16:32:15.358Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:15.381Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:15.462 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:010a10cc-efa6-a3c0-e74c-40ad6bfa87bd Address:127.0.0.1:29881}]" 32:15.462 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29881 [Follower]" leader= 32:15.463 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:15.463 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:15.463Z [INFO] agent.router: Initializing LAN area manager 32:15.464 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29945 network=udp 32:15.464 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29881) (DC: dc1)" 32:15.464 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:15.464 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29945 network=tcp 32:15.464 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29925 network=tcp 32:15.464 [INFO] TestAgent: started state syncer 32:15.465 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29882 network=tcp 32:15.524 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:15.524 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29881 [Candidate]" term=2 32:15.555 [DEBUG] TestAgent.server.raft: votes: needed=1 32:15.555 [DEBUG] TestAgent.server.raft: vote granted: from=010a10cc-efa6-a3c0-e74c-40ad6bfa87bd term=2 tally=1 32:15.555 [INFO] TestAgent.server.raft: election won: tally=1 32:15.555 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29881 [Leader]" 32:15.555 [INFO] TestAgent.server: cluster leadership acquired 32:15.556 [INFO] TestAgent.server: New leader elected: payload=test-node 32:15.572 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29881 32:15.612 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:15.651 [INFO] TestAgent: Synced node info 32:15.690 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:15.690 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:15.690 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:15.690 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:15.690 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:15.691 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:15.691 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:15.738 [INFO] TestAgent.server: federation state anti-entropy synced 32:16.779 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.315861ms client=127.0.0.1:56141 client_network=udp 32:16.780 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.211664ms client=127.0.0.1:42143 client_network=udp 32:16.786 [DEBUG] TestAgent.dns: request served from client: name=47724686-9c5e-c11d-69bf-f959de081f14.query.consul. type=A class=IN latency=1.427524ms client=127.0.0.1:35158 client_network=udp 32:16.787 [INFO] TestAgent: Requesting shutdown 32:16.787 [INFO] TestAgent.server: shutting down server 32:16.787 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.787 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.787 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.787 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.787 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.787 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.787 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.787 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.787 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.787 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.791 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.794Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.794Z [INFO] agent.router.manager: shutting down 32:16.794 [INFO] TestAgent: consul server down 32:16.794 [INFO] TestAgent: shutdown complete 32:16.794 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29945 network=tcp 32:16.795 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29945 network=udp 32:16.795 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29925 network=tcp 32:17.296 [INFO] TestAgent: Waiting for endpoints to shut down 32:17.296 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{1_1_1_1_1_1_1_1_1_1_1} [WARN] freeport: 4 out of 25 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:15.146Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:15.179Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:15.270 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bdc5c2bc-9d4d-d1ad-fc8c-db0bf1f170b0 Address:127.0.0.1:29943}]" 32:15.271 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:15.271 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:15.271Z [INFO] agent.router: Initializing LAN area manager 32:15.271 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29924 network=udp 32:15.271 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29943 [Follower]" leader= 32:15.272 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29943) (DC: dc1)" 32:15.272 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:15.272 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29924 network=tcp 32:15.273 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29939 network=tcp 32:15.273 [INFO] TestAgent: started state syncer 32:15.273 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29944 network=tcp 32:15.340 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:15.340 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29943 [Candidate]" term=2 32:15.361 [DEBUG] TestAgent.server.raft: votes: needed=1 32:15.361 [DEBUG] TestAgent.server.raft: vote granted: from=bdc5c2bc-9d4d-d1ad-fc8c-db0bf1f170b0 term=2 tally=1 32:15.361 [INFO] TestAgent.server.raft: election won: tally=1 32:15.361 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29943 [Leader]" 32:15.361 [INFO] TestAgent.server: cluster leadership acquired 32:15.362 [INFO] TestAgent.server: New leader elected: payload=test-node 32:15.377 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29943 32:15.406 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:15.472 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:15.472 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:15.472 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:15.472 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:15.472 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:15.472 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:15.472 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:15.511 [INFO] TestAgent: Synced node info 32:15.511 [DEBUG] TestAgent: Node info in sync 32:15.523 [INFO] TestAgent.server: federation state anti-entropy synced 32:16.921 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.32712ms client=127.0.0.1:57659 client_network=udp 32:16.929 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.027317ms client=127.0.0.1:59629 client_network=udp 32:16.930 [DEBUG] TestAgent.dns: request served from client: name=e35d44d1-66be-5e56-a084-c328dd6414ff.query.consul. type=AAAA class=IN latency=935.832µs client=127.0.0.1:49190 client_network=udp 32:16.930 [INFO] TestAgent: Requesting shutdown 32:16.930 [INFO] TestAgent.server: shutting down server 32:16.930 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:16.930 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:16.930 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:16.930 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:16.930 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:16.930 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:16.930 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:16.930 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:16.930 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:16.930 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:16.935 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:16.940Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:16.940Z [INFO] agent.router.manager: shutting down 32:16.940 [INFO] TestAgent: consul server down 32:16.940 [INFO] TestAgent: shutdown complete 32:16.940 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29924 network=tcp 32:16.940 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29924 network=udp 32:16.940 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29939 network=tcp 32:17.440 [INFO] TestAgent: Waiting for endpoints to shut down 32:17.440 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{0_0_0_0_0_0_0_0_0_0_0} [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:16.312Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:16.328Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:16.403 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4f893a5a-4b01-d4b6-bc9e-16cd90086cca Address:127.0.0.1:29978}]" 32:16.403 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29978 [Follower]" leader= 32:16.404 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:16.404 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:16.404Z [INFO] agent.router: Initializing LAN area manager 32:16.405 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29869 network=udp 32:16.405 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29978) (DC: dc1)" 32:16.405 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:16.405 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29869 network=tcp 32:16.405 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30002 network=tcp 32:16.405 [INFO] TestAgent: started state syncer 32:16.405 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29979 network=tcp 32:16.461 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:16.461 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29978 [Candidate]" term=2 32:16.482 [DEBUG] TestAgent.server.raft: votes: needed=1 32:16.482 [DEBUG] TestAgent.server.raft: vote granted: from=4f893a5a-4b01-d4b6-bc9e-16cd90086cca term=2 tally=1 32:16.482 [INFO] TestAgent.server.raft: election won: tally=1 32:16.482 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29978 [Leader]" 32:16.484 [INFO] TestAgent.server: cluster leadership acquired 32:16.484 [INFO] TestAgent.server: New leader elected: payload=test-node 32:16.501 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29978 32:16.576 [INFO] TestAgent: Synced node info 32:16.576 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:16.652 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:16.652 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:16.652 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:16.652 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:16.652 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:16.652 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:16.652 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:16.692 [INFO] TestAgent.server: federation state anti-entropy synced 32:18.177 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.511462ms client=127.0.0.1:58664 client_network=udp 32:18.182 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.666034ms client=127.0.0.1:52285 client_network=udp 32:18.189 [DEBUG] TestAgent.dns: request served from client: name=c1e0c2eb-61df-c90b-7711-82b82069e7ff.query.consul. type=ANY class=IN latency=6.131846ms client=127.0.0.1:43768 client_network=udp 32:18.192 [INFO] TestAgent: Requesting shutdown 32:18.192 [INFO] TestAgent.server: shutting down server 32:18.192 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:18.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:18.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:18.192 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:18.192 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:18.192 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:18.192 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:18.192 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:18.192 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:18.192 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:18.204 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:18.208Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:18.208Z [INFO] agent.router.manager: shutting down 32:18.208 [INFO] TestAgent: consul server down 32:18.208 [INFO] TestAgent: shutdown complete 32:18.208 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29869 network=tcp 32:18.208 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29869 network=udp 32:18.208 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30002 network=tcp 32:18.712 [INFO] TestAgent: Waiting for endpoints to shut down 32:18.712 [INFO] TestAgent: Endpoints down === CONT TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{0_0_0_0_0_0_0_0_0_0_0} === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=true [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:16.850Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:16.877Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:16.930 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2effb4fb-fa6e-d23b-8a17-ece4b408f992 Address:127.0.0.1:29971}]" 32:16.931 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:16.931 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29971 [Follower]" leader= 32:16.932 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:16.932Z [INFO] agent.router: Initializing LAN area manager 32:16.932 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:16.932 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29971) (DC: dc1)" 32:16.932 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29959 network=udp 32:16.932 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29959 network=tcp 32:16.932 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29953 network=tcp 32:16.932 [INFO] TestAgent: started state syncer 32:16.933 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29972 network=tcp 32:17.001 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.001 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29971 [Candidate]" term=2 32:17.016 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.016 [DEBUG] TestAgent.server.raft: vote granted: from=2effb4fb-fa6e-d23b-8a17-ece4b408f992 term=2 tally=1 32:17.016 [INFO] TestAgent.server.raft: election won: tally=1 32:17.016 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29971 [Leader]" 32:17.016 [INFO] TestAgent.server: cluster leadership acquired 32:17.016 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.039 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29971 32:17.055 [INFO] TestAgent: Synced node info 32:17.086 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.172 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.172 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.172 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.172 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.172 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.172 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.172 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.233 [INFO] TestAgent.server: federation state anti-entropy synced 32:18.953 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.282069ms client=127.0.0.1:34558 client_network=udp 32:18.954 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.144549ms client=127.0.0.1:41578 client_network=udp 32:18.957 [DEBUG] TestAgent.dns: request served from client: name=41fc2a52-3793-c6b9-1349-afa9a0eedf01.query.consul. type=AAAA class=IN latency=1.3141ms client=127.0.0.1:32801 client_network=udp 32:18.964 [INFO] TestAgent: Requesting shutdown 32:18.964 [INFO] TestAgent.server: shutting down server 32:18.964 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:18.964 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:18.964 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:18.964 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:18.964 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:18.964 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:18.964 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:18.964 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:18.964 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:18.964 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:18.993 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:18.998Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:18.998Z [INFO] agent.router.manager: shutting down 32:18.998 [INFO] TestAgent: consul server down 32:18.998 [INFO] TestAgent: shutdown complete 32:18.998 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29959 network=tcp 32:18.998 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29959 network=udp 32:18.998 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29953 network=tcp 32:19.499 [INFO] TestAgent: Waiting for endpoints to shut down 32:19.516 [INFO] TestAgent: Endpoints down === CONT TestUiServices/No_Filter 2021-10-05T16:31:31.281Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:31.336Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:31.400 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:df28d22f-2ab1-b0b3-c13d-4e34e45f0de6 Address:127.0.0.1:29734}]" 31:31.401 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-df28d22f-2ab1-b0b3-c13d-4e34e45f0de6.dc1 127.0.0.1 31:31.401 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-df28d22f-2ab1-b0b3-c13d-4e34e45f0de6 127.0.0.1 2021-10-05T16:31:31.401Z [INFO] agent.router: Initializing LAN area manager 31:31.402 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29722 network=udp 31:31.402 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29734 [Follower]" leader= 31:31.402 [INFO] TestAgent.server: Adding LAN server: server="Node-df28d22f-2ab1-b0b3-c13d-4e34e45f0de6 (Addr: tcp/127.0.0.1:29734) (DC: dc1)" 31:31.402 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-df28d22f-2ab1-b0b3-c13d-4e34e45f0de6.dc1 area=wan 31:31.402 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29722 network=tcp 31:31.403 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29723 network=tcp 31:31.403 [INFO] TestAgent: started state syncer 31:31.403 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29735 network=tcp 31:31.456 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:31.456 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29734 [Candidate]" term=2 31:31.486 [DEBUG] TestAgent.server.raft: votes: needed=1 31:31.486 [DEBUG] TestAgent.server.raft: vote granted: from=df28d22f-2ab1-b0b3-c13d-4e34e45f0de6 term=2 tally=1 31:31.486 [INFO] TestAgent.server.raft: election won: tally=1 31:31.486 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29734 [Leader]" 31:31.486 [INFO] TestAgent.server: cluster leadership acquired 31:31.486 [INFO] TestAgent.server: New leader elected: payload=Node-df28d22f-2ab1-b0b3-c13d-4e34e45f0de6 31:31.495 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29734 31:31.528 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:31.568 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:31.568 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:31.568 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:31.568 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:31.568 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:31.568 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-df28d22f-2ab1-b0b3-c13d-4e34e45f0de6 31:31.568 [INFO] TestAgent.server: member joined, marking health alive: member=Node-df28d22f-2ab1-b0b3-c13d-4e34e45f0de6 31:31.589 [INFO] TestAgent.server: federation state anti-entropy synced 31:31.677 [INFO] TestAgent: Requesting shutdown 31:31.677 [INFO] TestAgent.server: shutting down server 31:31.677 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:31.677 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:31.677 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:31.677 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:31.677 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:31.677 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:31.677 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:31.677 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:31.677 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:31.677 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:31.677 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:31.685 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:31.689Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:31.689Z [INFO] agent.router.manager: shutting down 31:31.689 [INFO] TestAgent: consul server down 31:31.689 [INFO] TestAgent: shutdown complete 31:31.689 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29722 network=tcp 31:31.689 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29722 network=udp 31:31.689 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29723 network=tcp 31:32.191 [INFO] TestAgent: Waiting for endpoints to shut down 31:32.191 [INFO] TestAgent: Endpoints down --- PASS: TestUiServices (0.95s) --- PASS: TestUiServices/Filtered (0.00s) --- PASS: TestUiServices/No_Filter (0.00s) [WARN] freeport: 4 out of 18 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:16.998Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:17.021Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:17.142 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c6519e0c-db94-909f-3a96-ad4092add244 Address:127.0.0.1:30006}]" 32:17.143 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:17.144 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:17.144Z [INFO] agent.router: Initializing LAN area manager 32:17.144 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30006 [Follower]" leader= 32:17.144 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:17.144 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30006) (DC: dc1)" 32:17.144 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30029 network=udp 32:17.144 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30029 network=tcp 32:17.145 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30009 network=tcp 32:17.145 [INFO] TestAgent: started state syncer 32:17.145 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30007 network=tcp 32:17.183 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.184 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30006 [Candidate]" term=2 32:17.244 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.244 [DEBUG] TestAgent.server.raft: vote granted: from=c6519e0c-db94-909f-3a96-ad4092add244 term=2 tally=1 32:17.244 [INFO] TestAgent.server.raft: election won: tally=1 32:17.244 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30006 [Leader]" 32:17.248 [INFO] TestAgent.server: cluster leadership acquired 32:17.248 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.280 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30006 32:17.316 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.340 [INFO] TestAgent: Synced node info 32:17.340 [DEBUG] TestAgent: Node info in sync 32:17.372 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.372 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.372 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.372 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.372 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.372 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.372 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.440 [INFO] TestAgent.server: federation state anti-entropy synced 32:19.145 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=4.687512ms client=127.0.0.1:49482 client_network=udp 32:19.167 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=21.803328ms client=127.0.0.1:52549 client_network=udp 32:19.192 [DEBUG] TestAgent.dns: request served from client: name=27485fa2-054f-40dc-3553-0eb7c8bd5c40.query.consul. type=ANY class=IN latency=20.796117ms client=127.0.0.1:43761 client_network=udp 32:19.192 [INFO] TestAgent: Requesting shutdown 32:19.192 [INFO] TestAgent.server: shutting down server 32:19.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:19.192 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:19.192 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:19.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:19.192 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:19.193 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:19.193 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:19.193 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:19.193 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:19.193 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:19.200 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:19.204Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:19.204Z [INFO] agent.router.manager: shutting down 32:19.210 [INFO] TestAgent: consul server down 32:19.210 [INFO] TestAgent: shutdown complete 32:19.210 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30029 network=tcp 32:19.228 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30029 network=udp 32:19.228 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30009 network=tcp 32:19.729 [INFO] TestAgent: Waiting for endpoints to shut down 32:19.729 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:17.144Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:17.176Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:17.303 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:89c7d317-b8e5-bd56-2e5c-001e07774d6b Address:127.0.0.1:29964}]" 32:17.304 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29964 [Follower]" leader= 32:17.304 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:17.305 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:17.305Z [INFO] agent.router: Initializing LAN area manager 32:17.305 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30057 network=udp 32:17.305 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29964) (DC: dc1)" 32:17.305 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:17.305 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30057 network=tcp 32:17.306 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29960 network=tcp 32:17.306 [INFO] TestAgent: started state syncer 32:17.307 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29965 network=tcp 32:17.355 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.355 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29964 [Candidate]" term=2 32:17.383 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.383 [DEBUG] TestAgent.server.raft: vote granted: from=89c7d317-b8e5-bd56-2e5c-001e07774d6b term=2 tally=1 32:17.383 [INFO] TestAgent.server.raft: election won: tally=1 32:17.383 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29964 [Leader]" 32:17.384 [INFO] TestAgent.server: cluster leadership acquired 32:17.384 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.404 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29964 32:17.452 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.513 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.513 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.513 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.513 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.513 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.514 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.514 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.542 [INFO] TestAgent: Synced node info 32:17.542 [DEBUG] TestAgent: Node info in sync 32:17.573 [INFO] TestAgent.server: federation state anti-entropy synced 32:18.461 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:18.480 [INFO] TestAgent: Synced node info 32:19.204 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=12.082695ms client=127.0.0.1:41349 client_network=udp 32:19.207 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=2.282381ms client=127.0.0.1:54592 client_network=udp 32:19.231 [DEBUG] TestAgent.dns: request served from client: name=2f5cde29-5ddf-e1b5-72e8-0d1808ca3f5b.query.consul. type=A class=IN latency=2.966356ms client=127.0.0.1:42484 client_network=udp 32:19.231 [INFO] TestAgent: Requesting shutdown 32:19.231 [INFO] TestAgent.server: shutting down server 32:19.231 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:19.231 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:19.231 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:19.231 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:19.231 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:19.231 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:19.231 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:19.231 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:19.231 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:19.231 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:19.238 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:19.243Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:19.243Z [INFO] agent.router.manager: shutting down 32:19.243 [INFO] TestAgent: consul server down 32:19.243 [INFO] TestAgent: shutdown complete 32:19.243 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30057 network=tcp 32:19.243 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30057 network=udp 32:19.243 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29960 network=tcp 32:19.744 [INFO] TestAgent: Waiting for endpoints to shut down 32:19.744 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:17.041Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:17.065Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:17.264 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:60fa77bc-50f3-7123-faf1-873dcb403079 Address:127.0.0.1:30048}]" 32:17.264 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30048 [Follower]" leader= 32:17.265 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:17.265 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:17.265Z [INFO] agent.router: Initializing LAN area manager 32:17.265 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29966 network=udp 32:17.266 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30048) (DC: dc1)" 32:17.266 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:17.266 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29966 network=tcp 32:17.266 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30044 network=tcp 32:17.266 [INFO] TestAgent: started state syncer 32:17.267 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30049 network=tcp 32:17.328 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.328 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30048 [Candidate]" term=2 32:17.361 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.361 [DEBUG] TestAgent.server.raft: vote granted: from=60fa77bc-50f3-7123-faf1-873dcb403079 term=2 tally=1 32:17.361 [INFO] TestAgent.server.raft: election won: tally=1 32:17.361 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30048 [Leader]" 32:17.361 [INFO] TestAgent.server: cluster leadership acquired 32:17.361 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.377 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30048 32:17.438 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.495 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.495 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.495 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.495 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.495 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.495 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.495 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.524 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:17.540 [INFO] TestAgent: Synced node info 32:17.540 [DEBUG] TestAgent: Node info in sync 32:17.540 [INFO] TestAgent.server: federation state anti-entropy synced 32:17.851 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:17.851 [DEBUG] TestAgent: Node info in sync 32:19.264 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.699529ms client=127.0.0.1:49249 client_network=udp 32:19.266 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.671977ms client=127.0.0.1:52060 client_network=udp 32:19.274 [DEBUG] TestAgent.dns: request served from client: name=71e7a5b7-3da9-1e66-fe92-39cacce8b755.query.consul. type=ANY class=IN latency=1.99708ms client=127.0.0.1:40391 client_network=udp 32:19.274 [INFO] TestAgent: Requesting shutdown 32:19.274 [INFO] TestAgent.server: shutting down server 32:19.274 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:19.274 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:19.274 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:19.274 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:19.274 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:19.274 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:19.274 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:19.274 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:19.274 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:19.274 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:19.278 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:19.278Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:19.278Z [INFO] agent.router.manager: shutting down 32:19.279 [INFO] TestAgent: consul server down 32:19.279 [INFO] TestAgent: shutdown complete 32:19.281 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29966 network=tcp 32:19.281 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29966 network=udp 32:19.281 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30044 network=tcp 32:19.783 [INFO] TestAgent: Waiting for endpoints to shut down 32:19.783 [INFO] TestAgent: Endpoints down [WARN] freeport: 4 out of 25 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=false 2021-10-05T16:32:17.067Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:17.110Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:17.278 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bbbb429f-4be1-5787-cfb9-903949548f92 Address:127.0.0.1:30055}]" 32:17.279 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30055 [Follower]" leader= 32:17.279 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:17.280 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:17.280Z [INFO] agent.router: Initializing LAN area manager 32:17.280 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30015 network=udp 32:17.280 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30055) (DC: dc1)" 32:17.280 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30015 network=tcp 32:17.280 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:17.281 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30051 network=tcp 32:17.281 [INFO] TestAgent: started state syncer 32:17.281 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30056 network=tcp 32:17.338 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.338 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30055 [Candidate]" term=2 32:17.371 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.371 [DEBUG] TestAgent.server.raft: vote granted: from=bbbb429f-4be1-5787-cfb9-903949548f92 term=2 tally=1 32:17.372 [INFO] TestAgent.server.raft: election won: tally=1 32:17.372 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30055 [Leader]" 32:17.372 [INFO] TestAgent.server: cluster leadership acquired 32:17.372 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.396 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30055 32:17.440 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.514 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.514 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.514 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.514 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.514 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.515 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.515 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.542 [INFO] TestAgent.server: federation state anti-entropy synced 32:17.694 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:17.744 [INFO] TestAgent: Synced node info 32:18.980 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:18.980 [DEBUG] TestAgent: Node info in sync 32:18.980 [DEBUG] TestAgent: Node info in sync 32:19.388 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.248775ms client=127.0.0.1:36959 client_network=udp 32:19.397 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.275797ms client=127.0.0.1:57024 client_network=udp 32:19.399 [DEBUG] TestAgent.dns: request served from client: name=feef02ef-05e4-5443-9fe4-03cbbeb7be29.query.consul. type=AAAA class=IN latency=1.247746ms client=127.0.0.1:36856 client_network=udp 32:19.400 [INFO] TestAgent: Requesting shutdown 32:19.400 [INFO] TestAgent.server: shutting down server 32:19.400 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:19.400 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:19.400 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:19.400 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:19.400 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:19.400 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:19.400 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:19.400 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:19.400 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:19.400 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:19.412 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:19.425Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:19.425Z [INFO] agent.router.manager: shutting down 32:19.425 [INFO] TestAgent: consul server down 32:19.425 [INFO] TestAgent: shutdown complete 32:19.425 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30015 network=tcp 32:19.425 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30015 network=udp 32:19.425 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30051 network=tcp 32:19.928 [INFO] TestAgent: Waiting for endpoints to shut down 32:19.928 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:17.324Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:17.349Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:17.442 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e36b3928-4af1-77b1-183b-1875fd9a91ff Address:127.0.0.1:30041}]" 32:17.442 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30041 [Follower]" leader= 32:17.444 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:17.445 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:17.445Z [INFO] agent.router: Initializing LAN area manager 32:17.450 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30041) (DC: dc1)" 32:17.450 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:17.450 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30008 network=tcp 32:17.450 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30008 network=udp 32:17.451 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30037 network=tcp 32:17.451 [INFO] TestAgent: started state syncer 32:17.451 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30042 network=tcp 32:17.510 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.510 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30041 [Candidate]" term=2 32:17.542 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.542 [DEBUG] TestAgent.server.raft: vote granted: from=e36b3928-4af1-77b1-183b-1875fd9a91ff term=2 tally=1 32:17.542 [INFO] TestAgent.server.raft: election won: tally=1 32:17.542 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30041 [Leader]" 32:17.542 [INFO] TestAgent.server: cluster leadership acquired 32:17.543 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.564 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30041 32:17.614 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.690 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.690 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.690 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.690 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.690 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.690 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.690 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.728 [INFO] TestAgent.server: federation state anti-entropy synced 32:17.808 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:17.831 [INFO] TestAgent: Synced node info 32:19.490 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.720012ms client=127.0.0.1:46187 client_network=udp 32:19.513 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.502079ms client=127.0.0.1:33572 client_network=udp 32:19.519 [DEBUG] TestAgent.dns: request served from client: name=b4b448b1-3c8f-6c26-a2c9-bbbe777b8378.query.consul. type=AAAA class=IN latency=1.017815ms client=127.0.0.1:33452 client_network=udp 32:19.519 [INFO] TestAgent: Requesting shutdown 32:19.519 [INFO] TestAgent.server: shutting down server 32:19.519 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:19.519 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:19.519 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:19.519 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:19.519 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:19.519 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:19.519 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:19.519 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:19.519 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:19.519 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:19.524 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:19.525Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:19.525Z [INFO] agent.router.manager: shutting down 32:19.525 [INFO] TestAgent: consul server down 32:19.525 [INFO] TestAgent: shutdown complete 32:19.525 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30008 network=tcp 32:19.525 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30008 network=udp 32:19.525 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30037 network=tcp 32:20.028 [INFO] TestAgent: Waiting for endpoints to shut down 32:20.028 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:17.154Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:17.177Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:17.298 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5988b08e-d295-db62-b010-8ea76cdc1a9b Address:127.0.0.1:29957}]" 32:17.299 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:17.300 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29957 [Follower]" leader= 32:17.300 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:17.300Z [INFO] agent.router: Initializing LAN area manager 32:17.300 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:29957) (DC: dc1)" 32:17.300 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:17.300 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29994 network=udp 32:17.300 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29994 network=tcp 32:17.301 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30016 network=tcp 32:17.301 [INFO] TestAgent: started state syncer 32:17.301 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29958 network=tcp 32:17.366 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.366 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29957 [Candidate]" term=2 32:17.400 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.400 [DEBUG] TestAgent.server.raft: vote granted: from=5988b08e-d295-db62-b010-8ea76cdc1a9b term=2 tally=1 32:17.400 [INFO] TestAgent.server.raft: election won: tally=1 32:17.400 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29957 [Leader]" 32:17.400 [INFO] TestAgent.server: cluster leadership acquired 32:17.400 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.408 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29957 32:17.456 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.528 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.528 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.528 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.528 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.528 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.528 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.528 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.576 [INFO] TestAgent.server: federation state anti-entropy synced 32:17.719 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:17.729 [INFO] TestAgent: Synced node info 32:17.729 [DEBUG] TestAgent: Node info in sync 32:19.487 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=A class=IN latency=1.835848ms client=127.0.0.1:37166 client_network=udp 32:19.489 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=A class=IN latency=1.625015ms client=127.0.0.1:60668 client_network=udp 32:19.513 [DEBUG] TestAgent.dns: request served from client: name=c4d378a3-9519-1ba6-9559-ee40902cdfdf.query.consul. type=A class=IN latency=1.27861ms client=127.0.0.1:39343 client_network=udp 32:19.516 [INFO] TestAgent: Requesting shutdown 32:19.516 [INFO] TestAgent.server: shutting down server 32:19.516 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:19.516 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:19.516 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:19.516 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:19.516 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:19.516 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:19.516 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:19.516 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:19.516 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:19.516 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:19.524 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:19.524Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:19.524Z [INFO] agent.router.manager: shutting down 32:19.524 [INFO] TestAgent: consul server down 32:19.524 [INFO] TestAgent: shutdown complete 32:19.524 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29994 network=tcp 32:19.524 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29994 network=udp 32:19.525 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30016 network=tcp 32:20.028 [INFO] TestAgent: Waiting for endpoints to shut down 32:20.028 [INFO] TestAgent: Endpoints down [WARN] freeport: 4 out of 25 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:17.461Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:17.476Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:17.566 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b13fd73b-7130-602a-6674-b21fcde3eb54 Address:127.0.0.1:30111}]" 32:17.566 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30111 [Follower]" leader= 32:17.567 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:17.567 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:17.568Z [INFO] agent.router: Initializing LAN area manager 32:17.568 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30064 network=udp 32:17.568 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30111) (DC: dc1)" 32:17.568 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:17.569 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30064 network=tcp 32:17.569 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30030 network=tcp 32:17.569 [INFO] TestAgent: started state syncer 32:17.571 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30112 network=tcp 32:17.603 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:17.603 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30111 [Candidate]" term=2 32:17.624 [DEBUG] TestAgent.server.raft: votes: needed=1 32:17.624 [DEBUG] TestAgent.server.raft: vote granted: from=b13fd73b-7130-602a-6674-b21fcde3eb54 term=2 tally=1 32:17.624 [INFO] TestAgent.server.raft: election won: tally=1 32:17.624 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30111 [Leader]" 32:17.624 [INFO] TestAgent.server: cluster leadership acquired 32:17.624 [INFO] TestAgent.server: New leader elected: payload=test-node 32:17.640 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30111 32:17.681 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:17.741 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:17.741 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:17.741 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:17.741 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:17.741 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:17.741 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:17.741 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:17.765 [INFO] TestAgent.server: federation state anti-entropy synced 32:17.805 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:17.819 [INFO] TestAgent: Synced node info 32:19.519 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:19.519 [DEBUG] TestAgent: Node info in sync 32:19.519 [DEBUG] TestAgent: Node info in sync 32:19.613 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=ANY class=IN latency=1.42809ms client=127.0.0.1:50090 client_network=udp 32:19.615 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=ANY class=IN latency=1.53822ms client=127.0.0.1:34273 client_network=udp 32:19.625 [DEBUG] TestAgent.dns: request served from client: name=b3427783-0e0f-ac1d-41aa-ed9b390439ee.query.consul. type=ANY class=IN latency=9.527276ms client=127.0.0.1:43266 client_network=udp 32:19.625 [INFO] TestAgent: Requesting shutdown 32:19.625 [INFO] TestAgent.server: shutting down server 32:19.625 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:19.625 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:19.625 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:19.625 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:19.625 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:19.625 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:19.625 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:19.625 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:19.625 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:19.625 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:19.649 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:19.649Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:19.649Z [INFO] agent.router.manager: shutting down 32:19.649 [INFO] TestAgent: consul server down 32:19.649 [INFO] TestAgent: shutdown complete 32:19.649 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30064 network=tcp 32:19.649 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30064 network=udp 32:19.649 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30030 network=tcp 32:20.152 [INFO] TestAgent: Waiting for endpoints to shut down 32:20.152 [INFO] TestAgent: Endpoints down [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:32:18.772Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:18.825Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:18.952 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:16b2223b-391b-301a-9803-ba9a32b1df8b Address:127.0.0.1:30062}]" 32:18.952 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 32:18.953 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:32:18.953Z [INFO] agent.router: Initializing LAN area manager 32:18.953 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30036 network=udp 32:18.953 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30062 [Follower]" leader= 32:18.953 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:30062) (DC: dc1)" 32:18.953 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 32:18.953 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30036 network=tcp 32:18.954 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30023 network=tcp 32:18.954 [INFO] TestAgent: started state syncer 32:18.954 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30063 network=tcp 32:19.000 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:19.000 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30062 [Candidate]" term=2 32:19.055 [DEBUG] TestAgent.server.raft: votes: needed=1 32:19.055 [DEBUG] TestAgent.server.raft: vote granted: from=16b2223b-391b-301a-9803-ba9a32b1df8b term=2 tally=1 32:19.055 [INFO] TestAgent.server.raft: election won: tally=1 32:19.055 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30062 [Leader]" 32:19.055 [INFO] TestAgent.server: cluster leadership acquired 32:19.056 [INFO] TestAgent.server: New leader elected: payload=test-node 32:19.085 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30062 32:19.143 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:19.209 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:19.209 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:19.209 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:19.209 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:19.209 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:19.228 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 32:19.228 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 32:19.238 [INFO] TestAgent: Synced node info 32:19.238 [DEBUG] TestAgent: Node info in sync 32:19.264 [INFO] TestAgent.server: federation state anti-entropy synced 32:20.492 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:20.508 [INFO] TestAgent: Synced node info 32:20.529 [DEBUG] TestAgent.dns: request served from client: name=api-tier.service.consul. type=AAAA class=IN latency=1.293161ms client=127.0.0.1:53607 client_network=udp 32:20.537 [DEBUG] TestAgent.dns: request served from client: name=api-tier.query.consul. type=AAAA class=IN latency=1.338775ms client=127.0.0.1:37492 client_network=udp 32:20.541 [DEBUG] TestAgent.dns: request served from client: name=7d4989bb-8b66-7fa1-9bf3-19dfa12c4af0.query.consul. type=AAAA class=IN latency=1.312653ms client=127.0.0.1:49820 client_network=udp 32:20.541 [INFO] TestAgent: Requesting shutdown 32:20.541 [INFO] TestAgent.server: shutting down server 32:20.541 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:20.541 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:20.542 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:20.542 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:20.542 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:20.542 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:20.542 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:20.542 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:20.542 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:20.542 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:20.545 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:20.546Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:20.546Z [INFO] agent.router.manager: shutting down 32:20.546 [INFO] TestAgent: consul server down 32:20.546 [INFO] TestAgent: shutdown complete 32:20.546 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30036 network=tcp 32:20.546 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30036 network=udp 32:20.546 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30023 network=tcp 32:21.048 [INFO] TestAgent: Waiting for endpoints to shut down 32:21.048 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_ServiceLookup_AnswerLimits (0.00s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{0_0_0_0_0_0_0_0_0_0_0} (2.17s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} (2.28s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} (2.13s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} (2.29s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} (2.39s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{30_30_8_8_6_8_8_5_8_-5_-5} (2.46s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{6_6_6_6_6_6_6_5_6_6_-5} (2.52s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{20_20_8_8_6_8_8_5_8_-5_-5} (2.14s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{9_9_8_8_6_8_8_5_8_8_-5} (2.24s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{9_9_8_8_6_8_8_5_8_8_-5} (2.35s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{8_8_8_8_6_8_8_5_8_8_-5} (2.44s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{9_9_8_8_6_8_8_5_8_8_-5} (2.55s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{8_8_8_8_6_8_8_5_8_8_-5} (2.45s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{7_7_7_7_6_7_7_5_7_7_-5} (2.43s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{8_8_8_8_6_8_8_5_8_8_-5} (2.43s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{7_7_7_7_6_7_7_5_7_7_-5} (2.19s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{7_7_7_7_6_7_7_5_7_7_-5} (2.16s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{6_6_6_6_6_6_6_5_6_6_-5} (2.30s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{6_6_6_6_6_6_6_5_6_6_-5} (2.29s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{5_5_5_5_5_5_5_5_5_5_5} (2.29s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{5_5_5_5_5_5_5_5_5_5_5} (2.28s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{4_4_4_4_4_4_4_4_4_4_4} (2.29s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{3_3_3_3_3_3_3_3_3_3_3} (2.48s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{5_5_5_5_5_5_5_5_5_5_5} (2.43s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{4_4_4_4_4_4_4_4_4_4_4} (1.97s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{4_4_4_4_4_4_4_4_4_4_4} (2.34s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{3_3_3_3_3_3_3_3_3_3_3} (2.43s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{3_3_3_3_3_3_3_3_3_3_3} (2.70s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{1_1_1_1_1_1_1_1_1_1_1} (2.75s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{2_2_2_2_2_2_2_2_2_2_2} (2.63s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{2_2_2_2_2_2_2_2_2_2_2} (2.77s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{2_2_2_2_2_2_2_2_2_2_2} (2.89s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{1_1_1_1_1_1_1_1_1_1_1} (2.73s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/A_lookup_{1_1_1_1_1_1_1_1_1_1_1} (2.92s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/ANY_lookup_{0_0_0_0_0_0_0_0_0_0_0} (2.71s) --- PASS: TestDNS_ServiceLookup_AnswerLimits/AAAA_lookup_{0_0_0_0_0_0_0_0_0_0_0} (2.33s) [WARN] freeport: 4 out of 11 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=false [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=false [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=false [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=true === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=false [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=false [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=false [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=true [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=false === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=false#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=true#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=true#01 === RUN TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=false#01 [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! [WARN] freeport: 4 out of 4 pending ports are still in use; something probably didn't wait around for the port to be closed! 2021-10-05T16:31:20.090Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.107Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.210 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8f5033a9-434a-0580-7404-3dcc33e58ca5 Address:127.0.0.1:30092}]" 31:20.211 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8f5033a9-434a-0580-7404-3dcc33e58ca5.dc1 127.0.0.1 31:20.212 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8f5033a9-434a-0580-7404-3dcc33e58ca5 127.0.0.1 2021-10-05T16:31:20.212Z [INFO] agent.router: Initializing LAN area manager 31:20.212 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30087 network=udp 31:20.212 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30092 [Follower]" leader= 31:20.212 [INFO] TestAgent.server: Adding LAN server: server="Node-8f5033a9-434a-0580-7404-3dcc33e58ca5 (Addr: tcp/127.0.0.1:30092) (DC: dc1)" 31:20.212 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8f5033a9-434a-0580-7404-3dcc33e58ca5.dc1 area=wan 31:20.212 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30087 network=tcp 31:20.213 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30088 network=tcp 31:20.213 [INFO] TestAgent: started state syncer 31:20.213 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30079 network=tcp 31:20.249 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.249 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30092 [Candidate]" term=2 31:20.275 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.276 [DEBUG] TestAgent.server.raft: vote granted: from=8f5033a9-434a-0580-7404-3dcc33e58ca5 term=2 tally=1 31:20.276 [INFO] TestAgent.server.raft: election won: tally=1 31:20.276 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30092 [Leader]" 31:20.276 [INFO] TestAgent.server: cluster leadership acquired 31:20.276 [INFO] TestAgent.server: New leader elected: payload=Node-8f5033a9-434a-0580-7404-3dcc33e58ca5 31:20.285 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30092 31:20.336 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.367 [INFO] TestAgent: Synced node info 31:20.410 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.410 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.410 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.410 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.410 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.410 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f5033a9-434a-0580-7404-3dcc33e58ca5 31:20.410 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8f5033a9-434a-0580-7404-3dcc33e58ca5 31:20.443 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.444 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=210.137µs client=127.0.0.1:53956 client_network=tcp 31:20.449 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=155.539µs client=127.0.0.1:53958 client_network=tcp 31:20.460 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=429.997µs client=127.0.0.1:37915 client_network=udp 31:20.467 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=532.058µs client=127.0.0.1:35033 client_network=udp 31:20.467 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=305.255µs client=127.0.0.1:53962 client_network=tcp 31:20.468 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=164.205µs client=127.0.0.1:53964 client_network=tcp 31:20.468 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=116.234µs client=127.0.0.1:46482 client_network=udp 31:20.469 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=112.025µs client=127.0.0.1:52598 client_network=udp 31:20.469 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=103.751µs client=127.0.0.1:53966 client_network=tcp 31:20.470 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=100.301µs client=127.0.0.1:53968 client_network=tcp 31:20.470 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=92.734µs client=127.0.0.1:40444 client_network=udp 31:20.470 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=88.471µs client=127.0.0.1:60955 client_network=udp 31:20.471 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=107.018µs client=127.0.0.1:53970 client_network=tcp 31:20.471 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=103.461µs client=127.0.0.1:53972 client_network=tcp 31:20.471 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=111.538µs client=127.0.0.1:55309 client_network=udp 31:20.486 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=290.684µs client=127.0.0.1:33634 client_network=udp 31:20.488 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=139.42µs client=127.0.0.1:53976 client_network=tcp 31:20.489 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=139.936µs client=127.0.0.1:53978 client_network=tcp 31:20.489 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=190.049µs client=127.0.0.1:54861 client_network=udp 31:20.496 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=150.753µs client=127.0.0.1:54085 client_network=udp 31:20.497 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=182.66µs client=127.0.0.1:53980 client_network=tcp 31:20.498 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=130.899µs client=127.0.0.1:53982 client_network=tcp 31:20.498 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=136.05µs client=127.0.0.1:59071 client_network=udp 31:20.500 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=143.895µs client=127.0.0.1:56881 client_network=udp 31:20.500 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=125.216µs client=127.0.0.1:53986 client_network=tcp 31:20.501 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=86.808µs client=127.0.0.1:53988 client_network=tcp 31:20.501 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=100.909µs client=127.0.0.1:41776 client_network=udp 31:20.502 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=133.357µs client=127.0.0.1:52428 client_network=udp 31:20.502 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=128.359µs client=127.0.0.1:53990 client_network=tcp 31:20.503 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=173.619µs client=127.0.0.1:53992 client_network=tcp 31:20.508 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=186.853µs client=127.0.0.1:50868 client_network=udp 31:20.512 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=168.579µs client=127.0.0.1:47782 client_network=udp 31:20.515 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=132.509µs client=127.0.0.1:53998 client_network=tcp 31:20.516 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=111.294µs client=127.0.0.1:54000 client_network=tcp 31:20.516 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=196.469µs client=127.0.0.1:46271 client_network=udp 31:20.517 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=126.079µs client=127.0.0.1:55678 client_network=udp 31:20.517 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=160.394µs client=127.0.0.1:54002 client_network=tcp 31:20.518 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=124.313µs client=127.0.0.1:54004 client_network=tcp 31:20.518 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=126.934µs client=127.0.0.1:40742 client_network=udp 31:20.519 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=139.764µs client=127.0.0.1:34022 client_network=udp 31:20.519 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=191.324µs client=127.0.0.1:54006 client_network=tcp 31:20.520 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=141.503µs client=127.0.0.1:54008 client_network=tcp 31:20.521 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=361.978µs client=127.0.0.1:36843 client_network=udp 31:20.521 [DEBUG] TestAgent.dns: request served from client: name=normal.service.consul. type=ANY class=IN latency=143.28µs client=127.0.0.1:36930 client_network=udp 31:20.522 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=125.841µs client=127.0.0.1:54010 client_network=tcp 31:20.522 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=147.626µs client=127.0.0.1:54012 client_network=tcp 31:20.523 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=178.926µs client=127.0.0.1:58586 client_network=udp 31:20.523 [DEBUG] TestAgent.dns: request served from client: name=526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul. type=ANY class=IN latency=130.728µs client=127.0.0.1:44075 client_network=udp 31:20.938 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.938 [DEBUG] TestAgent: Node info in sync 31:20.938 [DEBUG] TestAgent: Node info in sync 32:19.022 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:19.024 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=223.018331ms client=127.0.0.1:54444 client_network=tcp 32:19.947 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:19.949 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=101.540185ms client=127.0.0.1:54450 client_network=tcp 32:20.296 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f5033a9-434a-0580-7404-3dcc33e58ca5 32:20.598 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=133.263212ms client=127.0.0.1:55980 client_network=udp 32:20.736 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=131.879975ms client=127.0.0.1:60841 client_network=udp 32:20.853 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:20.856 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=109.533671ms client=127.0.0.1:54456 client_network=tcp 32:21.639 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:21.644 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=109.561722ms client=127.0.0.1:54458 client_network=tcp 32:22.321 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=123.128157ms client=127.0.0.1:49547 client_network=udp 32:22.502 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=161.855059ms client=127.0.0.1:55677 client_network=udp 32:22.615 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:22.617 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=104.861577ms client=127.0.0.1:54470 client_network=tcp 32:23.240 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:23.242 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=121.704976ms client=127.0.0.1:54522 client_network=tcp 32:23.834 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=157.040166ms client=127.0.0.1:55816 client_network=udp 32:24.002 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=152.619225ms client=127.0.0.1:50831 client_network=udp 32:24.158 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:24.162 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=150.216982ms client=127.0.0.1:54524 client_network=tcp 32:25.034 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:25.037 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=189.72402ms client=127.0.0.1:54534 client_network=tcp 32:25.803 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=162.788064ms client=127.0.0.1:33266 client_network=udp 32:25.890 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=79.383486ms client=127.0.0.1:47975 client_network=udp 32:26.085 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:26.087 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=178.317686ms client=127.0.0.1:54552 client_network=tcp 32:26.780 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:26.782 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=130.941066ms client=127.0.0.1:54556 client_network=tcp 32:27.333 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=117.395961ms client=127.0.0.1:50396 client_network=udp 32:27.427 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=86.327732ms client=127.0.0.1:36130 client_network=udp 32:27.519 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:27.522 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=89.341631ms client=127.0.0.1:54562 client_network=tcp 32:28.338 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:28.342 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=94.642739ms client=127.0.0.1:54580 client_network=tcp 32:29.114 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=118.451143ms client=127.0.0.1:59491 client_network=udp 32:29.195 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=69.909546ms client=127.0.0.1:46525 client_network=udp 32:29.360 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:29.362 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=138.475093ms client=127.0.0.1:54586 client_network=tcp 32:30.133 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:30.135 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=170.20205ms client=127.0.0.1:54588 client_network=tcp 32:30.682 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=164.976963ms client=127.0.0.1:39960 client_network=udp 32:30.897 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=201.486543ms client=127.0.0.1:52555 client_network=udp 32:31.125 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:31.137 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=233.145726ms client=127.0.0.1:54594 client_network=tcp 32:32.202 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:32.206 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=136.870167ms client=127.0.0.1:54600 client_network=tcp 32:33.066 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=171.280599ms client=127.0.0.1:37523 client_network=udp 32:33.202 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=124.700023ms client=127.0.0.1:57220 client_network=udp 32:33.336 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:33.338 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=126.200489ms client=127.0.0.1:54606 client_network=tcp 32:34.060 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:34.062 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=87.661437ms client=127.0.0.1:54612 client_network=tcp 32:34.624 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=91.949239ms client=127.0.0.1:45340 client_network=udp 32:34.708 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=77.660738ms client=127.0.0.1:48218 client_network=udp 32:34.872 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:34.874 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=128.900651ms client=127.0.0.1:54622 client_network=tcp 32:35.723 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:35.726 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=129.855074ms client=127.0.0.1:54632 client_network=tcp 32:36.743 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=203.286658ms client=127.0.0.1:44606 client_network=udp 32:36.857 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=89.301692ms client=127.0.0.1:43739 client_network=udp 32:37.046 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:37.052 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=180.146407ms client=127.0.0.1:54638 client_network=tcp 32:37.592 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{truncated.service.consul. 255 1}"] records=4092/5001 size=65514/80058 32:37.593 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=94.21182ms client=127.0.0.1:54640 client_network=tcp 32:38.019 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=79.455242ms client=127.0.0.1:45495 client_network=udp 32:38.106 [DEBUG] TestAgent.dns: request served from client: name=truncated.service.consul. type=ANY class=IN latency=80.30551ms client=127.0.0.1:51999 client_network=udp 32:38.252 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:38.264 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=149.211572ms client=127.0.0.1:54652 client_network=tcp 32:39.002 [DEBUG] TestAgent.dns: TCP answer to question too large, truncated: question=["{b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. 255 1}"] records=4091/5001 size=65523/80083 32:39.010 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=185.798852ms client=127.0.0.1:54654 client_network=tcp 32:39.740 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=108.147394ms client=127.0.0.1:39974 client_network=udp 32:39.923 [DEBUG] TestAgent.dns: request served from client: name=b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul. type=ANY class=IN latency=165.386807ms client=127.0.0.1:37637 client_network=udp 32:39.933 [INFO] TestAgent: Requesting shutdown 32:39.933 [INFO] TestAgent.server: shutting down server 32:39.933 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:39.933 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:39.933 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:39.933 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:39.933 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:39.933 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:39.933 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:39.933 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:39.933 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:39.933 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:39.942 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:39.944Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:39.944Z [INFO] agent.router.manager: shutting down 32:39.944 [INFO] TestAgent: consul server down 32:39.944 [INFO] TestAgent: shutdown complete 32:39.944 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30087 network=tcp 32:39.944 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30087 network=udp 32:39.944 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30088 network=tcp 32:40.448 [INFO] TestAgent: Waiting for endpoints to shut down 32:40.448 [INFO] TestAgent: Endpoints down --- PASS: TestDNS_TCP_and_UDP_Truncate (80.41s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=true (0.01s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=true (0.01s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=false (0.01s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=false (0.01s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=true (0.01s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=true (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=false (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=255)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=255)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=255)_compressed=false#01 (0.01s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=255)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=1)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=1)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=1)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=1)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._tcp_(qType:=33)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_normal.service.consul._udp_(qType:=33)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._tcp_(qType:=33)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=true#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_526110bb-2f07-1e0f-db4c-a2c0a2adbdd5.query.consul._udp_(qType:=33)_compressed=false#01 (0.00s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=true (1.05s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=false (0.62s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=true (0.14s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=false (0.14s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=true (0.79s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=false (0.66s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=true (0.14s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=false (0.17s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=true (0.61s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=false (0.56s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=true (0.17s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=false (0.16s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=true (0.82s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=false (0.81s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=true (0.17s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=false (0.10s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=true (0.74s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=false (0.56s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=true (0.13s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=false (0.09s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=true (0.81s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=false (0.75s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=true (0.13s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=false (0.10s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=true#01 (0.74s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=255)_compressed=false#01 (0.55s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=true#01 (0.18s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=255)_compressed=false#01 (0.21s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=true#01 (1.17s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=255)_compressed=false#01 (0.83s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=true#01 (0.18s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=255)_compressed=false#01 (0.13s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=true#01 (0.76s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=1)_compressed=false#01 (0.56s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=true#01 (0.10s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=1)_compressed=false#01 (0.12s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=true#01 (0.85s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=1)_compressed=false#01 (0.94s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=true#01 (0.23s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=1)_compressed=false#01 (0.10s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=true#01 (0.63s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._tcp_(qType:=33)_compressed=false#01 (0.44s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=true#01 (0.09s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_truncated.service.consul._udp_(qType:=33)_compressed=false#01 (0.09s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=true#01 (0.71s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._tcp_(qType:=33)_compressed=false#01 (0.81s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=true#01 (0.13s) --- PASS: TestDNS_TCP_and_UDP_Truncate/lookup_b1b158c9-ee73-abee-dab6-7c15aa0da9f6.query.consul._udp_(qType:=33)_compressed=false#01 (0.18s) PASS ok github.com/hashicorp/consul/agent 186.596s === RUN TestAE_scaleFactor === PAUSE TestAE_scaleFactor === RUN TestAE_Pause_nestedPauseResume === PAUSE TestAE_Pause_nestedPauseResume === RUN TestAE_Pause_ResumeTriggersSyncChanges --- PASS: TestAE_Pause_ResumeTriggersSyncChanges (0.00s) === RUN TestAE_staggerDependsOnClusterSize --- PASS: TestAE_staggerDependsOnClusterSize (0.00s) === RUN TestAE_Run_SyncFullBeforeChanges --- PASS: TestAE_Run_SyncFullBeforeChanges (0.00s) === RUN TestAE_Run_Quit === RUN TestAE_Run_Quit/Run_panics_without_ClusterSize === RUN TestAE_Run_Quit/runFSM_quits --- PASS: TestAE_Run_Quit (0.00s) --- PASS: TestAE_Run_Quit/Run_panics_without_ClusterSize (0.00s) --- PASS: TestAE_Run_Quit/runFSM_quits (0.00s) === RUN TestAE_FSM === RUN TestAE_FSM/fullSyncState === RUN TestAE_FSM/fullSyncState/Paused_->_retryFullSyncState === RUN TestAE_FSM/fullSyncState/SyncFull()_error_->_retryFullSyncState 2021-10-05T16:29:18.392Z [ERROR] anti_entropy: failed to sync remote state: error=boom === RUN TestAE_FSM/fullSyncState/SyncFull()_OK_->_partialSyncState === RUN TestAE_FSM/retryFullSyncState === RUN TestAE_FSM/retryFullSyncState/shutdownEvent_->_doneState === RUN TestAE_FSM/retryFullSyncState/syncFullNotifEvent_->_fullSyncState === RUN TestAE_FSM/retryFullSyncState/syncFullTimerEvent_->_fullSyncState === RUN TestAE_FSM/retryFullSyncState/invalid_event_->_panic_ === RUN TestAE_FSM/partialSyncState === RUN TestAE_FSM/partialSyncState/shutdownEvent_->_doneState === RUN TestAE_FSM/partialSyncState/syncFullNotifEvent_->_fullSyncState === RUN TestAE_FSM/partialSyncState/syncFullTimerEvent_->_fullSyncState === RUN TestAE_FSM/partialSyncState/syncChangesEvent+Paused_->_partialSyncState === RUN TestAE_FSM/partialSyncState/syncChangesEvent+SyncChanges()_error_->_partialSyncState 2021-10-05T16:29:18.397Z [ERROR] anti_entropy: failed to sync changes: error=boom === RUN TestAE_FSM/partialSyncState/syncChangesEvent+SyncChanges()_OK_->_partialSyncState === RUN TestAE_FSM/partialSyncState/invalid_event_->_panic_ === RUN TestAE_FSM/invalid_state_->_panic_ --- PASS: TestAE_FSM (0.01s) --- PASS: TestAE_FSM/fullSyncState (0.00s) --- PASS: TestAE_FSM/fullSyncState/Paused_->_retryFullSyncState (0.00s) --- PASS: TestAE_FSM/fullSyncState/SyncFull()_error_->_retryFullSyncState (0.00s) --- PASS: TestAE_FSM/fullSyncState/SyncFull()_OK_->_partialSyncState (0.00s) --- PASS: TestAE_FSM/retryFullSyncState (0.00s) --- PASS: TestAE_FSM/retryFullSyncState/shutdownEvent_->_doneState (0.00s) --- PASS: TestAE_FSM/retryFullSyncState/syncFullNotifEvent_->_fullSyncState (0.00s) --- PASS: TestAE_FSM/retryFullSyncState/syncFullTimerEvent_->_fullSyncState (0.00s) --- PASS: TestAE_FSM/retryFullSyncState/invalid_event_->_panic_ (0.00s) --- PASS: TestAE_FSM/partialSyncState (0.00s) --- PASS: TestAE_FSM/partialSyncState/shutdownEvent_->_doneState (0.00s) --- PASS: TestAE_FSM/partialSyncState/syncFullNotifEvent_->_fullSyncState (0.00s) --- PASS: TestAE_FSM/partialSyncState/syncFullTimerEvent_->_fullSyncState (0.00s) --- PASS: TestAE_FSM/partialSyncState/syncChangesEvent+Paused_->_partialSyncState (0.00s) --- PASS: TestAE_FSM/partialSyncState/syncChangesEvent+SyncChanges()_error_->_partialSyncState (0.00s) --- PASS: TestAE_FSM/partialSyncState/syncChangesEvent+SyncChanges()_OK_->_partialSyncState (0.00s) --- PASS: TestAE_FSM/partialSyncState/invalid_event_->_panic_ (0.00s) --- PASS: TestAE_FSM/invalid_state_->_panic_ (0.00s) === RUN TestAE_RetrySyncFullEvent === RUN TestAE_RetrySyncFullEvent/trigger_shutdownEvent === RUN TestAE_RetrySyncFullEvent/trigger_shutdownEvent_during_FullNotif === RUN TestAE_RetrySyncFullEvent/trigger_syncFullNotifEvent === RUN TestAE_RetrySyncFullEvent/trigger_syncFullTimerEvent --- PASS: TestAE_RetrySyncFullEvent (0.13s) --- PASS: TestAE_RetrySyncFullEvent/trigger_shutdownEvent (0.00s) --- PASS: TestAE_RetrySyncFullEvent/trigger_shutdownEvent_during_FullNotif (0.10s) --- PASS: TestAE_RetrySyncFullEvent/trigger_syncFullNotifEvent (0.01s) --- PASS: TestAE_RetrySyncFullEvent/trigger_syncFullTimerEvent (0.02s) === RUN TestAE_SyncChangesEvent === RUN TestAE_SyncChangesEvent/trigger_shutdownEvent === RUN TestAE_SyncChangesEvent/trigger_shutdownEvent_during_FullNotif === RUN TestAE_SyncChangesEvent/trigger_syncFullNotifEvent === RUN TestAE_SyncChangesEvent/trigger_syncFullTimerEvent === RUN TestAE_SyncChangesEvent/trigger_syncChangesNotifEvent --- PASS: TestAE_SyncChangesEvent (2.11s) --- PASS: TestAE_SyncChangesEvent/trigger_shutdownEvent (0.00s) --- PASS: TestAE_SyncChangesEvent/trigger_shutdownEvent_during_FullNotif (0.10s) --- PASS: TestAE_SyncChangesEvent/trigger_syncFullNotifEvent (0.01s) --- PASS: TestAE_SyncChangesEvent/trigger_syncFullTimerEvent (2.00s) --- PASS: TestAE_SyncChangesEvent/trigger_syncChangesNotifEvent (0.00s) === CONT TestAE_scaleFactor === RUN TestAE_scaleFactor/100_nodes === RUN TestAE_scaleFactor/200_nodes === RUN TestAE_scaleFactor/1000_nodes === RUN TestAE_scaleFactor/10000_nodes --- PASS: TestAE_scaleFactor (0.00s) --- PASS: TestAE_scaleFactor/100_nodes (0.00s) --- PASS: TestAE_scaleFactor/200_nodes (0.00s) --- PASS: TestAE_scaleFactor/1000_nodes (0.00s) --- PASS: TestAE_scaleFactor/10000_nodes (0.00s) === CONT TestAE_Pause_nestedPauseResume --- PASS: TestAE_Pause_nestedPauseResume (0.00s) PASS ok github.com/hashicorp/consul/agent/ae 2.357s === RUN TestNew === RUN TestNew/no-tls-configurator === RUN TestNew/no-tokens === RUN TestNew/ok === RUN TestNew/no-direct-rpc === RUN TestNew/no-config-loader === RUN TestNew/no-cache --- PASS: TestNew (0.00s) --- PASS: TestNew/no-tls-configurator (0.00s) --- PASS: TestNew/no-tokens (0.00s) --- PASS: TestNew/ok (0.00s) --- PASS: TestNew/no-direct-rpc (0.00s) --- PASS: TestNew/no-config-loader (0.00s) --- PASS: TestNew/no-cache (0.00s) === RUN TestReadConfig --- PASS: TestReadConfig (0.00s) === RUN TestInitialConfiguration_disabled --- PASS: TestInitialConfiguration_disabled (0.03s) === RUN TestInitialConfiguration_cancelled 2021-10-05T16:29:27.889Z [DEBUG] TestInitialConfiguration_cancelled.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestInitialConfiguration_cancelled-auto-config000186405/auto-config.json 2021-10-05T16:29:27.889Z [INFO] TestInitialConfiguration_cancelled.auto_config: retrieving initial agent auto configuration remotely 2021-10-05T16:29:27.891Z [DEBUG] TestInitialConfiguration_cancelled.auto_config: making AutoConfig.InitialConfiguration RPC: addr=127.0.0.1:8300 2021-10-05T16:29:27.891Z [ERROR] TestInitialConfiguration_cancelled.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=127.0.0.1:8300 error="injected error" 2021-10-05T16:29:27.891Z [ERROR] TestInitialConfiguration_cancelled.auto_config: No server successfully responded to the auto-config request 2021-10-05T16:29:27.891Z [DEBUG] TestInitialConfiguration_cancelled.auto_config: making AutoConfig.InitialConfiguration RPC: addr=127.0.0.1:8300 2021-10-05T16:29:27.891Z [ERROR] TestInitialConfiguration_cancelled.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=127.0.0.1:8300 error="injected error" 2021-10-05T16:29:27.891Z [ERROR] TestInitialConfiguration_cancelled.auto_config: No server successfully responded to the auto-config request 2021-10-05T16:29:27.980Z [INFO] TestInitialConfiguration_cancelled.auto_config: interrupted during initial auto configuration: err="context deadline exceeded" mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,string) mock_test.go:242: PASS: FindLANServer() --- PASS: TestInitialConfiguration_cancelled (0.11s) === RUN TestInitialConfiguration_restored 2021-10-05T16:29:28.046Z [DEBUG] TestInitialConfiguration_restored.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestInitialConfiguration_restored-auto-config886542144/auto-config.json 2021-10-05T16:29:28.053Z [INFO] TestInitialConfiguration_restored.auto_config: read persisted configuration: path=/tmp/consul-test/TestInitialConfiguration_restored-auto-config886542144/auto-config.json 2021-10-05T16:29:28.053Z [DEBUG] TestInitialConfiguration_restored.auto_config: updating auto-config settings 2021-10-05T16:29:28.070Z [DEBUG] TestInitialConfiguration_restored.auto_config: auto-config settings were persisted to disk mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) --- PASS: TestInitialConfiguration_restored (0.09s) === RUN TestInitialConfiguration_success 2021-10-05T16:29:28.104Z [DEBUG] TestInitialConfiguration_success.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestInitialConfiguration_success-auto-config331186079/auto-config.json 2021-10-05T16:29:28.104Z [INFO] TestInitialConfiguration_success.auto_config: retrieving initial agent auto configuration remotely 2021-10-05T16:29:28.107Z [DEBUG] TestInitialConfiguration_success.auto_config: making AutoConfig.InitialConfiguration RPC: addr=127.0.0.1:8300 2021-10-05T16:29:28.107Z [DEBUG] TestInitialConfiguration_success.auto_config: AutoConfig.InitialConfiguration RPC was successful 2021-10-05T16:29:28.107Z [DEBUG] TestInitialConfiguration_success.auto_config: updating auto-config settings 2021-10-05T16:29:28.130Z [DEBUG] TestInitialConfiguration_success.auto_config: auto-config settings were persisted to disk mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) --- PASS: TestInitialConfiguration_success (0.06s) === RUN TestInitialConfiguration_retries 2021-10-05T16:29:28.166Z [DEBUG] TestInitialConfiguration_retries.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestInitialConfiguration_retries-auto-config879675506/auto-config.json 2021-10-05T16:29:28.166Z [INFO] TestInitialConfiguration_retries.auto_config: retrieving initial agent auto configuration remotely 2021-10-05T16:29:28.169Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.169Z [ERROR] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=198.18.0.1:8300 error="injected failure" 2021-10-05T16:29:28.169Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.2:8398 2021-10-05T16:29:28.169Z [ERROR] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=198.18.0.2:8398 error="injected failure" 2021-10-05T16:29:28.169Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.3:8399 2021-10-05T16:29:28.169Z [ERROR] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=198.18.0.3:8399 error="injected failure" 2021-10-05T16:29:28.169Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=127.0.0.1:1234 2021-10-05T16:29:28.169Z [ERROR] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=127.0.0.1:1234 error="injected failure" 2021-10-05T16:29:28.169Z [ERROR] TestInitialConfiguration_retries.auto_config: No server successfully responded to the auto-config request 2021-10-05T16:29:28.170Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.170Z [ERROR] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=198.18.0.1:8300 error="injected failure" 2021-10-05T16:29:28.170Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.2:8398 2021-10-05T16:29:28.170Z [ERROR] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=198.18.0.2:8398 error="injected failure" 2021-10-05T16:29:28.170Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.3:8399 2021-10-05T16:29:28.170Z [ERROR] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC failed: addr=198.18.0.3:8399 error="injected failure" 2021-10-05T16:29:28.170Z [DEBUG] TestInitialConfiguration_retries.auto_config: making AutoConfig.InitialConfiguration RPC: addr=127.0.0.1:1234 2021-10-05T16:29:28.171Z [DEBUG] TestInitialConfiguration_retries.auto_config: AutoConfig.InitialConfiguration RPC was successful 2021-10-05T16:29:28.171Z [DEBUG] TestInitialConfiguration_retries.auto_config: updating auto-config settings 2021-10-05T16:29:28.188Z [DEBUG] TestInitialConfiguration_retries.auto_config: auto-config settings were persisted to disk mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) --- PASS: TestInitialConfiguration_retries (0.08s) === RUN TestGoRoutineManagement 2021-10-05T16:29:28.241Z [INFO] TestGoRoutineManagement.auto_config: auto-config started 2021-10-05T16:29:28.251Z [DEBUG] TestGoRoutineManagement.auto_config: stopping auto-config 2021-10-05T16:29:28.251Z [DEBUG] TestGoRoutineManagement.auto_config: auto-config has been stopped 2021-10-05T16:29:28.252Z [INFO] TestGoRoutineManagement.auto_config: auto-config started 2021-10-05T16:29:28.252Z [DEBUG] TestGoRoutineManagement.auto_config: stopping auto-config 2021-10-05T16:29:28.252Z [DEBUG] TestGoRoutineManagement.auto_config: auto-config has been stopped mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestGoRoutineManagement (0.03s) === RUN TestTokenUpdate 2021-10-05T16:29:28.285Z [DEBUG] TestTokenUpdate.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestTokenUpdate-auto-config412817012/auto-config.json 2021-10-05T16:29:28.285Z [INFO] TestTokenUpdate.auto_config: retrieving initial agent auto configuration remotely 2021-10-05T16:29:28.287Z [DEBUG] TestTokenUpdate.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.287Z [DEBUG] TestTokenUpdate.auto_config: AutoConfig.InitialConfiguration RPC was successful 2021-10-05T16:29:28.287Z [DEBUG] TestTokenUpdate.auto_config: updating auto-config settings 2021-10-05T16:29:28.307Z [DEBUG] TestTokenUpdate.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.326Z [INFO] TestTokenUpdate.auto_config: auto-config started 2021-10-05T16:29:28.326Z [DEBUG] TestTokenUpdate.auto_config: handling a token update event 2021-10-05T16:29:28.326Z [DEBUG] TestTokenUpdate.auto_config: Agent token updated - resetting watches 2021-10-05T16:29:28.327Z [DEBUG] TestTokenUpdate.auto_config: stopping auto-config 2021-10-05T16:29:28.327Z [DEBUG] TestTokenUpdate.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestTokenUpdate (0.08s) === RUN TestRootsUpdate 2021-10-05T16:29:28.347Z [DEBUG] TestRootsUpdate.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestRootsUpdate-auto-config231585603/auto-config.json 2021-10-05T16:29:28.347Z [INFO] TestRootsUpdate.auto_config: retrieving initial agent auto configuration remotely 2021-10-05T16:29:28.349Z [DEBUG] TestRootsUpdate.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.350Z [DEBUG] TestRootsUpdate.auto_config: AutoConfig.InitialConfiguration RPC was successful 2021-10-05T16:29:28.350Z [DEBUG] TestRootsUpdate.auto_config: updating auto-config settings 2021-10-05T16:29:28.370Z [DEBUG] TestRootsUpdate.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.380Z [INFO] TestRootsUpdate.auto_config: auto-config started 2021-10-05T16:29:28.385Z [DEBUG] TestRootsUpdate.auto_config: handling a cache update event: correlation_id=roots 2021-10-05T16:29:28.385Z [DEBUG] TestRootsUpdate.auto_config: roots watch fired - updating CA certificates 2021-10-05T16:29:28.387Z [DEBUG] TestRootsUpdate.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestRootsUpdate-auto-config231585603/auto-config.json 2021-10-05T16:29:28.387Z [DEBUG] TestRootsUpdate.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.390Z [INFO] TestRootsUpdate.auto_config: read persisted configuration: path=/tmp/consul-test/TestRootsUpdate-auto-config231585603/auto-config.json 2021-10-05T16:29:28.390Z [DEBUG] TestRootsUpdate.auto_config: stopping auto-config 2021-10-05T16:29:28.390Z [DEBUG] TestRootsUpdate.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestRootsUpdate (0.06s) === RUN TestCertUpdate 2021-10-05T16:29:28.415Z [DEBUG] TestCertUpdate.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestCertUpdate-auto-config343521734/auto-config.json 2021-10-05T16:29:28.415Z [INFO] TestCertUpdate.auto_config: retrieving initial agent auto configuration remotely 2021-10-05T16:29:28.417Z [DEBUG] TestCertUpdate.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.418Z [DEBUG] TestCertUpdate.auto_config: AutoConfig.InitialConfiguration RPC was successful 2021-10-05T16:29:28.418Z [DEBUG] TestCertUpdate.auto_config: updating auto-config settings 2021-10-05T16:29:28.430Z [DEBUG] TestCertUpdate.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.445Z [INFO] TestCertUpdate.auto_config: auto-config started 2021-10-05T16:29:28.449Z [DEBUG] TestCertUpdate.auto_config: handling a cache update event: correlation_id=leaf 2021-10-05T16:29:28.449Z [DEBUG] TestCertUpdate.auto_config: leaf certificate watch fired - updating TLS certificate 2021-10-05T16:29:28.451Z [DEBUG] TestCertUpdate.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.451Z [DEBUG] TestCertUpdate.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestCertUpdate-auto-config343521734/auto-config.json 2021-10-05T16:29:28.452Z [INFO] TestCertUpdate.auto_config: read persisted configuration: path=/tmp/consul-test/TestCertUpdate-auto-config343521734/auto-config.json 2021-10-05T16:29:28.452Z [DEBUG] TestCertUpdate.auto_config: stopping auto-config 2021-10-05T16:29:28.452Z [DEBUG] TestCertUpdate.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestCertUpdate (0.06s) === RUN TestFallback 2021-10-05T16:29:28.471Z [DEBUG] TestFallback.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestFallback-auto-config942139501/auto-config.json 2021-10-05T16:29:28.471Z [INFO] TestFallback.auto_config: retrieving initial agent auto configuration remotely 2021-10-05T16:29:28.474Z [DEBUG] TestFallback.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.474Z [DEBUG] TestFallback.auto_config: AutoConfig.InitialConfiguration RPC was successful 2021-10-05T16:29:28.474Z [DEBUG] TestFallback.auto_config: updating auto-config settings 2021-10-05T16:29:28.522Z [DEBUG] TestFallback.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.533Z [INFO] TestFallback.auto_config: auto-config started 2021-10-05T16:29:28.548Z [DEBUG] TestFallback.auto_config: handling a cache update event: correlation_id=leaf 2021-10-05T16:29:28.548Z [DEBUG] TestFallback.auto_config: leaf certificate watch fired - updating TLS certificate 2021-10-05T16:29:28.550Z [DEBUG] TestFallback.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.550Z [WARN] TestFallback.auto_config: agent's client certificate has expired 2021-10-05T16:29:28.556Z [DEBUG] TestFallback.auto_config: making AutoConfig.InitialConfiguration RPC: addr=198.18.23.2:8300 2021-10-05T16:29:28.558Z [DEBUG] TestFallback.auto_config: AutoConfig.InitialConfiguration RPC was successful 2021-10-05T16:29:28.566Z [DEBUG] TestFallback.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestFallback-auto-config942139501/auto-config.json 2021-10-05T16:29:28.568Z [INFO] TestFallback.auto_config: read persisted configuration: path=/tmp/consul-test/TestFallback-auto-config942139501/auto-config.json 2021-10-05T16:29:28.582Z [DEBUG] TestFallback.auto_config: auto-config settings were persisted to disk 2021-10-05T16:29:28.600Z [DEBUG] TestFallback.auto_config: attempting to restore any persisted configuration: path=/tmp/consul-test/TestFallback-auto-config942139501/auto-config.json 2021-10-05T16:29:28.602Z [INFO] TestFallback.auto_config: read persisted configuration: path=/tmp/consul-test/TestFallback-auto-config942139501/auto-config.json 2021-10-05T16:29:28.602Z [DEBUG] TestFallback.auto_config: stopping auto-config 2021-10-05T16:29:28.602Z [DEBUG] TestFallback.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*pbautoconf.AutoConfigRequest,*pbautoconf.AutoConfigResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: UpdateAgentToken(string,token.TokenSource) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: AutoEncryptCertExpired() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestFallback (0.15s) === RUN TestIntroToken === RUN TestIntroToken/config === RUN TestIntroToken/file === RUN TestIntroToken/file-empty --- PASS: TestIntroToken (0.00s) --- PASS: TestIntroToken/config (0.00s) --- PASS: TestIntroToken/file (0.00s) --- PASS: TestIntroToken/file-empty (0.00s) === RUN TestAutoEncrypt_generateCSR === RUN TestAutoEncrypt_generateCSR/ip-sans === RUN TestAutoEncrypt_generateCSR/dns-sans --- PASS: TestAutoEncrypt_generateCSR (0.01s) --- PASS: TestAutoEncrypt_generateCSR/ip-sans (0.00s) --- PASS: TestAutoEncrypt_generateCSR/dns-sans (0.00s) === RUN TestAutoEncrypt_hosts === RUN TestAutoEncrypt_hosts/router-override === RUN TestAutoEncrypt_hosts/various-addresses === RUN TestAutoEncrypt_hosts/split-host-port-error 2021-10-05T16:29:28.611Z [WARN] TestAutoEncrypt_hosts/split-host-port-error: error splitting host address into IP and port: address=this-is-not:a:ip:and_port error="address this-is-not:a:ip:and_port: too many colons in address" --- PASS: TestAutoEncrypt_hosts (0.00s) --- PASS: TestAutoEncrypt_hosts/router-override (0.00s) --- PASS: TestAutoEncrypt_hosts/various-addresses (0.00s) --- PASS: TestAutoEncrypt_hosts/split-host-port-error (0.00s) === RUN TestAutoEncrypt_InitialCerts 2021-10-05T16:29:28.619Z [DEBUG] TestAutoEncrypt_InitialCerts: making AutoEncrypt.Sign RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.619Z [ERROR] TestAutoEncrypt_InitialCerts: AutoEncrypt.Sign RPC failed: addr=198.18.0.1:8300 error="injected error" 2021-10-05T16:29:28.619Z [DEBUG] TestAutoEncrypt_InitialCerts: making AutoEncrypt.Sign RPC: addr=198.18.0.2:8300 2021-10-05T16:29:28.619Z [ERROR] TestAutoEncrypt_InitialCerts: AutoEncrypt.Sign RPC failed: addr=198.18.0.2:8300 error="injected error" 2021-10-05T16:29:28.619Z [ERROR] TestAutoEncrypt_InitialCerts: No servers successfully responded to the auto-encrypt request 2021-10-05T16:29:28.619Z [DEBUG] TestAutoEncrypt_InitialCerts: making AutoEncrypt.Sign RPC: addr=198.18.0.1:8300 mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:244: PASS: AgentToken() --- PASS: TestAutoEncrypt_InitialCerts (0.01s) === RUN TestAutoEncrypt_InitialConfiguration 2021-10-05T16:29:28.651Z [DEBUG] TestAutoEncrypt_InitialConfiguration.auto_config: making AutoEncrypt.Sign RPC: addr=127.0.0.1:8300 2021-10-05T16:29:28.652Z [INFO] TestAutoEncrypt_InitialConfiguration.auto_config: automatically upgraded to TLS mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) --- PASS: TestAutoEncrypt_InitialConfiguration (0.03s) === RUN TestAutoEncrypt_TokenUpdate 2021-10-05T16:29:28.676Z [DEBUG] TestAutoEncrypt_TokenUpdate.auto_config: making AutoEncrypt.Sign RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.676Z [INFO] TestAutoEncrypt_TokenUpdate.auto_config: automatically upgraded to TLS 2021-10-05T16:29:28.677Z [INFO] TestAutoEncrypt_TokenUpdate.auto_config: auto-config started 2021-10-05T16:29:28.677Z [DEBUG] TestAutoEncrypt_TokenUpdate.auto_config: handling a token update event 2021-10-05T16:29:28.677Z [DEBUG] TestAutoEncrypt_TokenUpdate.auto_config: Agent token updated - resetting watches 2021-10-05T16:29:28.677Z [DEBUG] TestAutoEncrypt_TokenUpdate.auto_config: stopping auto-config 2021-10-05T16:29:28.677Z [DEBUG] TestAutoEncrypt_TokenUpdate.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestAutoEncrypt_TokenUpdate (0.03s) === RUN TestAutoEncrypt_RootsUpdate 2021-10-05T16:29:28.697Z [DEBUG] TestAutoEncrypt_RootsUpdate.auto_config: making AutoEncrypt.Sign RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.698Z [INFO] TestAutoEncrypt_RootsUpdate.auto_config: automatically upgraded to TLS 2021-10-05T16:29:28.698Z [INFO] TestAutoEncrypt_RootsUpdate.auto_config: auto-config started 2021-10-05T16:29:28.711Z [DEBUG] TestAutoEncrypt_RootsUpdate.auto_config: handling a cache update event: correlation_id=roots 2021-10-05T16:29:28.711Z [DEBUG] TestAutoEncrypt_RootsUpdate.auto_config: roots watch fired - updating CA certificates 2021-10-05T16:29:28.712Z [DEBUG] TestAutoEncrypt_RootsUpdate.auto_config: stopping auto-config 2021-10-05T16:29:28.716Z [DEBUG] TestAutoEncrypt_RootsUpdate.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: UpdateAutoTLSCA([]string) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestAutoEncrypt_RootsUpdate (0.04s) === RUN TestAutoEncrypt_CertUpdate 2021-10-05T16:29:28.744Z [DEBUG] TestAutoEncrypt_CertUpdate.auto_config: making AutoEncrypt.Sign RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.745Z [INFO] TestAutoEncrypt_CertUpdate.auto_config: automatically upgraded to TLS 2021-10-05T16:29:28.745Z [INFO] TestAutoEncrypt_CertUpdate.auto_config: auto-config started 2021-10-05T16:29:28.750Z [DEBUG] TestAutoEncrypt_CertUpdate.auto_config: handling a cache update event: correlation_id=leaf 2021-10-05T16:29:28.750Z [DEBUG] TestAutoEncrypt_CertUpdate.auto_config: leaf certificate watch fired - updating TLS certificate 2021-10-05T16:29:28.750Z [DEBUG] TestAutoEncrypt_CertUpdate.auto_config: stopping auto-config 2021-10-05T16:29:28.750Z [DEBUG] TestAutoEncrypt_CertUpdate.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: UpdateAutoTLSCert(string,string) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestAutoEncrypt_CertUpdate (0.03s) === RUN TestAutoEncrypt_Fallback 2021-10-05T16:29:28.787Z [DEBUG] TestAutoEncrypt_Fallback.auto_config: making AutoEncrypt.Sign RPC: addr=198.18.0.1:8300 2021-10-05T16:29:28.789Z [INFO] TestAutoEncrypt_Fallback.auto_config: automatically upgraded to TLS 2021-10-05T16:29:28.789Z [INFO] TestAutoEncrypt_Fallback.auto_config: auto-config started 2021-10-05T16:29:28.801Z [DEBUG] TestAutoEncrypt_Fallback.auto_config: handling a cache update event: correlation_id=leaf 2021-10-05T16:29:28.802Z [DEBUG] TestAutoEncrypt_Fallback.auto_config: leaf certificate watch fired - updating TLS certificate 2021-10-05T16:29:28.802Z [WARN] TestAutoEncrypt_Fallback.auto_config: agent's client certificate has expired 2021-10-05T16:29:28.804Z [DEBUG] TestAutoEncrypt_Fallback.auto_config: making AutoEncrypt.Sign RPC: addr=198.18.23.2:8300 2021-10-05T16:29:28.805Z [DEBUG] TestAutoEncrypt_Fallback.auto_config: stopping auto-config 2021-10-05T16:29:28.805Z [DEBUG] TestAutoEncrypt_Fallback.auto_config: auto-config has been stopped mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:241: PASS: RPC(string,string,*net.TCPAddr,string,*structs.CASignRequest,*structs.SignedResponse) mock_test.go:242: PASS: FindLANServer() mock_test.go:242: PASS: FindLANServer() mock_test.go:243: PASS: Notify(string,string,*structs.DCSpecificRequest,string,string) mock_test.go:243: PASS: Notify(string,string,*cachetype.ConnectCALeafRequest,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:243: PASS: Prepopulate(string,cache.FetchResult,string,string,string) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: Notify(token.TokenKind) mock_test.go:244: PASS: StopNotify(token.Notifier) mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:244: PASS: AgentToken() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: UpdateAutoTLSCert(string,string) mock_test.go:245: PASS: AutoEncryptCertNotAfter() mock_test.go:245: PASS: AutoEncryptCertExpired() mock_test.go:245: PASS: UpdateAutoTLS([]string,[]string,string,string,bool) mock_test.go:245: PASS: AutoEncryptCertNotAfter() --- PASS: TestAutoEncrypt_Fallback (0.06s) === RUN TestTranslateConfig --- PASS: TestTranslateConfig (0.00s) === RUN TestCArootsTranslation --- PASS: TestCArootsTranslation (0.01s) PASS ok github.com/hashicorp/consul/agent/auto-config 1.044s === RUN TestBuildAndValidate_HTTPMaxConnsPerClientExceedsRLimit === PAUSE TestBuildAndValidate_HTTPMaxConnsPerClientExceedsRLimit === RUN TestBuilder_validateEnterpriseConfigKeys === RUN TestBuilder_validateEnterpriseConfigKeys/non_voting_server === RUN TestBuilder_validateEnterpriseConfigKeys/segments === RUN TestBuilder_validateEnterpriseConfigKeys/autopilot.redundancy_zone_tag === RUN TestBuilder_validateEnterpriseConfigKeys/autopilot.upgrade_version_tag === RUN TestBuilder_validateEnterpriseConfigKeys/dns_config.prefer_namespace === RUN TestBuilder_validateEnterpriseConfigKeys/acl.msp_disable_bootstrap === RUN TestBuilder_validateEnterpriseConfigKeys/segment === RUN TestBuilder_validateEnterpriseConfigKeys/autopilot.disable_upgrade_migration === RUN TestBuilder_validateEnterpriseConfigKeys/acl.tokens.managed_service_provider === RUN TestBuilder_validateEnterpriseConfigKeys/multi --- PASS: TestBuilder_validateEnterpriseConfigKeys (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/non_voting_server (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/segments (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/autopilot.redundancy_zone_tag (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/autopilot.upgrade_version_tag (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/dns_config.prefer_namespace (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/acl.msp_disable_bootstrap (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/segment (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/autopilot.disable_upgrade_migration (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/acl.tokens.managed_service_provider (0.00s) --- PASS: TestBuilder_validateEnterpriseConfigKeys/multi (0.00s) === RUN TestLoad --- PASS: TestLoad (0.02s) === RUN TestShouldParseFile === RUN TestShouldParseFile/filename=config.json,_format= === RUN TestShouldParseFile/filename=config.hcl,_format= === RUN TestShouldParseFile/filename=config,_format=hcl === RUN TestShouldParseFile/filename=config.js,_format=json === RUN TestShouldParseFile/filename=config.yaml,_format= --- PASS: TestShouldParseFile (0.00s) --- PASS: TestShouldParseFile/filename=config.json,_format= (0.00s) --- PASS: TestShouldParseFile/filename=config.hcl,_format= (0.00s) --- PASS: TestShouldParseFile/filename=config,_format=hcl (0.00s) --- PASS: TestShouldParseFile/filename=config.js,_format=json (0.00s) --- PASS: TestShouldParseFile/filename=config.yaml,_format= (0.00s) === RUN TestNewBuilder_PopulatesSourcesFromConfigFiles --- PASS: TestNewBuilder_PopulatesSourcesFromConfigFiles (0.00s) === RUN TestNewBuilder_PopulatesSourcesFromConfigFiles_WithConfigFormat --- PASS: TestNewBuilder_PopulatesSourcesFromConfigFiles_WithConfigFormat (0.00s) === RUN TestBuilder_BuildAndValidate_NodeName === RUN TestBuilder_BuildAndValidate_NodeName/invalid_character_-_unicode === RUN TestBuilder_BuildAndValidate_NodeName/invalid_character_-_slash === RUN TestBuilder_BuildAndValidate_NodeName/too_long --- PASS: TestBuilder_BuildAndValidate_NodeName (0.04s) --- PASS: TestBuilder_BuildAndValidate_NodeName/invalid_character_-_unicode (0.01s) --- PASS: TestBuilder_BuildAndValidate_NodeName/invalid_character_-_slash (0.02s) --- PASS: TestBuilder_BuildAndValidate_NodeName/too_long (0.01s) === RUN TestAddFlags_WithParse === RUN TestAddFlags_WithParse/#00 === RUN TestAddFlags_WithParse/-bind_a === RUN TestAddFlags_WithParse/-bootstrap === RUN TestAddFlags_WithParse/-bootstrap=true === RUN TestAddFlags_WithParse/-bootstrap=false === RUN TestAddFlags_WithParse/-config-file_a_-config-dir_b_-config-file_c_-config-dir_d === RUN TestAddFlags_WithParse/-datacenter_a === RUN TestAddFlags_WithParse/-dns-port_1 === RUN TestAddFlags_WithParse/-grpc-port_1 === RUN TestAddFlags_WithParse/-http-port_1 === RUN TestAddFlags_WithParse/-https-port_1 === RUN TestAddFlags_WithParse/-serf-lan-port_1 === RUN TestAddFlags_WithParse/-serf-wan-port_1 === RUN TestAddFlags_WithParse/-server-port_1 === RUN TestAddFlags_WithParse/-join_a_-join_b === RUN TestAddFlags_WithParse/-node-meta_a:b_-node-meta_c:d === RUN TestAddFlags_WithParse/-bootstrap_true === RUN TestAddFlags_WithParse/-primary-gateway_foo.local_-primary-gateway_bar.local --- PASS: TestAddFlags_WithParse (0.00s) --- PASS: TestAddFlags_WithParse/#00 (0.00s) --- PASS: TestAddFlags_WithParse/-bind_a (0.00s) --- PASS: TestAddFlags_WithParse/-bootstrap (0.00s) --- PASS: TestAddFlags_WithParse/-bootstrap=true (0.00s) --- PASS: TestAddFlags_WithParse/-bootstrap=false (0.00s) --- PASS: TestAddFlags_WithParse/-config-file_a_-config-dir_b_-config-file_c_-config-dir_d (0.00s) --- PASS: TestAddFlags_WithParse/-datacenter_a (0.00s) --- PASS: TestAddFlags_WithParse/-dns-port_1 (0.00s) --- PASS: TestAddFlags_WithParse/-grpc-port_1 (0.00s) --- PASS: TestAddFlags_WithParse/-http-port_1 (0.00s) --- PASS: TestAddFlags_WithParse/-https-port_1 (0.00s) --- PASS: TestAddFlags_WithParse/-serf-lan-port_1 (0.00s) --- PASS: TestAddFlags_WithParse/-serf-wan-port_1 (0.00s) --- PASS: TestAddFlags_WithParse/-server-port_1 (0.00s) --- PASS: TestAddFlags_WithParse/-join_a_-join_b (0.00s) --- PASS: TestAddFlags_WithParse/-node-meta_a:b_-node-meta_c:d (0.00s) --- PASS: TestAddFlags_WithParse/-bootstrap_true (0.00s) --- PASS: TestAddFlags_WithParse/-primary-gateway_foo.local_-primary-gateway_bar.local (0.00s) === RUN TestMerge === RUN TestMerge/top_level_fields --- PASS: TestMerge (0.01s) --- PASS: TestMerge/top_level_fields (0.01s) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-advertise === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-advertise-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-advertise_and_-advertise-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-bind === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-bootstrap === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-bootstrap-expect === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-client === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-dir === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-file_json === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-file_hcl_and_json === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-data-dir_empty === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-data-dir_non-directory === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-datacenter === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-datacenter_empty === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-dev === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-disable-host-node-id === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-disable-keyring-file === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-dns-port === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-domain === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can't_be_prefixed_by_DC === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can't_be_prefixed_by_service === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can_be_prefixed_by_non-keywords === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can't_be_prefixed_by_DC#01 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-enable-script-checks === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-encrypt === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-format_disabled,_skip_unknown_files === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-format=json === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-format=hcl === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-http-port === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-join === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-join-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-log-level === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-log-json === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:-log-rotate-max-files === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:-log-rotate-max-files === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-node === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-node-id === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-node-meta === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-non-voting-server === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-pid-file === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:-primary-gateway === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:-primary-gateway === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-protocol === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-raft-protocol === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-recursor === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-rejoin === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-interval === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-interval-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-join === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-join-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-max === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-max-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-lan-bind === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-lan-port === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-wan-bind === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-wan-port === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-server === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-server-port === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-syslog === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-ui === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-ui-dir === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-ui-content-path === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_any_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_any_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_any_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_any_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_any_and_advertise_set_should_not_detect === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_any_and_advertise_set_should_not_detect === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr_and_ports_==_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr_and_ports_==_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr_and_ports_<_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr_and_ports_<_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr_and_ports_>_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr_and_ports_>_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr,_addresses_and_ports_==_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr,_addresses_and_ports_==_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr,_addresses_and_ports_<_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr,_addresses_and_ports_<_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr,_addresses_and_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr,_addresses_and_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_template_and_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_template_and_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client,_address_template_and_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client,_address_template_and_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_lan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_lan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_wan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_wan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_lan_with_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_lan_with_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_wan_with_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_wan_with_ports === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:allow_disabling_serf_wan_port === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:allow_disabling_serf_wan_port === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:serf_bind_address_lan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:serf_bind_address_lan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:serf_bind_address_wan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:serf_bind_address_wan_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_recursor_templates_with_deduplication === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_recursor_templates_with_deduplication === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:start_join_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:start_join_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:start_join_wan_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:start_join_wan_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:retry_join_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:retry_join_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:retry_join_wan_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:retry_join_wan_address_template === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:min/max_ports_for_dynamic_exposed_listeners === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:min/max_ports_for_dynamic_exposed_listeners === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/defaults_for_dynamic_exposed_listeners === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:precedence:_merge_order === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:precedence:_merge_order === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:precedence:_flag_before_file === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:precedence:_flag_before_file === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:raft_performance_scaling === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:raft_performance_scaling === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/Serf_Allowed_CIDRS_LAN,_multiple_values_from_flags === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Serf_Allowed_CIDRS_LAN/WAN,_multiple_values_from_HCL/JSON === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Serf_Allowed_CIDRS_LAN/WAN,_multiple_values_from_HCL/JSON === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/Serf_Allowed_CIDRS_WAN,_multiple_values_from_flags === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:invalid_input === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:invalid_input === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:datacenter_is_lower-cased === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:datacenter_is_lower-cased === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_datacenter_is_lower-cased === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_datacenter_is_lower-cased === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_replication_token_enables_acl_replication === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_replication_token_enables_acl_replication === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_enforce_version_8_is_deprecated === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_enforce_version_8_is_deprecated === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_fails_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_fails_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_none_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_none_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_multiple_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_multiple_v4 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_fails_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_fails_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_none_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_none_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_multiple_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_multiple_v6 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/ae_interval_invalid_==_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/ae_interval_invalid_<_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_datacenter_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_datacenter_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:autopilot.max_trailing_logs_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:autopilot.max_trailing_logs_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_cannot_be_empty === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_cannot_be_empty === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_does_not_allow_multiple_addresses === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_does_not_allow_multiple_addresses === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_cannot_be_a_unix_socket === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_cannot_be_a_unix_socket === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap_without_server === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap_without_server === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_without_server === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_without_server === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_and_dev_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_and_dev_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_and_bootstrap === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_and_bootstrap === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect=1_equals_bootstrap === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect=1_equals_bootstrap === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect=2_warning === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect=2_warning === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_>_2_but_even_warning === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_>_2_but_even_warning === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_mode_sets_LeaveOnTerm_and_SkipLeaveOnInt_correctly === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_mode_sets_LeaveOnTerm_and_SkipLeaveOnInt_correctly === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_does_not_allow_socket === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_does_not_allow_socket === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:datacenter_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:datacenter_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_does_not_allow_socket === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_does_not_allow_socket === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ui_and_ui_dir === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ui_and_ui_dir === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_addr_any === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_addr_any === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_addr_wan_any === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_addr_wan_any === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:recursors_any === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:recursors_any === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_config.udp_answer_limit_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_config.udp_answer_limit_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_config.a_record_limit_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_config.a_record_limit_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:performance.raft_multiplier_<_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:performance.raft_multiplier_<_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:performance.raft_multiplier_==_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:performance.raft_multiplier_==_0 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:performance.raft_multiplier_>_10 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:performance.raft_multiplier_>_10 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/node_name_invalid === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:node_meta_key_too_long === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:node_meta_key_too_long === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:node_meta_value_too_long === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:node_meta_value_too_long === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:node_meta_too_many_keys === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:node_meta_too_many_keys === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_listeners_dns_vs_http === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_listeners_dns_vs_http === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_listeners_dns_vs_https === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_listeners_dns_vs_https === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_listeners_http_vs_https === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_listeners_http_vs_https === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_advertise_addresses_HTTP_vs_RPC === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_advertise_addresses_HTTP_vs_RPC === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_advertise_addresses_RPC_vs_Serf_LAN === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_advertise_addresses_RPC_vs_Serf_LAN === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_advertise_addresses_RPC_vs_Serf_WAN === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_advertise_addresses_RPC_vs_Serf_WAN === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:http_use_cache_defaults_to_true === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:http_use_cache_defaults_to_true === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:http_use_cache_is_enabled_when_true === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:http_use_cache_is_enabled_when_true === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:http_use_cache_is_disabled_when_false === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:http_use_cache_is_disabled_when_false === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:sidecar_service_can't_have_ID === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:sidecar_service_can't_have_ID === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:sidecar_service_can't_have_nested_sidecar === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:sidecar_service_can't_have_nested_sidecar === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:telemetry.prefix_filter_cannot_be_empty === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:telemetry.prefix_filter_cannot_be_empty === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:telemetry.prefix_filter_must_start_with_+_or_- === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:telemetry.prefix_filter_must_start_with_+_or_- === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:encrypt_has_invalid_key === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:encrypt_has_invalid_key === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:multiple_check_files === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:multiple_check_files === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:grpc_check === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:grpc_check === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:alias_check_with_no_node === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:alias_check_with_no_node === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:multiple_service_files === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:multiple_service_files === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service_with_wrong_meta:_too_long_key === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service_with_wrong_meta:_too_long_key === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service_with_wrong_meta:_too_long_value === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service_with_wrong_meta:_too_long_value === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service_with_wrong_meta:_too_many_meta === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service_with_wrong_meta:_too_many_meta === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:translated_keys === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:translated_keys === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ignore_snapshot_agent_sub-object === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ignore_snapshot_agent_sub-object === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service.connectsidecar_service_with_checks_and_upstreams === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service.connectsidecar_service_with_checks_and_upstreams === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:services.connect.sidecar_service_with_checks_and_upstreams === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:services.connect.sidecar_service_with_checks_and_upstreams === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:verify_server_hostname_implies_verify_outgoing === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:verify_server_hostname_implies_verify_outgoing === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_works_implies_connect === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_works_implies_connect === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_works_with_verify_incoming === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_works_with_verify_incoming === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_works_with_verify_incoming_rpc === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_works_with_verify_incoming_rpc === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_warns_without_verify_incoming_or_verify_incoming_rpc === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_warns_without_verify_incoming_or_verify_incoming_rpc === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_errors_in_client_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_errors_in_client_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.tls_errors_in_server_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.tls_errors_in_server_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:test_connect_vault_provider_configuration === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:test_connect_vault_provider_configuration === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Connect_AWS_CA_provider_configuration === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Connect_AWS_CA_provider_configuration === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Connect_AWS_CA_provider_TTL_validation === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Connect_AWS_CA_provider_TTL_validation === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Connect_AWS_CA_provider_EC_key_length_validation === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Connect_AWS_CA_provider_EC_key_length_validation === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_requires_connect.enabled === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_requires_connect.enabled === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_cannot_use_-join-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_cannot_use_-join-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_cannot_use_-retry-join-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_cannot_use_-retry-join-wan === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_requires_server_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_requires_server_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_requires_no_slashes_in_node_names === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_requires_no_slashes_in_node_names === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:primary_gateways_requires_server_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:primary_gateways_requires_server_mode === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:primary_gateways_only_works_in_a_secondary_datacenter === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:primary_gateways_only_works_in_a_secondary_datacenter === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_in_secondary_with_primary_gateways_configured === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_in_secondary_with_primary_gateways_configured === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_doesn't_parse === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_doesn't_parse === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_unknown_kind === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_unknown_kind === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_invalid_service-defaults === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_invalid_service-defaults === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_proxy-defaults_(snake-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_proxy-defaults_(snake-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_proxy-defaults_(camel-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_proxy-defaults_(camel-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_service-defaults_(snake-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_service-defaults_(snake-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_service-defaults_(camel-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_service-defaults_(camel-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_service-router_(snake-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_service-router_(snake-case) === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/default_limits === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_and_auto_encrypt_error === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_and_auto_encrypt_error === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_not_allowed_for_servers === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_not_allowed_for_servers === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_tls_not_enabled === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_tls_not_enabled === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_server_tls_not_enabled === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_server_tls_not_enabled === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_no_intro_token === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_no_intro_token === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_no_server_addresses === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_no_server_addresses === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_client === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_client === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_client_not_allowed === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_client_not_allowed === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_invalid_config === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_invalid_config === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_invalid_config_2 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_invalid_config_2 === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_require_token_replication_in_secondary === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_require_token_replication_in_secondary === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_invalid_claim_assertion === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_invalid_claim_assertion === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_ok === RUN TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_ok --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases (8.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-advertise (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-advertise-wan (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-advertise_and_-advertise-wan (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-bind (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-bootstrap (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-bootstrap-expect (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-client (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-dir (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-file_json (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-file_hcl_and_json (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-data-dir_empty (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-data-dir_non-directory (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-datacenter (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-datacenter_empty (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-dev (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-disable-host-node-id (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-disable-keyring-file (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-dns-port (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-domain (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can't_be_prefixed_by_DC (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can't_be_prefixed_by_service (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can_be_prefixed_by_non-keywords (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-alt-domain_can't_be_prefixed_by_DC#01 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-enable-script-checks (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-encrypt (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-format_disabled,_skip_unknown_files (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-format=json (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-config-format=hcl (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-http-port (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-join (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-join-wan (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-log-level (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-log-json (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:-log-rotate-max-files (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:-log-rotate-max-files (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-node (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-node-id (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-node-meta (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-non-voting-server (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-pid-file (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:-primary-gateway (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:-primary-gateway (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-protocol (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-raft-protocol (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-recursor (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-rejoin (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-interval (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-interval-wan (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-join (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-join-wan (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-max (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-retry-max-wan (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-lan-bind (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-lan-port (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-wan-bind (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-serf-wan-port (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-server (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-server-port (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-syslog (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-ui (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-ui-dir (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/-ui-content-path (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_any_v4 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_any_v4 (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_any_v6 (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_any_v6 (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_any_and_advertise_set_should_not_detect (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_any_and_advertise_set_should_not_detect (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr_and_ports_==_0 (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr_and_ports_==_0 (0.06s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr_and_ports_<_0 (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr_and_ports_<_0 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr_and_ports_>_0 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr_and_ports_>_0 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr,_addresses_and_ports_==_0 (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr,_addresses_and_ports_==_0 (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr,_addresses_and_ports_<_0 (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr,_addresses_and_ports_<_0 (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_addr,_addresses_and_ports (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_addr,_addresses_and_ports (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_template_and_ports (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_template_and_ports (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client,_address_template_and_ports (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client,_address_template_and_ports (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_lan_template (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_lan_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_wan_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_wan_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_lan_with_ports (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_lan_with_ports (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_wan_with_ports (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_wan_with_ports (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:allow_disabling_serf_wan_port (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:allow_disabling_serf_wan_port (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:serf_bind_address_lan_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:serf_bind_address_lan_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:serf_bind_address_wan_template (0.06s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:serf_bind_address_wan_template (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_recursor_templates_with_deduplication (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_recursor_templates_with_deduplication (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:start_join_address_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:start_join_address_template (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:start_join_wan_address_template (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:start_join_wan_address_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:retry_join_address_template (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:retry_join_address_template (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:retry_join_wan_address_template (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:retry_join_wan_address_template (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:min/max_ports_for_dynamic_exposed_listeners (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:min/max_ports_for_dynamic_exposed_listeners (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/defaults_for_dynamic_exposed_listeners (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:precedence:_merge_order (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:precedence:_merge_order (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:precedence:_flag_before_file (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:precedence:_flag_before_file (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:raft_performance_scaling (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:raft_performance_scaling (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/Serf_Allowed_CIDRS_LAN,_multiple_values_from_flags (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Serf_Allowed_CIDRS_LAN/WAN,_multiple_values_from_HCL/JSON (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Serf_Allowed_CIDRS_LAN/WAN,_multiple_values_from_HCL/JSON (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/Serf_Allowed_CIDRS_WAN,_multiple_values_from_flags (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:invalid_input (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:invalid_input (0.00s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:datacenter_is_lower-cased (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:datacenter_is_lower-cased (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_datacenter_is_lower-cased (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_datacenter_is_lower-cased (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_replication_token_enables_acl_replication (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_replication_token_enables_acl_replication (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_enforce_version_8_is_deprecated (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_enforce_version_8_is_deprecated (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_fails_v4 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_fails_v4 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_none_v4 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_none_v4 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_multiple_v4 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_multiple_v4 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_fails_v6 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_fails_v6 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_none_v6 (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_none_v6 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_address_detect_multiple_v6 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_address_detect_multiple_v6 (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/ae_interval_invalid_==_0 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/ae_interval_invalid_<_0 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:acl_datacenter_invalid (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:acl_datacenter_invalid (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:autopilot.max_trailing_logs_invalid (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:autopilot.max_trailing_logs_invalid (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_cannot_be_empty (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_cannot_be_empty (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_does_not_allow_multiple_addresses (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_does_not_allow_multiple_addresses (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bind_addr_cannot_be_a_unix_socket (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bind_addr_cannot_be_a_unix_socket (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap_without_server (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap_without_server (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_without_server (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_without_server (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_invalid (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_invalid (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_and_dev_mode (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_and_dev_mode (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_and_bootstrap (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_and_bootstrap (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect=1_equals_bootstrap (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect=1_equals_bootstrap (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect=2_warning (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect=2_warning (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:bootstrap-expect_>_2_but_even_warning (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:bootstrap-expect_>_2_but_even_warning (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_mode_sets_LeaveOnTerm_and_SkipLeaveOnInt_correctly (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_mode_sets_LeaveOnTerm_and_SkipLeaveOnInt_correctly (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:client_does_not_allow_socket (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:client_does_not_allow_socket (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:datacenter_invalid (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:datacenter_invalid (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_does_not_allow_socket (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_does_not_allow_socket (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ui_and_ui_dir (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ui_and_ui_dir (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_addr_any (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_addr_any (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:advertise_addr_wan_any (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:advertise_addr_wan_any (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:recursors_any (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:recursors_any (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_config.udp_answer_limit_invalid (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_config.udp_answer_limit_invalid (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:dns_config.a_record_limit_invalid (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:dns_config.a_record_limit_invalid (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:performance.raft_multiplier_<_0 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:performance.raft_multiplier_<_0 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:performance.raft_multiplier_==_0 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:performance.raft_multiplier_==_0 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:performance.raft_multiplier_>_10 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:performance.raft_multiplier_>_10 (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/node_name_invalid (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:node_meta_key_too_long (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:node_meta_key_too_long (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:node_meta_value_too_long (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:node_meta_value_too_long (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:node_meta_too_many_keys (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:node_meta_too_many_keys (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_listeners_dns_vs_http (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_listeners_dns_vs_http (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_listeners_dns_vs_https (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_listeners_dns_vs_https (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_listeners_http_vs_https (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_listeners_http_vs_https (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_advertise_addresses_HTTP_vs_RPC (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_advertise_addresses_HTTP_vs_RPC (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_advertise_addresses_RPC_vs_Serf_LAN (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_advertise_addresses_RPC_vs_Serf_LAN (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:unique_advertise_addresses_RPC_vs_Serf_WAN (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:unique_advertise_addresses_RPC_vs_Serf_WAN (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:http_use_cache_defaults_to_true (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:http_use_cache_defaults_to_true (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:http_use_cache_is_enabled_when_true (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:http_use_cache_is_enabled_when_true (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:http_use_cache_is_disabled_when_false (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:http_use_cache_is_disabled_when_false (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:sidecar_service_can't_have_ID (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:sidecar_service_can't_have_ID (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:sidecar_service_can't_have_nested_sidecar (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:sidecar_service_can't_have_nested_sidecar (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:telemetry.prefix_filter_cannot_be_empty (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:telemetry.prefix_filter_cannot_be_empty (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:telemetry.prefix_filter_must_start_with_+_or_- (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:telemetry.prefix_filter_must_start_with_+_or_- (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:encrypt_has_invalid_key (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:encrypt_has_invalid_key (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:multiple_check_files (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:multiple_check_files (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:grpc_check (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:grpc_check (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:alias_check_with_no_node (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:alias_check_with_no_node (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:multiple_service_files (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:multiple_service_files (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service_with_wrong_meta:_too_long_key (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service_with_wrong_meta:_too_long_key (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service_with_wrong_meta:_too_long_value (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service_with_wrong_meta:_too_long_value (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service_with_wrong_meta:_too_many_meta (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service_with_wrong_meta:_too_many_meta (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:translated_keys (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:translated_keys (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ignore_snapshot_agent_sub-object (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ignore_snapshot_agent_sub-object (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:service.connectsidecar_service_with_checks_and_upstreams (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:service.connectsidecar_service_with_checks_and_upstreams (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:services.connect.sidecar_service_with_checks_and_upstreams (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:services.connect.sidecar_service_with_checks_and_upstreams (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:verify_server_hostname_implies_verify_outgoing (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:verify_server_hostname_implies_verify_outgoing (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_works_implies_connect (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_works_implies_connect (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_works_with_verify_incoming (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_works_with_verify_incoming (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_works_with_verify_incoming_rpc (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_works_with_verify_incoming_rpc (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_warns_without_verify_incoming_or_verify_incoming_rpc (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_warns_without_verify_incoming_or_verify_incoming_rpc (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.allow_tls_errors_in_client_mode (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.allow_tls_errors_in_client_mode (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_encrypt.tls_errors_in_server_mode (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_encrypt.tls_errors_in_server_mode (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:test_connect_vault_provider_configuration (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:test_connect_vault_provider_configuration (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Connect_AWS_CA_provider_configuration (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Connect_AWS_CA_provider_configuration (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Connect_AWS_CA_provider_TTL_validation (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Connect_AWS_CA_provider_TTL_validation (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:Connect_AWS_CA_provider_EC_key_length_validation (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:Connect_AWS_CA_provider_EC_key_length_validation (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_requires_connect.enabled (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_requires_connect.enabled (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_cannot_use_-join-wan (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_cannot_use_-join-wan (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_cannot_use_-retry-join-wan (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_cannot_use_-retry-join-wan (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_requires_server_mode (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_requires_server_mode (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_requires_no_slashes_in_node_names (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_requires_no_slashes_in_node_names (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:primary_gateways_requires_server_mode (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:primary_gateways_requires_server_mode (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:primary_gateways_only_works_in_a_secondary_datacenter (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:primary_gateways_only_works_in_a_secondary_datacenter (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:connect.enable_mesh_gateway_wan_federation_in_secondary_with_primary_gateways_configured (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:connect.enable_mesh_gateway_wan_federation_in_secondary_with_primary_gateways_configured (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_doesn't_parse (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_doesn't_parse (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_unknown_kind (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_unknown_kind (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_invalid_service-defaults (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_invalid_service-defaults (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_proxy-defaults_(snake-case) (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_proxy-defaults_(snake-case) (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_proxy-defaults_(camel-case) (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_proxy-defaults_(camel-case) (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_service-defaults_(snake-case) (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_service-defaults_(snake-case) (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_service-defaults_(camel-case) (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_service-defaults_(camel-case) (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:ConfigEntry_bootstrap_service-router_(snake-case) (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:ConfigEntry_bootstrap_service-router_(snake-case) (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/default_limits (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_and_auto_encrypt_error (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_and_auto_encrypt_error (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_not_allowed_for_servers (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_not_allowed_for_servers (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_tls_not_enabled (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_tls_not_enabled (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_server_tls_not_enabled (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_server_tls_not_enabled (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_no_intro_token (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_no_intro_token (0.04s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_no_server_addresses (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_no_server_addresses (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_client (0.07s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_client (0.05s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_client_not_allowed (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_client_not_allowed (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_invalid_config (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_invalid_config (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_invalid_config_2 (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_invalid_config_2 (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_require_token_replication_in_secondary (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_require_token_replication_in_secondary (0.01s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_invalid_claim_assertion (0.03s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_invalid_claim_assertion (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/json:auto_config_authorizer_ok (0.02s) --- PASS: TestBuilder_BuildAndValide_ConfigFlagsAndEdgecases/hcl:auto_config_authorizer_ok (0.03s) === RUN TestNewBuilder_InvalidConfigFormat --- PASS: TestNewBuilder_InvalidConfigFormat (0.00s) === RUN TestFullConfig runtime_test.go:4426: DM-skipped --- SKIP: TestFullConfig (0.00s) === RUN TestNonZero === RUN TestNonZero/nil === RUN TestNonZero/zero_bool === RUN TestNonZero/zero_string === RUN TestNonZero/zero_int === RUN TestNonZero/zero_int8 === RUN TestNonZero/zero_int16 === RUN TestNonZero/zero_int32 === RUN TestNonZero/zero_int64 === RUN TestNonZero/zero_uint === RUN TestNonZero/zero_uint8 === RUN TestNonZero/zero_uint16 === RUN TestNonZero/zero_uint32 === RUN TestNonZero/zero_uint64 === RUN TestNonZero/zero_float32 === RUN TestNonZero/zero_float64 === RUN TestNonZero/ptr_to_zero_value === RUN TestNonZero/empty_slice === RUN TestNonZero/slice_with_zero_value === RUN TestNonZero/empty_map === RUN TestNonZero/map_with_zero_value_key === RUN TestNonZero/map_with_zero_value_elem === RUN TestNonZero/struct_with_nil_field === RUN TestNonZero/struct_with_zero_value_field === RUN TestNonZero/struct_with_empty_array --- PASS: TestNonZero (0.00s) --- PASS: TestNonZero/nil (0.00s) --- PASS: TestNonZero/zero_bool (0.00s) --- PASS: TestNonZero/zero_string (0.00s) --- PASS: TestNonZero/zero_int (0.00s) --- PASS: TestNonZero/zero_int8 (0.00s) --- PASS: TestNonZero/zero_int16 (0.00s) --- PASS: TestNonZero/zero_int32 (0.00s) --- PASS: TestNonZero/zero_int64 (0.00s) --- PASS: TestNonZero/zero_uint (0.00s) --- PASS: TestNonZero/zero_uint8 (0.00s) --- PASS: TestNonZero/zero_uint16 (0.00s) --- PASS: TestNonZero/zero_uint32 (0.00s) --- PASS: TestNonZero/zero_uint64 (0.00s) --- PASS: TestNonZero/zero_float32 (0.00s) --- PASS: TestNonZero/zero_float64 (0.00s) --- PASS: TestNonZero/ptr_to_zero_value (0.00s) --- PASS: TestNonZero/empty_slice (0.00s) --- PASS: TestNonZero/slice_with_zero_value (0.00s) --- PASS: TestNonZero/empty_map (0.00s) --- PASS: TestNonZero/map_with_zero_value_key (0.00s) --- PASS: TestNonZero/map_with_zero_value_elem (0.00s) --- PASS: TestNonZero/struct_with_nil_field (0.00s) --- PASS: TestNonZero/struct_with_zero_value_field (0.00s) --- PASS: TestNonZero/struct_with_empty_array (0.00s) === RUN TestConfigDecodeBytes === PAUSE TestConfigDecodeBytes === RUN TestSanitize --- PASS: TestSanitize (0.00s) === RUN TestRuntime_apiAddresses --- PASS: TestRuntime_apiAddresses (0.00s) === RUN TestRuntime_APIConfigHTTPS --- PASS: TestRuntime_APIConfigHTTPS (0.00s) === RUN TestRuntime_APIConfigHTTP --- PASS: TestRuntime_APIConfigHTTP (0.00s) === RUN TestRuntime_APIConfigUNIX --- PASS: TestRuntime_APIConfigUNIX (0.00s) === RUN TestRuntime_APIConfigANYAddrV4 --- PASS: TestRuntime_APIConfigANYAddrV4 (0.00s) === RUN TestRuntime_APIConfigANYAddrV6 --- PASS: TestRuntime_APIConfigANYAddrV6 (0.00s) === RUN TestRuntime_ClientAddress --- PASS: TestRuntime_ClientAddress (0.00s) === RUN TestRuntime_ClientAddressAnyV4 --- PASS: TestRuntime_ClientAddressAnyV4 (0.00s) === RUN TestRuntime_ClientAddressAnyV6 --- PASS: TestRuntime_ClientAddressAnyV6 (0.00s) === RUN TestRuntime_ToTLSUtilConfig --- PASS: TestRuntime_ToTLSUtilConfig (0.00s) === RUN TestRuntime_ToTLSUtilConfig_AutoConfig --- PASS: TestRuntime_ToTLSUtilConfig_AutoConfig (0.00s) === RUN Test_UIPathBuilder --- PASS: Test_UIPathBuilder (0.00s) === RUN TestConnectCAConfiguration === RUN TestConnectCAConfiguration/cluster-id-non-uuid === RUN TestConnectCAConfiguration/provider-override === RUN TestConnectCAConfiguration/other-config === RUN TestConnectCAConfiguration/defaults === RUN TestConnectCAConfiguration/cluster-id-override --- PASS: TestConnectCAConfiguration (0.00s) --- PASS: TestConnectCAConfiguration/cluster-id-non-uuid (0.00s) --- PASS: TestConnectCAConfiguration/provider-override (0.00s) --- PASS: TestConnectCAConfiguration/other-config (0.00s) --- PASS: TestConnectCAConfiguration/defaults (0.00s) --- PASS: TestConnectCAConfiguration/cluster-id-override (0.00s) === RUN TestSegments segment_oss_test.go:13: DM-skipped --- SKIP: TestSegments (0.00s) === CONT TestBuildAndValidate_HTTPMaxConnsPerClientExceedsRLimit === CONT TestConfigDecodeBytes --- PASS: TestConfigDecodeBytes (0.00s) --- PASS: TestBuildAndValidate_HTTPMaxConnsPerClientExceedsRLimit (0.02s) PASS ok github.com/hashicorp/consul/agent/config 8.195s === RUN TestCollectHostInfo --- PASS: TestCollectHostInfo (0.00s) PASS ok github.com/hashicorp/consul/agent/debug 0.021s ? github.com/hashicorp/consul/agent/dns [no test files] ? github.com/hashicorp/consul/agent/exec [no test files] === RUN TestAgentAntiEntropy_Services === PAUSE TestAgentAntiEntropy_Services === RUN TestAgentAntiEntropy_Services_ConnectProxy === PAUSE TestAgentAntiEntropy_Services_ConnectProxy === RUN TestAgent_ServiceWatchCh === PAUSE TestAgent_ServiceWatchCh === RUN TestAgentAntiEntropy_EnableTagOverride === PAUSE TestAgentAntiEntropy_EnableTagOverride === RUN TestAgentAntiEntropy_Services_WithChecks === PAUSE TestAgentAntiEntropy_Services_WithChecks === RUN TestAgentAntiEntropy_Services_ACLDeny === PAUSE TestAgentAntiEntropy_Services_ACLDeny === RUN TestAgentAntiEntropy_Checks === PAUSE TestAgentAntiEntropy_Checks === RUN TestAgentAntiEntropy_RemovingServiceAndCheck === PAUSE TestAgentAntiEntropy_RemovingServiceAndCheck === RUN TestAgentAntiEntropy_Checks_ACLDeny === PAUSE TestAgentAntiEntropy_Checks_ACLDeny === RUN TestAgent_UpdateCheck_DiscardOutput === PAUSE TestAgent_UpdateCheck_DiscardOutput === RUN TestAgentAntiEntropy_Check_DeferSync === PAUSE TestAgentAntiEntropy_Check_DeferSync === RUN TestAgentAntiEntropy_NodeInfo === PAUSE TestAgentAntiEntropy_NodeInfo === RUN TestAgent_ServiceTokens === PAUSE TestAgent_ServiceTokens === RUN TestAgent_CheckTokens === PAUSE TestAgent_CheckTokens === RUN TestAgent_CheckCriticalTime state_test.go:1780: DM-skipped --- SKIP: TestAgent_CheckCriticalTime (0.00s) === RUN TestAgent_AddCheckFailure === PAUSE TestAgent_AddCheckFailure === RUN TestAgent_AliasCheck === PAUSE TestAgent_AliasCheck === RUN TestAgent_AliasCheck_ServiceNotification === PAUSE TestAgent_AliasCheck_ServiceNotification === RUN TestAgent_sendCoordinate === PAUSE TestAgent_sendCoordinate === RUN TestState_Notify === PAUSE TestState_Notify === RUN TestAliasNotifications_local === PAUSE TestAliasNotifications_local === CONT TestAgentAntiEntropy_Services [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestAgentAntiEntropy_NodeInfo === CONT TestAliasNotifications_local === CONT TestState_Notify --- PASS: TestState_Notify (0.00s) === CONT TestAgent_sendCoordinate === CONT TestAgent_AliasCheck_ServiceNotification === CONT TestAgentAntiEntropy_Checks === CONT TestAgentAntiEntropy_Check_DeferSync === CONT TestAgent_UpdateCheck_DiscardOutput === CONT TestAgentAntiEntropy_Checks_ACLDeny === CONT TestAgentAntiEntropy_RemovingServiceAndCheck [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range --- PASS: TestAgent_AliasCheck_ServiceNotification (0.03s) === CONT TestAgentAntiEntropy_EnableTagOverride === CONT TestAgent_sendCoordinate state_test.go:1985: 128 5 100ms 2021-10-05T16:29:38.837Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:38.865Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:38.996 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 Address:127.0.0.1:27363}]" 29:38.997 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 29:38.999 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0.dc1 127.0.0.1 29:39.062 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.062 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 29:39.064 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 127.0.0.1 2021-10-05T16:29:39.064Z [INFO] agent.router: Initializing LAN area manager 29:39.065 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=udp 29:39.065 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0.dc1 area=wan 29:39.065 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=tcp 29:39.066 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27359 network=tcp 29:39.066 [INFO] TestAgent: started state syncer 29:39.066 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27364 network=tcp 29:39.067 [WARN] TestAgent.server.raft: unable to get address for sever, using fallback address: id=ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 fallback=127.0.0.1:27363 error="Could not find address for server id ebc6538d-f99c-1a2f-66d3-18e3c9906bf0" 29:39.090 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.090 [DEBUG] TestAgent.server.raft: vote granted: from=ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 term=2 tally=1 29:39.090 [INFO] TestAgent.server.raft: election won: tally=1 29:39.090 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 29:39.092 [INFO] TestAgent.server: cluster leadership acquired 29:39.097 [INFO] TestAgent.server: Adding LAN server: server="Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 29:39.097 [INFO] TestAgent.server: New leader elected: payload=Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 29:39.149 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27363 29:39.193 [INFO] TestAgent: Synced node info 29:39.245 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.290 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.290 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.290 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.290 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.290 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.290 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 29:39.291 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 29:39.304 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ebc6538d-f99c-1a2f-66d3-18e3c9906bf0 29:39.323 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.369 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.379 [INFO] TestAgent: Synced node info 29:39.387 [INFO] TestAgent: Synced service: service=redis 29:39.402 [INFO] TestAgent: Synced service: service=web 29:39.416 [INFO] TestAgent: Synced service: service=api 29:39.431 [INFO] TestAgent: Synced service: service=cache 29:39.436 [INFO] TestAgent: Deregistered service: service=lb 29:39.436 [DEBUG] TestAgent: Service in sync: service=mysql 29:39.437 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.459 [INFO] TestAgent: Synced node info 29:39.459 [DEBUG] TestAgent: Service in sync: service=mysql 29:39.460 [DEBUG] TestAgent: Service in sync: service=redis 29:39.460 [DEBUG] TestAgent: Service in sync: service=web 29:39.476 [INFO] TestAgent: Deregistered service: service=api 29:39.476 [DEBUG] TestAgent: Service in sync: service=cache 29:39.476 [INFO] TestAgent: Requesting shutdown 29:39.476 [INFO] TestAgent.server: shutting down server 29:39.476 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.476 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.476 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.476 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.476 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.476 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.476 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.476 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.476 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.476 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.492 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.508Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.508Z [INFO] agent.router.manager: shutting down 29:39.508 [INFO] TestAgent: consul server down 29:39.508 [INFO] TestAgent: shutdown complete 29:39.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 29:39.508 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 29:39.508 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 29:40.012 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.012 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_Services (1.30s) === CONT TestAgentAntiEntropy_Services_ACLDeny 2021-10-05T16:29:38.980Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.073Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.233 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:40e4a748-2192-161a-0510-9bf59fe950b5 Address:127.0.0.1:27370}]" 29:39.234 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27370 [Follower]" leader= 29:39.235 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-103ad76c-d4d9-640a-3e30-3d5acce29852.dc1 127.0.0.1 29:39.236 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-103ad76c-d4d9-640a-3e30-3d5acce29852 127.0.0.1 2021-10-05T16:29:39.236Z [INFO] agent.router: Initializing LAN area manager 29:39.237 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=udp 29:39.237 [INFO] TestAgent.server: Adding LAN server: server="Node-103ad76c-d4d9-640a-3e30-3d5acce29852 (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 29:39.237 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-103ad76c-d4d9-640a-3e30-3d5acce29852.dc1 area=wan 29:39.237 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=tcp 29:39.244 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27366 network=tcp 29:39.244 [INFO] TestAgent: started state syncer 29:39.244 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27371 network=tcp 29:39.278 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.278 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27370 [Candidate]" term=2 29:39.298 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.298 [DEBUG] TestAgent.server.raft: vote granted: from=40e4a748-2192-161a-0510-9bf59fe950b5 term=2 tally=1 29:39.298 [INFO] TestAgent.server.raft: election won: tally=1 29:39.299 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27370 [Leader]" 29:39.299 [INFO] TestAgent.server: cluster leadership acquired 29:39.299 [INFO] TestAgent.server: New leader elected: payload=Node-103ad76c-d4d9-640a-3e30-3d5acce29852 29:39.316 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27370 29:39.365 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.420 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.420 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.420 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.420 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.420 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.420 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-103ad76c-d4d9-640a-3e30-3d5acce29852 29:39.420 [INFO] TestAgent.server: member joined, marking health alive: member=Node-103ad76c-d4d9-640a-3e30-3d5acce29852 29:39.457 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.471 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.477 [INFO] TestAgent: Synced node info 29:39.483 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.497 [INFO] TestAgent: Synced node info 29:39.497 [INFO] TestAgent: Requesting shutdown 29:39.497 [INFO] TestAgent.server: shutting down server 29:39.497 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.497 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.497 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.497 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.497 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.497 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.497 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.497 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:39.497 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.497 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.497 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.504 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.515Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.515Z [INFO] agent.router.manager: shutting down 29:39.515 [INFO] TestAgent: consul server down 29:39.515 [INFO] TestAgent: shutdown complete 29:39.515 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=tcp 29:39.515 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=udp 29:39.515 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27366 network=tcp 29:40.016 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.016 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_NodeInfo (1.31s) === CONT TestAgentAntiEntropy_Services_WithChecks 2021-10-05T16:29:38.991Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.157Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.274 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f95e355f-d096-9617-bdbf-eb57b4b21358 Address:127.0.0.1:27419}]" 29:39.275 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27419 [Follower]" leader= 29:39.275 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f95e355f-d096-9617-bdbf-eb57b4b21358.dc1 127.0.0.1 29:39.276 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f95e355f-d096-9617-bdbf-eb57b4b21358 127.0.0.1 2021-10-05T16:29:39.276Z [INFO] agent.router: Initializing LAN area manager 29:39.276 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27414 network=udp 29:39.276 [INFO] TestAgent.server: Adding LAN server: server="Node-f95e355f-d096-9617-bdbf-eb57b4b21358 (Addr: tcp/127.0.0.1:27419) (DC: dc1)" 29:39.277 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f95e355f-d096-9617-bdbf-eb57b4b21358.dc1 area=wan 29:39.277 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27414 network=tcp 29:39.277 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27415 network=tcp 29:39.277 [INFO] TestAgent: started state syncer 29:39.277 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27420 network=tcp 29:39.324 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.324 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27419 [Candidate]" term=2 29:39.361 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.361 [DEBUG] TestAgent.server.raft: vote granted: from=f95e355f-d096-9617-bdbf-eb57b4b21358 term=2 tally=1 29:39.361 [INFO] TestAgent.server.raft: election won: tally=1 29:39.361 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27419 [Leader]" 29:39.362 [INFO] TestAgent.server: cluster leadership acquired 29:39.362 [INFO] TestAgent.server: New leader elected: payload=Node-f95e355f-d096-9617-bdbf-eb57b4b21358 29:39.371 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27419 29:39.399 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.453 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.453 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.453 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.453 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.453 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.453 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f95e355f-d096-9617-bdbf-eb57b4b21358 29:39.453 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f95e355f-d096-9617-bdbf-eb57b4b21358 29:39.484 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.517 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.524 [INFO] TestAgent: Synced node info 29:39.530 [INFO] TestAgent: Deregistered service: service=deleted-check-service 29:39.539 [INFO] TestAgent: Deregistered check: check=lb 29:39.539 [INFO] TestAgent: Requesting shutdown 29:39.539 [INFO] TestAgent.server: shutting down server 29:39.539 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.539 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.539 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.539 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.539 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.539 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.539 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.539 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:39.539 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.539 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.539 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.547 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.559Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.559Z [INFO] agent.router.manager: shutting down 29:39.559 [INFO] TestAgent: consul server down 29:39.559 [INFO] TestAgent: shutdown complete 29:39.559 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27414 network=tcp 29:39.559 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27414 network=udp 29:39.559 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27415 network=tcp 29:40.059 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.059 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_RemovingServiceAndCheck (1.35s) === CONT TestAgent_ServiceWatchCh 2021-10-05T16:29:39.108Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.205Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.281 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2b3b1821-2caf-aae5-365b-23b3a6bd1906 Address:127.0.0.1:27405}]" 29:39.281 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27405 [Follower]" leader= 29:39.282 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2b3b1821-2caf-aae5-365b-23b3a6bd1906.dc1 127.0.0.1 29:39.283 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2b3b1821-2caf-aae5-365b-23b3a6bd1906 127.0.0.1 2021-10-05T16:29:39.283Z [INFO] agent.router: Initializing LAN area manager 29:39.284 [INFO] TestAgent.server: Adding LAN server: server="Node-2b3b1821-2caf-aae5-365b-23b3a6bd1906 (Addr: tcp/127.0.0.1:27405) (DC: dc1)" 29:39.284 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2b3b1821-2caf-aae5-365b-23b3a6bd1906.dc1 area=wan 29:39.284 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27400 network=udp 29:39.284 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27400 network=tcp 29:39.284 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27401 network=tcp 29:39.284 [INFO] TestAgent: started state syncer 29:39.284 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27406 network=tcp 29:39.335 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.335 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27405 [Candidate]" term=2 29:39.384 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.384 [DEBUG] TestAgent.server.raft: vote granted: from=2b3b1821-2caf-aae5-365b-23b3a6bd1906 term=2 tally=1 29:39.384 [INFO] TestAgent.server.raft: election won: tally=1 29:39.384 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27405 [Leader]" 29:39.384 [INFO] TestAgent.server: cluster leadership acquired 29:39.384 [INFO] TestAgent.server: New leader elected: payload=Node-2b3b1821-2caf-aae5-365b-23b3a6bd1906 29:39.412 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27405 29:39.471 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.523 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.523 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.523 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.523 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.524 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.524 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2b3b1821-2caf-aae5-365b-23b3a6bd1906 29:39.524 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2b3b1821-2caf-aae5-365b-23b3a6bd1906 29:39.524 [INFO] TestAgent: Synced node info 29:39.524 [DEBUG] TestAgent: Node info in sync 29:39.557 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.557 [DEBUG] TestAgent: Node info in sync 29:39.564 [INFO] TestAgent: Synced check: check=web 29:39.564 [INFO] TestAgent: Requesting shutdown 29:39.564 [INFO] TestAgent.server: shutting down server 29:39.564 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.564 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.564 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.564 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.564 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.564 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.564 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.564 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.564 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.564 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.575 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.584Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.584Z [INFO] agent.router.manager: shutting down 29:39.584 [INFO] TestAgent: consul server down 29:39.584 [INFO] TestAgent: shutdown complete 29:39.584 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27400 network=tcp 29:39.584 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27400 network=udp 29:39.584 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27401 network=tcp 29:40.084 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.084 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_UpdateCheck_DiscardOutput (1.37s) === CONT TestAgentAntiEntropy_Services_ConnectProxy 2021-10-05T16:29:38.893Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:38.983Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.156 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1e52c60b-e67a-1ba5-f8d4-7be3ddb64724 Address:127.0.0.1:27426}]" 29:39.157 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27426 [Follower]" leader= 29:39.158 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1e52c60b-e67a-1ba5-f8d4-7be3ddb64724.dc1 127.0.0.1 29:39.194 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1e52c60b-e67a-1ba5-f8d4-7be3ddb64724 127.0.0.1 2021-10-05T16:29:39.194Z [INFO] agent.router: Initializing LAN area manager 29:39.194 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27421 network=udp 29:39.195 [INFO] TestAgent.server: Adding LAN server: server="Node-1e52c60b-e67a-1ba5-f8d4-7be3ddb64724 (Addr: tcp/127.0.0.1:27426) (DC: dc1)" 29:39.195 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1e52c60b-e67a-1ba5-f8d4-7be3ddb64724.dc1 area=wan 29:39.196 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27421 network=tcp 29:39.200 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.200 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27426 [Candidate]" term=2 29:39.206 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27422 network=tcp 29:39.206 [INFO] TestAgent: started state syncer 29:39.207 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27427 network=tcp 29:39.253 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.253 [DEBUG] TestAgent.server.raft: vote granted: from=1e52c60b-e67a-1ba5-f8d4-7be3ddb64724 term=2 tally=1 29:39.253 [INFO] TestAgent.server.raft: election won: tally=1 29:39.253 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27426 [Leader]" 29:39.256 [INFO] TestAgent.server: cluster leadership acquired 29:39.256 [INFO] TestAgent.server: New leader elected: payload=Node-1e52c60b-e67a-1ba5-f8d4-7be3ddb64724 29:39.274 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27426 29:39.275 [INFO] TestAgent: Synced node info 29:39.316 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.374 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.374 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.374 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.374 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.374 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.374 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1e52c60b-e67a-1ba5-f8d4-7be3ddb64724 29:39.374 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1e52c60b-e67a-1ba5-f8d4-7be3ddb64724 29:39.404 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.440 [DEBUG] TestAgent: Node info in sync 29:39.456 [INFO] TestAgent: Synced service: service=svc_id1 29:39.472 [INFO] TestAgent: Synced service: service=svc_id2 29:39.505 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.530 [INFO] TestAgent: Synced node info 29:39.542 [INFO] TestAgent: Synced service: service=svc_id1 29:39.560 [INFO] TestAgent: Synced service: service=svc_id2 29:39.560 [INFO] TestAgent: Requesting shutdown 29:39.560 [INFO] TestAgent.server: shutting down server 29:39.561 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.561 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.561 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.561 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.561 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.561 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.561 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.561 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.561 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.561 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.569 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.579Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.579Z [INFO] agent.router.manager: shutting down 29:39.580 [INFO] TestAgent: consul server down 29:39.580 [INFO] TestAgent: shutdown complete 29:39.580 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27421 network=tcp 29:39.580 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27421 network=udp 29:39.580 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27422 network=tcp 29:40.087 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.087 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_EnableTagOverride (1.35s) === CONT TestAgent_CheckTokens 2021-10-05T16:29:38.941Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:38.970Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.076 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d318d95f-1790-fb80-19ab-6a2ef193764d Address:127.0.0.1:27391}]" 29:39.092 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27391 [Follower]" leader= 29:39.092 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d318d95f-1790-fb80-19ab-6a2ef193764d.dc1 127.0.0.1 29:39.145 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d318d95f-1790-fb80-19ab-6a2ef193764d 127.0.0.1 2021-10-05T16:29:39.145Z [INFO] agent.router: Initializing LAN area manager 29:39.145 [INFO] TestAgent.server: Adding LAN server: server="Node-d318d95f-1790-fb80-19ab-6a2ef193764d (Addr: tcp/127.0.0.1:27391) (DC: dc1)" 29:39.146 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27386 network=udp 29:39.146 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d318d95f-1790-fb80-19ab-6a2ef193764d.dc1 area=wan 29:39.146 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27386 network=tcp 29:39.147 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27387 network=tcp 29:39.147 [INFO] TestAgent: started state syncer 29:39.147 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27392 network=tcp 29:39.152 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.152 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27391 [Candidate]" term=2 29:39.232 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.232 [DEBUG] TestAgent.server.raft: vote granted: from=d318d95f-1790-fb80-19ab-6a2ef193764d term=2 tally=1 29:39.232 [INFO] TestAgent.server.raft: election won: tally=1 29:39.232 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27391 [Leader]" 29:39.234 [INFO] TestAgent.server: cluster leadership acquired 29:39.234 [INFO] TestAgent.server: New leader elected: payload=Node-d318d95f-1790-fb80-19ab-6a2ef193764d 29:39.259 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27391 29:39.288 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.336 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.336 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.336 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.336 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.336 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.336 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d318d95f-1790-fb80-19ab-6a2ef193764d 29:39.336 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d318d95f-1790-fb80-19ab-6a2ef193764d 29:39.361 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.534 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.546 [INFO] TestAgent: Synced node info 29:39.546 [DEBUG] TestAgent: Check in sync: check=mysql 29:39.553 [INFO] TestAgent: Synced check: check=redis 29:39.561 [INFO] TestAgent: Synced check: check=web 29:39.561 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.561 [DEBUG] TestAgent: Node info in sync 29:39.574 [INFO] TestAgent: Synced check: check=cache 29:39.578 [INFO] TestAgent: Deregistered check: check=lb 29:39.578 [DEBUG] TestAgent: Check in sync: check=mysql 29:39.578 [DEBUG] TestAgent: Check in sync: check=redis 29:39.578 [DEBUG] TestAgent: Check in sync: check=web 29:39.579 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.583 [INFO] TestAgent: Synced node info 29:39.583 [DEBUG] TestAgent: Check in sync: check=web 29:39.583 [DEBUG] TestAgent: Check in sync: check=cache 29:39.583 [DEBUG] TestAgent: Check in sync: check=mysql 29:39.590 [INFO] TestAgent: Deregistered check: check=redis 29:39.591 [INFO] TestAgent: Requesting shutdown 29:39.591 [INFO] TestAgent.server: shutting down server 29:39.591 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.591 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.591 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.591 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.591 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.591 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.591 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.591 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.591 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.591 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.595 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.599Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.599Z [INFO] agent.router.manager: shutting down 29:39.599 [INFO] TestAgent: consul server down 29:39.599 [INFO] TestAgent: shutdown complete 29:39.599 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27386 network=tcp 29:39.599 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27386 network=udp 29:39.599 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27387 network=tcp 29:40.100 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.100 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_Checks (1.39s) === CONT TestAgent_AddCheckFailure 2021-10-05T16:29:38.918Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.034Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.157 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:26239a8f-6625-b86c-41ff-482204c5a006 Address:127.0.0.1:27384}]" 29:39.159 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-26239a8f-6625-b86c-41ff-482204c5a006.dc1 127.0.0.1 29:39.195 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27384 [Follower]" leader= 29:39.195 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-26239a8f-6625-b86c-41ff-482204c5a006 127.0.0.1 2021-10-05T16:29:39.195Z [INFO] agent.router: Initializing LAN area manager 29:39.195 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27379 network=udp 29:39.196 [INFO] TestAgent.server: Adding LAN server: server="Node-26239a8f-6625-b86c-41ff-482204c5a006 (Addr: tcp/127.0.0.1:27384) (DC: dc1)" 29:39.196 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-26239a8f-6625-b86c-41ff-482204c5a006.dc1 area=wan 29:39.196 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27379 network=tcp 29:39.197 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27380 network=tcp 29:39.197 [INFO] TestAgent: started state syncer 29:39.197 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27385 network=tcp 29:39.244 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.244 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27384 [Candidate]" term=2 29:39.287 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.287 [DEBUG] TestAgent.server.raft: vote granted: from=26239a8f-6625-b86c-41ff-482204c5a006 term=2 tally=1 29:39.287 [INFO] TestAgent.server.raft: election won: tally=1 29:39.287 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27384 [Leader]" 29:39.287 [INFO] TestAgent.server: cluster leadership acquired 29:39.288 [INFO] TestAgent.server: New leader elected: payload=Node-26239a8f-6625-b86c-41ff-482204c5a006 29:39.297 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27384 29:39.328 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.410 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.410 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.410 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.410 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.410 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.410 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-26239a8f-6625-b86c-41ff-482204c5a006 29:39.410 [INFO] TestAgent.server: member joined, marking health alive: member=Node-26239a8f-6625-b86c-41ff-482204c5a006 29:39.410 [INFO] TestAgent: Synced node info 29:39.432 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.550 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.550 [DEBUG] TestAgent: Node info in sync 29:39.550 [DEBUG] TestAgent: Node info in sync 29:39.597 [INFO] TestAgent: Requesting shutdown 29:39.597 [INFO] TestAgent.server: shutting down server 29:39.597 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.597 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.597 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.597 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.597 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.597 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.597 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.597 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.597 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.597 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.603 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.607Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.607Z [INFO] agent.router.manager: shutting down 29:39.607 [INFO] TestAgent: consul server down 29:39.607 [INFO] TestAgent: shutdown complete 29:39.607 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27379 network=tcp 29:39.607 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27379 network=udp 29:39.608 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27380 network=tcp 29:40.108 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.108 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_sendCoordinate (1.40s) === CONT TestAgent_AliasCheck --- PASS: TestAgent_CheckTokens (0.02s) === CONT TestAgent_ServiceTokens --- PASS: TestAgent_AddCheckFailure (0.01s) 2021-10-05T16:29:38.989Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.156Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.274 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f6629171-7f17-0c89-7f20-65ac847d377e Address:127.0.0.1:27377}]" 29:39.274 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27377 [Follower]" leader= 29:39.275 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f6629171-7f17-0c89-7f20-65ac847d377e.dc1 127.0.0.1 29:39.276 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f6629171-7f17-0c89-7f20-65ac847d377e 127.0.0.1 2021-10-05T16:29:39.276Z [INFO] agent.router: Initializing LAN area manager 29:39.277 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27372 network=udp 29:39.277 [INFO] TestAgent.server: Adding LAN server: server="Node-f6629171-7f17-0c89-7f20-65ac847d377e (Addr: tcp/127.0.0.1:27377) (DC: dc1)" 29:39.277 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f6629171-7f17-0c89-7f20-65ac847d377e.dc1 area=wan 29:39.277 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27372 network=tcp 29:39.278 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27373 network=tcp 29:39.278 [INFO] TestAgent: started state syncer 29:39.278 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27378 network=tcp 29:39.316 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.316 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27377 [Candidate]" term=2 29:39.352 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.352 [DEBUG] TestAgent.server.raft: vote granted: from=f6629171-7f17-0c89-7f20-65ac847d377e term=2 tally=1 29:39.352 [INFO] TestAgent.server.raft: election won: tally=1 29:39.352 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27377 [Leader]" 29:39.357 [INFO] TestAgent.server: cluster leadership acquired 29:39.357 [INFO] TestAgent.server: New leader elected: payload=Node-f6629171-7f17-0c89-7f20-65ac847d377e 29:39.390 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27377 29:39.418 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.498 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.498 [INFO] TestAgent: Synced node info 29:39.498 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.498 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.498 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.498 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.498 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f6629171-7f17-0c89-7f20-65ac847d377e 29:39.498 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f6629171-7f17-0c89-7f20-65ac847d377e 29:39.617 [INFO] TestAgent: Requesting shutdown 29:39.617 [INFO] TestAgent.server: shutting down server 29:39.617 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.617 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.617 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.617 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.617 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.617 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 29:39.617 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.617 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.617 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.617 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.624 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.627Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.627Z [INFO] agent.router.manager: shutting down 29:39.627 [INFO] TestAgent: consul server down 29:39.627 [INFO] TestAgent: shutdown complete 29:39.627 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27372 network=tcp 29:39.627 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27372 network=udp 29:39.627 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27373 network=tcp 29:40.136 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.136 [INFO] TestAgent: Endpoints down --- PASS: TestAliasNotifications_local (1.43s) --- PASS: TestAgent_AliasCheck (0.05s) --- PASS: TestAgent_ServiceTokens (0.05s) 2021-10-05T16:29:38.937Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:38.937Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.092Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:39.092Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.248 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:85e2152d-50ce-5986-6fbe-98df93f8d680 Address:127.0.0.1:27412}]" 29:39.248 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27412 [Follower]" leader= 29:39.249 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-85e2152d-50ce-5986-6fbe-98df93f8d680.dc1 127.0.0.1 29:39.250 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-85e2152d-50ce-5986-6fbe-98df93f8d680 127.0.0.1 2021-10-05T16:29:39.250Z [INFO] agent.router: Initializing LAN area manager 29:39.251 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27407 network=udp 29:39.251 [INFO] TestAgent.server: Adding LAN server: server="Node-85e2152d-50ce-5986-6fbe-98df93f8d680 (Addr: tcp/127.0.0.1:27412) (DC: dc1)" 29:39.251 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-85e2152d-50ce-5986-6fbe-98df93f8d680.dc1 area=wan 29:39.251 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27407 network=tcp 29:39.260 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27408 network=tcp 29:39.260 [INFO] TestAgent: started state syncer 29:39.272 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27413 network=tcp 29:39.299 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.299 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27412 [Candidate]" term=2 29:39.302 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:39.350 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.350 [DEBUG] TestAgent.server.raft: vote granted: from=85e2152d-50ce-5986-6fbe-98df93f8d680 term=2 tally=1 29:39.350 [INFO] TestAgent.server.raft: election won: tally=1 29:39.350 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27412 [Leader]" 29:39.357 [INFO] TestAgent.server: cluster leadership acquired 29:39.357 [INFO] TestAgent.server: New leader elected: payload=Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.380 [INFO] TestAgent.server: initializing acls 29:39.398 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:39.398 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:39.403 [INFO] TestAgent.server: initializing acls 29:39.403 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:39.417 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:39.426 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 29:39.440 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:39.441 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:39.441 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:39.441 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:39.441 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.441 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-85e2152d-50ce-5986-6fbe-98df93f8d680.dc1 29:39.441 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-85e2152d-50ce-5986-6fbe-98df93f8d680.dc1 area=wan 29:39.441 [INFO] TestAgent.server: Updating LAN server: server="Node-85e2152d-50ce-5986-6fbe-98df93f8d680 (Addr: tcp/127.0.0.1:27412) (DC: dc1)" 29:39.476 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:39.476 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 29:39.476 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.476 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-85e2152d-50ce-5986-6fbe-98df93f8d680.dc1 29:39.476 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-85e2152d-50ce-5986-6fbe-98df93f8d680.dc1 area=wan 29:39.476 [INFO] TestAgent.server: Updating LAN server: server="Node-85e2152d-50ce-5986-6fbe-98df93f8d680 (Addr: tcp/127.0.0.1:27412) (DC: dc1)" 29:39.510 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.562 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.562 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.562 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.562 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.562 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.562 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.562 [INFO] TestAgent.server: member joined, marking health alive: member=Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.572 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.572 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.584 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.596 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-85e2152d-50ce-5986-6fbe-98df93f8d680 29:39.609 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 29:39.609 [WARN] TestAgent: Node info update blocked by ACLs: node=85e2152d-50ce-5986-6fbe-98df93f8d680 accessorID=00000000-0000-0000-0000-000000000002 29:39.616 [INFO] TestAgent: Synced service: service=mysql 29:39.622 [INFO] TestAgent: Synced service: service=api 29:39.623 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 29:39.623 [WARN] TestAgent: Node info update blocked by ACLs: node=85e2152d-50ce-5986-6fbe-98df93f8d680 accessorID=00000000-0000-0000-0000-000000000002 29:39.639 [INFO] TestAgent: Synced service: service=mysql 29:39.650 [INFO] TestAgent: Synced service: service=api 29:39.668 [INFO] TestAgent: Synced check: check=api-check 29:39.669 [WARN] TestAgent: Check registration blocked by ACLs: check=mysql-check accessorID= 29:39.669 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=api-check 29:39.669 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 29:39.669 [WARN] TestAgent: Node info update blocked by ACLs: node=85e2152d-50ce-5986-6fbe-98df93f8d680 accessorID=00000000-0000-0000-0000-000000000002 29:39.684 [INFO] TestAgent: Synced service: service=mysql 29:39.708 [INFO] TestAgent: Synced service: service=api 29:39.708 [WARN] TestAgent: Check registration blocked by ACLs: check=mysql-check accessorID= 29:39.722 [INFO] TestAgent: Deregistered check: check=api-check 29:39.722 [INFO] TestAgent: Requesting shutdown 29:39.722 [INFO] TestAgent.server: shutting down server 29:39.722 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:39.722 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:39.722 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:39.722 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:39.722 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:39.722 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:39.722 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:39.722 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:39.722 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:39.722 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:39.722 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:39.722 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:39.722 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:39.722 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:39.729 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:39.735Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:39.735Z [INFO] agent.router.manager: shutting down 29:39.735 [INFO] TestAgent: consul server down 29:39.735 [INFO] TestAgent: shutdown complete 29:39.735 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27407 network=tcp 29:39.735 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27407 network=udp 29:39.736 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27408 network=tcp 29:40.236 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.236 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_Checks_ACLDeny (1.52s) 2021-10-05T16:29:40.092Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:40.115Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:40.174 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:706b756e-f165-1681-5c72-bfe10f8308bc Address:127.0.0.1:27447}]" 29:40.174 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27447 [Follower]" leader= 29:40.175 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-706b756e-f165-1681-5c72-bfe10f8308bc.dc1 127.0.0.1 29:40.175 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-706b756e-f165-1681-5c72-bfe10f8308bc 127.0.0.1 2021-10-05T16:29:40.175Z [INFO] agent.router: Initializing LAN area manager 29:40.175 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27442 network=udp 29:40.176 [INFO] TestAgent.server: Adding LAN server: server="Node-706b756e-f165-1681-5c72-bfe10f8308bc (Addr: tcp/127.0.0.1:27447) (DC: dc1)" 29:40.176 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-706b756e-f165-1681-5c72-bfe10f8308bc.dc1 area=wan 29:40.176 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27442 network=tcp 29:40.176 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27443 network=tcp 29:40.176 [INFO] TestAgent: started state syncer 29:40.176 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27448 network=tcp 29:40.237 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:40.237 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27447 [Candidate]" term=2 29:40.259 [DEBUG] TestAgent.server.raft: votes: needed=1 29:40.259 [DEBUG] TestAgent.server.raft: vote granted: from=706b756e-f165-1681-5c72-bfe10f8308bc term=2 tally=1 29:40.259 [INFO] TestAgent.server.raft: election won: tally=1 29:40.259 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27447 [Leader]" 29:40.260 [INFO] TestAgent.server: cluster leadership acquired 29:40.260 [INFO] TestAgent.server: New leader elected: payload=Node-706b756e-f165-1681-5c72-bfe10f8308bc 29:40.270 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27447 29:40.308 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:40.380 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:40.380 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:40.380 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:40.380 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:40.380 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:40.380 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-706b756e-f165-1681-5c72-bfe10f8308bc 29:40.380 [INFO] TestAgent.server: member joined, marking health alive: member=Node-706b756e-f165-1681-5c72-bfe10f8308bc 29:40.406 [INFO] TestAgent: Requesting shutdown 29:40.406 [INFO] TestAgent.server: shutting down server 29:40.406 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:40.406 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:40.406 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:40.406 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:40.406 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:40.406 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:40.406 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:40.406 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:40.406 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:40.416 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 29:40.420 [INFO] TestAgent.server: federation state anti-entropy synced 29:40.420 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:29:40.430Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:40.430Z [INFO] agent.router.manager: shutting down 29:40.430 [INFO] TestAgent: consul server down 29:40.430 [INFO] TestAgent: shutdown complete 29:40.430 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27442 network=tcp 29:40.430 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27442 network=udp 29:40.430 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27443 network=tcp 29:40.930 [INFO] TestAgent: Waiting for endpoints to shut down 29:40.930 [INFO] TestAgent: Endpoints down --- PASS: TestAgent_ServiceWatchCh (0.87s) 2021-10-05T16:29:40.067Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:40.094Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:40.195 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2df35846-e044-bb03-f228-ec1822c3ab51 Address:127.0.0.1:27440}]" 29:40.205 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2df35846-e044-bb03-f228-ec1822c3ab51.dc1 127.0.0.1 29:40.207 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2df35846-e044-bb03-f228-ec1822c3ab51 127.0.0.1 2021-10-05T16:29:40.207Z [INFO] agent.router: Initializing LAN area manager 29:40.214 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27440 [Follower]" leader= 29:40.215 [INFO] TestAgent.server: Adding LAN server: server="Node-2df35846-e044-bb03-f228-ec1822c3ab51 (Addr: tcp/127.0.0.1:27440) (DC: dc1)" 29:40.215 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2df35846-e044-bb03-f228-ec1822c3ab51.dc1 area=wan 29:40.215 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27435 network=tcp 29:40.217 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27435 network=udp 29:40.218 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27436 network=tcp 29:40.218 [INFO] TestAgent: started state syncer 29:40.218 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27441 network=tcp 29:40.264 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:40.264 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27440 [Candidate]" term=2 29:40.316 [DEBUG] TestAgent.server.raft: votes: needed=1 29:40.316 [DEBUG] TestAgent.server.raft: vote granted: from=2df35846-e044-bb03-f228-ec1822c3ab51 term=2 tally=1 29:40.316 [INFO] TestAgent.server.raft: election won: tally=1 29:40.316 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27440 [Leader]" 29:40.320 [INFO] TestAgent.server: cluster leadership acquired 29:40.320 [INFO] TestAgent.server: New leader elected: payload=Node-2df35846-e044-bb03-f228-ec1822c3ab51 29:40.347 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27440 29:40.378 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:40.444 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:40.444 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:40.444 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:40.444 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:40.444 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:40.444 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2df35846-e044-bb03-f228-ec1822c3ab51 29:40.444 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2df35846-e044-bb03-f228-ec1822c3ab51 29:40.476 [INFO] TestAgent.server: federation state anti-entropy synced 29:40.484 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:40.499 [INFO] TestAgent: Synced node info 29:40.513 [INFO] TestAgent: Synced service: service=mysql 29:40.513 [DEBUG] TestAgent: Check in sync: check=mysql 29:40.514 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:40.514 [DEBUG] TestAgent: Node info in sync 29:40.538 [INFO] TestAgent: Synced service: service=mysql 29:40.549 [INFO] TestAgent: Synced service: service=redis 29:40.549 [DEBUG] TestAgent: Check in sync: check=mysql 29:40.549 [DEBUG] TestAgent: Check in sync: check=redis:1 29:40.549 [DEBUG] TestAgent: Check in sync: check=redis:2 29:40.549 [INFO] TestAgent: Requesting shutdown 29:40.549 [INFO] TestAgent.server: shutting down server 29:40.549 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:40.549 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:40.549 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:40.549 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:40.549 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:40.549 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:40.549 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:40.549 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:40.549 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:40.549 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:40.549 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:40.558 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:40.569Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:40.569Z [INFO] agent.router.manager: shutting down 29:40.569 [INFO] TestAgent: consul server down 29:40.569 [INFO] TestAgent: shutdown complete 29:40.569 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27435 network=tcp 29:40.569 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27435 network=udp 29:40.569 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27436 network=tcp 29:41.069 [INFO] TestAgent: Waiting for endpoints to shut down 29:41.069 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_Services_WithChecks (1.05s) 2021-10-05T16:29:40.161Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:40.182Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:40.261 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9853ddfc-c2d0-0830-e75b-5fa1e39947fe Address:127.0.0.1:27454}]" 29:40.261 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27454 [Follower]" leader= 29:40.262 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9853ddfc-c2d0-0830-e75b-5fa1e39947fe.dc1 127.0.0.1 29:40.263 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9853ddfc-c2d0-0830-e75b-5fa1e39947fe 127.0.0.1 2021-10-05T16:29:40.263Z [INFO] agent.router: Initializing LAN area manager 29:40.263 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27449 network=udp 29:40.263 [INFO] TestAgent.server: Adding LAN server: server="Node-9853ddfc-c2d0-0830-e75b-5fa1e39947fe (Addr: tcp/127.0.0.1:27454) (DC: dc1)" 29:40.264 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9853ddfc-c2d0-0830-e75b-5fa1e39947fe.dc1 area=wan 29:40.264 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27449 network=tcp 29:40.265 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27450 network=tcp 29:40.265 [INFO] TestAgent: started state syncer 29:40.265 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27455 network=tcp 29:40.332 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:40.332 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27454 [Candidate]" term=2 29:40.360 [DEBUG] TestAgent.server.raft: votes: needed=1 29:40.360 [DEBUG] TestAgent.server.raft: vote granted: from=9853ddfc-c2d0-0830-e75b-5fa1e39947fe term=2 tally=1 29:40.360 [INFO] TestAgent.server.raft: election won: tally=1 29:40.360 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27454 [Leader]" 29:40.361 [INFO] TestAgent.server: cluster leadership acquired 29:40.361 [INFO] TestAgent.server: New leader elected: payload=Node-9853ddfc-c2d0-0830-e75b-5fa1e39947fe 29:40.379 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27454 29:40.428 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:40.472 [INFO] TestAgent: Synced node info 29:40.488 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:40.488 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:40.488 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:40.488 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:40.488 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:40.488 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9853ddfc-c2d0-0830-e75b-5fa1e39947fe 29:40.488 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9853ddfc-c2d0-0830-e75b-5fa1e39947fe 29:40.509 [ERROR] TestAgent.proxycfg: watch error: service_id=mysql-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.509 [ERROR] TestAgent.proxycfg: watch error: service_id=mysql-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.509 [ERROR] TestAgent.proxycfg: watch error: service_id=mysql-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.509 [ERROR] TestAgent.proxycfg: watch error: service_id=mysql-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.532 [INFO] TestAgent.server: federation state anti-entropy synced 29:40.542 [ERROR] TestAgent.proxycfg: watch error: service_id=redis-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.542 [ERROR] TestAgent.proxycfg: watch error: service_id=redis-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.542 [ERROR] TestAgent.proxycfg: watch error: service_id=redis-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.542 [ERROR] TestAgent.proxycfg: watch error: service_id=redis-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.564 [ERROR] TestAgent.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.564 [ERROR] TestAgent.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.564 [ERROR] TestAgent.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.564 [ERROR] TestAgent.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 29:40.589 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:40.610 [INFO] TestAgent: Synced node info 29:40.614 [INFO] TestAgent: Deregistered service: service=lb-proxy 29:40.614 [DEBUG] TestAgent: Service in sync: service=mysql-proxy 29:40.621 [INFO] TestAgent: Synced service: service=redis-proxy 29:40.626 [INFO] TestAgent: Synced service: service=web-proxy 29:40.632 [INFO] TestAgent: Synced service: service=cache-proxy 29:40.632 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:40.632 [DEBUG] TestAgent: Node info in sync 29:40.632 [DEBUG] TestAgent: Service in sync: service=mysql-proxy 29:40.632 [DEBUG] TestAgent: Service in sync: service=redis-proxy 29:40.632 [DEBUG] TestAgent: Service in sync: service=web-proxy 29:40.648 [INFO] TestAgent: Deregistered service: service=cache-proxy 29:40.648 [INFO] TestAgent: Requesting shutdown 29:40.649 [INFO] TestAgent.server: shutting down server 29:40.649 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:40.649 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:40.649 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:40.649 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:40.649 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:40.649 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:40.649 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:40.649 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:40.649 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:40.649 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:40.653 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:40.658Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:40.658Z [INFO] agent.router.manager: shutting down 29:40.658 [INFO] TestAgent: consul server down 29:40.658 [INFO] TestAgent: shutdown complete 29:40.658 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27449 network=tcp 29:40.658 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27449 network=udp 29:40.658 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27450 network=tcp 29:41.160 [INFO] TestAgent: Waiting for endpoints to shut down 29:41.160 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_Services_ConnectProxy (1.08s) 2021-10-05T16:29:38.919Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:39.155Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:39.262 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a95eb5d9-e700-f655-1b10-115b4dae5836 Address:127.0.0.1:27398}]" 29:39.263 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a95eb5d9-e700-f655-1b10-115b4dae5836.dc1 127.0.0.1 29:39.273 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a95eb5d9-e700-f655-1b10-115b4dae5836 127.0.0.1 2021-10-05T16:29:39.273Z [INFO] agent.router: Initializing LAN area manager 29:39.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27393 network=udp 29:39.273 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27398 [Follower]" leader= 29:39.276 [INFO] TestAgent.server: Adding LAN server: server="Node-a95eb5d9-e700-f655-1b10-115b4dae5836 (Addr: tcp/127.0.0.1:27398) (DC: dc1)" 29:39.276 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a95eb5d9-e700-f655-1b10-115b4dae5836.dc1 area=wan 29:39.276 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27393 network=tcp 29:39.277 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27394 network=tcp 29:39.277 [INFO] TestAgent: started state syncer 29:39.277 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27399 network=tcp 29:39.320 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:39.320 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27398 [Candidate]" term=2 29:39.351 [DEBUG] TestAgent.server.raft: votes: needed=1 29:39.351 [DEBUG] TestAgent.server.raft: vote granted: from=a95eb5d9-e700-f655-1b10-115b4dae5836 term=2 tally=1 29:39.351 [INFO] TestAgent.server.raft: election won: tally=1 29:39.351 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27398 [Leader]" 29:39.354 [INFO] TestAgent.server: cluster leadership acquired 29:39.356 [INFO] TestAgent.server: New leader elected: payload=Node-a95eb5d9-e700-f655-1b10-115b4dae5836 29:39.366 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27398 29:39.397 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:39.415 [INFO] TestAgent: Synced node info 29:39.415 [DEBUG] TestAgent: Node info in sync 29:39.445 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:39.445 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:39.445 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:39.445 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:39.445 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:39.445 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a95eb5d9-e700-f655-1b10-115b4dae5836 29:39.445 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a95eb5d9-e700-f655-1b10-115b4dae5836 29:39.500 [INFO] TestAgent.server: federation state anti-entropy synced 29:39.672 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:39.672 [DEBUG] TestAgent: Node info in sync 29:39.690 [INFO] TestAgent: Synced check: check=web 29:40.141 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:40.141 [DEBUG] TestAgent: Node info in sync 29:40.154 [INFO] TestAgent: Synced check: check=web 29:40.154 [DEBUG] TestAgent: Node info in sync 29:40.154 [DEBUG] TestAgent: Check in sync: check=web 29:40.161 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:40.169 [INFO] TestAgent: Synced node info 29:40.176 [INFO] TestAgent: Synced check: check=web 29:40.187 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:40.215 [INFO] TestAgent: Synced node info 29:40.215 [DEBUG] TestAgent: Check in sync: check=web 29:40.689 [DEBUG] TestAgent: Node info in sync 29:40.694 [INFO] TestAgent: Synced check: check=web 29:40.705 [INFO] TestAgent: Requesting shutdown 29:40.705 [INFO] TestAgent.server: shutting down server 29:40.705 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:40.705 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:40.705 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:40.705 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:40.705 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:40.707 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:40.707 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:40.707 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:40.707 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:40.707 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:40.711 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:40.711Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:40.711Z [INFO] agent.router.manager: shutting down 29:40.712 [INFO] TestAgent: consul server down 29:40.712 [INFO] TestAgent: shutdown complete 29:40.712 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27393 network=tcp 29:40.712 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27393 network=udp 29:40.712 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27394 network=tcp 29:41.212 [INFO] TestAgent: Waiting for endpoints to shut down 29:41.212 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_Check_DeferSync (2.50s) 2021-10-05T16:29:40.101Z [WARN] agent: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:40.101Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:40.159Z [WARN] agent.auto_config: The 'acl_datacenter' field is deprecated. Use the 'primary_datacenter' field instead. 2021-10-05T16:29:40.159Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:40.248 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2dbe56ed-cafd-c221-d893-bfb4b85859c0 Address:127.0.0.1:27433}]" 29:40.248 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27433 [Follower]" leader= 29:40.249 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0.dc1 127.0.0.1 29:40.249 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 127.0.0.1 2021-10-05T16:29:40.249Z [INFO] agent.router: Initializing LAN area manager 29:40.249 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27428 network=udp 29:40.249 [INFO] TestAgent.server: Adding LAN server: server="Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 (Addr: tcp/127.0.0.1:27433) (DC: dc1)" 29:40.250 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27428 network=tcp 29:40.250 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0.dc1 area=wan 29:40.250 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27429 network=tcp 29:40.250 [INFO] TestAgent: started state syncer 29:40.250 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27434 network=tcp 29:40.300 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:40.318 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:40.318 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27433 [Candidate]" term=2 29:40.355 [DEBUG] TestAgent.server.raft: votes: needed=1 29:40.355 [DEBUG] TestAgent.server.raft: vote granted: from=2dbe56ed-cafd-c221-d893-bfb4b85859c0 term=2 tally=1 29:40.355 [INFO] TestAgent.server.raft: election won: tally=1 29:40.355 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27433 [Leader]" 29:40.356 [INFO] TestAgent.server: cluster leadership acquired 29:40.356 [INFO] TestAgent.server: New leader elected: payload=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.359 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 29:40.376 [INFO] TestAgent.server: initializing acls 29:40.381 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:40.381 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:40.400 [INFO] TestAgent.server: initializing acls 29:40.400 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:40.401 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:40.428 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:40.444 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:40.444 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:40.444 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:40.444 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.444 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0.dc1 29:40.444 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0.dc1 area=wan 29:40.445 [INFO] TestAgent.server: Updating LAN server: server="Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 (Addr: tcp/127.0.0.1:27433) (DC: dc1)" 29:40.473 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:40.473 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 29:40.473 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.473 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0.dc1 29:40.473 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0.dc1 area=wan 29:40.473 [INFO] TestAgent.server: Updating LAN server: server="Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 (Addr: tcp/127.0.0.1:27433) (DC: dc1)" 29:40.512 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:40.568 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:40.568 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:40.568 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:40.568 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:40.568 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:40.568 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.568 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.573 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.573 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.580 [INFO] TestAgent.server: federation state anti-entropy synced 29:40.688 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.688 [DEBUG] TestAgent.acl: dropping node from result due to ACLs: node=Node-2dbe56ed-cafd-c221-d893-bfb4b85859c0 29:40.694 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 29:40.694 [WARN] TestAgent: Node info update blocked by ACLs: node=2dbe56ed-cafd-c221-d893-bfb4b85859c0 accessorID=00000000-0000-0000-0000-000000000002 29:40.694 [WARN] TestAgent: Service registration blocked by ACLs: service=mysql accessorID= 29:40.706 [INFO] TestAgent: Synced service: service=api 29:40.706 [DEBUG] TestAgent.acl: dropping check from result due to ACLs: check=serfHealth 29:40.706 [WARN] TestAgent: Node info update blocked by ACLs: node=2dbe56ed-cafd-c221-d893-bfb4b85859c0 accessorID=00000000-0000-0000-0000-000000000002 29:40.706 [WARN] TestAgent: Service registration blocked by ACLs: service=mysql accessorID= 29:40.715 [INFO] TestAgent: Deregistered service: service=api 29:40.715 [INFO] TestAgent: Requesting shutdown 29:40.716 [INFO] TestAgent.server: shutting down server 29:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:40.716 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:40.716 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:40.716 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:40.716 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:40.721 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:40.727Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:40.727Z [INFO] agent.router.manager: shutting down 29:40.727 [INFO] TestAgent: consul server down 29:40.727 [INFO] TestAgent: shutdown complete 29:40.727 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27428 network=tcp 29:40.727 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27428 network=udp 29:40.727 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27429 network=tcp 29:41.228 [INFO] TestAgent: Waiting for endpoints to shut down 29:41.228 [INFO] TestAgent: Endpoints down --- PASS: TestAgentAntiEntropy_Services_ACLDeny (1.22s) PASS ok github.com/hashicorp/consul/agent/local 2.680s === RUN TestBuild === RUN TestBuild/no_version === RUN TestBuild/bad_version === RUN TestBuild/good_version === RUN TestBuild/rc_version === RUN TestBuild/ent_version --- PASS: TestBuild (0.00s) --- PASS: TestBuild/no_version (0.00s) --- PASS: TestBuild/bad_version (0.00s) --- PASS: TestBuild/good_version (0.00s) --- PASS: TestBuild/rc_version (0.00s) --- PASS: TestBuild/ent_version (0.00s) === RUN TestServer_Key_Equal --- PASS: TestServer_Key_Equal (0.00s) === RUN TestServer_Key --- PASS: TestServer_Key (0.00s) === RUN TestServer_Key_params --- PASS: TestServer_Key_params (0.00s) === RUN TestIsConsulServer --- PASS: TestIsConsulServer (0.00s) === RUN TestIsConsulServer_Optional --- PASS: TestIsConsulServer_Optional (0.00s) PASS ok github.com/hashicorp/consul/agent/metadata 0.034s ? github.com/hashicorp/consul/agent/mock [no test files] === RUN TestPeekForTLS_not_TLS === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_0 === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_1 === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_2 === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_3 === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_4 === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_5 === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_6 === RUN TestPeekForTLS_not_TLS/tcp_rpc_type_byte_7 --- PASS: TestPeekForTLS_not_TLS (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_0 (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_1 (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_2 (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_3 (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_4 (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_5 (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_6 (0.00s) --- PASS: TestPeekForTLS_not_TLS/tcp_rpc_type_byte_7 (0.00s) === RUN TestPeekForTLS_actual_TLS === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_0 === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_1 === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_2 === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_3 === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_4 === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_5 === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_6 === RUN TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_7 --- PASS: TestPeekForTLS_actual_TLS (0.17s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_0 (0.02s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_1 (0.02s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_2 (0.02s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_3 (0.03s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_4 (0.02s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_5 (0.02s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_6 (0.02s) --- PASS: TestPeekForTLS_actual_TLS/tcp_rpc_type_byte_7 (0.02s) PASS ok github.com/hashicorp/consul/agent/pool 0.199s === RUN TestManagerInternal_cycleServer --- PASS: TestManagerInternal_cycleServer (0.00s) === RUN TestManagerInternal_getServerList --- PASS: TestManagerInternal_getServerList (0.00s) === RUN TestManagerInternal_New --- PASS: TestManagerInternal_New (0.00s) === RUN TestManagerInternal_reconcileServerList --- PASS: TestManagerInternal_reconcileServerList (0.00s) === RUN TestManagerInternal_refreshServerRebalanceTimer --- PASS: TestManagerInternal_refreshServerRebalanceTimer (0.00s) === RUN TestManagerInternal_saveServerList --- PASS: TestManagerInternal_saveServerList (0.00s) === RUN TestManager_healthyServer === RUN TestManager_healthyServer/checking_itself === RUN TestManager_healthyServer/checking_another_server_with_successful_ping === RUN TestManager_healthyServer/checking_another_server_with_failed_ping --- PASS: TestManager_healthyServer (0.00s) --- PASS: TestManager_healthyServer/checking_itself (0.00s) --- PASS: TestManager_healthyServer/checking_another_server_with_successful_ping (0.00s) --- PASS: TestManager_healthyServer/checking_another_server_with_failed_ping (0.00s) === RUN TestManager_Rebalance === RUN TestManager_Rebalance/single_server_cluster_checking_itself === RUN TestManager_Rebalance/multi_server_cluster_is_unhealthy_when_pings_always_fail === RUN TestManager_Rebalance/multi_server_cluster_checking_itself_remains_healthy_despite_pings_always_fail --- PASS: TestManager_Rebalance (0.00s) --- PASS: TestManager_Rebalance/single_server_cluster_checking_itself (0.00s) --- PASS: TestManager_Rebalance/multi_server_cluster_is_unhealthy_when_pings_always_fail (0.00s) --- PASS: TestManager_Rebalance/multi_server_cluster_checking_itself_remains_healthy_despite_pings_always_fail (0.00s) === RUN TestRouter_Shutdown --- PASS: TestRouter_Shutdown (0.00s) === RUN TestRouter_Routing --- PASS: TestRouter_Routing (0.00s) === RUN TestRouter_Routing_Offline 2021-10-05T16:29:38.107Z [DEBUG] TestRouter_Routing_Offline.router.manager: pinging server failed: server="node3.dc1 (Addr: tcp/127.0.0.4:8300) (DC: dc1)" error= 2021-10-05T16:29:38.107Z [DEBUG] TestRouter_Routing_Offline.router.manager: pinging server failed: server="node2.dc1 (Addr: tcp/127.0.0.3:8300) (DC: dc1)" error= 2021-10-05T16:29:38.107Z [DEBUG] TestRouter_Routing_Offline.router.manager: pinging server failed: server="node1.dc1 (Addr: tcp/127.0.0.2:8300) (DC: dc1)" error= 2021-10-05T16:29:38.107Z [DEBUG] TestRouter_Routing_Offline.router.manager: pinging server failed: server="node4.dc1 (Addr: tcp/127.0.0.5:8300) (DC: dc1)" error= 2021-10-05T16:29:38.107Z [DEBUG] TestRouter_Routing_Offline.router.manager: No healthy servers during rebalance, aborting --- PASS: TestRouter_Routing_Offline (0.00s) === RUN TestRouter_GetDatacenters --- PASS: TestRouter_GetDatacenters (0.00s) === RUN TestRouter_distanceSorter --- PASS: TestRouter_distanceSorter (0.00s) === RUN TestRouter_GetDatacentersByDistance --- PASS: TestRouter_GetDatacentersByDistance (0.00s) === RUN TestRouter_GetDatacenterMaps --- PASS: TestRouter_GetDatacenterMaps (0.00s) === RUN TestRouter_FindLANServer 2021-10-05T16:29:38.110Z [INFO] TestRouter_FindLANServer.router: Initializing LAN area manager --- PASS: TestRouter_FindLANServer (0.00s) === RUN TestServers_AddServer --- PASS: TestServers_AddServer (0.00s) === RUN TestServers_IsOffline 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: pinging server failed: server="s1 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.111Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: Rebalanced servers, new active server: number_of_servers=1 active_server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.110Z [DEBUG] TestServers_IsOffline.manager: No healthy servers during rebalance, aborting --- PASS: TestServers_IsOffline (0.00s) === RUN TestServers_FindServer 2021-10-05T16:29:38.111Z [WARN] TestServers_FindServer.manager: No servers available 2021-10-05T16:29:38.111Z [DEBUG] TestServers_FindServer.manager: cycled away from server: server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_FindServer.manager: cycled away from server: server="s2 (Addr: /) (DC: )" --- PASS: TestServers_FindServer (0.00s) === RUN TestServers_New --- PASS: TestServers_New (0.00s) === RUN TestServers_NotifyFailedServer 2021-10-05T16:29:38.111Z [DEBUG] TestServers_NotifyFailedServer.manager: cycled away from server: server="s1 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_NotifyFailedServer.manager: cycled away from server: server="s2 (Addr: /) (DC: )" --- PASS: TestServers_NotifyFailedServer (0.00s) === RUN TestServers_NumServers --- PASS: TestServers_NumServers (0.00s) === RUN TestServers_RebalanceServers 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.111Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.112Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s67 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s29 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s71 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.113Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s17 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s15 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s83 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.114Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.115Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s33 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s11 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s79 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.117Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s73 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s76 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s56 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.118Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s14 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s92 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.119Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s09 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s13 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s71 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s48 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s07 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s89 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s72 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.120Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s79 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.121Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s71 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s21 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s13 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.122Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s20 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.123Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.124Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.125Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s33 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.126Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.127Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s97 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s68 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.128Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.131Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.132Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.133Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.160Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s51 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s03 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s00 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.161Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.162Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s17 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.163Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.164Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.164Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.164Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.164Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.164Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.164Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.164Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s94 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s16 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s40 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s99 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.168Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.169Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.170Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.177Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s77 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s26 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s84 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s00 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s08 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s69 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s83 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s01 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s87 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s22 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.178Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s54 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s91 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s84 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s42 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s92 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s25 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.179Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.180Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s43 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s07 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s75 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.181Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s62 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.182Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.183Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s45 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.184Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.192Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.193Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.194Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s49 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.195Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.196Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s72 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s48 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s25 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.197Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.198Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s95 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s72 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s60 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.199Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s35 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.200Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.202Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.203Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.204Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s33 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.205Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.206Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.208Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.208Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s39 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.212Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.213Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.214Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.215Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.216Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.217Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.218Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s70 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s12 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s22 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s29 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s91 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s34 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.219Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s06 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.220Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.228Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s79 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.229Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.230Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s03 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.231Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.232Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.236Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s28 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.237Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s10 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s84 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s28 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s47 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.238Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.239Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.240Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.248Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s27 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s73 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s54 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.249Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.250Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s23 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.251Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s62 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.252Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.253Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.254Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.255Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.264Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.265Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s59 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.266Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s72 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.267Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.268Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s72 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s17 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s89 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s39 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.272Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.273Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s19 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s71 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.274Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.275Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.276Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.284Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s99 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.285Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.286Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.287Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.288Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.298Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.299Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s17 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.305Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.316Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.317Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.318Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s26 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s11 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.319Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.320Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.324Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.341Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s95 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: pinging server failed: server="s05 (Addr: /) (DC: )" error= 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.342Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: Rebalanced servers, new active server: number_of_servers=100 active_server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s53 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s25 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s27 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s48 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s55 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s23 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s40 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s69 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s99 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s34 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s68 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s51 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s50 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s36 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s71 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s29 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s96 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s31 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s00 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s38 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s81 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s79 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s41 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s59 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s16 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s33 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s43 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s39 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s78 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s30 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s95 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s28 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s45 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s83 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s76 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s56 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s75 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s82 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s88 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s62 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s98 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s93 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s84 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s44 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s67 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s08 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s46 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s91 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s89 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s24 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s60 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s47 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s77 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s90 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s37 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s21 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s49 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s87 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s57 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s72 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s58 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s94 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s86 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s61 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s63 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s66 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s73 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s85 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s92 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s54 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s65 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s80 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s26 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s20 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s22 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s74 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s64 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s97 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s70 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s42 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s52 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s35 (Addr: /) (DC: )" 2021-10-05T16:29:38.343Z [DEBUG] TestServers_RebalanceServers.manager: cycled away from server: server="s32 (Addr: /) (DC: )" --- PASS: TestServers_RebalanceServers (0.28s) === RUN TestServers_RebalanceServers_AvoidFailed 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.390Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.389Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s1 (Addr: faux/s1) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: pinging server failed: server="s2 (Addr: faux/s2) (DC: )" error= 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" 2021-10-05T16:29:38.388Z [DEBUG] TestServers_RebalanceServers_AvoidFailed.manager: Rebalanced servers, new active server: number_of_servers=3 active_server="s3 (Addr: faux/s3) (DC: )" --- PASS: TestServers_RebalanceServers_AvoidFailed (0.00s) === RUN TestManager_RemoveServer 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: Rebalanced servers, new active server: number_of_servers=19 active_server="s12 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s17 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s18 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s01 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s03 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s14 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s04 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s10 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s07 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s19 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s15 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s05 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s13 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s11 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s09 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s02 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s06 (Addr: /) (DC: )" 2021-10-05T16:29:38.391Z [DEBUG] TestManager_RemoveServer.manager: cycled away from server: server="s02 (Addr: /) (DC: )" --- PASS: TestManager_RemoveServer (0.00s) PASS ok github.com/hashicorp/consul/agent/router 0.431s === RUN TestStructs_ACLCaches === RUN TestStructs_ACLCaches/New === RUN TestStructs_ACLCaches/New/Valid_Sizes === RUN TestStructs_ACLCaches/New/Zero_Sizes === RUN TestStructs_ACLCaches/Identities === RUN TestStructs_ACLCaches/Policies === RUN TestStructs_ACLCaches/ParsedPolicies === RUN TestStructs_ACLCaches/Authorizers === RUN TestStructs_ACLCaches/Roles --- PASS: TestStructs_ACLCaches (0.00s) --- PASS: TestStructs_ACLCaches/New (0.00s) --- PASS: TestStructs_ACLCaches/New/Valid_Sizes (0.00s) --- PASS: TestStructs_ACLCaches/New/Zero_Sizes (0.00s) --- PASS: TestStructs_ACLCaches/Identities (0.00s) --- PASS: TestStructs_ACLCaches/Policies (0.00s) --- PASS: TestStructs_ACLCaches/ParsedPolicies (0.00s) --- PASS: TestStructs_ACLCaches/Authorizers (0.00s) --- PASS: TestStructs_ACLCaches/Roles (0.00s) === RUN TestStructs_ACL_IsSame --- PASS: TestStructs_ACL_IsSame (0.00s) === RUN TestStructs_ACL_Convert --- PASS: TestStructs_ACL_Convert (0.00s) === RUN TestStructs_ACLToken_Convert === RUN TestStructs_ACLToken_Convert/Management === RUN TestStructs_ACLToken_Convert/Client === RUN TestStructs_ACLToken_Convert/Unconvertible --- PASS: TestStructs_ACLToken_Convert (0.00s) --- PASS: TestStructs_ACLToken_Convert/Management (0.00s) --- PASS: TestStructs_ACLToken_Convert/Client (0.00s) --- PASS: TestStructs_ACLToken_Convert/Unconvertible (0.00s) === RUN TestStructs_ACLToken_PolicyIDs === RUN TestStructs_ACLToken_PolicyIDs/Basic === RUN TestStructs_ACLToken_PolicyIDs/Legacy_Management === RUN TestStructs_ACLToken_PolicyIDs/Legacy_Management_With_Rules === RUN TestStructs_ACLToken_PolicyIDs/No_Policies --- PASS: TestStructs_ACLToken_PolicyIDs (0.00s) --- PASS: TestStructs_ACLToken_PolicyIDs/Basic (0.00s) --- PASS: TestStructs_ACLToken_PolicyIDs/Legacy_Management (0.00s) --- PASS: TestStructs_ACLToken_PolicyIDs/Legacy_Management_With_Rules (0.00s) --- PASS: TestStructs_ACLToken_PolicyIDs/No_Policies (0.00s) === RUN TestStructs_ACLToken_EmbeddedPolicy === RUN TestStructs_ACLToken_EmbeddedPolicy/No_Rules === RUN TestStructs_ACLToken_EmbeddedPolicy/Legacy_Client === RUN TestStructs_ACLToken_EmbeddedPolicy/Same_Policy_for_Tokens_with_same_Rules --- PASS: TestStructs_ACLToken_EmbeddedPolicy (0.00s) --- PASS: TestStructs_ACLToken_EmbeddedPolicy/No_Rules (0.00s) --- PASS: TestStructs_ACLToken_EmbeddedPolicy/Legacy_Client (0.00s) --- PASS: TestStructs_ACLToken_EmbeddedPolicy/Same_Policy_for_Tokens_with_same_Rules (0.00s) === RUN TestStructs_ACLServiceIdentity_SyntheticPolicy === RUN TestStructs_ACLServiceIdentity_SyntheticPolicy/web === RUN TestStructs_ACLServiceIdentity_SyntheticPolicy/companion-cube-99_[dc1,_dc2] --- PASS: TestStructs_ACLServiceIdentity_SyntheticPolicy (0.00s) --- PASS: TestStructs_ACLServiceIdentity_SyntheticPolicy/web (0.00s) --- PASS: TestStructs_ACLServiceIdentity_SyntheticPolicy/companion-cube-99_[dc1,_dc2] (0.00s) === RUN TestStructs_ACLToken_SetHash === RUN TestStructs_ACLToken_SetHash/Nil_Hash_-_Generate === RUN TestStructs_ACLToken_SetHash/Hash_Set_-_Dont_Generate === RUN TestStructs_ACLToken_SetHash/Hash_Set_-_Generate --- PASS: TestStructs_ACLToken_SetHash (0.00s) --- PASS: TestStructs_ACLToken_SetHash/Nil_Hash_-_Generate (0.00s) --- PASS: TestStructs_ACLToken_SetHash/Hash_Set_-_Dont_Generate (0.00s) --- PASS: TestStructs_ACLToken_SetHash/Hash_Set_-_Generate (0.00s) === RUN TestStructs_ACLToken_EstimateSize --- PASS: TestStructs_ACLToken_EstimateSize (0.00s) === RUN TestStructs_ACLToken_Stub === RUN TestStructs_ACLToken_Stub/Basic === RUN TestStructs_ACLToken_Stub/Legacy --- PASS: TestStructs_ACLToken_Stub (0.00s) --- PASS: TestStructs_ACLToken_Stub/Basic (0.00s) --- PASS: TestStructs_ACLToken_Stub/Legacy (0.00s) === RUN TestStructs_ACLTokens_Sort --- PASS: TestStructs_ACLTokens_Sort (0.00s) === RUN TestStructs_ACLTokenListStubs_Sort --- PASS: TestStructs_ACLTokenListStubs_Sort (0.00s) === RUN TestStructs_ACLPolicy_Stub --- PASS: TestStructs_ACLPolicy_Stub (0.00s) === RUN TestStructs_ACLPolicy_SetHash === RUN TestStructs_ACLPolicy_SetHash/Nil_Hash_-_Generate === RUN TestStructs_ACLPolicy_SetHash/Hash_Set_-_Dont_Generate === RUN TestStructs_ACLPolicy_SetHash/Hash_Set_-_Generate --- PASS: TestStructs_ACLPolicy_SetHash (0.00s) --- PASS: TestStructs_ACLPolicy_SetHash/Nil_Hash_-_Generate (0.00s) --- PASS: TestStructs_ACLPolicy_SetHash/Hash_Set_-_Dont_Generate (0.00s) --- PASS: TestStructs_ACLPolicy_SetHash/Hash_Set_-_Generate (0.00s) === RUN TestStructs_ACLPolicy_EstimateSize --- PASS: TestStructs_ACLPolicy_EstimateSize (0.00s) === RUN TestStructs_ACLPolicies_Sort --- PASS: TestStructs_ACLPolicies_Sort (0.00s) === RUN TestStructs_ACLPolicyListStubs_Sort --- PASS: TestStructs_ACLPolicyListStubs_Sort (0.00s) === RUN TestStructs_ACLPolicies_resolveWithCache === RUN TestStructs_ACLPolicies_resolveWithCache/Cache_Misses === RUN TestStructs_ACLPolicies_resolveWithCache/Check_Cache === RUN TestStructs_ACLPolicies_resolveWithCache/Cache_Hits --- PASS: TestStructs_ACLPolicies_resolveWithCache (0.00s) --- PASS: TestStructs_ACLPolicies_resolveWithCache/Cache_Misses (0.00s) --- PASS: TestStructs_ACLPolicies_resolveWithCache/Check_Cache (0.00s) --- PASS: TestStructs_ACLPolicies_resolveWithCache/Cache_Hits (0.00s) === RUN TestStructs_ACLPolicies_Compile === RUN TestStructs_ACLPolicies_Compile/Cache_Miss === RUN TestStructs_ACLPolicies_Compile/Check_Cache === RUN TestStructs_ACLPolicies_Compile/Cache_Hit --- PASS: TestStructs_ACLPolicies_Compile (0.00s) --- PASS: TestStructs_ACLPolicies_Compile/Cache_Miss (0.00s) --- PASS: TestStructs_ACLPolicies_Compile/Check_Cache (0.00s) --- PASS: TestStructs_ACLPolicies_Compile/Cache_Hit (0.00s) === RUN TestCheckDefinition_Defaults --- PASS: TestCheckDefinition_Defaults (0.00s) === RUN TestCheckDefinition_CheckType --- PASS: TestCheckDefinition_CheckType (0.00s) === RUN TestCheckDefinitionToCheckType --- PASS: TestCheckDefinitionToCheckType (0.00s) === RUN TestConfigEntries_ListRelatedServices_AndACLs === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self/deny === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self/can_read_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self/can_write_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/deny === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/can_read_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/cannot_write_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/can_write_test_(with_other:read) === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/deny === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/can_read_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/cannot_write_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/can_write_test_(with_other1:read_and_other2:read) === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self/deny === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self/can_read_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self/can_write_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/deny === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/can_read_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/cannot_write_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/can_write_test_(with_a:read,_b:read,_and_c:read) === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_self === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_self/deny === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_self/can_read_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_self/can_write_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_some === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_some/deny === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_some/can_read_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_some/cannot_write_test === RUN TestConfigEntries_ListRelatedServices_AndACLs/router:_some/can_write_test_(with_foo:read_and_bar:read) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self/deny (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self/can_read_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_self/can_write_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/deny (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/can_read_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/cannot_write_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_redirect/can_write_test_(with_other:read) (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/deny (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/can_read_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/cannot_write_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/resolver:_failover/can_write_test_(with_other1:read_and_other2:read) (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self/deny (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self/can_read_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_self/can_write_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/deny (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/can_read_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/cannot_write_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/splitter:_some/can_write_test_(with_a:read,_b:read,_and_c:read) (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_self (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_self/deny (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_self/can_read_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_self/can_write_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_some (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_some/deny (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_some/can_read_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_some/cannot_write_test (0.00s) --- PASS: TestConfigEntries_ListRelatedServices_AndACLs/router:_some/can_write_test_(with_foo:read_and_bar:read) (0.00s) === RUN TestServiceResolverConfigEntry === RUN TestServiceResolverConfigEntry/nil === RUN TestServiceResolverConfigEntry/no_name === RUN TestServiceResolverConfigEntry/empty === RUN TestServiceResolverConfigEntry/empty_subset_name === RUN TestServiceResolverConfigEntry/default_subset_does_not_exist === RUN TestServiceResolverConfigEntry/default_subset_does_exist === RUN TestServiceResolverConfigEntry/empty_redirect === RUN TestServiceResolverConfigEntry/redirect_subset_with_no_service === RUN TestServiceResolverConfigEntry/redirect_namespace_with_no_service === RUN TestServiceResolverConfigEntry/self_redirect_with_invalid_subset === RUN TestServiceResolverConfigEntry/self_redirect_with_valid_subset === RUN TestServiceResolverConfigEntry/simple_wildcard_failover === RUN TestServiceResolverConfigEntry/failover_for_missing_subset === RUN TestServiceResolverConfigEntry/failover_for_present_subset === RUN TestServiceResolverConfigEntry/failover_empty === RUN TestServiceResolverConfigEntry/failover_to_self_using_invalid_subset === RUN TestServiceResolverConfigEntry/failover_to_self_using_valid_subset === RUN TestServiceResolverConfigEntry/failover_with_empty_datacenters_in_list === RUN TestServiceResolverConfigEntry/bad_connect_timeout === RUN TestServiceResolverConfigEntry/invalid_subset_name:_A === RUN TestServiceResolverConfigEntry/invalid_subset_name:_AA === RUN TestServiceResolverConfigEntry/invalid_subset_name:_2A === RUN TestServiceResolverConfigEntry/invalid_subset_name:_A2 === RUN TestServiceResolverConfigEntry/invalid_subset_name:_A2A === RUN TestServiceResolverConfigEntry/invalid_subset_name:_A22A === RUN TestServiceResolverConfigEntry/invalid_subset_name:_A-A === RUN TestServiceResolverConfigEntry/invalid_subset_name:_A--A === RUN TestServiceResolverConfigEntry/invalid_subset_name:_A--A--A === RUN TestServiceResolverConfigEntry/invalid_subset_name:__ === RUN TestServiceResolverConfigEntry/invalid_subset_name:__a === RUN TestServiceResolverConfigEntry/invalid_subset_name:_a_ === RUN TestServiceResolverConfigEntry/invalid_subset_name:_a_a === RUN TestServiceResolverConfigEntry/invalid_subset_name:__#01 === RUN TestServiceResolverConfigEntry/invalid_subset_name:__a#01 === RUN TestServiceResolverConfigEntry/invalid_subset_name:_a_#01 === RUN TestServiceResolverConfigEntry/invalid_subset_name:_a_a#01 === RUN TestServiceResolverConfigEntry/invalid_subset_name:_. === RUN TestServiceResolverConfigEntry/invalid_subset_name:_.a === RUN TestServiceResolverConfigEntry/invalid_subset_name:_a. === RUN TestServiceResolverConfigEntry/invalid_subset_name:_a.a === RUN TestServiceResolverConfigEntry/invalid_subset_name:_- === RUN TestServiceResolverConfigEntry/invalid_subset_name:_-a === RUN TestServiceResolverConfigEntry/invalid_subset_name:_a- === RUN TestServiceResolverConfigEntry/invalid_subset_name:_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa === RUN TestServiceResolverConfigEntry/valid_subset_name:_a === RUN TestServiceResolverConfigEntry/valid_subset_name:_aa === RUN TestServiceResolverConfigEntry/valid_subset_name:_2a === RUN TestServiceResolverConfigEntry/valid_subset_name:_a2 === RUN TestServiceResolverConfigEntry/valid_subset_name:_a2a === RUN TestServiceResolverConfigEntry/valid_subset_name:_a22a === RUN TestServiceResolverConfigEntry/valid_subset_name:_1 === RUN TestServiceResolverConfigEntry/valid_subset_name:_11 === RUN TestServiceResolverConfigEntry/valid_subset_name:_10 === RUN TestServiceResolverConfigEntry/valid_subset_name:_01 === RUN TestServiceResolverConfigEntry/valid_subset_name:_a-a === RUN TestServiceResolverConfigEntry/valid_subset_name:_a--a === RUN TestServiceResolverConfigEntry/valid_subset_name:_a--a--a === RUN TestServiceResolverConfigEntry/valid_subset_name:_0-0 === RUN TestServiceResolverConfigEntry/valid_subset_name:_0--0 === RUN TestServiceResolverConfigEntry/valid_subset_name:_0--0--0 === RUN TestServiceResolverConfigEntry/valid_subset_name:_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa --- PASS: TestServiceResolverConfigEntry (0.00s) --- PASS: TestServiceResolverConfigEntry/nil (0.00s) --- PASS: TestServiceResolverConfigEntry/no_name (0.00s) --- PASS: TestServiceResolverConfigEntry/empty (0.00s) --- PASS: TestServiceResolverConfigEntry/empty_subset_name (0.00s) --- PASS: TestServiceResolverConfigEntry/default_subset_does_not_exist (0.00s) --- PASS: TestServiceResolverConfigEntry/default_subset_does_exist (0.00s) --- PASS: TestServiceResolverConfigEntry/empty_redirect (0.00s) --- PASS: TestServiceResolverConfigEntry/redirect_subset_with_no_service (0.00s) --- PASS: TestServiceResolverConfigEntry/redirect_namespace_with_no_service (0.00s) --- PASS: TestServiceResolverConfigEntry/self_redirect_with_invalid_subset (0.00s) --- PASS: TestServiceResolverConfigEntry/self_redirect_with_valid_subset (0.00s) --- PASS: TestServiceResolverConfigEntry/simple_wildcard_failover (0.00s) --- PASS: TestServiceResolverConfigEntry/failover_for_missing_subset (0.00s) --- PASS: TestServiceResolverConfigEntry/failover_for_present_subset (0.00s) --- PASS: TestServiceResolverConfigEntry/failover_empty (0.00s) --- PASS: TestServiceResolverConfigEntry/failover_to_self_using_invalid_subset (0.00s) --- PASS: TestServiceResolverConfigEntry/failover_to_self_using_valid_subset (0.00s) --- PASS: TestServiceResolverConfigEntry/failover_with_empty_datacenters_in_list (0.00s) --- PASS: TestServiceResolverConfigEntry/bad_connect_timeout (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_A (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_AA (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_2A (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_A2 (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_A2A (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_A22A (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_A-A (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_A--A (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_A--A--A (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:__ (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:__a (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_a_ (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_a_a (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:__#01 (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:__a#01 (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_a_#01 (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_a_a#01 (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_. (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_.a (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_a. (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_a.a (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_- (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_-a (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_a- (0.00s) --- PASS: TestServiceResolverConfigEntry/invalid_subset_name:_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_a (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_aa (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_2a (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_a2 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_a2a (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_a22a (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_1 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_11 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_10 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_01 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_a-a (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_a--a (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_a--a--a (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_0-0 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_0--0 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_0--0--0 (0.00s) --- PASS: TestServiceResolverConfigEntry/valid_subset_name:_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa (0.00s) === RUN TestServiceSplitterConfigEntry === RUN TestServiceSplitterConfigEntry/nil === RUN TestServiceSplitterConfigEntry/no_name === RUN TestServiceSplitterConfigEntry/empty === RUN TestServiceSplitterConfigEntry/1_split === RUN TestServiceSplitterConfigEntry/1_split_not_enough_weight === RUN TestServiceSplitterConfigEntry/1_split_too_much_weight === RUN TestServiceSplitterConfigEntry/2_splits === RUN TestServiceSplitterConfigEntry/2_splits_-_rounded_up_to_smallest_units === RUN TestServiceSplitterConfigEntry/2_splits_not_enough_weight === RUN TestServiceSplitterConfigEntry/2_splits_too_much_weight === RUN TestServiceSplitterConfigEntry/3_splits === RUN TestServiceSplitterConfigEntry/3_splits_one_duplicated_same_weights === RUN TestServiceSplitterConfigEntry/3_splits_one_duplicated_diff_weights --- PASS: TestServiceSplitterConfigEntry (0.00s) --- PASS: TestServiceSplitterConfigEntry/nil (0.00s) --- PASS: TestServiceSplitterConfigEntry/no_name (0.00s) --- PASS: TestServiceSplitterConfigEntry/empty (0.00s) --- PASS: TestServiceSplitterConfigEntry/1_split (0.00s) --- PASS: TestServiceSplitterConfigEntry/1_split_not_enough_weight (0.00s) --- PASS: TestServiceSplitterConfigEntry/1_split_too_much_weight (0.00s) --- PASS: TestServiceSplitterConfigEntry/2_splits (0.00s) --- PASS: TestServiceSplitterConfigEntry/2_splits_-_rounded_up_to_smallest_units (0.00s) --- PASS: TestServiceSplitterConfigEntry/2_splits_not_enough_weight (0.00s) --- PASS: TestServiceSplitterConfigEntry/2_splits_too_much_weight (0.00s) --- PASS: TestServiceSplitterConfigEntry/3_splits (0.00s) --- PASS: TestServiceSplitterConfigEntry/3_splits_one_duplicated_same_weights (0.00s) --- PASS: TestServiceSplitterConfigEntry/3_splits_one_duplicated_diff_weights (0.00s) === RUN TestServiceRouterConfigEntry === RUN TestServiceRouterConfigEntry/nil === RUN TestServiceRouterConfigEntry/no_name === RUN TestServiceRouterConfigEntry/empty === RUN TestServiceRouterConfigEntry/1_empty_route === RUN TestServiceRouterConfigEntry/route_with_path_exact === RUN TestServiceRouterConfigEntry/route_with_bad_path_exact === RUN TestServiceRouterConfigEntry/route_with_path_prefix === RUN TestServiceRouterConfigEntry/route_with_bad_path_prefix === RUN TestServiceRouterConfigEntry/route_with_path_regex === RUN TestServiceRouterConfigEntry/route_with_path_exact_and_prefix === RUN TestServiceRouterConfigEntry/route_with_path_exact_and_regex === RUN TestServiceRouterConfigEntry/route_with_path_prefix_and_regex === RUN TestServiceRouterConfigEntry/route_with_path_exact,_prefix,_and_regex === RUN TestServiceRouterConfigEntry/route_with_no_name_header === RUN TestServiceRouterConfigEntry/route_with_header_present === RUN TestServiceRouterConfigEntry/route_with_header_not_present === RUN TestServiceRouterConfigEntry/route_with_header_exact === RUN TestServiceRouterConfigEntry/route_with_header_regex === RUN TestServiceRouterConfigEntry/route_with_header_prefix === RUN TestServiceRouterConfigEntry/route_with_header_suffix === RUN TestServiceRouterConfigEntry/route_with_header_present_and_exact === RUN TestServiceRouterConfigEntry/route_with_header_present_and_regex === RUN TestServiceRouterConfigEntry/route_with_header_present_and_prefix === RUN TestServiceRouterConfigEntry/route_with_header_present_and_suffix === RUN TestServiceRouterConfigEntry/route_with_no_name_query_param === RUN TestServiceRouterConfigEntry/route_with_query_param_exact_match === RUN TestServiceRouterConfigEntry/route_with_query_param_regex_match === RUN TestServiceRouterConfigEntry/route_with_query_param_present_match === RUN TestServiceRouterConfigEntry/route_with_query_param_exact_and_regex_match === RUN TestServiceRouterConfigEntry/route_with_query_param_exact_and_present_match === RUN TestServiceRouterConfigEntry/route_with_query_param_regex_and_present_match === RUN TestServiceRouterConfigEntry/route_with_query_param_exact,_regex,_and_present_match === RUN TestServiceRouterConfigEntry/route_with_no_match_and_prefix_rewrite === RUN TestServiceRouterConfigEntry/route_with_path_prefix_match_and_prefix_rewrite === RUN TestServiceRouterConfigEntry/route_with_path_exact_match_and_prefix_rewrite === RUN TestServiceRouterConfigEntry/route_with_path_regex_match_and_prefix_rewrite === RUN TestServiceRouterConfigEntry/route_with_header_match_and_prefix_rewrite === RUN TestServiceRouterConfigEntry/route_with_header_match_and_prefix_rewrite#01 === RUN TestServiceRouterConfigEntry/route_with_method_matches === RUN TestServiceRouterConfigEntry/route_with_method_matches_repeated --- PASS: TestServiceRouterConfigEntry (0.00s) --- PASS: TestServiceRouterConfigEntry/nil (0.00s) --- PASS: TestServiceRouterConfigEntry/no_name (0.00s) --- PASS: TestServiceRouterConfigEntry/empty (0.00s) --- PASS: TestServiceRouterConfigEntry/1_empty_route (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_exact (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_bad_path_exact (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_prefix (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_bad_path_prefix (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_regex (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_exact_and_prefix (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_exact_and_regex (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_prefix_and_regex (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_exact,_prefix,_and_regex (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_no_name_header (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_present (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_not_present (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_exact (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_regex (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_prefix (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_suffix (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_present_and_exact (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_present_and_regex (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_present_and_prefix (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_present_and_suffix (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_no_name_query_param (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_query_param_exact_match (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_query_param_regex_match (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_query_param_present_match (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_query_param_exact_and_regex_match (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_query_param_exact_and_present_match (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_query_param_regex_and_present_match (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_query_param_exact,_regex,_and_present_match (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_no_match_and_prefix_rewrite (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_prefix_match_and_prefix_rewrite (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_exact_match_and_prefix_rewrite (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_path_regex_match_and_prefix_rewrite (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_match_and_prefix_rewrite (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_header_match_and_prefix_rewrite#01 (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_method_matches (0.00s) --- PASS: TestServiceRouterConfigEntry/route_with_method_matches_repeated (0.00s) === RUN TestValidateServiceSubset === RUN TestValidateServiceSubset/a === RUN TestValidateServiceSubset/aa === RUN TestValidateServiceSubset/2a === RUN TestValidateServiceSubset/a2 === RUN TestValidateServiceSubset/a2a === RUN TestValidateServiceSubset/a22a === RUN TestValidateServiceSubset/1 === RUN TestValidateServiceSubset/11 === RUN TestValidateServiceSubset/10 === RUN TestValidateServiceSubset/01 === RUN TestValidateServiceSubset/a-a === RUN TestValidateServiceSubset/a--a === RUN TestValidateServiceSubset/a--a--a === RUN TestValidateServiceSubset/0-0 === RUN TestValidateServiceSubset/0--0 === RUN TestValidateServiceSubset/0--0--0 === RUN TestValidateServiceSubset/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa === RUN TestValidateServiceSubset/A === RUN TestValidateServiceSubset/AA === RUN TestValidateServiceSubset/2A === RUN TestValidateServiceSubset/A2 === RUN TestValidateServiceSubset/A2A === RUN TestValidateServiceSubset/A22A === RUN TestValidateServiceSubset/A-A === RUN TestValidateServiceSubset/A--A === RUN TestValidateServiceSubset/A--A--A === RUN TestValidateServiceSubset/_ === RUN TestValidateServiceSubset/_a === RUN TestValidateServiceSubset/a_ === RUN TestValidateServiceSubset/a_a === RUN TestValidateServiceSubset/_#01 === RUN TestValidateServiceSubset/_a#01 === RUN TestValidateServiceSubset/a_#01 === RUN TestValidateServiceSubset/a_a#01 === RUN TestValidateServiceSubset/. === RUN TestValidateServiceSubset/.a === RUN TestValidateServiceSubset/a. === RUN TestValidateServiceSubset/a.a === RUN TestValidateServiceSubset/- === RUN TestValidateServiceSubset/-a === RUN TestValidateServiceSubset/a- === RUN TestValidateServiceSubset/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa --- PASS: TestValidateServiceSubset (0.00s) --- PASS: TestValidateServiceSubset/a (0.00s) --- PASS: TestValidateServiceSubset/aa (0.00s) --- PASS: TestValidateServiceSubset/2a (0.00s) --- PASS: TestValidateServiceSubset/a2 (0.00s) --- PASS: TestValidateServiceSubset/a2a (0.00s) --- PASS: TestValidateServiceSubset/a22a (0.00s) --- PASS: TestValidateServiceSubset/1 (0.00s) --- PASS: TestValidateServiceSubset/11 (0.00s) --- PASS: TestValidateServiceSubset/10 (0.00s) --- PASS: TestValidateServiceSubset/01 (0.00s) --- PASS: TestValidateServiceSubset/a-a (0.00s) --- PASS: TestValidateServiceSubset/a--a (0.00s) --- PASS: TestValidateServiceSubset/a--a--a (0.00s) --- PASS: TestValidateServiceSubset/0-0 (0.00s) --- PASS: TestValidateServiceSubset/0--0 (0.00s) --- PASS: TestValidateServiceSubset/0--0--0 (0.00s) --- PASS: TestValidateServiceSubset/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa (0.00s) --- PASS: TestValidateServiceSubset/A (0.00s) --- PASS: TestValidateServiceSubset/AA (0.00s) --- PASS: TestValidateServiceSubset/2A (0.00s) --- PASS: TestValidateServiceSubset/A2 (0.00s) --- PASS: TestValidateServiceSubset/A2A (0.00s) --- PASS: TestValidateServiceSubset/A22A (0.00s) --- PASS: TestValidateServiceSubset/A-A (0.00s) --- PASS: TestValidateServiceSubset/A--A (0.00s) --- PASS: TestValidateServiceSubset/A--A--A (0.00s) --- PASS: TestValidateServiceSubset/_ (0.00s) --- PASS: TestValidateServiceSubset/_a (0.00s) --- PASS: TestValidateServiceSubset/a_ (0.00s) --- PASS: TestValidateServiceSubset/a_a (0.00s) --- PASS: TestValidateServiceSubset/_#01 (0.00s) --- PASS: TestValidateServiceSubset/_a#01 (0.00s) --- PASS: TestValidateServiceSubset/a_#01 (0.00s) --- PASS: TestValidateServiceSubset/a_a#01 (0.00s) --- PASS: TestValidateServiceSubset/. (0.00s) --- PASS: TestValidateServiceSubset/.a (0.00s) --- PASS: TestValidateServiceSubset/a. (0.00s) --- PASS: TestValidateServiceSubset/a.a (0.00s) --- PASS: TestValidateServiceSubset/- (0.00s) --- PASS: TestValidateServiceSubset/-a (0.00s) --- PASS: TestValidateServiceSubset/a- (0.00s) --- PASS: TestValidateServiceSubset/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa (0.00s) === RUN TestIngressConfigEntry_Normalize === RUN TestIngressConfigEntry_Normalize/empty_protocol === RUN TestIngressConfigEntry_Normalize/lowercase_protocols --- PASS: TestIngressConfigEntry_Normalize (0.00s) --- PASS: TestIngressConfigEntry_Normalize/empty_protocol (0.00s) --- PASS: TestIngressConfigEntry_Normalize/lowercase_protocols (0.00s) === RUN TestIngressConfigEntry_ListRelatedServices === RUN TestIngressConfigEntry_ListRelatedServices/one_wild === RUN TestIngressConfigEntry_ListRelatedServices/kitchen_sink === RUN TestIngressConfigEntry_ListRelatedServices/one_exact --- PASS: TestIngressConfigEntry_ListRelatedServices (0.00s) --- PASS: TestIngressConfigEntry_ListRelatedServices/one_wild (0.00s) --- PASS: TestIngressConfigEntry_ListRelatedServices/kitchen_sink (0.00s) --- PASS: TestIngressConfigEntry_ListRelatedServices/one_exact (0.00s) === RUN TestIngressConfigEntry_Validate === RUN TestIngressConfigEntry_Validate/port_conflict === RUN TestIngressConfigEntry_Validate/http_features:_wildcard === RUN TestIngressConfigEntry_Validate/http_features:_wildcard_service_on_invalid_protocol === RUN TestIngressConfigEntry_Validate/http_features:_multiple_services === RUN TestIngressConfigEntry_Validate/tcp_listener_requires_a_defined_service === RUN TestIngressConfigEntry_Validate/http_listener_requires_a_defined_service === RUN TestIngressConfigEntry_Validate/empty_service_name_not_supported === RUN TestIngressConfigEntry_Validate/protocol_validation === RUN TestIngressConfigEntry_Validate/hosts_cannot_be_set_on_a_tcp_listener === RUN TestIngressConfigEntry_Validate/hosts_cannot_be_set_on_a_wildcard_specifier === RUN TestIngressConfigEntry_Validate/hosts_must_be_unique_per_listener === RUN TestIngressConfigEntry_Validate/hosts_must_be_a_valid_DNS_name === RUN TestIngressConfigEntry_Validate/wildcard_specifier_is_only_allowed_in_the_leftmost_label === RUN TestIngressConfigEntry_Validate/wildcard_specifier_is_not_allowed_in_non-leftmost_labels === RUN TestIngressConfigEntry_Validate/wildcard_specifier_is_not_allowed_in_leftmost_labels_as_a_partial === RUN TestIngressConfigEntry_Validate/wildcard_specifier_is_allowed_for_hosts_when_TLS_is_disabled === RUN TestIngressConfigEntry_Validate/wildcard_specifier_is_not_allowed_for_hosts_when_TLS_is_enabled --- PASS: TestIngressConfigEntry_Validate (0.00s) --- PASS: TestIngressConfigEntry_Validate/port_conflict (0.00s) --- PASS: TestIngressConfigEntry_Validate/http_features:_wildcard (0.00s) --- PASS: TestIngressConfigEntry_Validate/http_features:_wildcard_service_on_invalid_protocol (0.00s) --- PASS: TestIngressConfigEntry_Validate/http_features:_multiple_services (0.00s) --- PASS: TestIngressConfigEntry_Validate/tcp_listener_requires_a_defined_service (0.00s) --- PASS: TestIngressConfigEntry_Validate/http_listener_requires_a_defined_service (0.00s) --- PASS: TestIngressConfigEntry_Validate/empty_service_name_not_supported (0.00s) --- PASS: TestIngressConfigEntry_Validate/protocol_validation (0.00s) --- PASS: TestIngressConfigEntry_Validate/hosts_cannot_be_set_on_a_tcp_listener (0.00s) --- PASS: TestIngressConfigEntry_Validate/hosts_cannot_be_set_on_a_wildcard_specifier (0.00s) --- PASS: TestIngressConfigEntry_Validate/hosts_must_be_unique_per_listener (0.00s) --- PASS: TestIngressConfigEntry_Validate/hosts_must_be_a_valid_DNS_name (0.00s) --- PASS: TestIngressConfigEntry_Validate/wildcard_specifier_is_only_allowed_in_the_leftmost_label (0.00s) --- PASS: TestIngressConfigEntry_Validate/wildcard_specifier_is_not_allowed_in_non-leftmost_labels (0.00s) --- PASS: TestIngressConfigEntry_Validate/wildcard_specifier_is_not_allowed_in_leftmost_labels_as_a_partial (0.00s) --- PASS: TestIngressConfigEntry_Validate/wildcard_specifier_is_allowed_for_hosts_when_TLS_is_disabled (0.00s) --- PASS: TestIngressConfigEntry_Validate/wildcard_specifier_is_not_allowed_for_hosts_when_TLS_is_enabled (0.00s) === RUN TestTerminatingConfigEntry_Validate === RUN TestTerminatingConfigEntry_Validate/service_conflict === RUN TestTerminatingConfigEntry_Validate/blank_service_name === RUN TestTerminatingConfigEntry_Validate/not_all_TLS_options_provided-1 === RUN TestTerminatingConfigEntry_Validate/not_all_TLS_options_provided-2 === RUN TestTerminatingConfigEntry_Validate/all_TLS_options_provided === RUN TestTerminatingConfigEntry_Validate/only_providing_ca_file_is_allowed --- PASS: TestTerminatingConfigEntry_Validate (0.00s) --- PASS: TestTerminatingConfigEntry_Validate/service_conflict (0.00s) --- PASS: TestTerminatingConfigEntry_Validate/blank_service_name (0.00s) --- PASS: TestTerminatingConfigEntry_Validate/not_all_TLS_options_provided-1 (0.00s) --- PASS: TestTerminatingConfigEntry_Validate/not_all_TLS_options_provided-2 (0.00s) --- PASS: TestTerminatingConfigEntry_Validate/all_TLS_options_provided (0.00s) --- PASS: TestTerminatingConfigEntry_Validate/only_providing_ca_file_is_allowed (0.00s) === RUN TestGatewayService_Addresses === RUN TestGatewayService_Addresses/port_is_zero === RUN TestGatewayService_Addresses/no_hosts_with_empty_array === RUN TestGatewayService_Addresses/no_hosts_with_default === RUN TestGatewayService_Addresses/user-defined_hosts --- PASS: TestGatewayService_Addresses (0.00s) --- PASS: TestGatewayService_Addresses/port_is_zero (0.00s) --- PASS: TestGatewayService_Addresses/no_hosts_with_empty_array (0.00s) --- PASS: TestGatewayService_Addresses/no_hosts_with_default (0.00s) --- PASS: TestGatewayService_Addresses/user-defined_hosts (0.00s) === RUN TestDecodeConfigEntry_OSS === RUN TestDecodeConfigEntry_OSS/namespaces_invalid_top_level_(snake_case) === RUN TestDecodeConfigEntry_OSS/namespaces_invalid_top_level_(camel_case) === RUN TestDecodeConfigEntry_OSS/namespaces_invalid_deep_(snake_case) === RUN TestDecodeConfigEntry_OSS/namespaces_invalid_deep_(camel_case) --- PASS: TestDecodeConfigEntry_OSS (0.00s) --- PASS: TestDecodeConfigEntry_OSS/namespaces_invalid_top_level_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry_OSS/namespaces_invalid_top_level_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry_OSS/namespaces_invalid_deep_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry_OSS/namespaces_invalid_deep_(camel_case) (0.00s) === RUN TestDecodeConfigEntry === RUN TestDecodeConfigEntry/proxy-defaults:_extra_fields_or_typo_(snake_case) === RUN TestDecodeConfigEntry/proxy-defaults:_extra_fields_or_typo_(camel_case) === RUN TestDecodeConfigEntry/proxy-defaults_(snake_case) === RUN TestDecodeConfigEntry/proxy-defaults_(camel_case) === RUN TestDecodeConfigEntry/service-defaults_(snake_case) === RUN TestDecodeConfigEntry/service-defaults_(camel_case) === RUN TestDecodeConfigEntry/service-router:_kitchen_sink_(snake_case) === RUN TestDecodeConfigEntry/service-router:_kitchen_sink_(camel_case) === RUN TestDecodeConfigEntry/service-splitter:_kitchen_sink_(snake_case) === RUN TestDecodeConfigEntry/service-splitter:_kitchen_sink_(camel_case) === RUN TestDecodeConfigEntry/service-resolver:_subsets_with_failover_(snake_case) === RUN TestDecodeConfigEntry/service-resolver:_subsets_with_failover_(camel_case) === RUN TestDecodeConfigEntry/service-resolver:_redirect_(snake_case) === RUN TestDecodeConfigEntry/service-resolver:_redirect_(camel_case) === RUN TestDecodeConfigEntry/service-resolver:_default_(snake_case) === RUN TestDecodeConfigEntry/service-resolver:_default_(camel_case) === RUN TestDecodeConfigEntry/ingress-gateway:_kitchen_sink_(snake_case) === RUN TestDecodeConfigEntry/ingress-gateway:_kitchen_sink_(camel_case) === RUN TestDecodeConfigEntry/terminating-gateway:_kitchen_sink_(snake_case) === RUN TestDecodeConfigEntry/terminating-gateway:_kitchen_sink_(camel_case) --- PASS: TestDecodeConfigEntry (0.01s) --- PASS: TestDecodeConfigEntry/proxy-defaults:_extra_fields_or_typo_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/proxy-defaults:_extra_fields_or_typo_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/proxy-defaults_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/proxy-defaults_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-defaults_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-defaults_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-router:_kitchen_sink_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-router:_kitchen_sink_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-splitter:_kitchen_sink_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-splitter:_kitchen_sink_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-resolver:_subsets_with_failover_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-resolver:_subsets_with_failover_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-resolver:_redirect_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-resolver:_redirect_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-resolver:_default_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/service-resolver:_default_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/ingress-gateway:_kitchen_sink_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/ingress-gateway:_kitchen_sink_(camel_case) (0.00s) --- PASS: TestDecodeConfigEntry/terminating-gateway:_kitchen_sink_(snake_case) (0.00s) --- PASS: TestDecodeConfigEntry/terminating-gateway:_kitchen_sink_(camel_case) (0.00s) === RUN TestServiceConfigResponse_MsgPack --- PASS: TestServiceConfigResponse_MsgPack (0.00s) === RUN TestConfigEntryResponseMarshalling === RUN TestConfigEntryResponseMarshalling/nil_entry === RUN TestConfigEntryResponseMarshalling/proxy-default_entry === RUN TestConfigEntryResponseMarshalling/service-default_entry --- PASS: TestConfigEntryResponseMarshalling (0.00s) --- PASS: TestConfigEntryResponseMarshalling/nil_entry (0.00s) --- PASS: TestConfigEntryResponseMarshalling/proxy-default_entry (0.00s) --- PASS: TestConfigEntryResponseMarshalling/service-default_entry (0.00s) === RUN TestCAConfiguration_GetCommonConfig === RUN TestCAConfiguration_GetCommonConfig/basic_defaults === RUN TestCAConfiguration_GetCommonConfig/basic_defaults_after_encoding_fun --- PASS: TestCAConfiguration_GetCommonConfig (0.00s) --- PASS: TestCAConfiguration_GetCommonConfig/basic_defaults (0.00s) --- PASS: TestCAConfiguration_GetCommonConfig/basic_defaults_after_encoding_fun (0.00s) === RUN TestCAProviderConfig_Validate === RUN TestCAProviderConfig_Validate/defaults === RUN TestCAProviderConfig_Validate/intermediate_cert_ttl_too_short === RUN TestCAProviderConfig_Validate/intermediate_cert_ttl_too_short#01 === RUN TestCAProviderConfig_Validate/good_intermediate_and_leaf_cert_TTL,_missing_key_type === RUN TestCAProviderConfig_Validate/good_intermediate/leaf_cert_TTL/key_type,_missing_bits === RUN TestCAProviderConfig_Validate/good_intermediate/leaf_cert_TTL/key_type/bits --- PASS: TestCAProviderConfig_Validate (0.00s) --- PASS: TestCAProviderConfig_Validate/defaults (0.00s) --- PASS: TestCAProviderConfig_Validate/intermediate_cert_ttl_too_short (0.00s) --- PASS: TestCAProviderConfig_Validate/intermediate_cert_ttl_too_short#01 (0.00s) --- PASS: TestCAProviderConfig_Validate/good_intermediate_and_leaf_cert_TTL,_missing_key_type (0.00s) --- PASS: TestCAProviderConfig_Validate/good_intermediate/leaf_cert_TTL/key_type,_missing_bits (0.00s) --- PASS: TestCAProviderConfig_Validate/good_intermediate/leaf_cert_TTL/key_type/bits (0.00s) === RUN TestConnectProxyConfig_ToAPI === RUN TestConnectProxyConfig_ToAPI/service --- PASS: TestConnectProxyConfig_ToAPI (0.00s) --- PASS: TestConnectProxyConfig_ToAPI/service (0.00s) === RUN TestUpstream_MarshalJSON === RUN TestUpstream_MarshalJSON/service === RUN TestUpstream_MarshalJSON/pq --- PASS: TestUpstream_MarshalJSON (0.00s) --- PASS: TestUpstream_MarshalJSON/service (0.00s) --- PASS: TestUpstream_MarshalJSON/pq (0.00s) === RUN TestUpstream_UnmarshalJSON === RUN TestUpstream_UnmarshalJSON/service === RUN TestUpstream_UnmarshalJSON/pq === RUN TestUpstream_UnmarshalJSON/ingress-hosts-do-not-unmarshal --- PASS: TestUpstream_UnmarshalJSON (0.00s) --- PASS: TestUpstream_UnmarshalJSON/service (0.00s) --- PASS: TestUpstream_UnmarshalJSON/pq (0.00s) --- PASS: TestUpstream_UnmarshalJSON/ingress-hosts-do-not-unmarshal (0.00s) === RUN TestMeshGatewayConfig_OverlayWith === RUN TestMeshGatewayConfig_OverlayWith/_overlaid_with_ === RUN TestMeshGatewayConfig_OverlayWith/_overlaid_with_none === RUN TestMeshGatewayConfig_OverlayWith/_overlaid_with_remote === RUN TestMeshGatewayConfig_OverlayWith/_overlaid_with_local === RUN TestMeshGatewayConfig_OverlayWith/none_overlaid_with_ === RUN TestMeshGatewayConfig_OverlayWith/none_overlaid_with_none === RUN TestMeshGatewayConfig_OverlayWith/none_overlaid_with_remote === RUN TestMeshGatewayConfig_OverlayWith/none_overlaid_with_local === RUN TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_ === RUN TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_none === RUN TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_remote === RUN TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_local === RUN TestMeshGatewayConfig_OverlayWith/local_overlaid_with_ === RUN TestMeshGatewayConfig_OverlayWith/local_overlaid_with_none === RUN TestMeshGatewayConfig_OverlayWith/local_overlaid_with_remote === RUN TestMeshGatewayConfig_OverlayWith/local_overlaid_with_local --- PASS: TestMeshGatewayConfig_OverlayWith (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/_overlaid_with_ (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/_overlaid_with_none (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/_overlaid_with_remote (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/_overlaid_with_local (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/none_overlaid_with_ (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/none_overlaid_with_none (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/none_overlaid_with_remote (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/none_overlaid_with_local (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_ (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_none (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_remote (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/remote_overlaid_with_local (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/local_overlaid_with_ (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/local_overlaid_with_none (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/local_overlaid_with_remote (0.00s) --- PASS: TestMeshGatewayConfig_OverlayWith/local_overlaid_with_local (0.00s) === RUN TestValidateMeshGatewayMode === RUN TestValidateMeshGatewayMode/none_(constant) === RUN TestValidateMeshGatewayMode/none_(explicit) === RUN TestValidateMeshGatewayMode/_(constant) === RUN TestValidateMeshGatewayMode/_(explicit) === RUN TestValidateMeshGatewayMode/local_(constant) === RUN TestValidateMeshGatewayMode/local_(explicit) === RUN TestValidateMeshGatewayMode/remote_(constant) === RUN TestValidateMeshGatewayMode/remote_(explicit) --- PASS: TestValidateMeshGatewayMode (0.00s) --- PASS: TestValidateMeshGatewayMode/none_(constant) (0.00s) --- PASS: TestValidateMeshGatewayMode/none_(explicit) (0.00s) --- PASS: TestValidateMeshGatewayMode/_(constant) (0.00s) --- PASS: TestValidateMeshGatewayMode/_(explicit) (0.00s) --- PASS: TestValidateMeshGatewayMode/local_(constant) (0.00s) --- PASS: TestValidateMeshGatewayMode/local_(explicit) (0.00s) --- PASS: TestValidateMeshGatewayMode/remote_(constant) (0.00s) --- PASS: TestValidateMeshGatewayMode/remote_(explicit) (0.00s) === RUN TestIntention_ACLs === RUN TestIntention_ACLs/deny-write-with-source-write === RUN TestIntention_ACLs/deny-wildcard-write-allow-read === RUN TestIntention_ACLs/allow-wildcard-write === RUN TestIntention_ACLs/allow-wildcard-read === RUN TestIntention_ACLs/all-denied === RUN TestIntention_ACLs/deny-write-read-dest === RUN TestIntention_ACLs/deny-write-read-source === RUN TestIntention_ACLs/allow-write-with-dest-write --- PASS: TestIntention_ACLs (0.00s) --- PASS: TestIntention_ACLs/deny-write-with-source-write (0.00s) --- PASS: TestIntention_ACLs/deny-wildcard-write-allow-read (0.00s) --- PASS: TestIntention_ACLs/allow-wildcard-write (0.00s) --- PASS: TestIntention_ACLs/allow-wildcard-read (0.00s) --- PASS: TestIntention_ACLs/all-denied (0.00s) --- PASS: TestIntention_ACLs/deny-write-read-dest (0.00s) --- PASS: TestIntention_ACLs/deny-write-read-source (0.00s) --- PASS: TestIntention_ACLs/allow-write-with-dest-write (0.00s) === RUN TestIntentionValidate === RUN TestIntentionValidate/long_description === RUN TestIntentionValidate/no_action_set === RUN TestIntentionValidate/no_SourceNS === RUN TestIntentionValidate/no_SourceName === RUN TestIntentionValidate/no_DestinationNS === RUN TestIntentionValidate/no_DestinationName === RUN TestIntentionValidate/SourceNS_partial_wildcard === RUN TestIntentionValidate/SourceName_partial_wildcard === RUN TestIntentionValidate/SourceName_exact_following_wildcard === RUN TestIntentionValidate/DestinationNS_partial_wildcard === RUN TestIntentionValidate/DestinationName_partial_wildcard === RUN TestIntentionValidate/DestinationName_exact_following_wildcard === RUN TestIntentionValidate/SourceType_is_not_set === RUN TestIntentionValidate/SourceType_is_other --- PASS: TestIntentionValidate (0.00s) --- PASS: TestIntentionValidate/long_description (0.00s) --- PASS: TestIntentionValidate/no_action_set (0.00s) --- PASS: TestIntentionValidate/no_SourceNS (0.00s) --- PASS: TestIntentionValidate/no_SourceName (0.00s) --- PASS: TestIntentionValidate/no_DestinationNS (0.00s) --- PASS: TestIntentionValidate/no_DestinationName (0.00s) --- PASS: TestIntentionValidate/SourceNS_partial_wildcard (0.00s) --- PASS: TestIntentionValidate/SourceName_partial_wildcard (0.00s) --- PASS: TestIntentionValidate/SourceName_exact_following_wildcard (0.00s) --- PASS: TestIntentionValidate/DestinationNS_partial_wildcard (0.00s) --- PASS: TestIntentionValidate/DestinationName_partial_wildcard (0.00s) --- PASS: TestIntentionValidate/DestinationName_exact_following_wildcard (0.00s) --- PASS: TestIntentionValidate/SourceType_is_not_set (0.00s) --- PASS: TestIntentionValidate/SourceType_is_other (0.00s) === RUN TestIntentionPrecedenceSorter === RUN TestIntentionPrecedenceSorter/exhaustive_list === RUN TestIntentionPrecedenceSorter/tiebreak_deterministically --- PASS: TestIntentionPrecedenceSorter (0.00s) --- PASS: TestIntentionPrecedenceSorter/exhaustive_list (0.00s) --- PASS: TestIntentionPrecedenceSorter/tiebreak_deterministically (0.00s) === RUN TestStructs_PreparedQuery_GetACLPrefix --- PASS: TestStructs_PreparedQuery_GetACLPrefix (0.00s) === RUN TestAgentStructs_CheckTypes --- PASS: TestAgentStructs_CheckTypes (0.00s) === RUN TestServiceDefinitionValidate === RUN TestServiceDefinitionValidate/valid --- PASS: TestServiceDefinitionValidate (0.00s) --- PASS: TestServiceDefinitionValidate/valid (0.00s) === RUN TestStructs_FilterFieldConfigurations === RUN TestStructs_FilterFieldConfigurations/ServiceNode === RUN TestStructs_FilterFieldConfigurations/HealthCheck === RUN TestStructs_FilterFieldConfigurations/CheckServiceNode === RUN TestStructs_FilterFieldConfigurations/NodeInfo === RUN TestStructs_FilterFieldConfigurations/api.AgentService === RUN TestStructs_FilterFieldConfigurations/Intention === RUN TestStructs_FilterFieldConfigurations/Node === RUN TestStructs_FilterFieldConfigurations/NodeService --- PASS: TestStructs_FilterFieldConfigurations (0.01s) --- PASS: TestStructs_FilterFieldConfigurations/ServiceNode (0.00s) --- PASS: TestStructs_FilterFieldConfigurations/HealthCheck (0.00s) --- PASS: TestStructs_FilterFieldConfigurations/CheckServiceNode (0.00s) --- PASS: TestStructs_FilterFieldConfigurations/NodeInfo (0.00s) --- PASS: TestStructs_FilterFieldConfigurations/api.AgentService (0.01s) --- PASS: TestStructs_FilterFieldConfigurations/Intention (0.00s) --- PASS: TestStructs_FilterFieldConfigurations/Node (0.00s) --- PASS: TestStructs_FilterFieldConfigurations/NodeService (0.00s) === RUN TestEncodeDecode --- PASS: TestEncodeDecode (0.00s) === RUN TestStructs_Implements --- PASS: TestStructs_Implements (0.00s) === RUN TestStructs_RegisterRequest_ChangesNode --- PASS: TestStructs_RegisterRequest_ChangesNode (0.00s) === RUN TestRegisterRequest_UnmarshalJSON_WithConnectNilDoesNotPanic --- PASS: TestRegisterRequest_UnmarshalJSON_WithConnectNilDoesNotPanic (0.00s) === RUN TestNode_IsSame --- PASS: TestNode_IsSame (0.00s) === RUN TestStructs_ServiceNode_IsSameService --- PASS: TestStructs_ServiceNode_IsSameService (0.00s) === RUN TestStructs_ServiceNode_PartialClone --- PASS: TestStructs_ServiceNode_PartialClone (0.00s) === RUN TestStructs_ServiceNode_Conversions --- PASS: TestStructs_ServiceNode_Conversions (0.00s) === RUN TestStructs_NodeService_ValidateMeshGateway === RUN TestStructs_NodeService_ValidateMeshGateway/proxy-local-address === RUN TestStructs_NodeService_ValidateMeshGateway/proxy-local-port === RUN TestStructs_NodeService_ValidateMeshGateway/proxy-upstreams === RUN TestStructs_NodeService_ValidateMeshGateway/valid === RUN TestStructs_NodeService_ValidateMeshGateway/zero-port === RUN TestStructs_NodeService_ValidateMeshGateway/sidecar-service === RUN TestStructs_NodeService_ValidateMeshGateway/proxy-destination-name === RUN TestStructs_NodeService_ValidateMeshGateway/proxy-destination-id --- PASS: TestStructs_NodeService_ValidateMeshGateway (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/proxy-local-address (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/proxy-local-port (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/proxy-upstreams (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/valid (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/zero-port (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/sidecar-service (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/proxy-destination-name (0.00s) --- PASS: TestStructs_NodeService_ValidateMeshGateway/proxy-destination-id (0.00s) === RUN TestStructs_NodeService_ValidateTerminatingGateway === RUN TestStructs_NodeService_ValidateTerminatingGateway/valid === RUN TestStructs_NodeService_ValidateTerminatingGateway/sidecar-service === RUN TestStructs_NodeService_ValidateTerminatingGateway/proxy-destination-name === RUN TestStructs_NodeService_ValidateTerminatingGateway/proxy-destination-id === RUN TestStructs_NodeService_ValidateTerminatingGateway/proxy-local-address === RUN TestStructs_NodeService_ValidateTerminatingGateway/proxy-local-port === RUN TestStructs_NodeService_ValidateTerminatingGateway/proxy-upstreams --- PASS: TestStructs_NodeService_ValidateTerminatingGateway (0.00s) --- PASS: TestStructs_NodeService_ValidateTerminatingGateway/valid (0.00s) --- PASS: TestStructs_NodeService_ValidateTerminatingGateway/sidecar-service (0.00s) --- PASS: TestStructs_NodeService_ValidateTerminatingGateway/proxy-destination-name (0.00s) --- PASS: TestStructs_NodeService_ValidateTerminatingGateway/proxy-destination-id (0.00s) --- PASS: TestStructs_NodeService_ValidateTerminatingGateway/proxy-local-address (0.00s) --- PASS: TestStructs_NodeService_ValidateTerminatingGateway/proxy-local-port (0.00s) --- PASS: TestStructs_NodeService_ValidateTerminatingGateway/proxy-upstreams (0.00s) === RUN TestStructs_NodeService_ValidateIngressGateway === RUN TestStructs_NodeService_ValidateIngressGateway/valid === RUN TestStructs_NodeService_ValidateIngressGateway/sidecar-service === RUN TestStructs_NodeService_ValidateIngressGateway/proxy-destination-name === RUN TestStructs_NodeService_ValidateIngressGateway/proxy-destination-id === RUN TestStructs_NodeService_ValidateIngressGateway/proxy-local-address === RUN TestStructs_NodeService_ValidateIngressGateway/proxy-local-port === RUN TestStructs_NodeService_ValidateIngressGateway/proxy-upstreams --- PASS: TestStructs_NodeService_ValidateIngressGateway (0.00s) --- PASS: TestStructs_NodeService_ValidateIngressGateway/valid (0.00s) --- PASS: TestStructs_NodeService_ValidateIngressGateway/sidecar-service (0.00s) --- PASS: TestStructs_NodeService_ValidateIngressGateway/proxy-destination-name (0.00s) --- PASS: TestStructs_NodeService_ValidateIngressGateway/proxy-destination-id (0.00s) --- PASS: TestStructs_NodeService_ValidateIngressGateway/proxy-local-address (0.00s) --- PASS: TestStructs_NodeService_ValidateIngressGateway/proxy-local-port (0.00s) --- PASS: TestStructs_NodeService_ValidateIngressGateway/proxy-upstreams (0.00s) === RUN TestStructs_NodeService_ValidateExposeConfig === RUN TestStructs_NodeService_ValidateExposeConfig/valid === RUN TestStructs_NodeService_ValidateExposeConfig/empty_path === RUN TestStructs_NodeService_ValidateExposeConfig/invalid_port_negative === RUN TestStructs_NodeService_ValidateExposeConfig/invalid_port_too_large === RUN TestStructs_NodeService_ValidateExposeConfig/duplicate_paths === RUN TestStructs_NodeService_ValidateExposeConfig/duplicate_ports === RUN TestStructs_NodeService_ValidateExposeConfig/protocol_not_supported --- PASS: TestStructs_NodeService_ValidateExposeConfig (0.00s) --- PASS: TestStructs_NodeService_ValidateExposeConfig/valid (0.00s) --- PASS: TestStructs_NodeService_ValidateExposeConfig/empty_path (0.00s) --- PASS: TestStructs_NodeService_ValidateExposeConfig/invalid_port_negative (0.00s) --- PASS: TestStructs_NodeService_ValidateExposeConfig/invalid_port_too_large (0.00s) --- PASS: TestStructs_NodeService_ValidateExposeConfig/duplicate_paths (0.00s) --- PASS: TestStructs_NodeService_ValidateExposeConfig/duplicate_ports (0.00s) --- PASS: TestStructs_NodeService_ValidateExposeConfig/protocol_not_supported (0.00s) === RUN TestStructs_NodeService_ValidateConnectProxy === RUN TestStructs_NodeService_ValidateConnectProxy/valid === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_no_Proxy.DestinationServiceName === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_whitespace_Proxy.DestinationServiceName === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_valid_Proxy.DestinationServiceName === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_no_port_set === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_ConnectNative_set === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_missing_type_(defaulted) === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_invalid_type === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_empty_name === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_empty_bind_port === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_almost-but-not-quite-duplicated_in_various_ways === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_port === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_ip_and_port === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_ip_and_port_with_ip_defaulted_in_one === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_name === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_name_and_datacenter === RUN TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_name_and_namespace --- PASS: TestStructs_NodeService_ValidateConnectProxy (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/valid (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_no_Proxy.DestinationServiceName (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_whitespace_Proxy.DestinationServiceName (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_valid_Proxy.DestinationServiceName (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_no_port_set (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_ConnectNative_set (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_missing_type_(defaulted) (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_invalid_type (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_empty_name (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_upstream_empty_bind_port (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_almost-but-not-quite-duplicated_in_various_ways (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_port (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_ip_and_port (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_ip_and_port_with_ip_defaulted_in_one (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_name (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_name_and_datacenter (0.00s) --- PASS: TestStructs_NodeService_ValidateConnectProxy/connect-proxy:_Upstreams_duplicated_by_name_and_namespace (0.00s) === RUN TestStructs_NodeService_ValidateSidecarService === RUN TestStructs_NodeService_ValidateSidecarService/valid === RUN TestStructs_NodeService_ValidateSidecarService/ID_can't_be_set === RUN TestStructs_NodeService_ValidateSidecarService/Nested_sidecar_can't_be_set --- PASS: TestStructs_NodeService_ValidateSidecarService (0.00s) --- PASS: TestStructs_NodeService_ValidateSidecarService/valid (0.00s) --- PASS: TestStructs_NodeService_ValidateSidecarService/ID_can't_be_set (0.00s) --- PASS: TestStructs_NodeService_ValidateSidecarService/Nested_sidecar_can't_be_set (0.00s) === RUN TestStructs_NodeService_IsSame --- PASS: TestStructs_NodeService_IsSame (0.00s) === RUN TestStructs_HealthCheck_IsSame --- PASS: TestStructs_HealthCheck_IsSame (0.00s) === RUN TestStructs_HealthCheck_Marshalling --- PASS: TestStructs_HealthCheck_Marshalling (0.00s) === RUN TestStructs_HealthCheck_Clone --- PASS: TestStructs_HealthCheck_Clone (0.00s) === RUN TestStructs_CheckServiceNodes_Shuffle --- PASS: TestStructs_CheckServiceNodes_Shuffle (0.00s) === RUN TestStructs_CheckServiceNodes_Filter --- PASS: TestStructs_CheckServiceNodes_Filter (0.00s) === RUN TestStructs_DirEntry_Clone --- PASS: TestStructs_DirEntry_Clone (0.00s) === RUN TestStructs_ValidateServiceAndNodeMetadata === RUN TestStructs_ValidateServiceAndNodeMetadata/should_succeed === RUN TestStructs_ValidateServiceAndNodeMetadata/should_succeed/ValidateNodeMetadata === RUN TestStructs_ValidateServiceAndNodeMetadata/should_succeed/ValidateServiceMetadata_-_typical === RUN TestStructs_ValidateServiceAndNodeMetadata/should_succeed/ValidateServiceMetadata_-_mesh-gateway === RUN TestStructs_ValidateServiceAndNodeMetadata/invalid_key === RUN TestStructs_ValidateServiceAndNodeMetadata/invalid_key/ValidateNodeMetadata === RUN TestStructs_ValidateServiceAndNodeMetadata/invalid_key/ValidateServiceMetadata_-_typical === RUN TestStructs_ValidateServiceAndNodeMetadata/invalid_key/ValidateServiceMetadata_-_mesh-gateway === RUN TestStructs_ValidateServiceAndNodeMetadata/too_many_keys === RUN TestStructs_ValidateServiceAndNodeMetadata/too_many_keys/ValidateNodeMetadata === RUN TestStructs_ValidateServiceAndNodeMetadata/too_many_keys/ValidateServiceMetadata_-_typical === RUN TestStructs_ValidateServiceAndNodeMetadata/too_many_keys/ValidateServiceMetadata_-_mesh-gateway === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied/ValidateNodeMetadata === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied/ValidateServiceMetadata_-_typical === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied/ValidateServiceMetadata_-_mesh-gateway === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed/ValidateNodeMetadata === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed/ValidateServiceMetadata_-_typical === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed/ValidateServiceMetadata_-_mesh-gateway === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation/ValidateNodeMetadata === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation/ValidateServiceMetadata_-_typical === RUN TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation/ValidateServiceMetadata_-_mesh-gateway --- PASS: TestStructs_ValidateServiceAndNodeMetadata (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/should_succeed (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/should_succeed/ValidateNodeMetadata (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/should_succeed/ValidateServiceMetadata_-_typical (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/should_succeed/ValidateServiceMetadata_-_mesh-gateway (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/invalid_key (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/invalid_key/ValidateNodeMetadata (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/invalid_key/ValidateServiceMetadata_-_typical (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/invalid_key/ValidateServiceMetadata_-_mesh-gateway (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/too_many_keys (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/too_many_keys/ValidateNodeMetadata (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/too_many_keys/ValidateServiceMetadata_-_typical (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/too_many_keys/ValidateServiceMetadata_-_mesh-gateway (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied/ValidateNodeMetadata (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied/ValidateServiceMetadata_-_typical (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_denied/ValidateServiceMetadata_-_mesh-gateway (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed/ValidateNodeMetadata (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed/ValidateServiceMetadata_-_typical (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed/ValidateServiceMetadata_-_mesh-gateway (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation/ValidateNodeMetadata (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation/ValidateServiceMetadata_-_typical (0.00s) --- PASS: TestStructs_ValidateServiceAndNodeMetadata/reserved_key_prefix_allowed_via_an_allowlist_just_for_gateway_-_consul-wan-federation/ValidateServiceMetadata_-_mesh-gateway (0.00s) === RUN TestStructs_validateMetaPair --- PASS: TestStructs_validateMetaPair (0.00s) === RUN TestSpecificServiceRequest_CacheInfo === RUN TestSpecificServiceRequest_CacheInfo/basic_params === RUN TestSpecificServiceRequest_CacheInfo/name_should_be_considered === RUN TestSpecificServiceRequest_CacheInfo/node_meta_should_be_considered === RUN TestSpecificServiceRequest_CacheInfo/address_should_be_considered === RUN TestSpecificServiceRequest_CacheInfo/tag_filter_should_be_considered === RUN TestSpecificServiceRequest_CacheInfo/connect_should_be_considered === RUN TestSpecificServiceRequest_CacheInfo/tags_should_be_different === RUN TestSpecificServiceRequest_CacheInfo/tags_should_not_depend_on_order === RUN TestSpecificServiceRequest_CacheInfo/legacy_requests_with_singular_tag_should_be_different --- PASS: TestSpecificServiceRequest_CacheInfo (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/basic_params (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/name_should_be_considered (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/node_meta_should_be_considered (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/address_should_be_considered (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/tag_filter_should_be_considered (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/connect_should_be_considered (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/tags_should_be_different (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/tags_should_not_depend_on_order (0.00s) --- PASS: TestSpecificServiceRequest_CacheInfo/legacy_requests_with_singular_tag_should_be_different (0.00s) === RUN TestNodeService_JSON_OmitTaggedAdddresses === RUN TestNodeService_JSON_OmitTaggedAdddresses/nil === RUN TestNodeService_JSON_OmitTaggedAdddresses/empty --- PASS: TestNodeService_JSON_OmitTaggedAdddresses (0.00s) --- PASS: TestNodeService_JSON_OmitTaggedAdddresses/nil (0.00s) --- PASS: TestNodeService_JSON_OmitTaggedAdddresses/empty (0.00s) === RUN TestServiceNode_JSON_OmitServiceTaggedAdddresses === RUN TestServiceNode_JSON_OmitServiceTaggedAdddresses/nil === RUN TestServiceNode_JSON_OmitServiceTaggedAdddresses/empty --- PASS: TestServiceNode_JSON_OmitServiceTaggedAdddresses (0.00s) --- PASS: TestServiceNode_JSON_OmitServiceTaggedAdddresses/nil (0.00s) --- PASS: TestServiceNode_JSON_OmitServiceTaggedAdddresses/empty (0.00s) === RUN TestNode_BestAddress === RUN TestNode_BestAddress/address === RUN TestNode_BestAddress/wan-address --- PASS: TestNode_BestAddress (0.00s) --- PASS: TestNode_BestAddress/address (0.00s) --- PASS: TestNode_BestAddress/wan-address (0.00s) === RUN TestNodeService_BestAddress === RUN TestNodeService_BestAddress/no-address === RUN TestNodeService_BestAddress/service-address === RUN TestNodeService_BestAddress/service-wan-address === RUN TestNodeService_BestAddress/service-wan-address-default-port === RUN TestNodeService_BestAddress/service-wan-address-node-lan --- PASS: TestNodeService_BestAddress (0.00s) --- PASS: TestNodeService_BestAddress/no-address (0.00s) --- PASS: TestNodeService_BestAddress/service-address (0.00s) --- PASS: TestNodeService_BestAddress/service-wan-address (0.00s) --- PASS: TestNodeService_BestAddress/service-wan-address-default-port (0.00s) --- PASS: TestNodeService_BestAddress/service-wan-address-node-lan (0.00s) === RUN TestCheckServiceNode_BestAddress === RUN TestCheckServiceNode_BestAddress/service-wan-address-default-port === RUN TestCheckServiceNode_BestAddress/service-wan-address-node-lan === RUN TestCheckServiceNode_BestAddress/node-address === RUN TestCheckServiceNode_BestAddress/node-wan-address === RUN TestCheckServiceNode_BestAddress/service-address === RUN TestCheckServiceNode_BestAddress/service-wan-address --- PASS: TestCheckServiceNode_BestAddress (0.00s) --- PASS: TestCheckServiceNode_BestAddress/service-wan-address-default-port (0.00s) --- PASS: TestCheckServiceNode_BestAddress/service-wan-address-node-lan (0.00s) --- PASS: TestCheckServiceNode_BestAddress/node-address (0.00s) --- PASS: TestCheckServiceNode_BestAddress/node-wan-address (0.00s) --- PASS: TestCheckServiceNode_BestAddress/service-address (0.00s) --- PASS: TestCheckServiceNode_BestAddress/service-wan-address (0.00s) === RUN TestNodeService_JSON_Marshal --- PASS: TestNodeService_JSON_Marshal (0.00s) === RUN TestServiceNode_JSON_Marshal --- PASS: TestServiceNode_JSON_Marshal (0.00s) === RUN TestStructs_MsgpackEncodeDecode_Monolith === RUN TestStructs_MsgpackEncodeDecode_Monolith/monster === RUN TestStructs_MsgpackEncodeDecode_Monolith/monster/old_encoder_and_old_decoder === RUN TestStructs_MsgpackEncodeDecode_Monolith/monster/old_encoder_and_new_decoder === RUN TestStructs_MsgpackEncodeDecode_Monolith/monster/new_encoder_and_old_decoder === RUN TestStructs_MsgpackEncodeDecode_Monolith/monster/new_encoder_and_new_decoder === RUN TestStructs_MsgpackEncodeDecode_Monolith/frankenstein === RUN TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/old_encoder_and_old_decoder === RUN TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/old_encoder_and_new_decoder === RUN TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/new_encoder_and_old_decoder === RUN TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/new_encoder_and_new_decoder --- PASS: TestStructs_MsgpackEncodeDecode_Monolith (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/monster (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/monster/old_encoder_and_old_decoder (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/monster/old_encoder_and_new_decoder (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/monster/new_encoder_and_old_decoder (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/monster/new_encoder_and_new_decoder (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/frankenstein (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/old_encoder_and_old_decoder (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/old_encoder_and_new_decoder (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/new_encoder_and_old_decoder (0.00s) --- PASS: TestStructs_MsgpackEncodeDecode_Monolith/frankenstein/new_encoder_and_new_decoder (0.00s) === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/request === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/request/old_encoder_and_old_decoder === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/request/old_encoder_and_new_decoder === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/request/new_encoder_and_old_decoder === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/request/new_encoder_and_new_decoder === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/response === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/response/old_encoder_and_old_decoder === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/response/old_encoder_and_new_decoder === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/response/new_encoder_and_old_decoder === RUN TestSnapshotRequestResponse_MsgpackEncodeDecode/response/new_encoder_and_new_decoder --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/request (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/request/old_encoder_and_old_decoder (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/request/old_encoder_and_new_decoder (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/request/new_encoder_and_old_decoder (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/request/new_encoder_and_new_decoder (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/response (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/response/old_encoder_and_old_decoder (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/response/old_encoder_and_new_decoder (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/response/new_encoder_and_old_decoder (0.00s) --- PASS: TestSnapshotRequestResponse_MsgpackEncodeDecode/response/new_encoder_and_new_decoder (0.00s) === RUN TestGatewayService_IsSame --- PASS: TestGatewayService_IsSame (0.00s) PASS ok github.com/hashicorp/consul/agent/structs 0.094s ? github.com/hashicorp/consul/agent/systemd [no test files] === RUN TestStore_RegularTokens === PAUSE TestStore_RegularTokens === RUN TestStore_AgentMasterToken === PAUSE TestStore_AgentMasterToken === RUN TestStore_Notify === PAUSE TestStore_Notify === CONT TestStore_RegularTokens === RUN TestStore_RegularTokens/set_user_-_config === PAUSE TestStore_RegularTokens/set_user_-_config === RUN TestStore_RegularTokens/set_user_-_api === PAUSE TestStore_RegularTokens/set_user_-_api === RUN TestStore_RegularTokens/set_agent_-_config === PAUSE TestStore_RegularTokens/set_agent_-_config === RUN TestStore_RegularTokens/set_agent_-_api === PAUSE TestStore_RegularTokens/set_agent_-_api === RUN TestStore_RegularTokens/set_user_and_agent === PAUSE TestStore_RegularTokens/set_user_and_agent === RUN TestStore_RegularTokens/set_repl_-_config === PAUSE TestStore_RegularTokens/set_repl_-_config === RUN TestStore_RegularTokens/set_repl_-_api === PAUSE TestStore_RegularTokens/set_repl_-_api === RUN TestStore_RegularTokens/set_master_-_config === PAUSE TestStore_RegularTokens/set_master_-_config === RUN TestStore_RegularTokens/set_master_-_api === PAUSE TestStore_RegularTokens/set_master_-_api === RUN TestStore_RegularTokens/set_all === PAUSE TestStore_RegularTokens/set_all === CONT TestStore_RegularTokens/set_user_-_config === CONT TestStore_Notify --- PASS: TestStore_Notify (0.00s) === CONT TestStore_RegularTokens/set_repl_-_config === CONT TestStore_RegularTokens/set_repl_-_api === CONT TestStore_RegularTokens/set_user_and_agent === CONT TestStore_RegularTokens/set_agent_-_api === CONT TestStore_RegularTokens/set_agent_-_config === CONT TestStore_AgentMasterToken === CONT TestStore_RegularTokens/set_user_-_api --- PASS: TestStore_AgentMasterToken (0.00s) === CONT TestStore_RegularTokens/set_all === CONT TestStore_RegularTokens/set_master_-_api === CONT TestStore_RegularTokens/set_master_-_config --- PASS: TestStore_RegularTokens (0.00s) --- PASS: TestStore_RegularTokens/set_user_-_config (0.00s) --- PASS: TestStore_RegularTokens/set_repl_-_config (0.00s) --- PASS: TestStore_RegularTokens/set_user_and_agent (0.00s) --- PASS: TestStore_RegularTokens/set_agent_-_api (0.00s) --- PASS: TestStore_RegularTokens/set_repl_-_api (0.00s) --- PASS: TestStore_RegularTokens/set_agent_-_config (0.00s) --- PASS: TestStore_RegularTokens/set_user_-_api (0.00s) --- PASS: TestStore_RegularTokens/set_all (0.00s) --- PASS: TestStore_RegularTokens/set_master_-_api (0.00s) --- PASS: TestStore_RegularTokens/set_master_-_config (0.00s) PASS ok github.com/hashicorp/consul/agent/token 0.038s === RUN TestClustersFromSnapshot === RUN TestClustersFromSnapshot/envoy-1.14.5 === RUN TestClustersFromSnapshot/envoy-1.14.5/defaults 2021-10-05T16:29:46.733Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/defaults: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-local-app 2021-10-05T16:29:46.745Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-local-app: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-local-app-typed 2021-10-05T16:29:46.753Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-local-app-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-upstream 2021-10-05T16:29:46.761Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-upstream: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-default-chain 2021-10-05T16:29:46.769Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-default-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-typed 2021-10-05T16:29:46.777Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-ignores-tls 2021-10-05T16:29:46.785Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-ignores-tls: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-timeouts 2021-10-05T16:29:46.810Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-timeouts: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-limits-max-connections-only 2021-10-05T16:29:46.825Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-limits-max-connections-only: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-limits-set-to-zero 2021-10-05T16:29:46.835Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-limits-set-to-zero: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/custom-limits 2021-10-05T16:29:46.846Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/custom-limits: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain 2021-10-05T16:29:46.855Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni 2021-10-05T16:29:46.864Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:46.872Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-failover 2021-10-05T16:29:46.880Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:46.906Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:46.916Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:46.924Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:46.932Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:46.943Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:46.951Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:46.959Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:46.967Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect 2021-10-05T16:29:46.975Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:46.975Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/expose-paths-local-app-paths === RUN TestClustersFromSnapshot/envoy-1.14.5/expose-paths-new-cluster-http2 === RUN TestClustersFromSnapshot/envoy-1.14.5/expose-paths-grpc-new-cluster-http1 === RUN TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway 2021-10-05T16:29:46.998Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-using-federation-states 2021-10-05T16:29:47.006Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-using-federation-states.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-service-subsets 2021-10-05T16:29:47.031Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-service-subsets.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-ignore-extra-resolvers 2021-10-05T16:29:47.053Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-ignore-extra-resolvers.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-service-timeouts 2021-10-05T16:29:47.068Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-service-timeouts.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-gateway 2021-10-05T16:29:47.079Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain 2021-10-05T16:29:47.103Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni 2021-10-05T16:29:47.116Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides 2021-10-05T16:29:47.123Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-failover 2021-10-05T16:29:47.137Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:47.144Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:47.150Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:47.156Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:47.173Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:47.185Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:47.198Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:47.205Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:47.211Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:47.217Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:47.217Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway 2021-10-05T16:29:47.233Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.233Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets 2021-10-05T16:29:47.245Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.245Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db 2021-10-05T16:29:47.245Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache === RUN TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-hostname-service-subsets 2021-10-05T16:29:47.256Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-hostname-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.256Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db 2021-10-05T16:29:47.257Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache === RUN TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-ignore-extra-resolvers 2021-10-05T16:29:47.265Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-ignore-extra-resolvers.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.266Z [WARN] TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-ignore-extra-resolvers.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:47.274Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:47.274Z [DEBUG] TestClustersFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6 === RUN TestClustersFromSnapshot/envoy-1.13.6/defaults 2021-10-05T16:29:47.306Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/defaults: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-local-app 2021-10-05T16:29:47.314Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-local-app: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-local-app-typed 2021-10-05T16:29:47.330Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-local-app-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-upstream 2021-10-05T16:29:47.339Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-upstream: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-default-chain 2021-10-05T16:29:47.352Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-default-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-typed 2021-10-05T16:29:47.358Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-ignores-tls 2021-10-05T16:29:47.363Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-ignores-tls: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-timeouts 2021-10-05T16:29:47.369Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-timeouts: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-limits-max-connections-only 2021-10-05T16:29:47.375Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-limits-max-connections-only: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-limits-set-to-zero 2021-10-05T16:29:47.395Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-limits-set-to-zero: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/custom-limits 2021-10-05T16:29:47.403Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/custom-limits: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain 2021-10-05T16:29:47.409Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni 2021-10-05T16:29:47.420Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:47.455Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-failover 2021-10-05T16:29:47.469Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:47.483Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:47.493Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:47.502Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:47.511Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:47.519Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:47.532Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:47.547Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:47.554Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect 2021-10-05T16:29:47.561Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:47.561Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/expose-paths-local-app-paths === RUN TestClustersFromSnapshot/envoy-1.13.6/expose-paths-new-cluster-http2 === RUN TestClustersFromSnapshot/envoy-1.13.6/expose-paths-grpc-new-cluster-http1 === RUN TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway 2021-10-05T16:29:47.572Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-using-federation-states 2021-10-05T16:29:47.578Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-using-federation-states.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-service-subsets 2021-10-05T16:29:47.589Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-service-subsets.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-ignore-extra-resolvers 2021-10-05T16:29:47.595Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-ignore-extra-resolvers.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-service-timeouts 2021-10-05T16:29:47.621Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-service-timeouts.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-gateway 2021-10-05T16:29:47.630Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain 2021-10-05T16:29:47.654Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni 2021-10-05T16:29:47.675Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides 2021-10-05T16:29:47.683Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-failover 2021-10-05T16:29:47.693Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:47.702Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:47.710Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:47.723Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:47.732Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:47.743Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:47.758Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:47.768Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:47.776Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:47.786Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:47.786Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway 2021-10-05T16:29:47.801Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.801Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets 2021-10-05T16:29:47.818Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.818Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db 2021-10-05T16:29:47.818Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache === RUN TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-hostname-service-subsets 2021-10-05T16:29:47.828Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-hostname-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.828Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db 2021-10-05T16:29:47.829Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache === RUN TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-ignore-extra-resolvers 2021-10-05T16:29:47.849Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-ignore-extra-resolvers.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:47.849Z [WARN] TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-ignore-extra-resolvers.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:47.860Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:47.860Z [DEBUG] TestClustersFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7 === RUN TestClustersFromSnapshot/envoy-1.12.7/defaults 2021-10-05T16:29:47.869Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/defaults: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-local-app 2021-10-05T16:29:47.877Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-local-app: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-local-app-typed 2021-10-05T16:29:47.886Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-local-app-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-upstream 2021-10-05T16:29:47.900Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-upstream: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-default-chain 2021-10-05T16:29:47.909Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-default-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-typed 2021-10-05T16:29:47.921Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-ignores-tls 2021-10-05T16:29:47.929Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-ignores-tls: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-timeouts 2021-10-05T16:29:47.942Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-timeouts: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-limits-max-connections-only 2021-10-05T16:29:47.955Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-limits-max-connections-only: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-limits-set-to-zero 2021-10-05T16:29:47.964Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-limits-set-to-zero: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/custom-limits 2021-10-05T16:29:47.973Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/custom-limits: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain 2021-10-05T16:29:47.983Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni 2021-10-05T16:29:47.991Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:48.000Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-failover 2021-10-05T16:29:48.022Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:48.034Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.041Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:48.060Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.068Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:48.092Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:48.111Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:48.120Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:48.130Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect 2021-10-05T16:29:48.144Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:48.144Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/expose-paths-local-app-paths === RUN TestClustersFromSnapshot/envoy-1.12.7/expose-paths-new-cluster-http2 === RUN TestClustersFromSnapshot/envoy-1.12.7/expose-paths-grpc-new-cluster-http1 === RUN TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway 2021-10-05T16:29:48.160Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-using-federation-states 2021-10-05T16:29:48.171Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-using-federation-states.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-service-subsets 2021-10-05T16:29:48.190Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-service-subsets.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-ignore-extra-resolvers 2021-10-05T16:29:48.200Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-ignore-extra-resolvers.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-service-timeouts 2021-10-05T16:29:48.209Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-service-timeouts.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-gateway 2021-10-05T16:29:48.218Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain 2021-10-05T16:29:48.235Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni 2021-10-05T16:29:48.244Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides 2021-10-05T16:29:48.251Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-failover 2021-10-05T16:29:48.259Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:48.266Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.274Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:48.281Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.289Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:48.299Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:48.308Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:48.316Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:48.326Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:48.336Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:48.336Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway 2021-10-05T16:29:48.356Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:48.356Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets 2021-10-05T16:29:48.395Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache 2021-10-05T16:29:48.404Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:48.404Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-hostname-service-subsets 2021-10-05T16:29:48.427Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-hostname-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:48.428Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db 2021-10-05T16:29:48.431Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache === RUN TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-ignore-extra-resolvers 2021-10-05T16:29:48.441Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-ignore-extra-resolvers.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:48.441Z [WARN] TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-ignore-extra-resolvers.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:48.451Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:48.452Z [DEBUG] TestClustersFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2 === RUN TestClustersFromSnapshot/envoy-1.11.2/defaults 2021-10-05T16:29:48.476Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/defaults: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-local-app 2021-10-05T16:29:48.503Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-local-app: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-local-app-typed 2021-10-05T16:29:48.535Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-local-app-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-upstream 2021-10-05T16:29:48.547Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-upstream: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-default-chain 2021-10-05T16:29:48.566Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-default-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-typed 2021-10-05T16:29:48.581Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-typed: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-ignores-tls 2021-10-05T16:29:48.591Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-ignores-tls: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-timeouts 2021-10-05T16:29:48.597Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-timeouts: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-limits-max-connections-only 2021-10-05T16:29:48.603Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-limits-max-connections-only: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-limits-set-to-zero 2021-10-05T16:29:48.618Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-limits-set-to-zero: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/custom-limits 2021-10-05T16:29:48.625Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/custom-limits: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain 2021-10-05T16:29:48.644Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni 2021-10-05T16:29:48.659Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:48.667Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-failover 2021-10-05T16:29:48.696Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:48.710Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.719Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:48.728Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.736Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:48.753Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:48.766Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:48.784Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:48.798Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect 2021-10-05T16:29:48.807Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:48.807Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/expose-paths-local-app-paths === RUN TestClustersFromSnapshot/envoy-1.11.2/expose-paths-new-cluster-http2 === RUN TestClustersFromSnapshot/envoy-1.11.2/expose-paths-grpc-new-cluster-http1 === RUN TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway 2021-10-05T16:29:48.821Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-using-federation-states 2021-10-05T16:29:48.835Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-using-federation-states.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-service-subsets 2021-10-05T16:29:48.863Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-service-subsets.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-ignore-extra-resolvers 2021-10-05T16:29:48.872Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-ignore-extra-resolvers.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-service-timeouts 2021-10-05T16:29:48.881Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-service-timeouts.mesh_gateway: upstream service does not contain any healthy instances: dc=dc6 service=mesh-gateway === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-gateway 2021-10-05T16:29:48.890Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain 2021-10-05T16:29:48.927Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni 2021-10-05T16:29:48.935Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides 2021-10-05T16:29:48.943Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides: generating cluster for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-failover 2021-10-05T16:29:48.951Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-failover: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:48.960Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.967Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:48.976Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:48.984Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:48.991Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:49.000Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:49.007Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:49.044Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:49.063Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.063Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect: generating cluster for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway 2021-10-05T16:29:49.080Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:49.080Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-no-services === RUN TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets 2021-10-05T16:29:49.101Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db 2021-10-05T16:29:49.102Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache 2021-10-05T16:29:49.102Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api === RUN TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-hostname-service-subsets 2021-10-05T16:29:49.112Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=cache 2021-10-05T16:29:49.112Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-hostname-service-subsets.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:49.112Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-hostname-service-subsets.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-ignore-extra-resolvers 2021-10-05T16:29:49.125Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-ignore-extra-resolvers.terminating_gateway: service contains instances with more than one unique hostname; only "api.altdomain" be resolved by Envoy: dc=dc1 service=api 2021-10-05T16:29:49.126Z [WARN] TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-ignore-extra-resolvers.terminating_gateway: upstream service does not contain any healthy instances: dc=dc1 service=db === RUN TestClustersFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:49.148Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.148Z [DEBUG] TestClustersFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service: generating cluster for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul --- PASS: TestClustersFromSnapshot (2.43s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5 (0.55s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/defaults (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-local-app (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-local-app-typed (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-upstream (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-default-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-typed (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-upstream-ignores-tls (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-timeouts (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-limits-max-connections-only (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-limits-set-to-zero (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/custom-limits (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-failover (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/expose-paths-local-app-paths (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/expose-paths-grpc-new-cluster-http1 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-using-federation-states (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-service-subsets (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-ignore-extra-resolvers (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/mesh-gateway-service-timeouts (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-failover (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-hostname-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/terminating-gateway-ignore-extra-resolvers (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6 (0.56s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/defaults (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-local-app (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-local-app-typed (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-upstream (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-default-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-typed (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-upstream-ignores-tls (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-timeouts (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-limits-max-connections-only (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-limits-set-to-zero (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/custom-limits (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides (0.04s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-failover (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/expose-paths-local-app-paths (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/expose-paths-grpc-new-cluster-http1 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-using-federation-states (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-ignore-extra-resolvers (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/mesh-gateway-service-timeouts (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-gateway (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-failover (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-hostname-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/terminating-gateway-ignore-extra-resolvers (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7 (0.60s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/defaults (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-local-app (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-local-app-typed (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-upstream (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-default-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-typed (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-upstream-ignores-tls (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-timeouts (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-limits-max-connections-only (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-limits-set-to-zero (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/custom-limits (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-failover (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.03s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/expose-paths-local-app-paths (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/expose-paths-grpc-new-cluster-http1 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-using-federation-states (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-ignore-extra-resolvers (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/mesh-gateway-service-timeouts (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-failover (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-no-services (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets (0.03s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-hostname-service-subsets (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/terminating-gateway-ignore-extra-resolvers (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2 (0.69s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/defaults (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-local-app (0.03s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-local-app-typed (0.03s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-upstream (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-default-chain (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-typed (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-upstream-ignores-tls (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-timeouts (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-limits-max-connections-only (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-limits-set-to-zero (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/custom-limits (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-failover (0.03s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/expose-paths-local-app-paths (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/expose-paths-grpc-new-cluster-http1 (0.00s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-using-federation-states (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-ignore-extra-resolvers (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/mesh-gateway-service-timeouts (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-gateway (0.03s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-failover (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect (0.02s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-no-services (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-hostname-service-subsets (0.01s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/terminating-gateway-ignore-extra-resolvers (0.03s) --- PASS: TestClustersFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service (0.02s) === RUN TestParseProxyConfig === RUN TestParseProxyConfig/defaults_-_nil === RUN TestParseProxyConfig/defaults_-_empty === RUN TestParseProxyConfig/defaults_-_other_stuff === RUN TestParseProxyConfig/protocol_override === RUN TestParseProxyConfig/protocol_uppercase_override === RUN TestParseProxyConfig/bind_address_override,_string === RUN TestParseProxyConfig/bind_port_override,_string === RUN TestParseProxyConfig/bind_port_override,_int === RUN TestParseProxyConfig/local_connect_timeout_override,_string === RUN TestParseProxyConfig/local_connect_timeout_override,_float_ === RUN TestParseProxyConfig/local_connect_timeout_override,_int_ --- PASS: TestParseProxyConfig (0.00s) --- PASS: TestParseProxyConfig/defaults_-_nil (0.00s) --- PASS: TestParseProxyConfig/defaults_-_empty (0.00s) --- PASS: TestParseProxyConfig/defaults_-_other_stuff (0.00s) --- PASS: TestParseProxyConfig/protocol_override (0.00s) --- PASS: TestParseProxyConfig/protocol_uppercase_override (0.00s) --- PASS: TestParseProxyConfig/bind_address_override,_string (0.00s) --- PASS: TestParseProxyConfig/bind_port_override,_string (0.00s) --- PASS: TestParseProxyConfig/bind_port_override,_int (0.00s) --- PASS: TestParseProxyConfig/local_connect_timeout_override,_string (0.00s) --- PASS: TestParseProxyConfig/local_connect_timeout_override,_float_ (0.00s) --- PASS: TestParseProxyConfig/local_connect_timeout_override,_int_ (0.00s) === RUN TestParseUpstreamConfig === RUN TestParseUpstreamConfig/defaults_-_nil === RUN TestParseUpstreamConfig/defaults_-_empty === RUN TestParseUpstreamConfig/defaults_-_other_stuff === RUN TestParseUpstreamConfig/protocol_override === RUN TestParseUpstreamConfig/connect_timeout_override,_string === RUN TestParseUpstreamConfig/connect_timeout_override,_float_ === RUN TestParseUpstreamConfig/connect_timeout_override,_int_ === RUN TestParseUpstreamConfig/connect_limits_map === RUN TestParseUpstreamConfig/connect_limits_map_zero === RUN TestParseUpstreamConfig/passive_health_check_map --- PASS: TestParseUpstreamConfig (0.00s) --- PASS: TestParseUpstreamConfig/defaults_-_nil (0.00s) --- PASS: TestParseUpstreamConfig/defaults_-_empty (0.00s) --- PASS: TestParseUpstreamConfig/defaults_-_other_stuff (0.00s) --- PASS: TestParseUpstreamConfig/protocol_override (0.00s) --- PASS: TestParseUpstreamConfig/connect_timeout_override,_string (0.00s) --- PASS: TestParseUpstreamConfig/connect_timeout_override,_float_ (0.00s) --- PASS: TestParseUpstreamConfig/connect_timeout_override,_int_ (0.00s) --- PASS: TestParseUpstreamConfig/connect_limits_map (0.00s) --- PASS: TestParseUpstreamConfig/connect_limits_map_zero (0.00s) --- PASS: TestParseUpstreamConfig/passive_health_check_map (0.00s) === RUN TestParseGatewayConfig === RUN TestParseGatewayConfig/defaults_-_nil === RUN TestParseGatewayConfig/defaults_-_empty === RUN TestParseGatewayConfig/defaults_-_other_stuff === RUN TestParseGatewayConfig/kitchen_sink === RUN TestParseGatewayConfig/deprecated_kitchen_sink === RUN TestParseGatewayConfig/new_fields_override_deprecated_ones --- PASS: TestParseGatewayConfig (0.00s) --- PASS: TestParseGatewayConfig/defaults_-_nil (0.00s) --- PASS: TestParseGatewayConfig/defaults_-_empty (0.00s) --- PASS: TestParseGatewayConfig/defaults_-_other_stuff (0.00s) --- PASS: TestParseGatewayConfig/kitchen_sink (0.00s) --- PASS: TestParseGatewayConfig/deprecated_kitchen_sink (0.00s) --- PASS: TestParseGatewayConfig/new_fields_override_deprecated_ones (0.00s) === RUN Test_makeLoadAssignment === RUN Test_makeLoadAssignment/no_instances === RUN Test_makeLoadAssignment/instances,_no_weights === RUN Test_makeLoadAssignment/instances,_healthy_weights === RUN Test_makeLoadAssignment/instances,_warning_weights --- PASS: Test_makeLoadAssignment (0.00s) --- PASS: Test_makeLoadAssignment/no_instances (0.00s) --- PASS: Test_makeLoadAssignment/instances,_no_weights (0.00s) --- PASS: Test_makeLoadAssignment/instances,_healthy_weights (0.00s) --- PASS: Test_makeLoadAssignment/instances,_warning_weights (0.00s) === RUN Test_endpointsFromSnapshot === RUN Test_endpointsFromSnapshot/envoy-1.14.5 === RUN Test_endpointsFromSnapshot/envoy-1.14.5/defaults 2021-10-05T16:29:49.167Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/defaults: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway === RUN Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-using-federation-states === RUN Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain 2021-10-05T16:29:49.196Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni 2021-10-05T16:29:49.202Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:49.210Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-failover 2021-10-05T16:29:49.225Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:49.232Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.239Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:49.246Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.253Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:49.264Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:49.274Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:49.286Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:49.302Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-default-chain-and-custom-cluster 2021-10-05T16:29:49.312Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-default-chain-and-custom-cluster: generating endpoints for: cluster=myservice === RUN Test_endpointsFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect 2021-10-05T16:29:49.329Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.329Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-gateway 2021-10-05T16:29:49.359Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain 2021-10-05T16:29:49.373Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni 2021-10-05T16:29:49.380Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides 2021-10-05T16:29:49.388Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-and-failover 2021-10-05T16:29:49.395Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:49.402Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.409Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:49.421Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.427Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:49.433Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:49.439Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:49.444Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:49.449Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:49.454Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.454Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway === RUN Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:49.481Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.481Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6 === RUN Test_endpointsFromSnapshot/envoy-1.13.6/defaults 2021-10-05T16:29:49.487Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/defaults: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway === RUN Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-using-federation-states === RUN Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain 2021-10-05T16:29:49.508Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni 2021-10-05T16:29:49.525Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:49.533Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-failover 2021-10-05T16:29:49.539Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:49.544Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.549Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:49.555Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.560Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:49.565Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:49.571Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:49.576Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:49.581Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-default-chain-and-custom-cluster 2021-10-05T16:29:49.587Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-default-chain-and-custom-cluster: generating endpoints for: cluster=myservice === RUN Test_endpointsFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect 2021-10-05T16:29:49.592Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.592Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-gateway 2021-10-05T16:29:49.643Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain 2021-10-05T16:29:49.660Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni 2021-10-05T16:29:49.667Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides 2021-10-05T16:29:49.678Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-and-failover 2021-10-05T16:29:49.687Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:49.695Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.702Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:49.708Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.715Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:49.722Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:49.729Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:49.738Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:49.745Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:49.752Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.752Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway === RUN Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:49.790Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.790Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7 === RUN Test_endpointsFromSnapshot/envoy-1.12.7/defaults 2021-10-05T16:29:49.797Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/defaults: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway === RUN Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-using-federation-states === RUN Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain 2021-10-05T16:29:49.826Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni 2021-10-05T16:29:49.832Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:49.842Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-failover 2021-10-05T16:29:49.849Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:49.856Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.863Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:49.870Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.877Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:49.883Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:49.890Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:49.897Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:49.904Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-default-chain-and-custom-cluster 2021-10-05T16:29:49.911Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-default-chain-and-custom-cluster: generating endpoints for: cluster=myservice === RUN Test_endpointsFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect 2021-10-05T16:29:49.917Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:49.917Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-gateway 2021-10-05T16:29:49.945Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain 2021-10-05T16:29:49.958Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni 2021-10-05T16:29:49.965Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides 2021-10-05T16:29:49.972Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-and-failover 2021-10-05T16:29:49.979Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:49.986Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:49.993Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:50.000Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:50.007Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:50.019Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:50.033Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:50.040Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:50.058Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:50.064Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:50.064Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway === RUN Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:50.113Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:50.113Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2 === RUN Test_endpointsFromSnapshot/envoy-1.11.2/defaults 2021-10-05T16:29:50.119Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/defaults: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway === RUN Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-using-federation-states === RUN Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain 2021-10-05T16:29:50.168Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni 2021-10-05T16:29:50.183Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides 2021-10-05T16:29:50.203Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-failover 2021-10-05T16:29:50.223Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:50.238Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:50.244Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:50.250Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:50.265Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:50.277Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:50.282Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:50.287Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:50.293Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-default-chain-and-custom-cluster 2021-10-05T16:29:50.298Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-default-chain-and-custom-cluster: generating endpoints for: cluster=myservice === RUN Test_endpointsFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect 2021-10-05T16:29:50.304Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:50.304Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-gateway 2021-10-05T16:29:50.336Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain 2021-10-05T16:29:50.347Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni 2021-10-05T16:29:50.352Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides 2021-10-05T16:29:50.357Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides: generating endpoints for: cluster=a236e964~db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-and-failover 2021-10-05T16:29:50.363Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-and-failover: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway 2021-10-05T16:29:50.368Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway-triggered 2021-10-05T16:29:50.373Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway 2021-10-05T16:29:50.379Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered 2021-10-05T16:29:50.384Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway 2021-10-05T16:29:50.389Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway-triggered 2021-10-05T16:29:50.397Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway 2021-10-05T16:29:50.410Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered 2021-10-05T16:29:50.424Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect 2021-10-05T16:29:50.442Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v1.db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:50.442Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect: generating endpoints for: cluster=v2.db.default.dc2.internal.11111111-2222-3333-4444-555555555555.consul === RUN Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway === RUN Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway-no-services === RUN Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets === RUN Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway-default-service-subset === RUN Test_endpointsFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service 2021-10-05T16:29:50.506Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=foo.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:50.506Z [DEBUG] Test_endpointsFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service: generating endpoints for: cluster=bar.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul --- PASS: Test_endpointsFromSnapshot (1.35s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5 (0.32s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/defaults (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-using-federation-states (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-no-services (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-failover (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/connect-proxy-with-default-chain-and-custom-cluster (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-service-subsets (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/mesh-gateway-default-service-subset (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-gateway-no-services (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-chain-and-failover (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway-no-services (0.00s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/terminating-gateway-default-service-subset (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.14.5/ingress-multiple-listeners-duplicate-service (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6 (0.31s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/defaults (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-using-federation-states (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-no-services (0.00s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-failover (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/connect-proxy-with-default-chain-and-custom-cluster (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-service-subsets (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/mesh-gateway-default-service-subset (0.03s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-gateway-no-services (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-chain-and-failover (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway-no-services (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/terminating-gateway-default-service-subset (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.13.6/ingress-multiple-listeners-duplicate-service (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7 (0.32s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/defaults (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-using-federation-states (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-no-services (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-failover (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/connect-proxy-with-default-chain-and-custom-cluster (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-service-subsets (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/mesh-gateway-default-service-subset (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-gateway-no-services (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-chain-and-failover (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway-no-services (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/terminating-gateway-default-service-subset (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.12.7/ingress-multiple-listeners-duplicate-service (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2 (0.39s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/defaults (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-using-federation-states (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-no-services (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-failover (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-double-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/connect-proxy-with-default-chain-and-custom-cluster (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-service-subsets (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/mesh-gateway-default-service-subset (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-gateway-no-services (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-chain-and-failover (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-remote-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway-triggered (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-double-failover-through-local-gateway-triggered (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway-no-services (0.02s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/terminating-gateway-default-service-subset (0.01s) --- PASS: Test_endpointsFromSnapshot/envoy-1.11.2/ingress-multiple-listeners-duplicate-service (0.01s) === RUN TestDetermineEnvoyVersionFromNode === RUN TestDetermineEnvoyVersionFromNode/user_agent_build_version_with_user_agent === RUN TestDetermineEnvoyVersionFromNode/empty === RUN TestDetermineEnvoyVersionFromNode/only_build_version === RUN TestDetermineEnvoyVersionFromNode/user_agent_build_version_but_no_user_agent --- PASS: TestDetermineEnvoyVersionFromNode (0.00s) --- PASS: TestDetermineEnvoyVersionFromNode/user_agent_build_version_with_user_agent (0.00s) --- PASS: TestDetermineEnvoyVersionFromNode/empty (0.00s) --- PASS: TestDetermineEnvoyVersionFromNode/only_build_version (0.00s) --- PASS: TestDetermineEnvoyVersionFromNode/user_agent_build_version_but_no_user_agent (0.00s) === RUN TestFirstHealthyTarget === RUN TestFirstHealthyTarget/all-ok.default.dc1_and_[] === RUN TestFirstHealthyTarget/all-warn.default.dc1_and_[] === RUN TestFirstHealthyTarget/all-fail.default.dc1_and_[] === RUN TestFirstHealthyTarget/all-warn-onlypassing.default.dc1_and_[] === RUN TestFirstHealthyTarget/all-fail-onlypassing.default.dc1_and_[] === RUN TestFirstHealthyTarget/all-ok.default.dc1_and_[all-warn.default.dc1] === RUN TestFirstHealthyTarget/all-warn.default.dc1_and_[all-ok.default.dc1] === RUN TestFirstHealthyTarget/all-warn-onlypassing.default.dc1_and_[all-ok.default.dc1] === RUN TestFirstHealthyTarget/all-fail.default.dc1_and_[all-ok.default.dc1] === RUN TestFirstHealthyTarget/all-fail-onlypassing.default.dc1_and_[all-ok.default.dc1] === RUN TestFirstHealthyTarget/all-fail.default.dc1_and_[all-warn-onlypassing.default.dc1_all-warn.default.dc1_all-ok.default.dc1] --- PASS: TestFirstHealthyTarget (0.00s) --- PASS: TestFirstHealthyTarget/all-ok.default.dc1_and_[] (0.00s) --- PASS: TestFirstHealthyTarget/all-warn.default.dc1_and_[] (0.00s) --- PASS: TestFirstHealthyTarget/all-fail.default.dc1_and_[] (0.00s) --- PASS: TestFirstHealthyTarget/all-warn-onlypassing.default.dc1_and_[] (0.00s) --- PASS: TestFirstHealthyTarget/all-fail-onlypassing.default.dc1_and_[] (0.00s) --- PASS: TestFirstHealthyTarget/all-ok.default.dc1_and_[all-warn.default.dc1] (0.00s) --- PASS: TestFirstHealthyTarget/all-warn.default.dc1_and_[all-ok.default.dc1] (0.00s) --- PASS: TestFirstHealthyTarget/all-warn-onlypassing.default.dc1_and_[all-ok.default.dc1] (0.00s) --- PASS: TestFirstHealthyTarget/all-fail.default.dc1_and_[all-ok.default.dc1] (0.00s) --- PASS: TestFirstHealthyTarget/all-fail-onlypassing.default.dc1_and_[all-ok.default.dc1] (0.00s) --- PASS: TestFirstHealthyTarget/all-fail.default.dc1_and_[all-warn-onlypassing.default.dc1_all-warn.default.dc1_all-ok.default.dc1] (0.00s) === RUN TestListenersFromSnapshot === RUN TestListenersFromSnapshot/envoy-1.14.5 === RUN TestListenersFromSnapshot/envoy-1.14.5/defaults === RUN TestListenersFromSnapshot/envoy-1.14.5/listener-bind-address === RUN TestListenersFromSnapshot/envoy-1.14.5/listener-bind-port === RUN TestListenersFromSnapshot/envoy-1.14.5/listener-bind-address-port === RUN TestListenersFromSnapshot/envoy-1.14.5/http-public-listener === RUN TestListenersFromSnapshot/envoy-1.14.5/http-upstream === RUN TestListenersFromSnapshot/envoy-1.14.5/custom-public-listener === RUN TestListenersFromSnapshot/envoy-1.14.5/custom-public-listener-typed === RUN TestListenersFromSnapshot/envoy-1.14.5/custom-public-listener-ignores-tls === RUN TestListenersFromSnapshot/envoy-1.14.5/custom-upstream === RUN TestListenersFromSnapshot/envoy-1.14.5/custom-upstream-typed === RUN TestListenersFromSnapshot/envoy-1.14.5/custom-upstream-typed-ignored-with-disco-chain 2021-10-05T16:29:50.651Z [WARN] TestListenersFromSnapshot/envoy-1.14.5/custom-upstream-typed-ignored-with-disco-chain: ignoring escape hatch setting because already configured for: discovery chain=db upstream=db config=envoy_listener_json === RUN TestListenersFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-http-chain === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-http2-chain === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-grpc-chain === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.14.5/expose-paths-local-app-paths === RUN TestListenersFromSnapshot/envoy-1.14.5/expose-paths-new-cluster-http2 === RUN TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway === RUN TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-using-federation-states === RUN TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-custom-addresses === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-gateway === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-gateway-bind-addrs === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway === RUN TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-custom-and-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-http-multiple-services === RUN TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-no-api-cert 2021-10-05T16:29:50.978Z [ERROR] TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-no-api-cert.terminating_gateway: no client certificate available for linked service, skipping filter chain creation: service=api error= === RUN TestListenersFromSnapshot/envoy-1.14.5/ingress-with-tls-listener === RUN TestListenersFromSnapshot/envoy-1.13.6 === RUN TestListenersFromSnapshot/envoy-1.13.6/defaults === RUN TestListenersFromSnapshot/envoy-1.13.6/listener-bind-address === RUN TestListenersFromSnapshot/envoy-1.13.6/listener-bind-port === RUN TestListenersFromSnapshot/envoy-1.13.6/listener-bind-address-port === RUN TestListenersFromSnapshot/envoy-1.13.6/http-public-listener === RUN TestListenersFromSnapshot/envoy-1.13.6/http-upstream === RUN TestListenersFromSnapshot/envoy-1.13.6/custom-public-listener === RUN TestListenersFromSnapshot/envoy-1.13.6/custom-public-listener-typed === RUN TestListenersFromSnapshot/envoy-1.13.6/custom-public-listener-ignores-tls === RUN TestListenersFromSnapshot/envoy-1.13.6/custom-upstream === RUN TestListenersFromSnapshot/envoy-1.13.6/custom-upstream-typed === RUN TestListenersFromSnapshot/envoy-1.13.6/custom-upstream-typed-ignored-with-disco-chain 2021-10-05T16:29:51.130Z [WARN] TestListenersFromSnapshot/envoy-1.13.6/custom-upstream-typed-ignored-with-disco-chain: ignoring escape hatch setting because already configured for: discovery chain=db upstream=db config=envoy_listener_json === RUN TestListenersFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-http-chain === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-http2-chain === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-grpc-chain === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.13.6/expose-paths-local-app-paths === RUN TestListenersFromSnapshot/envoy-1.13.6/expose-paths-new-cluster-http2 === RUN TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway === RUN TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-using-federation-states === RUN TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-custom-addresses === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-gateway === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-gateway-bind-addrs === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway === RUN TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-custom-and-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-http-multiple-services === RUN TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-no-api-cert 2021-10-05T16:29:51.454Z [ERROR] TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-no-api-cert.terminating_gateway: no client certificate available for linked service, skipping filter chain creation: service=api error= === RUN TestListenersFromSnapshot/envoy-1.13.6/ingress-with-tls-listener === RUN TestListenersFromSnapshot/envoy-1.12.7 === RUN TestListenersFromSnapshot/envoy-1.12.7/defaults === RUN TestListenersFromSnapshot/envoy-1.12.7/listener-bind-address === RUN TestListenersFromSnapshot/envoy-1.12.7/listener-bind-port === RUN TestListenersFromSnapshot/envoy-1.12.7/listener-bind-address-port === RUN TestListenersFromSnapshot/envoy-1.12.7/http-public-listener === RUN TestListenersFromSnapshot/envoy-1.12.7/http-upstream === RUN TestListenersFromSnapshot/envoy-1.12.7/custom-public-listener === RUN TestListenersFromSnapshot/envoy-1.12.7/custom-public-listener-typed === RUN TestListenersFromSnapshot/envoy-1.12.7/custom-public-listener-ignores-tls === RUN TestListenersFromSnapshot/envoy-1.12.7/custom-upstream === RUN TestListenersFromSnapshot/envoy-1.12.7/custom-upstream-typed === RUN TestListenersFromSnapshot/envoy-1.12.7/custom-upstream-typed-ignored-with-disco-chain 2021-10-05T16:29:51.582Z [WARN] TestListenersFromSnapshot/envoy-1.12.7/custom-upstream-typed-ignored-with-disco-chain: ignoring escape hatch setting because already configured for: discovery chain=db upstream=db config=envoy_listener_json === RUN TestListenersFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-http-chain === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-http2-chain === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-grpc-chain === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.12.7/expose-paths-local-app-paths === RUN TestListenersFromSnapshot/envoy-1.12.7/expose-paths-new-cluster-http2 === RUN TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway === RUN TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-using-federation-states === RUN TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-custom-addresses === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-gateway === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-gateway-bind-addrs === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway === RUN TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-custom-and-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-http-multiple-services === RUN TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-no-api-cert 2021-10-05T16:29:51.952Z [ERROR] TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-no-api-cert.terminating_gateway: no client certificate available for linked service, skipping filter chain creation: service=api error= === RUN TestListenersFromSnapshot/envoy-1.12.7/ingress-with-tls-listener === RUN TestListenersFromSnapshot/envoy-1.11.2 === RUN TestListenersFromSnapshot/envoy-1.11.2/defaults === RUN TestListenersFromSnapshot/envoy-1.11.2/listener-bind-address === RUN TestListenersFromSnapshot/envoy-1.11.2/listener-bind-port === RUN TestListenersFromSnapshot/envoy-1.11.2/listener-bind-address-port === RUN TestListenersFromSnapshot/envoy-1.11.2/http-public-listener === RUN TestListenersFromSnapshot/envoy-1.11.2/http-upstream === RUN TestListenersFromSnapshot/envoy-1.11.2/custom-public-listener === RUN TestListenersFromSnapshot/envoy-1.11.2/custom-public-listener-typed === RUN TestListenersFromSnapshot/envoy-1.11.2/custom-public-listener-ignores-tls === RUN TestListenersFromSnapshot/envoy-1.11.2/custom-upstream === RUN TestListenersFromSnapshot/envoy-1.11.2/custom-upstream-typed === RUN TestListenersFromSnapshot/envoy-1.11.2/custom-upstream-typed-ignored-with-disco-chain 2021-10-05T16:29:52.079Z [WARN] TestListenersFromSnapshot/envoy-1.11.2/custom-upstream-typed-ignored-with-disco-chain: ignoring escape hatch setting because already configured for: discovery chain=db upstream=db config=envoy_listener_json === RUN TestListenersFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-http-chain === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-http2-chain === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-grpc-chain === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.11.2/expose-paths-local-app-paths === RUN TestListenersFromSnapshot/envoy-1.11.2/expose-paths-new-cluster-http2 === RUN TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway === RUN TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-using-federation-states === RUN TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-custom-addresses === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-gateway === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-gateway-bind-addrs === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect === RUN TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway === RUN TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-no-services === RUN TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-custom-and-tagged-addresses === RUN TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-http-multiple-services === RUN TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-no-api-cert 2021-10-05T16:29:52.445Z [ERROR] TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-no-api-cert.terminating_gateway: no client certificate available for linked service, skipping filter chain creation: service=api error= === RUN TestListenersFromSnapshot/envoy-1.11.2/ingress-with-tls-listener --- PASS: TestListenersFromSnapshot (1.95s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5 (0.49s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/defaults (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/listener-bind-address (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/listener-bind-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/listener-bind-address-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/http-public-listener (0.03s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/http-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/custom-public-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/custom-public-listener-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/custom-public-listener-ignores-tls (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/custom-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/custom-upstream-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/custom-upstream-typed-ignored-with-disco-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-http-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-http2-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-grpc-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/expose-paths-local-app-paths (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-using-federation-states (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-tagged-addresses (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/mesh-gateway-custom-addresses (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-gateway-bind-addrs (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-gateway-no-services (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-no-services (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-custom-and-tagged-addresses (0.03s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-service-subsets (0.03s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-http-multiple-services (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/terminating-gateway-no-api-cert (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.14.5/ingress-with-tls-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6 (0.47s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/defaults (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/listener-bind-address (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/listener-bind-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/listener-bind-address-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/http-public-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/http-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/custom-public-listener (0.03s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/custom-public-listener-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/custom-public-listener-ignores-tls (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/custom-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/custom-upstream-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/custom-upstream-typed-ignored-with-disco-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-http-chain (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-http2-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-grpc-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/expose-paths-local-app-paths (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway (0.03s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-using-federation-states (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-tagged-addresses (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/mesh-gateway-custom-addresses (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-gateway-bind-addrs (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-custom-and-tagged-addresses (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-service-subsets (0.03s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-http-multiple-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/terminating-gateway-no-api-cert (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.13.6/ingress-with-tls-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7 (0.51s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/defaults (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/listener-bind-address (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/listener-bind-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/listener-bind-address-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/http-public-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/http-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/custom-public-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/custom-public-listener-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/custom-public-listener-ignores-tls (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/custom-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/custom-upstream-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/custom-upstream-typed-ignored-with-disco-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-http-chain (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-http2-chain (0.03s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-grpc-chain (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/expose-paths-local-app-paths (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-using-federation-states (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-tagged-addresses (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/mesh-gateway-custom-addresses (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-gateway-bind-addrs (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-custom-and-tagged-addresses (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-service-subsets (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-http-multiple-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/terminating-gateway-no-api-cert (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.12.7/ingress-with-tls-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2 (0.49s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/defaults (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/listener-bind-address (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/listener-bind-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/listener-bind-address-port (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/http-public-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/http-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/custom-public-listener (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/custom-public-listener-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/custom-public-listener-ignores-tls (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/custom-upstream (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/custom-upstream-typed (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/custom-upstream-typed-ignored-with-disco-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-http-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-http2-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-grpc-chain (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/connect-proxy-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/expose-paths-local-app-paths (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/expose-paths-new-cluster-http2 (0.00s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-using-federation-states (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-no-services (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-tagged-addresses (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/mesh-gateway-custom-addresses (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-gateway-bind-addrs (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-gateway-no-services (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-remote-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-with-tcp-chain-failover-through-local-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-no-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-custom-and-tagged-addresses (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-service-subsets (0.02s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-http-multiple-services (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/terminating-gateway-no-api-cert (0.01s) --- PASS: TestListenersFromSnapshot/envoy-1.11.2/ingress-with-tls-listener (0.01s) === RUN TestRoutesFromSnapshot === RUN TestRoutesFromSnapshot/envoy-1.14.5 === RUN TestRoutesFromSnapshot/envoy-1.14.5/defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain === RUN TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.14.5/ingress-http-multiple-services === RUN TestRoutesFromSnapshot/envoy-1.13.6 === RUN TestRoutesFromSnapshot/envoy-1.13.6/defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain === RUN TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.13.6/ingress-http-multiple-services === RUN TestRoutesFromSnapshot/envoy-1.12.7 === RUN TestRoutesFromSnapshot/envoy-1.12.7/defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain === RUN TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.12.7/ingress-http-multiple-services === RUN TestRoutesFromSnapshot/envoy-1.11.2 === RUN TestRoutesFromSnapshot/envoy-1.11.2/defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain === RUN TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-defaults-no-chain === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-and-splitter === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-grpc-router === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-and-router === RUN TestRoutesFromSnapshot/envoy-1.11.2/ingress-http-multiple-services --- PASS: TestRoutesFromSnapshot (0.50s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5 (0.13s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/defaults-no-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-external-sni (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-splitter (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-grpc-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/connect-proxy-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-defaults-no-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-external-sni (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-and-overrides (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-and-splitter (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-grpc-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.14.5/ingress-http-multiple-services (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6 (0.10s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/defaults-no-chain (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-external-sni (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-overrides (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-splitter (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-grpc-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/connect-proxy-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-defaults-no-chain (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-external-sni (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-and-overrides (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-and-splitter (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-grpc-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.13.6/ingress-http-multiple-services (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7 (0.14s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/defaults-no-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-external-sni (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-splitter (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-grpc-router (0.02s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/connect-proxy-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-defaults-no-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-external-sni (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-and-overrides (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-and-splitter (0.02s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-grpc-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.12.7/ingress-http-multiple-services (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2 (0.13s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/defaults-no-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-external-sni (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-overrides (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-splitter (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-grpc-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/connect-proxy-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-defaults-no-chain (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-external-sni (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-and-overrides (0.00s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-splitter-with-resolver-redirect (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-and-splitter (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-grpc-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-with-chain-and-router (0.01s) --- PASS: TestRoutesFromSnapshot/envoy-1.11.2/ingress-http-multiple-services (0.01s) === RUN TestServer_StreamAggregatedResources_BasicProtocol 2021-10-05T16:29:52.973Z [DEBUG] TestServer_StreamAggregatedResources_BasicProtocol.envoy: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:52.975Z [DEBUG] TestServer_StreamAggregatedResources_BasicProtocol.envoy: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:53.006Z [DEBUG] TestServer_StreamAggregatedResources_BasicProtocol.envoy: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:53.006Z [DEBUG] TestServer_StreamAggregatedResources_BasicProtocol.envoy: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:53.026Z [DEBUG] TestServer_StreamAggregatedResources_BasicProtocol.envoy: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:53.026Z [DEBUG] TestServer_StreamAggregatedResources_BasicProtocol.envoy: generating endpoints for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul --- PASS: TestServer_StreamAggregatedResources_BasicProtocol (0.08s) === RUN TestServer_StreamAggregatedResources_ACLEnforcement server_test.go:396: DM-skipped --- SKIP: TestServer_StreamAggregatedResources_ACLEnforcement (0.00s) === RUN TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedDuringDiscoveryRequest 2021-10-05T16:29:53.047Z [DEBUG] TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedDuringDiscoveryRequest.envoy: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:53.049Z [DEBUG] TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedDuringDiscoveryRequest.envoy: Error handling ADS stream: error="rpc error: code = Unauthenticated desc = unauthenticated: ACL not found" --- PASS: TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedDuringDiscoveryRequest (0.02s) === RUN TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedInBackground 2021-10-05T16:29:53.066Z [DEBUG] TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedInBackground.envoy: generating cluster for: cluster=db.default.dc1.internal.11111111-2222-3333-4444-555555555555.consul 2021-10-05T16:29:53.175Z [DEBUG] TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedInBackground.envoy: Error handling ADS stream: error="rpc error: code = Unauthenticated desc = unauthenticated: ACL not found" --- PASS: TestServer_StreamAggregatedResources_ACLTokenDeleted_StreamTerminatedInBackground (0.13s) === RUN TestServer_Check === RUN TestServer_Check/auth_allowed 2021-10-05T16:29:53.175Z [DEBUG] TestServer_Check/auth_allowed.envoy: Connect AuthZ ALLOWED: source=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/web destination=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/db reason="default allow" === RUN TestServer_Check/auth_denied 2021-10-05T16:29:53.175Z [DEBUG] TestServer_Check/auth_denied.envoy: Connect AuthZ DENIED: source=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/web destination=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/db reason="default deny" === RUN TestServer_Check/no_source === RUN TestServer_Check/no_dest === RUN TestServer_Check/dest_invalid_format 2021-10-05T16:29:53.176Z [DEBUG] TestServer_Check/dest_invalid_format.envoy: Connect AuthZ DENIED: bad destination URI: source=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/web destination=not-a-spiffe-id === RUN TestServer_Check/dest_not_a_service_URI 2021-10-05T16:29:53.176Z [DEBUG] TestServer_Check/dest_not_a_service_URI.envoy: Connect AuthZ DENIED: bad destination service ID: source=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/web destination=spiffe://trust-domain.consul === RUN TestServer_Check/ACL_not_got_permission_for_authz_call 2021-10-05T16:29:53.176Z [DEBUG] TestServer_Check/ACL_not_got_permission_for_authz_call.envoy: Connect AuthZ failed ACL check: error="Permission denied" source=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/web dest=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/db === RUN TestServer_Check/Random_error_running_authz 2021-10-05T16:29:53.176Z [DEBUG] TestServer_Check/Random_error_running_authz.envoy: Connect AuthZ failed: error="gremlin attack" source=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/web destination=spiffe://11111111-2222-3333-4444-555555555555.consul/ns/default/dc/dc1/svc/db --- PASS: TestServer_Check (0.00s) --- PASS: TestServer_Check/auth_allowed (0.00s) --- PASS: TestServer_Check/auth_denied (0.00s) --- PASS: TestServer_Check/no_source (0.00s) --- PASS: TestServer_Check/no_dest (0.00s) --- PASS: TestServer_Check/dest_invalid_format (0.00s) --- PASS: TestServer_Check/dest_not_a_service_URI (0.00s) --- PASS: TestServer_Check/ACL_not_got_permission_for_authz_call (0.00s) --- PASS: TestServer_Check/Random_error_running_authz (0.00s) === RUN TestServer_StreamAggregatedResources_IngressEmptyResponse --- PASS: TestServer_StreamAggregatedResources_IngressEmptyResponse (0.02s) PASS ok github.com/hashicorp/consul/agent/xds 6.616s ? github.com/hashicorp/consul/agent/xds/proxysupport [no test files] ? github.com/hashicorp/consul/command [no test files] ? github.com/hashicorp/consul/command/acl [no test files] === RUN TestAgentTokensCommand_noTabs === PAUSE TestAgentTokensCommand_noTabs === RUN TestAgentTokensCommand === PAUSE TestAgentTokensCommand === CONT TestAgentTokensCommand_noTabs === CONT TestAgentTokensCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestAgentTokensCommand_noTabs (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:29:49.664Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:49.681Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:49.710 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ab476ec3-311f-2720-b510-ec39faa83891 Address:127.0.0.1:25321}]" 29:49.711 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ab476ec3-311f-2720-b510-ec39faa83891.dc1 127.0.0.1 29:49.712 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ab476ec3-311f-2720-b510-ec39faa83891 127.0.0.1 2021-10-05T16:29:49.712Z [INFO] agent.router: Initializing LAN area manager 29:49.712 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=udp 29:49.712 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:25321 [Follower]" leader= 29:49.713 [INFO] TestAgent.server: Adding LAN server: server="Node-ab476ec3-311f-2720-b510-ec39faa83891 (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 29:49.713 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ab476ec3-311f-2720-b510-ec39faa83891.dc1 area=wan 29:49.713 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=tcp 29:49.713 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:25317 network=tcp 29:49.714 [INFO] TestAgent: started state syncer 29:49.714 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:25322 network=tcp 29:49.763 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:49.782 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:49.782 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:25321 [Candidate]" term=2 29:49.790 [DEBUG] TestAgent.server.raft: votes: needed=1 29:49.790 [DEBUG] TestAgent.server.raft: vote granted: from=ab476ec3-311f-2720-b510-ec39faa83891 term=2 tally=1 29:49.790 [INFO] TestAgent.server.raft: election won: tally=1 29:49.790 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:25321 [Leader]" 29:49.791 [INFO] TestAgent.server: cluster leadership acquired 29:49.791 [INFO] TestAgent.server: New leader elected: payload=Node-ab476ec3-311f-2720-b510-ec39faa83891 29:49.797 [INFO] TestAgent.server: initializing acls 29:49.813 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:49.813 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:49.820 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:49.828 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:49.828 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:49.828 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:49.828 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ab476ec3-311f-2720-b510-ec39faa83891 29:49.828 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ab476ec3-311f-2720-b510-ec39faa83891.dc1 29:49.828 [INFO] TestAgent.server: Updating LAN server: server="Node-ab476ec3-311f-2720-b510-ec39faa83891 (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 29:49.829 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ab476ec3-311f-2720-b510-ec39faa83891.dc1 area=wan 29:49.844 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:49.863 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:49.863 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:49.863 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:49.863 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:49.863 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:49.863 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ab476ec3-311f-2720-b510-ec39faa83891 29:49.863 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ab476ec3-311f-2720-b510-ec39faa83891 29:49.872 [INFO] TestAgent.server: federation state anti-entropy synced 29:49.872 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ab476ec3-311f-2720-b510-ec39faa83891 29:50.046 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:50.056 [INFO] TestAgent: Synced node info 29:50.056 [DEBUG] TestAgent: Node info in sync 29:50.078 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:52692 latency=11.056089ms 29:50.084 [INFO] TestAgent: Updated agent's ACL token: token=default 29:50.084 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/token/default from=127.0.0.1:52694 latency=170.43µs 29:50.085 [INFO] TestAgent: Updated agent's ACL token: token=agent 29:50.085 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/token/agent from=127.0.0.1:52696 latency=80.6µs 29:50.085 [INFO] TestAgent: Updated agent's ACL token: token=agent_master 29:50.085 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/token/agent_master from=127.0.0.1:52698 latency=77.195µs 29:50.087 [INFO] TestAgent: Updated agent's ACL token: token=replication 29:50.087 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/token/replication from=127.0.0.1:52700 latency=64.167µs 29:50.092 [INFO] TestAgent: Requesting shutdown 29:50.092 [INFO] TestAgent.server: shutting down server 29:50.092 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:50.092 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:50.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:50.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:50.092 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:50.092 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:50.092 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:50.092 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:50.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:50.092 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:50.092 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:50.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:50.092 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:50.092 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:50.099 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:50.105Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:50.105Z [INFO] agent.router.manager: shutting down 29:50.105 [INFO] TestAgent: consul server down 29:50.105 [INFO] TestAgent: shutdown complete 29:50.105 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=tcp 29:50.106 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=udp 29:50.106 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:25317 network=tcp 29:50.612 [INFO] TestAgent: Waiting for endpoints to shut down 29:50.612 [INFO] TestAgent: Endpoints down --- PASS: TestAgentTokensCommand (1.00s) PASS ok github.com/hashicorp/consul/command/acl/agenttokens 1.089s ? github.com/hashicorp/consul/command/acl/authmethod [no test files] === RUN TestAuthMethodCreateCommand_noTabs === PAUSE TestAuthMethodCreateCommand_noTabs === RUN TestAuthMethodCreateCommand === PAUSE TestAuthMethodCreateCommand === RUN TestAuthMethodCreateCommand_JSON === PAUSE TestAuthMethodCreateCommand_JSON === RUN TestAuthMethodCreateCommand_k8s === PAUSE TestAuthMethodCreateCommand_k8s === RUN TestAuthMethodCreateCommand_config === PAUSE TestAuthMethodCreateCommand_config === CONT TestAuthMethodCreateCommand_noTabs === CONT TestAuthMethodCreateCommand_config [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestAuthMethodCreateCommand_JSON --- PASS: TestAuthMethodCreateCommand_noTabs (0.00s) === CONT TestAuthMethodCreateCommand === CONT TestAuthMethodCreateCommand_k8s [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestAuthMethodCreateCommand_k8s/k8s_host_required === RUN TestAuthMethodCreateCommand_k8s/k8s_ca_cert_required === RUN TestAuthMethodCreateCommand_k8s/k8s_jwt_required === RUN TestAuthMethodCreateCommand_k8s/create_k8s === RUN TestAuthMethodCreateCommand_k8s/create_k8s_with_cert_file === RUN TestAuthMethodCreateCommand_config/config_file === RUN TestAuthMethodCreateCommand_config/config_std-in === RUN TestAuthMethodCreateCommand_config/config_string === RUN TestAuthMethodCreateCommand/type_required === RUN TestAuthMethodCreateCommand/name_required === RUN TestAuthMethodCreateCommand/invalid_type === RUN TestAuthMethodCreateCommand/create_testing === RUN TestAuthMethodCreateCommand/create_testing_with_max_token_ttl === RUN TestAuthMethodCreateCommand/create_testing_with_token_type_global === RUN TestAuthMethodCreateCommand_JSON/type_required === RUN TestAuthMethodCreateCommand_JSON/create_testing === RUN TestAuthMethodCreateCommand_JSON/create_testing_with_max_token_ttl === RUN TestAuthMethodCreateCommand_JSON/create_testing_with_token_type_global 2021-10-05T16:29:50.978Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:51.016Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:51.120 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ab846f55-0116-5db1-3c8a-7435c41a2c7a Address:127.0.0.1:14111}]" 29:51.121 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a.dc1 127.0.0.1 29:51.121 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a 127.0.0.1 2021-10-05T16:29:51.121Z [INFO] agent.router: Initializing LAN area manager 29:51.122 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14106 network=udp 29:51.122 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14111 [Follower]" leader= 29:51.122 [INFO] TestAgent.server: Adding LAN server: server="Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a (Addr: tcp/127.0.0.1:14111) (DC: dc1)" 29:51.122 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a.dc1 area=wan 29:51.122 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14106 network=tcp 29:51.123 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14107 network=tcp 29:51.123 [INFO] TestAgent: started state syncer 29:51.123 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14112 network=tcp 29:51.160 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:51.160 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14111 [Candidate]" term=2 29:51.173 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:51.188 [DEBUG] TestAgent.server.raft: votes: needed=1 29:51.188 [DEBUG] TestAgent.server.raft: vote granted: from=ab846f55-0116-5db1-3c8a-7435c41a2c7a term=2 tally=1 29:51.189 [INFO] TestAgent.server.raft: election won: tally=1 29:51.189 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14111 [Leader]" 29:51.189 [INFO] TestAgent.server: cluster leadership acquired 29:51.189 [INFO] TestAgent.server: New leader elected: payload=Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a 29:51.202 [INFO] TestAgent.server: initializing acls 29:51.210 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:51.210 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.223 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.249 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.249 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:51.249 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:51.249 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a 29:51.249 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a.dc1 29:51.250 [INFO] TestAgent.server: Updating LAN server: server="Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a (Addr: tcp/127.0.0.1:14111) (DC: dc1)" 29:51.250 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a.dc1 area=wan 29:51.296 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:51.361 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:51.362 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:51.362 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:51.362 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:51.362 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:51.362 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a 29:51.362 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a 29:51.372 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ab846f55-0116-5db1-3c8a-7435c41a2c7a 29:51.387 [INFO] TestAgent.server: federation state anti-entropy synced 29:51.395 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46670 latency=13.068466ms 29:51.405 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-b7bb1b1e-9a3a-8885-71ca-08503e931e62 from=127.0.0.1:46672 latency=7.632881ms 29:51.441 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46674 latency=15.075913ms 29:51.442 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-443245ef-d05e-f18a-d19a-207ea68732e0 from=127.0.0.1:46672 latency=282.133µs 29:51.446 [INFO] TestAgent: Requesting shutdown 29:51.447 [INFO] TestAgent.server: shutting down server 29:51.447 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:51.447 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:51.447 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:51.447 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:51.447 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:51.447 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:51.447 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:51.447 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:51.447 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:51.447 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 29:51.447 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:51.447 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:51.447 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:51.447 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:51.447 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:51.452 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:51.461Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:51.461Z [INFO] agent.router.manager: shutting down 29:51.462 [INFO] TestAgent: consul server down 29:51.462 [INFO] TestAgent: shutdown complete 29:51.462 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14106 network=tcp 29:51.462 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14106 network=udp 29:51.462 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14107 network=tcp 29:51.962 [INFO] TestAgent: Waiting for endpoints to shut down 29:51.962 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodCreateCommand_k8s (1.13s) --- PASS: TestAuthMethodCreateCommand_k8s/k8s_host_required (0.00s) --- PASS: TestAuthMethodCreateCommand_k8s/k8s_ca_cert_required (0.00s) --- PASS: TestAuthMethodCreateCommand_k8s/k8s_jwt_required (0.00s) --- PASS: TestAuthMethodCreateCommand_k8s/create_k8s (0.03s) --- PASS: TestAuthMethodCreateCommand_k8s/create_k8s_with_cert_file (0.04s) 2021-10-05T16:29:50.982Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:51.018Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:51.085 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7227c63f-9b5c-588d-4847-95af215d9f27 Address:127.0.0.1:14090}]" 29:51.092 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7227c63f-9b5c-588d-4847-95af215d9f27.dc1 127.0.0.1 29:51.093 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14090 [Follower]" leader= 29:51.120 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7227c63f-9b5c-588d-4847-95af215d9f27 127.0.0.1 2021-10-05T16:29:51.121Z [INFO] agent.router: Initializing LAN area manager 29:51.121 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=udp 29:51.121 [INFO] TestAgent.server: Adding LAN server: server="Node-7227c63f-9b5c-588d-4847-95af215d9f27 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 29:51.121 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7227c63f-9b5c-588d-4847-95af215d9f27.dc1 area=wan 29:51.121 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=tcp 29:51.122 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14086 network=tcp 29:51.122 [INFO] TestAgent: started state syncer 29:51.122 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14091 network=tcp 29:51.143 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:51.143 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14090 [Candidate]" term=2 29:51.166 [DEBUG] TestAgent.server.raft: votes: needed=1 29:51.166 [DEBUG] TestAgent.server.raft: vote granted: from=7227c63f-9b5c-588d-4847-95af215d9f27 term=2 tally=1 29:51.166 [INFO] TestAgent.server.raft: election won: tally=1 29:51.166 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14090 [Leader]" 29:51.167 [INFO] TestAgent.server: cluster leadership acquired 29:51.167 [INFO] TestAgent.server: New leader elected: payload=Node-7227c63f-9b5c-588d-4847-95af215d9f27 29:51.173 [INFO] TestAgent.server: initializing acls 29:51.186 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:51.186 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.187 [INFO] TestAgent.server: initializing acls 29:51.187 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.221 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.221 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.244 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.244 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:51.244 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:51.244 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 29:51.245 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7227c63f-9b5c-588d-4847-95af215d9f27 29:51.245 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7227c63f-9b5c-588d-4847-95af215d9f27.dc1 29:51.245 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7227c63f-9b5c-588d-4847-95af215d9f27.dc1 area=wan 29:51.245 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.245 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7227c63f-9b5c-588d-4847-95af215d9f27 29:51.245 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7227c63f-9b5c-588d-4847-95af215d9f27.dc1 29:51.246 [INFO] TestAgent.server: Updating LAN server: server="Node-7227c63f-9b5c-588d-4847-95af215d9f27 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 29:51.246 [INFO] TestAgent.server: Updating LAN server: server="Node-7227c63f-9b5c-588d-4847-95af215d9f27 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 29:51.246 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7227c63f-9b5c-588d-4847-95af215d9f27.dc1 area=wan 29:51.266 [INFO] TestAgent: Synced node info 29:51.266 [DEBUG] TestAgent: Node info in sync 29:51.275 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:51.311 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:51.311 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:51.311 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:51.311 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:51.311 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:51.311 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7227c63f-9b5c-588d-4847-95af215d9f27 29:51.311 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7227c63f-9b5c-588d-4847-95af215d9f27 29:51.322 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7227c63f-9b5c-588d-4847-95af215d9f27 29:51.322 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7227c63f-9b5c-588d-4847-95af215d9f27 29:51.335 [INFO] TestAgent.server: federation state anti-entropy synced 29:51.446 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:43054 latency=6.979704ms 29:51.447 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-8558741c-7ef9-ed6d-989b-91edca0b4b96 from=127.0.0.1:43056 latency=285.698µs 29:51.453 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:43058 latency=5.147477ms 29:51.454 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-293fcd9c-3aa6-bbdb-025c-10d2b2476c9f from=127.0.0.1:43056 latency=202.898µs 29:51.466 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:43060 latency=6.159696ms 29:51.473 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-8a4d2705-1f39-d7cf-6317-61d4b8c5d8a1 from=127.0.0.1:43056 latency=265.71µs 29:51.473 [INFO] TestAgent: Requesting shutdown 29:51.473 [INFO] TestAgent.server: shutting down server 29:51.473 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:51.473 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:51.473 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:51.473 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:51.473 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:51.473 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:51.473 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:51.473 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:51.473 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:51.473 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:51.473 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:51.473 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:51.473 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:51.473 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:51.480 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:51.485Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:51.485Z [INFO] agent.router.manager: shutting down 29:51.485 [INFO] TestAgent: consul server down 29:51.485 [INFO] TestAgent: shutdown complete 29:51.485 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=tcp 29:51.485 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=udp 29:51.485 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14086 network=tcp 29:51.985 [INFO] TestAgent: Waiting for endpoints to shut down 29:51.985 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodCreateCommand_config (1.15s) --- PASS: TestAuthMethodCreateCommand_config/config_file (0.01s) --- PASS: TestAuthMethodCreateCommand_config/config_std-in (0.01s) --- PASS: TestAuthMethodCreateCommand_config/config_string (0.02s) 2021-10-05T16:29:50.915Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:50.980Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:51.072 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8f7f871c-7bb7-3035-cc9e-0d741046e684 Address:127.0.0.1:14097}]" 29:51.074 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14097 [Follower]" leader= 29:51.075 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8f7f871c-7bb7-3035-cc9e-0d741046e684.dc1 127.0.0.1 29:51.120 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 127.0.0.1 2021-10-05T16:29:51.120Z [INFO] agent.router: Initializing LAN area manager 29:51.121 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=udp 29:51.121 [INFO] TestAgent.server: Adding LAN server: server="Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 29:51.121 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684.dc1 area=wan 29:51.121 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=tcp 29:51.122 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14093 network=tcp 29:51.122 [INFO] TestAgent: started state syncer 29:51.122 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14098 network=tcp 29:51.134 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:51.134 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14097 [Candidate]" term=2 29:51.155 [DEBUG] TestAgent.server.raft: votes: needed=1 29:51.155 [DEBUG] TestAgent.server.raft: vote granted: from=8f7f871c-7bb7-3035-cc9e-0d741046e684 term=2 tally=1 29:51.155 [INFO] TestAgent.server.raft: election won: tally=1 29:51.155 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14097 [Leader]" 29:51.160 [INFO] TestAgent.server: cluster leadership acquired 29:51.160 [INFO] TestAgent.server: New leader elected: payload=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 29:51.167 [INFO] TestAgent.server: initializing acls 29:51.173 [INFO] TestAgent.server: initializing acls 29:51.190 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:51.190 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:51.190 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.190 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.210 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.224 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.224 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.224 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:51.224 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:51.224 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 29:51.224 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 29:51.224 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8f7f871c-7bb7-3035-cc9e-0d741046e684.dc1 29:51.224 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684.dc1 area=wan 29:51.224 [INFO] TestAgent.server: Updating LAN server: server="Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 29:51.224 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 29:51.225 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8f7f871c-7bb7-3035-cc9e-0d741046e684.dc1 29:51.231 [INFO] TestAgent.server: Updating LAN server: server="Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 29:51.231 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684.dc1 area=wan 29:51.270 [INFO] TestAgent: Synced node info 29:51.270 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:51.270 [DEBUG] TestAgent: Node info in sync 29:51.313 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:51.313 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:51.313 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:51.313 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:51.313 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:51.314 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 29:51.314 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 29:51.323 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 29:51.323 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f7f871c-7bb7-3035-cc9e-0d741046e684 29:51.462 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 29:51.462 [DEBUG] TestAgent: Node info in sync 29:51.525 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/auth-method from=127.0.0.1:58382 error="Invalid Auth Method: Type should be one of: [jwt kubernetes testing]" 29:51.526 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:58382 latency=1.481317ms 29:51.540 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:58384 latency=11.076104ms 29:51.541 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-43604b2a-728f-9313-85a6-39f8bb6f9160 from=127.0.0.1:58386 latency=348.248µs 29:51.554 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:58388 latency=11.59789ms 29:51.555 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-f1465fd4-9a07-b888-c452-20a89cce2154 from=127.0.0.1:58386 latency=193.404µs 29:51.572 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:58390 latency=15.206573ms 29:51.575 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-b4484306-0ffd-3461-e769-4b714dd580e9 from=127.0.0.1:58386 latency=479.683µs 29:51.576 [INFO] TestAgent: Requesting shutdown 29:51.576 [INFO] TestAgent.server: shutting down server 29:51.576 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:51.576 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:51.576 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:51.576 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:51.576 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:51.576 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:51.576 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:51.576 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 29:51.576 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:51.576 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:51.576 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:51.576 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:51.576 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:51.576 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:51.589 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:51.595Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:51.595Z [INFO] agent.router.manager: shutting down 29:51.596 [INFO] TestAgent: consul server down 29:51.596 [INFO] TestAgent: shutdown complete 29:51.596 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=tcp 29:51.596 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=udp 29:51.596 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14093 network=tcp 29:52.099 [INFO] TestAgent: Waiting for endpoints to shut down 29:52.099 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodCreateCommand (1.26s) --- PASS: TestAuthMethodCreateCommand/type_required (0.00s) --- PASS: TestAuthMethodCreateCommand/name_required (0.00s) --- PASS: TestAuthMethodCreateCommand/invalid_type (0.00s) --- PASS: TestAuthMethodCreateCommand/create_testing (0.01s) --- PASS: TestAuthMethodCreateCommand/create_testing_with_max_token_ttl (0.01s) --- PASS: TestAuthMethodCreateCommand/create_testing_with_token_type_global (0.02s) 2021-10-05T16:29:50.982Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:51.013Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:51.064 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5b277b9c-bcba-375b-8c78-c1e550e35769 Address:127.0.0.1:14104}]" 29:51.065 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5b277b9c-bcba-375b-8c78-c1e550e35769.dc1 127.0.0.1 29:51.067 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5b277b9c-bcba-375b-8c78-c1e550e35769 127.0.0.1 2021-10-05T16:29:51.067Z [INFO] agent.router: Initializing LAN area manager 29:51.072 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14099 network=udp 29:51.072 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14104 [Follower]" leader= 29:51.072 [INFO] TestAgent.server: Adding LAN server: server="Node-5b277b9c-bcba-375b-8c78-c1e550e35769 (Addr: tcp/127.0.0.1:14104) (DC: dc1)" 29:51.073 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5b277b9c-bcba-375b-8c78-c1e550e35769.dc1 area=wan 29:51.072 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14099 network=tcp 29:51.093 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14100 network=tcp 29:51.122 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:51.122 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14104 [Candidate]" term=2 29:51.123 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:51.123 [INFO] TestAgent: started state syncer 29:51.123 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14105 network=tcp 29:51.141 [DEBUG] TestAgent.server.raft: votes: needed=1 29:51.141 [DEBUG] TestAgent.server.raft: vote granted: from=5b277b9c-bcba-375b-8c78-c1e550e35769 term=2 tally=1 29:51.141 [INFO] TestAgent.server.raft: election won: tally=1 29:51.141 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14104 [Leader]" 29:51.141 [INFO] TestAgent.server: cluster leadership acquired 29:51.141 [INFO] TestAgent.server: New leader elected: payload=Node-5b277b9c-bcba-375b-8c78-c1e550e35769 29:51.157 [INFO] TestAgent.server: initializing acls 29:51.163 [INFO] TestAgent.server: Created ACL 'global-management' policy 29:51.163 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 29:51.173 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 29:51.181 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 29:51.201 [INFO] TestAgent.server: Created ACL anonymous token from configuration 29:51.201 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 29:51.201 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 29:51.201 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5b277b9c-bcba-375b-8c78-c1e550e35769 29:51.202 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5b277b9c-bcba-375b-8c78-c1e550e35769.dc1 29:51.202 [INFO] TestAgent.server: Updating LAN server: server="Node-5b277b9c-bcba-375b-8c78-c1e550e35769 (Addr: tcp/127.0.0.1:14104) (DC: dc1)" 29:51.202 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5b277b9c-bcba-375b-8c78-c1e550e35769.dc1 area=wan 29:51.224 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 29:51.290 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 29:51.290 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 29:51.290 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 29:51.290 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 29:51.290 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 29:51.290 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5b277b9c-bcba-375b-8c78-c1e550e35769 29:51.291 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5b277b9c-bcba-375b-8c78-c1e550e35769 29:51.314 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5b277b9c-bcba-375b-8c78-c1e550e35769 29:51.336 [INFO] TestAgent.server: federation state anti-entropy synced 29:51.577 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:38130 latency=15.758621ms 29:51.579 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-d7fc6165-168a-368b-bc49-3b369981081d from=127.0.0.1:38132 latency=327.74µs 29:51.590 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:38134 latency=6.943242ms 29:51.592 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-7bc38728-7b88-8f51-8030-f3a3048d7240 from=127.0.0.1:38132 latency=429.634µs 29:51.598 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:38136 latency=4.762684ms 29:51.599 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-5cbcf4da-597d-6126-78c0-b15196308128 from=127.0.0.1:38132 latency=201.465µs 29:51.599 [INFO] TestAgent: Requesting shutdown 29:51.599 [INFO] TestAgent.server: shutting down server 29:51.599 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 29:51.599 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 29:51.599 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 29:51.599 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 29:51.599 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 29:51.599 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 29:51.599 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 29:51.600 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 29:51.600 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 29:51.600 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 29:51.600 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 29:51.600 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 29:51.600 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 29:51.600 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 29:51.604 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:29:51.612Z [INFO] agent.router.manager: shutting down 2021-10-05T16:29:51.612Z [INFO] agent.router.manager: shutting down 29:51.612 [INFO] TestAgent: consul server down 29:51.612 [INFO] TestAgent: shutdown complete 29:51.612 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14099 network=tcp 29:51.612 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14099 network=udp 29:51.612 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14100 network=tcp 29:52.116 [INFO] TestAgent: Waiting for endpoints to shut down 29:52.116 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodCreateCommand_JSON (1.28s) --- PASS: TestAuthMethodCreateCommand_JSON/type_required (0.00s) --- PASS: TestAuthMethodCreateCommand_JSON/create_testing (0.02s) --- PASS: TestAuthMethodCreateCommand_JSON/create_testing_with_max_token_ttl (0.01s) --- PASS: TestAuthMethodCreateCommand_JSON/create_testing_with_token_type_global (0.01s) PASS ok github.com/hashicorp/consul/command/acl/authmethod/create 1.384s === RUN TestAuthMethodDeleteCommand_noTabs === PAUSE TestAuthMethodDeleteCommand_noTabs === RUN TestAuthMethodDeleteCommand === PAUSE TestAuthMethodDeleteCommand === CONT TestAuthMethodDeleteCommand_noTabs --- PASS: TestAuthMethodDeleteCommand_noTabs (0.00s) === CONT TestAuthMethodDeleteCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestAuthMethodDeleteCommand/name_required === RUN TestAuthMethodDeleteCommand/delete_notfound === RUN TestAuthMethodDeleteCommand/delete_works 2021-10-05T16:29:59.820Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:29:59.832Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 29:59.882 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0b0e15c3-d049-9051-2bcb-5c90be815f1e Address:127.0.0.1:18174}]" 29:59.886 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e.dc1 127.0.0.1 29:59.887 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 127.0.0.1 2021-10-05T16:29:59.887Z [INFO] agent.router: Initializing LAN area manager 29:59.888 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:18174 [Follower]" leader= 29:59.890 [INFO] TestAgent.server: Adding LAN server: server="Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e (Addr: tcp/127.0.0.1:18174) (DC: dc1)" 29:59.890 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18169 network=udp 29:59.891 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e.dc1 area=wan 29:59.893 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18169 network=tcp 29:59.893 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:18170 network=tcp 29:59.893 [INFO] TestAgent: started state syncer 29:59.894 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:18175 network=tcp 29:59.942 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 29:59.956 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 29:59.956 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:18174 [Candidate]" term=2 29:59.997 [DEBUG] TestAgent.server.raft: votes: needed=1 29:59.997 [DEBUG] TestAgent.server.raft: vote granted: from=0b0e15c3-d049-9051-2bcb-5c90be815f1e term=2 tally=1 29:59.997 [INFO] TestAgent.server.raft: election won: tally=1 29:59.997 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:18174 [Leader]" 30:00.000 [INFO] TestAgent.server: cluster leadership acquired 30:00.000 [INFO] TestAgent.server: New leader elected: payload=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 30:00.018 [INFO] TestAgent.server: initializing acls 30:00.022 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:00.022 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:00.034 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:00.043 [INFO] TestAgent.server: initializing acls 30:00.043 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:00.046 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:00.046 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:00.046 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:00.046 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:00.047 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 30:00.047 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e.dc1 30:00.047 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e.dc1 area=wan 30:00.047 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:00.047 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 30:00.047 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e.dc1 30:00.047 [INFO] TestAgent.server: Updating LAN server: server="Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e (Addr: tcp/127.0.0.1:18174) (DC: dc1)" 30:00.047 [INFO] TestAgent.server: Updating LAN server: server="Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e (Addr: tcp/127.0.0.1:18174) (DC: dc1)" 30:00.047 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e.dc1 area=wan 30:00.056 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:00.076 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:00.076 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:00.076 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:00.076 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:00.076 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:00.076 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 30:00.076 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 30:00.079 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 30:00.079 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0b0e15c3-d049-9051-2bcb-5c90be815f1e 30:00.085 [INFO] TestAgent.server: federation state anti-entropy synced 30:00.098 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/auth-method/notfound from=127.0.0.1:51538 latency=867.775µs 30:00.108 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:51540 latency=9.379965ms 30:00.144 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/auth-method/test-df28dc21-d617-b9da-7f59-ca8833f018ef from=127.0.0.1:51542 latency=26.779753ms 30:00.148 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-df28dc21-d617-b9da-7f59-ca8833f018ef from=127.0.0.1:51540 latency=113.526µs 30:00.148 [INFO] TestAgent: Requesting shutdown 30:00.148 [INFO] TestAgent.server: shutting down server 30:00.148 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:00.148 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:00.148 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:00.148 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:00.148 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:00.149 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:00.149 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:00.149 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:00.149 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:00.149 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:00.149 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:00.149 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:00.149 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:00.149 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:00.149 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:00.160 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:00.164Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:00.164Z [INFO] agent.router.manager: shutting down 30:00.164 [INFO] TestAgent: consul server down 30:00.164 [INFO] TestAgent: shutdown complete 30:00.164 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18169 network=tcp 30:00.164 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18169 network=udp 30:00.164 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:18170 network=tcp 30:00.668 [INFO] TestAgent: Waiting for endpoints to shut down 30:00.668 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodDeleteCommand (0.97s) --- PASS: TestAuthMethodDeleteCommand/name_required (0.00s) --- PASS: TestAuthMethodDeleteCommand/delete_notfound (0.00s) --- PASS: TestAuthMethodDeleteCommand/delete_works (0.05s) PASS ok github.com/hashicorp/consul/command/acl/authmethod/delete 1.120s === RUN TestAuthMethodListCommand_noTabs === PAUSE TestAuthMethodListCommand_noTabs === RUN TestAuthMethodListCommand === PAUSE TestAuthMethodListCommand === RUN TestAuthMethodListCommand_JSON === PAUSE TestAuthMethodListCommand_JSON === CONT TestAuthMethodListCommand_noTabs --- PASS: TestAuthMethodListCommand_noTabs (0.00s) === CONT TestAuthMethodListCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestAuthMethodListCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestAuthMethodListCommand/found_none === RUN TestAuthMethodListCommand_JSON/found_some === RUN TestAuthMethodListCommand/found_some 2021-10-05T16:30:00.824Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:00.863Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:00.914 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5e6bce4a-e560-b6ee-7776-ee43e43636b9 Address:127.0.0.1:11027}]" 30:00.915 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9.dc1 127.0.0.1 30:00.915 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 127.0.0.1 2021-10-05T16:30:00.915Z [INFO] agent.router: Initializing LAN area manager 30:00.916 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11022 network=udp 30:00.916 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11027 [Follower]" leader= 30:00.916 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11022 network=tcp 30:00.916 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9.dc1 area=wan 30:00.916 [INFO] TestAgent.server: Adding LAN server: server="Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 (Addr: tcp/127.0.0.1:11027) (DC: dc1)" 30:00.917 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11023 network=tcp 30:00.917 [INFO] TestAgent: started state syncer 30:00.917 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11028 network=tcp 30:00.968 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:00.980 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:00.980 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11027 [Candidate]" term=2 30:00.999 [DEBUG] TestAgent.server.raft: votes: needed=1 30:00.999 [DEBUG] TestAgent.server.raft: vote granted: from=5e6bce4a-e560-b6ee-7776-ee43e43636b9 term=2 tally=1 30:00.999 [INFO] TestAgent.server.raft: election won: tally=1 30:00.999 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11027 [Leader]" 30:00.999 [INFO] TestAgent.server: cluster leadership acquired 30:00.999 [INFO] TestAgent.server: New leader elected: payload=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 30:01.029 [INFO] TestAgent.server: initializing acls 30:01.040 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:01.040 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:01.054 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:01.069 [INFO] TestAgent.server: initializing acls 30:01.069 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:01.081 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:01.081 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:01.081 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:01.081 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:01.081 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 30:01.081 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9.dc1 30:01.081 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9.dc1 area=wan 30:01.081 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:01.081 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 30:01.082 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9.dc1 30:01.084 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9.dc1 area=wan 30:01.084 [INFO] TestAgent.server: Updating LAN server: server="Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 (Addr: tcp/127.0.0.1:11027) (DC: dc1)" 30:01.084 [INFO] TestAgent.server: Updating LAN server: server="Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 (Addr: tcp/127.0.0.1:11027) (DC: dc1)" 30:01.109 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:01.118 [INFO] TestAgent: Synced node info 30:01.118 [DEBUG] TestAgent: Node info in sync 30:01.131 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:01.131 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:01.131 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:01.131 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:01.131 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:01.132 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 30:01.132 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 30:01.169 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 30:01.169 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5e6bce4a-e560-b6ee-7776-ee43e43636b9 30:01.181 [INFO] TestAgent.server: federation state anti-entropy synced 30:01.223 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59632 latency=18.877551ms 30:01.240 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59632 latency=12.500389ms 30:01.264 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59632 latency=14.175026ms 30:01.285 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59632 latency=16.277298ms 30:01.308 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59632 latency=22.755059ms 30:01.315 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-methods from=127.0.0.1:59638 latency=319.212µs 30:01.315 [INFO] TestAgent: Requesting shutdown 30:01.316 [INFO] TestAgent.server: shutting down server 30:01.316 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:01.316 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:01.316 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:01.316 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:01.316 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:01.316 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:01.320 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:01.320 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:01.320 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:01.320 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:01.320 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:01.320 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:01.320 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:01.320 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:01.324 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:01.336Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:01.336Z [INFO] agent.router.manager: shutting down 30:01.340 [INFO] TestAgent: consul server down 30:01.340 [INFO] TestAgent: shutdown complete 30:01.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11022 network=tcp 30:01.340 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11022 network=udp 30:01.340 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11023 network=tcp 30:01.844 [INFO] TestAgent: Waiting for endpoints to shut down 30:01.844 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodListCommand_JSON (1.15s) --- PASS: TestAuthMethodListCommand_JSON/found_some (0.00s) 2021-10-05T16:30:00.814Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:00.870Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:00.944 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 Address:127.0.0.1:11034}]" 30:00.945 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3.dc1 127.0.0.1 30:00.945 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 127.0.0.1 2021-10-05T16:30:00.945Z [INFO] agent.router: Initializing LAN area manager 30:00.946 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11029 network=udp 30:00.946 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11034 [Follower]" leader= 30:00.946 [INFO] TestAgent.server: Adding LAN server: server="Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 (Addr: tcp/127.0.0.1:11034) (DC: dc1)" 30:00.946 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3.dc1 area=wan 30:00.946 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11029 network=tcp 30:00.947 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11030 network=tcp 30:00.947 [INFO] TestAgent: started state syncer 30:00.947 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11035 network=tcp 30:00.997 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:01.015 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:01.015 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11034 [Candidate]" term=2 30:01.052 [DEBUG] TestAgent.server.raft: votes: needed=1 30:01.052 [DEBUG] TestAgent.server.raft: vote granted: from=b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 term=2 tally=1 30:01.052 [INFO] TestAgent.server.raft: election won: tally=1 30:01.052 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11034 [Leader]" 30:01.052 [INFO] TestAgent.server: cluster leadership acquired 30:01.052 [INFO] TestAgent.server: New leader elected: payload=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 30:01.072 [INFO] TestAgent.server: initializing acls 30:01.100 [INFO] TestAgent.server: initializing acls 30:01.101 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:01.101 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:01.122 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:01.123 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:01.123 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:01.144 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:01.144 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:01.144 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:01.144 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:01.144 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 30:01.144 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3.dc1 30:01.145 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3.dc1 area=wan 30:01.145 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:01.145 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 30:01.145 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3.dc1 30:01.148 [INFO] TestAgent.server: Updating LAN server: server="Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 (Addr: tcp/127.0.0.1:11034) (DC: dc1)" 30:01.148 [INFO] TestAgent.server: Updating LAN server: server="Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 (Addr: tcp/127.0.0.1:11034) (DC: dc1)" 30:01.148 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3.dc1 area=wan 30:01.200 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:01.248 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:01.248 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:01.248 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:01.248 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:01.248 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:01.248 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 30:01.248 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 30:01.269 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 30:01.269 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b8296bc8-b245-fbcd-d7fc-db5ba32ad9b3 30:01.292 [INFO] TestAgent.server: federation state anti-entropy synced 30:01.293 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-methods from=127.0.0.1:46514 latency=7.326343ms 30:01.297 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:01.312 [INFO] TestAgent: Synced node info 30:01.321 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46516 latency=24.222138ms 30:01.328 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46516 latency=5.939929ms 30:01.343 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46516 latency=14.467444ms 30:01.353 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46516 latency=9.733248ms 30:01.366 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46516 latency=9.536534ms 30:01.373 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-methods from=127.0.0.1:46520 latency=342.213µs 30:01.373 [INFO] TestAgent: Requesting shutdown 30:01.373 [INFO] TestAgent.server: shutting down server 30:01.373 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:01.373 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:01.373 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:01.373 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:01.373 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:01.373 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:01.373 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:01.373 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:01.374 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:01.374 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:01.374 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:01.374 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:01.374 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:01.374 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:01.383 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:01.389Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:01.389Z [INFO] agent.router.manager: shutting down 30:01.389 [INFO] TestAgent: consul server down 30:01.389 [INFO] TestAgent: shutdown complete 30:01.389 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11029 network=tcp 30:01.389 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11029 network=udp 30:01.389 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11030 network=tcp 30:01.892 [INFO] TestAgent: Waiting for endpoints to shut down 30:01.892 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodListCommand (1.19s) --- PASS: TestAuthMethodListCommand/found_none (0.01s) --- PASS: TestAuthMethodListCommand/found_some (0.01s) PASS ok github.com/hashicorp/consul/command/acl/authmethod/list 1.318s === RUN TestAuthMethodReadCommand_noTabs === PAUSE TestAuthMethodReadCommand_noTabs === RUN TestAuthMethodReadCommand === PAUSE TestAuthMethodReadCommand === RUN TestAuthMethodReadCommand_JSON === PAUSE TestAuthMethodReadCommand_JSON === CONT TestAuthMethodReadCommand_noTabs --- PASS: TestAuthMethodReadCommand_noTabs (0.00s) === CONT TestAuthMethodReadCommand_JSON === CONT TestAuthMethodReadCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestAuthMethodReadCommand_JSON/read_by_name === RUN TestAuthMethodReadCommand/name_required === RUN TestAuthMethodReadCommand/not_found === RUN TestAuthMethodReadCommand/read_by_name 2021-10-05T16:30:02.691Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:02.727Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:02.779 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:237a9d16-7963-ce7d-1e66-00bf3c86f639 Address:127.0.0.1:14090}]" 30:02.779 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14090 [Follower]" leader= 30:02.780 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-237a9d16-7963-ce7d-1e66-00bf3c86f639.dc1 127.0.0.1 30:02.781 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 127.0.0.1 2021-10-05T16:30:02.781Z [INFO] agent.router: Initializing LAN area manager 30:02.781 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=udp 30:02.781 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-237a9d16-7963-ce7d-1e66-00bf3c86f639.dc1 area=wan 30:02.781 [INFO] TestAgent.server: Adding LAN server: server="Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 30:02.782 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=tcp 30:02.782 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14086 network=tcp 30:02.782 [INFO] TestAgent: started state syncer 30:02.782 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14091 network=tcp 30:02.825 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:02.825 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14090 [Candidate]" term=2 30:02.832 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:02.836 [DEBUG] TestAgent.server.raft: votes: needed=1 30:02.836 [DEBUG] TestAgent.server.raft: vote granted: from=237a9d16-7963-ce7d-1e66-00bf3c86f639 term=2 tally=1 30:02.836 [INFO] TestAgent.server.raft: election won: tally=1 30:02.836 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14090 [Leader]" 30:02.836 [INFO] TestAgent.server: cluster leadership acquired 30:02.836 [INFO] TestAgent.server: New leader elected: payload=Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 30:02.856 [INFO] TestAgent.server: initializing acls 30:02.872 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:02.872 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:02.892 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:02.920 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:02.920 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:02.921 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:02.922 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 30:02.922 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-237a9d16-7963-ce7d-1e66-00bf3c86f639.dc1 30:02.924 [INFO] TestAgent.server: Updating LAN server: server="Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 30:02.924 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-237a9d16-7963-ce7d-1e66-00bf3c86f639.dc1 area=wan 30:02.952 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:02.952 [INFO] TestAgent: Synced node info 30:03.014 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:03.014 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:03.014 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:03.014 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:03.014 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:03.014 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 30:03.014 [INFO] TestAgent.server: member joined, marking health alive: member=Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 30:03.023 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-237a9d16-7963-ce7d-1e66-00bf3c86f639 30:03.032 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.039 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:43158 latency=14.506221ms 30:03.042 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-3730235f-6b62-8f3e-9a7e-a1057c29d1ac from=127.0.0.1:43164 latency=330.656µs 30:03.048 [INFO] TestAgent: Requesting shutdown 30:03.048 [INFO] TestAgent.server: shutting down server 30:03.048 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:03.048 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.048 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.048 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.048 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.048 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:03.048 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.048 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.048 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.048 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:03.048 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.048 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.048 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.048 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:03.060 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.066Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.066Z [INFO] agent.router.manager: shutting down 30:03.066 [INFO] TestAgent: consul server down 30:03.066 [INFO] TestAgent: shutdown complete 30:03.066 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=tcp 30:03.066 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=udp 30:03.066 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14086 network=tcp 30:03.567 [INFO] TestAgent: Waiting for endpoints to shut down 30:03.567 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodReadCommand_JSON (1.00s) --- PASS: TestAuthMethodReadCommand_JSON/read_by_name (0.06s) 2021-10-05T16:30:02.692Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:02.721Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:02.788 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:44beda08-5e41-42c5-b67a-9276aa6e5512 Address:127.0.0.1:14097}]" 30:02.788 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-44beda08-5e41-42c5-b67a-9276aa6e5512.dc1 127.0.0.1 30:02.789 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-44beda08-5e41-42c5-b67a-9276aa6e5512 127.0.0.1 2021-10-05T16:30:02.789Z [INFO] agent.router: Initializing LAN area manager 30:02.789 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=udp 30:02.789 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14097 [Follower]" leader= 30:02.789 [INFO] TestAgent.server: Adding LAN server: server="Node-44beda08-5e41-42c5-b67a-9276aa6e5512 (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 30:02.790 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-44beda08-5e41-42c5-b67a-9276aa6e5512.dc1 area=wan 30:02.790 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=tcp 30:02.790 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14093 network=tcp 30:02.790 [INFO] TestAgent: started state syncer 30:02.790 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14098 network=tcp 30:02.840 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:02.844 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:02.844 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14097 [Candidate]" term=2 30:02.883 [DEBUG] TestAgent.server.raft: votes: needed=1 30:02.883 [DEBUG] TestAgent.server.raft: vote granted: from=44beda08-5e41-42c5-b67a-9276aa6e5512 term=2 tally=1 30:02.883 [INFO] TestAgent.server.raft: election won: tally=1 30:02.883 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14097 [Leader]" 30:02.885 [INFO] TestAgent.server: cluster leadership acquired 30:02.886 [INFO] TestAgent.server: New leader elected: payload=Node-44beda08-5e41-42c5-b67a-9276aa6e5512 30:02.891 [INFO] TestAgent.server: initializing acls 30:02.896 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:02.896 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:02.903 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:02.912 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:02.912 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:02.912 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:02.913 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-44beda08-5e41-42c5-b67a-9276aa6e5512 30:02.913 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-44beda08-5e41-42c5-b67a-9276aa6e5512.dc1 30:02.919 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-44beda08-5e41-42c5-b67a-9276aa6e5512.dc1 area=wan 30:02.919 [INFO] TestAgent.server: Updating LAN server: server="Node-44beda08-5e41-42c5-b67a-9276aa6e5512 (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 30:02.935 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:02.986 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:02.986 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:02.986 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:02.986 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:02.986 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:02.986 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-44beda08-5e41-42c5-b67a-9276aa6e5512 30:02.986 [INFO] TestAgent.server: member joined, marking health alive: member=Node-44beda08-5e41-42c5-b67a-9276aa6e5512 30:02.997 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-44beda08-5e41-42c5-b67a-9276aa6e5512 30:03.014 [INFO] TestAgent.server: federation state anti-entropy synced 30:03.033 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/notfound from=127.0.0.1:58480 latency=482.621µs 30:03.055 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:58482 latency=21.052088ms 30:03.065 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-d9d5bc6c-7ca2-aea7-fba3-2a837c00f1e8 from=127.0.0.1:58486 latency=1.990881ms 30:03.069 [INFO] TestAgent: Requesting shutdown 30:03.069 [INFO] TestAgent.server: shutting down server 30:03.069 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:03.069 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:03.069 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:03.069 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:03.069 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:03.069 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:03.069 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:03.069 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:03.069 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:03.069 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:03.069 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:03.069 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:03.069 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:03.069 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:03.069 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:03.084 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:03.092Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:03.092Z [INFO] agent.router.manager: shutting down 30:03.092 [INFO] TestAgent: consul server down 30:03.092 [INFO] TestAgent: shutdown complete 30:03.092 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=tcp 30:03.092 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=udp 30:03.092 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14093 network=tcp 30:03.596 [INFO] TestAgent: Waiting for endpoints to shut down 30:03.596 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodReadCommand (1.03s) --- PASS: TestAuthMethodReadCommand/name_required (0.00s) --- PASS: TestAuthMethodReadCommand/not_found (0.02s) --- PASS: TestAuthMethodReadCommand/read_by_name (0.04s) PASS ok github.com/hashicorp/consul/command/acl/authmethod/read 1.153s === RUN TestAuthMethodUpdateCommand_noTabs === PAUSE TestAuthMethodUpdateCommand_noTabs === RUN TestAuthMethodUpdateCommand === PAUSE TestAuthMethodUpdateCommand === RUN TestAuthMethodUpdateCommand_JSON === PAUSE TestAuthMethodUpdateCommand_JSON === RUN TestAuthMethodUpdateCommand_noMerge === PAUSE TestAuthMethodUpdateCommand_noMerge === RUN TestAuthMethodUpdateCommand_k8s === PAUSE TestAuthMethodUpdateCommand_k8s === RUN TestAuthMethodUpdateCommand_k8s_noMerge === PAUSE TestAuthMethodUpdateCommand_k8s_noMerge === RUN TestAuthMethodUpdateCommand_config === PAUSE TestAuthMethodUpdateCommand_config === CONT TestAuthMethodUpdateCommand_noTabs === CONT TestAuthMethodUpdateCommand_k8s_noMerge [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestAuthMethodUpdateCommand_noMerge === CONT TestAuthMethodUpdateCommand_k8s --- PASS: TestAuthMethodUpdateCommand_noTabs (0.00s) === CONT TestAuthMethodUpdateCommand_JSON === CONT TestAuthMethodUpdateCommand_config === CONT TestAuthMethodUpdateCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestAuthMethodUpdateCommand_noMerge/update_without_name === RUN TestAuthMethodUpdateCommand_noMerge/update_nonexistent_method === RUN TestAuthMethodUpdateCommand_noMerge/update_all_fields === RUN TestAuthMethodUpdateCommand_k8s/update_all_fields === RUN TestAuthMethodUpdateCommand_k8s_noMerge/update_missing_k8s_host === RUN TestAuthMethodUpdateCommand_config/config_file === RUN TestAuthMethodUpdateCommand_k8s_noMerge/update_missing_k8s_ca_cert === RUN TestAuthMethodUpdateCommand/update_without_name === RUN TestAuthMethodUpdateCommand/update_nonexistent_method === RUN TestAuthMethodUpdateCommand_k8s/update_all_fields_with_cert_file === RUN TestAuthMethodUpdateCommand/update_all_fields === RUN TestAuthMethodUpdateCommand_JSON/update_without_name === RUN TestAuthMethodUpdateCommand_JSON/update_all_fields === RUN TestAuthMethodUpdateCommand_k8s_noMerge/update_missing_k8s_jwt === RUN TestAuthMethodUpdateCommand/update_config_field_and_prove_no_merging_happens === RUN TestAuthMethodUpdateCommand_config/config_stdin === RUN TestAuthMethodUpdateCommand_k8s_noMerge/update_all_fields === RUN TestAuthMethodUpdateCommand_k8s/update_all_fields_but_k8s_host === RUN TestAuthMethodUpdateCommand_config/config_string === RUN TestAuthMethodUpdateCommand_k8s_noMerge/update_all_fields_with_cert_file === RUN TestAuthMethodUpdateCommand_k8s/update_all_fields_but_k8s_ca_cert === RUN TestAuthMethodUpdateCommand_config/config_with_no_merge === RUN TestAuthMethodUpdateCommand_k8s/update_all_fields_but_k8s_jwt 2021-10-05T16:30:10.181Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:10.262Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:10.380 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:55971041-5f11-4c3b-63b7-4b27dd51cfc1 Address:127.0.0.1:11034}]" 30:10.381 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1.dc1 127.0.0.1 30:10.381 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 127.0.0.1 2021-10-05T16:30:10.381Z [INFO] agent.router: Initializing LAN area manager 30:10.382 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11029 network=udp 30:10.382 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11034 [Follower]" leader= 30:10.382 [INFO] TestAgent.server: Adding LAN server: server="Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 (Addr: tcp/127.0.0.1:11034) (DC: dc1)" 30:10.382 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1.dc1 area=wan 30:10.382 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11029 network=tcp 30:10.383 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11030 network=tcp 30:10.383 [INFO] TestAgent: started state syncer 30:10.383 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11035 network=tcp 30:10.424 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.424 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11034 [Candidate]" term=2 30:10.432 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:10.468 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.468 [DEBUG] TestAgent.server.raft: vote granted: from=55971041-5f11-4c3b-63b7-4b27dd51cfc1 term=2 tally=1 30:10.468 [INFO] TestAgent.server.raft: election won: tally=1 30:10.468 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11034 [Leader]" 30:10.472 [INFO] TestAgent.server: cluster leadership acquired 30:10.472 [INFO] TestAgent.server: New leader elected: payload=Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 30:10.508 [INFO] TestAgent.server: initializing acls 30:10.528 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:10.528 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.536 [INFO] TestAgent.server: initializing acls 30:10.536 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.553 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.584 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.584 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:10.584 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:10.584 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 30:10.585 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1.dc1 30:10.585 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.585 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:10.585 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 30:10.585 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1.dc1 30:10.585 [INFO] TestAgent.server: Updating LAN server: server="Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 (Addr: tcp/127.0.0.1:11034) (DC: dc1)" 30:10.585 [INFO] TestAgent.server: Updating LAN server: server="Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 (Addr: tcp/127.0.0.1:11034) (DC: dc1)" 30:10.586 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1.dc1 area=wan 30:10.586 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1.dc1 area=wan 30:10.632 [INFO] TestAgent: Synced node info 30:10.632 [DEBUG] TestAgent: Node info in sync 30:10.641 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.642 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-34697363-e44f-ca56-4998-865bb9ce785c from=127.0.0.1:46578 latency=2.531148ms 30:10.703 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:46580 latency=54.650783ms 30:10.706 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-dd01bd48-b496-a00b-cd55-56c732ef62ab from=127.0.0.1:46582 latency=607.212µs 30:10.755 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.759 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test-dd01bd48-b496-a00b-cd55-56c732ef62ab from=127.0.0.1:46582 latency=51.936444ms 30:10.761 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-dd01bd48-b496-a00b-cd55-56c732ef62ab from=127.0.0.1:46580 latency=471.646µs 30:10.761 [INFO] TestAgent: Requesting shutdown 30:10.761 [INFO] TestAgent.server: shutting down server 30:10.761 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:10.761 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:10.761 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:10.761 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:10.761 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:10.761 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.761 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.761 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.761 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.761 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 30:10.762 [INFO] TestAgent.server: member joined, marking health alive: member=Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 30:10.768 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:10.773Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:10.773Z [INFO] agent.router.manager: shutting down 30:10.780 [INFO] TestAgent: consul server down 30:10.780 [INFO] TestAgent: shutdown complete 30:10.780 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11029 network=tcp 30:10.780 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11029 network=udp 30:10.780 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11030 network=tcp 30:10.780 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-55971041-5f11-4c3b-63b7-4b27dd51cfc1 127.0.0.1 11032 map[acls:1 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:55971041-5f11-4c3b-63b7-4b27dd51cfc1 port:11034 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:11033] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 30:10.780 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:10.780 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:10.780 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:10.780 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:10.782 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:10.782 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:10.782 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:11.284 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.284 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodUpdateCommand_noMerge (1.36s) --- PASS: TestAuthMethodUpdateCommand_noMerge/update_without_name (0.00s) --- PASS: TestAuthMethodUpdateCommand_noMerge/update_nonexistent_method (0.01s) --- PASS: TestAuthMethodUpdateCommand_noMerge/update_all_fields (0.12s) 2021-10-05T16:30:10.181Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:10.317Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:10.410 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f97b425f-67ff-55b6-821c-3453c2fad690 Address:127.0.0.1:11048}]" 30:10.411 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f97b425f-67ff-55b6-821c-3453c2fad690.dc1 127.0.0.1 30:10.411 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f97b425f-67ff-55b6-821c-3453c2fad690 127.0.0.1 2021-10-05T16:30:10.411Z [INFO] agent.router: Initializing LAN area manager 30:10.412 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11048 [Follower]" leader= 30:10.412 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11043 network=udp 30:10.412 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11043 network=tcp 30:10.412 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f97b425f-67ff-55b6-821c-3453c2fad690.dc1 area=wan 30:10.412 [INFO] TestAgent.server: Adding LAN server: server="Node-f97b425f-67ff-55b6-821c-3453c2fad690 (Addr: tcp/127.0.0.1:11048) (DC: dc1)" 30:10.413 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11044 network=tcp 30:10.413 [INFO] TestAgent: started state syncer 30:10.413 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11049 network=tcp 30:10.464 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:10.480 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.480 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11048 [Candidate]" term=2 30:10.528 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.528 [DEBUG] TestAgent.server.raft: vote granted: from=f97b425f-67ff-55b6-821c-3453c2fad690 term=2 tally=1 30:10.528 [INFO] TestAgent.server.raft: election won: tally=1 30:10.528 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11048 [Leader]" 30:10.528 [INFO] TestAgent.server: cluster leadership acquired 30:10.528 [INFO] TestAgent.server: New leader elected: payload=Node-f97b425f-67ff-55b6-821c-3453c2fad690 30:10.564 [INFO] TestAgent.server: initializing acls 30:10.584 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:10.584 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.584 [INFO] TestAgent.server: initializing acls 30:10.584 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.644 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.648 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.660 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.660 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:10.660 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:10.660 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f97b425f-67ff-55b6-821c-3453c2fad690 30:10.660 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f97b425f-67ff-55b6-821c-3453c2fad690.dc1 30:10.661 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f97b425f-67ff-55b6-821c-3453c2fad690.dc1 area=wan 30:10.661 [INFO] TestAgent.server: Updating LAN server: server="Node-f97b425f-67ff-55b6-821c-3453c2fad690 (Addr: tcp/127.0.0.1:11048) (DC: dc1)" 30:10.680 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.680 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:10.680 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f97b425f-67ff-55b6-821c-3453c2fad690 30:10.680 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f97b425f-67ff-55b6-821c-3453c2fad690.dc1 30:10.680 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f97b425f-67ff-55b6-821c-3453c2fad690.dc1 area=wan 30:10.680 [INFO] TestAgent.server: Updating LAN server: server="Node-f97b425f-67ff-55b6-821c-3453c2fad690 (Addr: tcp/127.0.0.1:11048) (DC: dc1)" 30:10.727 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.796 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.796 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.796 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.796 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.796 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.796 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f97b425f-67ff-55b6-821c-3453c2fad690 30:10.796 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f97b425f-67ff-55b6-821c-3453c2fad690 30:10.809 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f97b425f-67ff-55b6-821c-3453c2fad690 30:10.809 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f97b425f-67ff-55b6-821c-3453c2fad690 30:10.824 [INFO] TestAgent.server: federation state anti-entropy synced 30:10.849 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:39348 latency=23.233129ms 30:10.855 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-a1161b7f-62b5-9949-8a92-e108cfbf818d from=127.0.0.1:39354 latency=522.364µs 30:10.876 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test-a1161b7f-62b5-9949-8a92-e108cfbf818d from=127.0.0.1:39354 latency=20.893339ms 30:10.882 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-a1161b7f-62b5-9949-8a92-e108cfbf818d from=127.0.0.1:39348 latency=146.994µs 30:10.882 [INFO] TestAgent: Requesting shutdown 30:10.882 [INFO] TestAgent.server: shutting down server 30:10.882 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:10.882 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:10.882 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:10.882 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:10.882 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:10.882 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:10.882 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:10.882 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:10.882 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:10.882 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:10.882 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:10.882 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:10.882 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:10.882 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:10.882 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:10.902 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:10.903Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:10.903Z [INFO] agent.router.manager: shutting down 30:10.903 [INFO] TestAgent: consul server down 30:10.903 [INFO] TestAgent: shutdown complete 30:10.903 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11043 network=tcp 30:10.903 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11043 network=udp 30:10.903 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11044 network=tcp 30:11.403 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.403 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodUpdateCommand_JSON (1.48s) --- PASS: TestAuthMethodUpdateCommand_JSON/update_without_name (0.00s) --- PASS: TestAuthMethodUpdateCommand_JSON/update_all_fields (0.06s) 2021-10-05T16:30:10.123Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:10.278Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:10.383 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5d3e2f1d-9218-d9e5-bdc4-f5832637820a Address:127.0.0.1:11062}]" 30:10.384 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11062 [Follower]" leader= 30:10.389 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a.dc1 127.0.0.1 30:10.390 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 127.0.0.1 2021-10-05T16:30:10.390Z [INFO] agent.router: Initializing LAN area manager 30:10.396 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a.dc1 area=wan 30:10.404 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11057 network=tcp 30:10.405 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11057 network=udp 30:10.405 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11058 network=tcp 30:10.405 [INFO] TestAgent: started state syncer 30:10.406 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11063 network=tcp 30:10.406 [INFO] TestAgent.server: Adding LAN server: server="Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a (Addr: tcp/127.0.0.1:11062) (DC: dc1)" 30:10.435 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.435 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11062 [Candidate]" term=2 30:10.447 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:10.452 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.452 [DEBUG] TestAgent.server.raft: vote granted: from=5d3e2f1d-9218-d9e5-bdc4-f5832637820a term=2 tally=1 30:10.452 [INFO] TestAgent.server.raft: election won: tally=1 30:10.452 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11062 [Leader]" 30:10.454 [INFO] TestAgent.server: cluster leadership acquired 30:10.454 [INFO] TestAgent.server: New leader elected: payload=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 30:10.480 [INFO] TestAgent.server: initializing acls 30:10.503 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:10.503 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.528 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.548 [INFO] TestAgent.server: initializing acls 30:10.548 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.560 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.560 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:10.560 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:10.561 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 30:10.561 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a.dc1 30:10.561 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a.dc1 area=wan 30:10.561 [INFO] TestAgent.server: Updating LAN server: server="Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a (Addr: tcp/127.0.0.1:11062) (DC: dc1)" 30:10.594 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.594 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:10.595 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 30:10.595 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a.dc1 30:10.595 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a.dc1 area=wan 30:10.595 [INFO] TestAgent.server: Updating LAN server: server="Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a (Addr: tcp/127.0.0.1:11062) (DC: dc1)" 30:10.629 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.666 [INFO] TestAgent: Synced node info 30:10.666 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.666 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.666 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.666 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.666 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.666 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 30:10.666 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 30:10.679 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 30:10.679 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5d3e2f1d-9218-d9e5-bdc4-f5832637820a 30:10.708 [INFO] TestAgent.server: federation state anti-entropy synced 30:10.794 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-8b3f503f-5078-c224-e7cd-6e7418312f7c from=127.0.0.1:43916 latency=683.247µs 30:10.807 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:43918 latency=12.033185ms 30:10.825 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-974961ca-79ba-3a73-834e-2656249038c9 from=127.0.0.1:43922 latency=2.274179ms 30:10.844 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test-974961ca-79ba-3a73-834e-2656249038c9 from=127.0.0.1:43922 latency=18.580678ms 30:10.854 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-974961ca-79ba-3a73-834e-2656249038c9 from=127.0.0.1:43918 latency=481.201µs 30:10.856 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-974961ca-79ba-3a73-834e-2656249038c9 from=127.0.0.1:43934 latency=248.491µs 30:10.900 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test-974961ca-79ba-3a73-834e-2656249038c9 from=127.0.0.1:43934 latency=35.834369ms 30:10.902 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test-974961ca-79ba-3a73-834e-2656249038c9 from=127.0.0.1:43918 latency=341.309µs 30:10.902 [INFO] TestAgent: Requesting shutdown 30:10.903 [INFO] TestAgent.server: shutting down server 30:10.903 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:10.903 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:10.903 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:10.903 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:10.903 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:10.903 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:10.903 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:10.903 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:10.903 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:10.903 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:10.903 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:10.903 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:10.903 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:10.903 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:10.911 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:10.913Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:10.913Z [INFO] agent.router.manager: shutting down 30:10.913 [INFO] TestAgent: consul server down 30:10.913 [INFO] TestAgent: shutdown complete 30:10.913 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11057 network=tcp 30:10.913 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11057 network=udp 30:10.913 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11058 network=tcp 30:11.416 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.416 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodUpdateCommand (1.49s) --- PASS: TestAuthMethodUpdateCommand/update_without_name (0.00s) --- PASS: TestAuthMethodUpdateCommand/update_nonexistent_method (0.01s) --- PASS: TestAuthMethodUpdateCommand/update_all_fields (0.05s) --- PASS: TestAuthMethodUpdateCommand/update_config_field_and_prove_no_merging_happens (0.05s) 2021-10-05T16:30:10.132Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:10.222Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:10.344 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:40ec56d2-673a-8339-7e4f-a4293df61bd1 Address:127.0.0.1:11027}]" 30:10.344 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11027 [Follower]" leader= 30:10.345 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-40ec56d2-673a-8339-7e4f-a4293df61bd1.dc1 127.0.0.1 30:10.345 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 127.0.0.1 2021-10-05T16:30:10.346Z [INFO] agent.router: Initializing LAN area manager 30:10.346 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11022 network=udp 30:10.346 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-40ec56d2-673a-8339-7e4f-a4293df61bd1.dc1 area=wan 30:10.346 [INFO] TestAgent.server: Adding LAN server: server="Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 (Addr: tcp/127.0.0.1:11027) (DC: dc1)" 30:10.346 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11022 network=tcp 30:10.347 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11023 network=tcp 30:10.347 [INFO] TestAgent: started state syncer 30:10.347 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11028 network=tcp 30:10.400 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:10.413 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.413 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11027 [Candidate]" term=2 30:10.431 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.431 [DEBUG] TestAgent.server.raft: vote granted: from=40ec56d2-673a-8339-7e4f-a4293df61bd1 term=2 tally=1 30:10.431 [INFO] TestAgent.server.raft: election won: tally=1 30:10.431 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11027 [Leader]" 30:10.432 [INFO] TestAgent.server: cluster leadership acquired 30:10.433 [INFO] TestAgent.server: New leader elected: payload=Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 30:10.444 [INFO] TestAgent.server: initializing acls 30:10.453 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:10.453 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.468 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.492 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.492 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:10.492 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:10.492 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 30:10.492 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-40ec56d2-673a-8339-7e4f-a4293df61bd1.dc1 30:10.493 [INFO] TestAgent.server: Updating LAN server: server="Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 (Addr: tcp/127.0.0.1:11027) (DC: dc1)" 30:10.493 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-40ec56d2-673a-8339-7e4f-a4293df61bd1.dc1 area=wan 30:10.517 [INFO] TestAgent: Synced node info 30:10.528 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.593 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.593 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.593 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.593 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.593 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.593 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 30:10.593 [INFO] TestAgent.server: member joined, marking health alive: member=Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 30:10.616 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-40ec56d2-673a-8339-7e4f-a4293df61bd1 30:10.628 [INFO] TestAgent.server: federation state anti-entropy synced 30:10.766 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59706 latency=37.700732ms 30:10.774 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-ffacfc36-97d6-126a-556a-14cf5e9fadc5 from=127.0.0.1:59714 latency=464.517µs 30:10.809 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59706 latency=33.659993ms 30:10.826 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-ee1a1245-86fb-c417-97aa-ca87307d440b from=127.0.0.1:59724 latency=387.824µs 30:10.856 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59706 latency=29.460414ms 30:10.864 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-7aa7df28-c128-1f7c-34b7-23067f0ad4c7 from=127.0.0.1:59736 latency=446.31µs 30:10.917 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59706 latency=48.839288ms 30:10.921 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-3c8d807f-1cc6-2eb6-9622-6b966cb65957 from=127.0.0.1:59740 latency=416.852µs 30:10.941 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/k8s-3c8d807f-1cc6-2eb6-9622-6b966cb65957 from=127.0.0.1:59740 latency=19.080367ms 30:10.949 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-3c8d807f-1cc6-2eb6-9622-6b966cb65957 from=127.0.0.1:59706 latency=678.714µs 30:10.985 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59706 latency=34.767048ms 30:10.987 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-83d909ac-c0b8-5898-ef4d-27828e25126f from=127.0.0.1:59746 latency=329.207µs 30:11.004 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/k8s-83d909ac-c0b8-5898-ef4d-27828e25126f from=127.0.0.1:59746 latency=14.828658ms 30:11.013 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-83d909ac-c0b8-5898-ef4d-27828e25126f from=127.0.0.1:59706 latency=1.076966ms 30:11.014 [INFO] TestAgent: Requesting shutdown 30:11.014 [INFO] TestAgent.server: shutting down server 30:11.014 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:11.014 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:11.014 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:11.014 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:11.014 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:11.014 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:11.014 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:11.014 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:11.014 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:11.014 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:11.014 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:11.014 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:11.014 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:11.014 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:11.037 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:11.040Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:11.040Z [INFO] agent.router.manager: shutting down 30:11.040 [INFO] TestAgent: consul server down 30:11.040 [INFO] TestAgent: shutdown complete 30:11.040 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11022 network=tcp 30:11.040 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11022 network=udp 30:11.040 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11023 network=tcp 30:11.543 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.543 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodUpdateCommand_k8s_noMerge (1.62s) --- PASS: TestAuthMethodUpdateCommand_k8s_noMerge/update_missing_k8s_host (0.05s) --- PASS: TestAuthMethodUpdateCommand_k8s_noMerge/update_missing_k8s_ca_cert (0.05s) --- PASS: TestAuthMethodUpdateCommand_k8s_noMerge/update_missing_k8s_jwt (0.04s) --- PASS: TestAuthMethodUpdateCommand_k8s_noMerge/update_all_fields (0.08s) --- PASS: TestAuthMethodUpdateCommand_k8s_noMerge/update_all_fields_with_cert_file (0.06s) 2021-10-05T16:30:10.138Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:10.299Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:10.440 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:24b5d716-0393-5765-d731-2ee9bfe72fe2 Address:127.0.0.1:11055}]" 30:10.440 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11055 [Follower]" leader= 30:10.441 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-24b5d716-0393-5765-d731-2ee9bfe72fe2.dc1 127.0.0.1 30:10.442 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 127.0.0.1 2021-10-05T16:30:10.442Z [INFO] agent.router: Initializing LAN area manager 30:10.442 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11050 network=udp 30:10.442 [INFO] TestAgent.server: Adding LAN server: server="Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 (Addr: tcp/127.0.0.1:11055) (DC: dc1)" 30:10.443 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-24b5d716-0393-5765-d731-2ee9bfe72fe2.dc1 area=wan 30:10.443 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11050 network=tcp 30:10.443 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11051 network=tcp 30:10.443 [INFO] TestAgent: started state syncer 30:10.443 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11056 network=tcp 30:10.482 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.482 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11055 [Candidate]" term=2 30:10.493 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:10.519 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.519 [DEBUG] TestAgent.server.raft: vote granted: from=24b5d716-0393-5765-d731-2ee9bfe72fe2 term=2 tally=1 30:10.519 [INFO] TestAgent.server.raft: election won: tally=1 30:10.519 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11055 [Leader]" 30:10.519 [INFO] TestAgent.server: cluster leadership acquired 30:10.519 [INFO] TestAgent.server: New leader elected: payload=Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 30:10.530 [INFO] TestAgent.server: initializing acls 30:10.536 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:10.536 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.564 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.592 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.592 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:10.592 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:10.593 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 30:10.593 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-24b5d716-0393-5765-d731-2ee9bfe72fe2.dc1 30:10.595 [INFO] TestAgent.server: Updating LAN server: server="Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 (Addr: tcp/127.0.0.1:11055) (DC: dc1)" 30:10.606 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-24b5d716-0393-5765-d731-2ee9bfe72fe2.dc1 area=wan 30:10.644 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.720 [INFO] TestAgent: Synced node info 30:10.759 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.759 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.759 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.759 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.759 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.759 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 30:10.759 [INFO] TestAgent.server: member joined, marking health alive: member=Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 30:10.793 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-24b5d716-0393-5765-d731-2ee9bfe72fe2 30:10.821 [INFO] TestAgent.server: federation state anti-entropy synced 30:10.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48124 latency=57.230311ms 30:10.835 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test0f2822f2-d38c-818e-e7fa-358c74368315 from=127.0.0.1:48144 latency=389.282µs 30:10.848 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test0f2822f2-d38c-818e-e7fa-358c74368315 from=127.0.0.1:48144 latency=13.151316ms 30:10.855 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test0f2822f2-d38c-818e-e7fa-358c74368315 from=127.0.0.1:48124 latency=342.35µs 30:10.896 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48124 latency=40.830247ms 30:10.917 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test8325447e-93cf-48e6-95d4-32eac2a021a0 from=127.0.0.1:48152 latency=689.273µs 30:10.923 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test8325447e-93cf-48e6-95d4-32eac2a021a0 from=127.0.0.1:48152 latency=4.284155ms 30:10.927 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test8325447e-93cf-48e6-95d4-32eac2a021a0 from=127.0.0.1:48124 latency=926.934µs 30:10.954 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48124 latency=25.820256ms 30:10.972 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test91942e81-4a78-1fa7-c6d4-7207124bdf62 from=127.0.0.1:48158 latency=14.242276ms 30:10.992 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test91942e81-4a78-1fa7-c6d4-7207124bdf62 from=127.0.0.1:48158 latency=19.372237ms 30:10.996 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test91942e81-4a78-1fa7-c6d4-7207124bdf62 from=127.0.0.1:48124 latency=260.437µs 30:11.012 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48124 latency=15.0946ms 30:11.016 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test94ef1880-d083-7459-ec6f-86b953acbb68 from=127.0.0.1:48164 latency=281.527µs 30:11.040 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/test94ef1880-d083-7459-ec6f-86b953acbb68 from=127.0.0.1:48164 latency=23.546335ms 30:11.041 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/test94ef1880-d083-7459-ec6f-86b953acbb68 from=127.0.0.1:48124 latency=213.732µs 30:11.042 [INFO] TestAgent: Requesting shutdown 30:11.042 [INFO] TestAgent.server: shutting down server 30:11.042 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:11.042 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:11.042 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:11.042 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:11.042 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:11.042 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:11.042 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:11.042 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:11.042 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:11.042 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:11.042 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:11.042 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:11.042 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:11.042 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:11.047 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:11.047Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:11.047Z [INFO] agent.router.manager: shutting down 30:11.048 [INFO] TestAgent: consul server down 30:11.048 [INFO] TestAgent: shutdown complete 30:11.048 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11050 network=tcp 30:11.048 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11050 network=udp 30:11.048 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11051 network=tcp 30:11.551 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.551 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodUpdateCommand_config (1.62s) --- PASS: TestAuthMethodUpdateCommand_config/config_file (0.11s) --- PASS: TestAuthMethodUpdateCommand_config/config_stdin (0.07s) --- PASS: TestAuthMethodUpdateCommand_config/config_string (0.07s) --- PASS: TestAuthMethodUpdateCommand_config/config_with_no_merge (0.05s) 2021-10-05T16:30:10.099Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:10.231Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:10.347 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:71d0a91c-0ee8-5579-0b7f-e222ae97a63b Address:127.0.0.1:11041}]" 30:10.347 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11041 [Follower]" leader= 30:10.347 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b.dc1 127.0.0.1 30:10.398 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 127.0.0.1 2021-10-05T16:30:10.398Z [INFO] agent.router: Initializing LAN area manager 30:10.399 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11036 network=udp 30:10.399 [INFO] TestAgent.server: Adding LAN server: server="Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b (Addr: tcp/127.0.0.1:11041) (DC: dc1)" 30:10.399 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b.dc1 area=wan 30:10.406 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11036 network=tcp 30:10.406 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:10.406 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11041 [Candidate]" term=2 30:10.406 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11037 network=tcp 30:10.406 [INFO] TestAgent: started state syncer 30:10.406 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11042 network=tcp 30:10.448 [DEBUG] TestAgent.server.raft: votes: needed=1 30:10.448 [DEBUG] TestAgent.server.raft: vote granted: from=71d0a91c-0ee8-5579-0b7f-e222ae97a63b term=2 tally=1 30:10.448 [INFO] TestAgent.server.raft: election won: tally=1 30:10.448 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11041 [Leader]" 30:10.448 [INFO] TestAgent.server: cluster leadership acquired 30:10.448 [INFO] TestAgent.server: New leader elected: payload=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 30:10.452 [INFO] TestAgent.server: initializing acls 30:10.480 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:10.480 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.480 [INFO] TestAgent.server: initializing acls 30:10.480 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:10.514 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.553 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:10.553 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:10.553 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:10.553 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:10.554 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 30:10.554 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b.dc1 30:10.554 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b.dc1 area=wan 30:10.554 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:10.554 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 30:10.554 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b.dc1 30:10.555 [INFO] TestAgent.server: Updating LAN server: server="Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b (Addr: tcp/127.0.0.1:11041) (DC: dc1)" 30:10.556 [INFO] TestAgent.server: Updating LAN server: server="Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b (Addr: tcp/127.0.0.1:11041) (DC: dc1)" 30:10.556 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b.dc1 area=wan 30:10.618 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:10.647 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:10.647 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:10.647 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:10.647 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:10.647 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:10.647 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 30:10.647 [INFO] TestAgent.server: member joined, marking health alive: member=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 30:10.659 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 30:10.659 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-71d0a91c-0ee8-5579-0b7f-e222ae97a63b 30:10.680 [INFO] TestAgent.server: federation state anti-entropy synced 30:10.688 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:10.700 [INFO] TestAgent: Synced node info 30:10.700 [DEBUG] TestAgent: Node info in sync 30:10.742 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48230 latency=25.774064ms 30:10.761 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-f35f482a-f940-1969-90cc-2555b845ce15 from=127.0.0.1:48238 latency=485.546µs 30:10.781 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/k8s-f35f482a-f940-1969-90cc-2555b845ce15 from=127.0.0.1:48238 latency=19.332909ms 30:10.797 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-f35f482a-f940-1969-90cc-2555b845ce15 from=127.0.0.1:48230 latency=2.859851ms 30:10.827 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48230 latency=25.883935ms 30:10.831 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-74dec523-90bd-df95-759d-af5197fc02fd from=127.0.0.1:48254 latency=429.828µs 30:10.873 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/k8s-74dec523-90bd-df95-759d-af5197fc02fd from=127.0.0.1:48254 latency=32.29205ms 30:10.881 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-74dec523-90bd-df95-759d-af5197fc02fd from=127.0.0.1:48230 latency=557.772µs 30:10.920 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48230 latency=32.481495ms 30:10.923 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-1ab28ef8-6946-f8b2-bf08-955e6f128537 from=127.0.0.1:48268 latency=314.466µs 30:10.949 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/k8s-1ab28ef8-6946-f8b2-bf08-955e6f128537 from=127.0.0.1:48268 latency=25.93694ms 30:10.951 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-1ab28ef8-6946-f8b2-bf08-955e6f128537 from=127.0.0.1:48230 latency=338.793µs 30:10.992 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48230 latency=35.642761ms 30:10.997 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-ac1e85d3-433c-6de3-8250-fbbd28cdcb4d from=127.0.0.1:48274 latency=253.753µs 30:11.020 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/k8s-ac1e85d3-433c-6de3-8250-fbbd28cdcb4d from=127.0.0.1:48274 latency=22.230859ms 30:11.025 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-ac1e85d3-433c-6de3-8250-fbbd28cdcb4d from=127.0.0.1:48230 latency=296.383µs 30:11.048 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:48230 latency=22.683391ms 30:11.050 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-f8f99bfc-38fc-f866-f126-7c996f750395 from=127.0.0.1:48278 latency=403.475µs 30:11.059 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method/k8s-f8f99bfc-38fc-f866-f126-7c996f750395 from=127.0.0.1:48278 latency=7.69423ms 30:11.060 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/auth-method/k8s-f8f99bfc-38fc-f866-f126-7c996f750395 from=127.0.0.1:48230 latency=277.805µs 30:11.061 [INFO] TestAgent: Requesting shutdown 30:11.061 [INFO] TestAgent.server: shutting down server 30:11.061 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:11.061 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:11.061 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:11.061 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:11.061 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:11.061 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:11.061 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:11.061 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:11.061 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:11.061 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:11.061 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:11.061 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:11.061 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:11.061 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:11.078 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:11.079Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:11.079Z [INFO] agent.router.manager: shutting down 30:11.079 [INFO] TestAgent: consul server down 30:11.079 [INFO] TestAgent: shutdown complete 30:11.079 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11036 network=tcp 30:11.079 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11036 network=udp 30:11.080 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11037 network=tcp 30:11.580 [INFO] TestAgent: Waiting for endpoints to shut down 30:11.580 [INFO] TestAgent: Endpoints down --- PASS: TestAuthMethodUpdateCommand_k8s (1.65s) --- PASS: TestAuthMethodUpdateCommand_k8s/update_all_fields (0.09s) --- PASS: TestAuthMethodUpdateCommand_k8s/update_all_fields_with_cert_file (0.08s) --- PASS: TestAuthMethodUpdateCommand_k8s/update_all_fields_but_k8s_host (0.07s) --- PASS: TestAuthMethodUpdateCommand_k8s/update_all_fields_but_k8s_ca_cert (0.07s) --- PASS: TestAuthMethodUpdateCommand_k8s/update_all_fields_but_k8s_jwt (0.04s) PASS ok github.com/hashicorp/consul/command/acl/authmethod/update 1.786s ? github.com/hashicorp/consul/command/acl/bindingrule [no test files] === RUN TestBindingRuleCreateCommand_noTabs === PAUSE TestBindingRuleCreateCommand_noTabs === RUN TestBindingRuleCreateCommand === PAUSE TestBindingRuleCreateCommand === RUN TestBindingRuleCreateCommand_JSON === PAUSE TestBindingRuleCreateCommand_JSON === CONT TestBindingRuleCreateCommand_noTabs --- PASS: TestBindingRuleCreateCommand_noTabs (0.00s) === CONT TestBindingRuleCreateCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestBindingRuleCreateCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestBindingRuleCreateCommand/method_is_required === RUN TestBindingRuleCreateCommand/bind_type_required === RUN TestBindingRuleCreateCommand/bind_name_required === RUN TestBindingRuleCreateCommand/must_use_roughly_valid_selector === RUN TestBindingRuleCreateCommand/create_it_with_no_selector === RUN TestBindingRuleCreateCommand/create_it_with_a_match_selector === RUN TestBindingRuleCreateCommand_JSON/create_it_with_no_selector === RUN TestBindingRuleCreateCommand/create_it_with_type_role 2021-10-05T16:30:13.235Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:13.273Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:13.315 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:209c7822-3b9c-9e8b-f958-e16e61a393c6 Address:127.0.0.1:10006}]" 30:13.315 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-209c7822-3b9c-9e8b-f958-e16e61a393c6.dc1 127.0.0.1 30:13.316 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:10006 [Follower]" leader= 30:13.316 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 127.0.0.1 2021-10-05T16:30:13.316Z [INFO] agent.router: Initializing LAN area manager 30:13.317 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10001 network=udp 30:13.317 [INFO] TestAgent.server: Adding LAN server: server="Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 (Addr: tcp/127.0.0.1:10006) (DC: dc1)" 30:13.317 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-209c7822-3b9c-9e8b-f958-e16e61a393c6.dc1 area=wan 30:13.317 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10001 network=tcp 30:13.318 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:10002 network=tcp 30:13.318 [INFO] TestAgent: started state syncer 30:13.318 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:10007 network=tcp 30:13.367 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:13.370 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:13.370 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:10006 [Candidate]" term=2 30:13.383 [DEBUG] TestAgent.server.raft: votes: needed=1 30:13.383 [DEBUG] TestAgent.server.raft: vote granted: from=209c7822-3b9c-9e8b-f958-e16e61a393c6 term=2 tally=1 30:13.383 [INFO] TestAgent.server.raft: election won: tally=1 30:13.383 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:10006 [Leader]" 30:13.383 [INFO] TestAgent.server: cluster leadership acquired 30:13.383 [INFO] TestAgent.server: New leader elected: payload=Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 30:13.402 [INFO] TestAgent.server: initializing acls 30:13.418 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:13.418 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:13.431 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:13.446 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:13.446 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:13.446 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:13.446 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 30:13.446 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-209c7822-3b9c-9e8b-f958-e16e61a393c6.dc1 30:13.447 [INFO] TestAgent.server: Updating LAN server: server="Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 (Addr: tcp/127.0.0.1:10006) (DC: dc1)" 30:13.447 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-209c7822-3b9c-9e8b-f958-e16e61a393c6.dc1 area=wan 30:13.475 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:13.506 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:13.506 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:13.506 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:13.506 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:13.506 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:13.506 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 30:13.506 [INFO] TestAgent.server: member joined, marking health alive: member=Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 30:13.514 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-209c7822-3b9c-9e8b-f958-e16e61a393c6 30:13.519 [INFO] TestAgent.server: federation state anti-entropy synced 30:13.526 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:13.543 [INFO] TestAgent: Synced node info 30:13.738 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:47554 latency=17.910072ms 30:13.766 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:47556 latency=13.643614ms 30:13.768 [INFO] TestAgent: Requesting shutdown 30:13.768 [INFO] TestAgent.server: shutting down server 30:13.768 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:13.768 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:13.768 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:13.768 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:13.768 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:13.768 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:13.768 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:13.768 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:13.768 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:13.768 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:13.768 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:13.768 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:13.768 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:13.768 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:13.781 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:13.788Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:13.788Z [INFO] agent.router.manager: shutting down 30:13.788 [INFO] TestAgent: consul server down 30:13.788 [INFO] TestAgent: shutdown complete 30:13.788 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10001 network=tcp 30:13.788 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10001 network=udp 30:13.788 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:10002 network=tcp 30:14.290 [INFO] TestAgent: Waiting for endpoints to shut down 30:14.290 [INFO] TestAgent: Endpoints down --- PASS: TestBindingRuleCreateCommand_JSON (1.16s) --- PASS: TestBindingRuleCreateCommand_JSON/create_it_with_no_selector (0.03s) 2021-10-05T16:30:13.225Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:13.258Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:13.320 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:08c9f4e9-8b43-143e-a72d-5bfa3b682687 Address:127.0.0.1:10013}]" 30:13.321 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687.dc1 127.0.0.1 30:13.322 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 127.0.0.1 2021-10-05T16:30:13.322Z [INFO] agent.router: Initializing LAN area manager 30:13.322 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10008 network=udp 30:13.322 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:10013 [Follower]" leader= 30:13.322 [INFO] TestAgent.server: Adding LAN server: server="Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 (Addr: tcp/127.0.0.1:10013) (DC: dc1)" 30:13.322 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687.dc1 area=wan 30:13.323 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10008 network=tcp 30:13.323 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:10009 network=tcp 30:13.323 [INFO] TestAgent: started state syncer 30:13.323 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:10014 network=tcp 30:13.358 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:13.358 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:10013 [Candidate]" term=2 30:13.367 [DEBUG] TestAgent.server.raft: votes: needed=1 30:13.367 [DEBUG] TestAgent.server.raft: vote granted: from=08c9f4e9-8b43-143e-a72d-5bfa3b682687 term=2 tally=1 30:13.367 [INFO] TestAgent.server.raft: election won: tally=1 30:13.367 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:10013 [Leader]" 30:13.367 [INFO] TestAgent.server: cluster leadership acquired 30:13.368 [INFO] TestAgent.server: New leader elected: payload=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 30:13.373 [INFO] TestAgent.server: initializing acls 30:13.376 [INFO] TestAgent.server: initializing acls 30:13.389 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:13.389 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:13.389 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:13.389 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:13.416 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:13.430 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:13.430 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:13.430 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:13.431 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 30:13.431 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687.dc1 30:13.432 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:13.432 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:13.432 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 30:13.432 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687.dc1 30:13.432 [INFO] TestAgent.server: Updating LAN server: server="Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 (Addr: tcp/127.0.0.1:10013) (DC: dc1)" 30:13.432 [INFO] TestAgent.server: Updating LAN server: server="Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 (Addr: tcp/127.0.0.1:10013) (DC: dc1)" 30:13.432 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687.dc1 area=wan 30:13.432 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687.dc1 area=wan 30:13.452 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:13.493 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:13.493 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:13.493 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:13.493 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:13.493 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:13.493 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 30:13.493 [INFO] TestAgent.server: member joined, marking health alive: member=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 30:13.510 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 30:13.510 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-08c9f4e9-8b43-143e-a72d-5bfa3b682687 30:13.510 [INFO] TestAgent.server: federation state anti-entropy synced 30:13.656 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:13.666 [INFO] TestAgent: Synced node info 30:13.666 [DEBUG] TestAgent: Node info in sync 30:13.684 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:47854 latency=8.150391ms 30:13.700 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:47856 error="invalid Binding Rule: Selector is invalid: 1:4 (3): no match found, expected: "!=", ".", "==", "[", [ \t\r\n] or [a-zA-Z0-9_]" 30:13.700 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:47856 latency=1.098417ms 30:13.708 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:47858 latency=6.118298ms 30:13.737 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:47860 latency=24.029723ms 30:13.776 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:47866 latency=34.483055ms 30:13.781 [INFO] TestAgent: Requesting shutdown 30:13.781 [INFO] TestAgent.server: shutting down server 30:13.781 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:13.781 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:13.781 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:13.781 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:13.781 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:13.781 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:13.781 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:13.782 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:13.782 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:13.782 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:13.782 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:13.782 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:13.782 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:13.782 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:13.789 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:13.794Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:13.794Z [INFO] agent.router.manager: shutting down 30:13.794 [INFO] TestAgent: consul server down 30:13.794 [INFO] TestAgent: shutdown complete 30:13.794 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10008 network=tcp 30:13.794 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10008 network=udp 30:13.794 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:10009 network=tcp 30:14.298 [INFO] TestAgent: Waiting for endpoints to shut down 30:14.298 [INFO] TestAgent: Endpoints down --- PASS: TestBindingRuleCreateCommand (1.17s) --- PASS: TestBindingRuleCreateCommand/method_is_required (0.00s) --- PASS: TestBindingRuleCreateCommand/bind_type_required (0.00s) --- PASS: TestBindingRuleCreateCommand/bind_name_required (0.00s) --- PASS: TestBindingRuleCreateCommand/must_use_roughly_valid_selector (0.01s) --- PASS: TestBindingRuleCreateCommand/create_it_with_no_selector (0.01s) --- PASS: TestBindingRuleCreateCommand/create_it_with_a_match_selector (0.03s) --- PASS: TestBindingRuleCreateCommand/create_it_with_type_role (0.04s) PASS ok github.com/hashicorp/consul/command/acl/bindingrule/create 1.320s === RUN TestBindingRuleDeleteCommand_noTabs === PAUSE TestBindingRuleDeleteCommand_noTabs === RUN TestBindingRuleDeleteCommand === PAUSE TestBindingRuleDeleteCommand === CONT TestBindingRuleDeleteCommand_noTabs === CONT TestBindingRuleDeleteCommand --- PASS: TestBindingRuleDeleteCommand_noTabs (0.00s) [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestBindingRuleDeleteCommand/id_required === RUN TestBindingRuleDeleteCommand/delete_works === RUN TestBindingRuleDeleteCommand/delete_works_via_prefixes === RUN TestBindingRuleDeleteCommand/delete_fails_when_prefix_matches_more_than_one_rule 2021-10-05T16:30:13.659Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:13.676Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:13.715 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cf0e2de1-0d15-181c-2f02-6565348c3593 Address:127.0.0.1:21237}]" 30:13.715 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21237 [Follower]" leader= 30:13.716 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cf0e2de1-0d15-181c-2f02-6565348c3593.dc1 127.0.0.1 30:13.717 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cf0e2de1-0d15-181c-2f02-6565348c3593 127.0.0.1 2021-10-05T16:30:13.717Z [INFO] agent.router: Initializing LAN area manager 30:13.717 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=udp 30:13.718 [INFO] TestAgent.server: Adding LAN server: server="Node-cf0e2de1-0d15-181c-2f02-6565348c3593 (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 30:13.718 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cf0e2de1-0d15-181c-2f02-6565348c3593.dc1 area=wan 30:13.718 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=tcp 30:13.718 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21233 network=tcp 30:13.718 [INFO] TestAgent: started state syncer 30:13.718 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21238 network=tcp 30:13.768 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:13.781 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:13.781 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21237 [Candidate]" term=2 30:13.809 [DEBUG] TestAgent.server.raft: votes: needed=1 30:13.809 [DEBUG] TestAgent.server.raft: vote granted: from=cf0e2de1-0d15-181c-2f02-6565348c3593 term=2 tally=1 30:13.809 [INFO] TestAgent.server.raft: election won: tally=1 30:13.809 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21237 [Leader]" 30:13.809 [INFO] TestAgent.server: cluster leadership acquired 30:13.810 [INFO] TestAgent.server: New leader elected: payload=Node-cf0e2de1-0d15-181c-2f02-6565348c3593 30:13.821 [INFO] TestAgent.server: initializing acls 30:13.826 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:13.826 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:13.833 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:13.841 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:13.841 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:13.841 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:13.841 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-cf0e2de1-0d15-181c-2f02-6565348c3593 30:13.841 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-cf0e2de1-0d15-181c-2f02-6565348c3593.dc1 30:13.842 [INFO] TestAgent.server: Updating LAN server: server="Node-cf0e2de1-0d15-181c-2f02-6565348c3593 (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 30:13.842 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-cf0e2de1-0d15-181c-2f02-6565348c3593.dc1 area=wan 30:13.850 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:13.872 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:13.872 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:13.872 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:13.872 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:13.872 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:13.872 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cf0e2de1-0d15-181c-2f02-6565348c3593 30:13.872 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cf0e2de1-0d15-181c-2f02-6565348c3593 30:13.886 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cf0e2de1-0d15-181c-2f02-6565348c3593 30:13.904 [INFO] TestAgent.server: federation state anti-entropy synced 30:13.924 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:33480 latency=15.563058ms 30:13.929 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:33480 latency=4.20662ms 30:13.993 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/a6e578ce-3f71-b807-6b78-0151faa74335 from=127.0.0.1:33482 latency=16.873813ms 30:13.994 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/a6e578ce-3f71-b807-6b78-0151faa74335 from=127.0.0.1:33480 latency=118.016µs 30:14.001 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:33480 latency=6.780217ms 30:14.006 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:33484 latency=374.855µs 30:14.020 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/d0916522-c88f-6317-7ac9-193d7358719a from=127.0.0.1:33484 latency=13.287242ms 30:14.024 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/d0916522-c88f-6317-7ac9-193d7358719a from=127.0.0.1:33480 latency=100.757µs 30:14.025 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:33480 latency=208.798µs 30:14.044 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:33480 latency=18.996695ms 30:14.052 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:33480 latency=286.535µs 30:14.076 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:33480 latency=20.041429ms 30:14.078 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:33480 latency=304.187µs 30:14.084 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:33480 latency=5.465596ms 30:14.085 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:33480 latency=259.604µs 30:14.089 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:33480 latency=4.033705ms 30:14.090 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:33480 latency=283.307µs 30:14.091 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:33486 latency=225.22µs 30:14.092 [INFO] TestAgent: Requesting shutdown 30:14.092 [INFO] TestAgent.server: shutting down server 30:14.092 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:14.092 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:14.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:14.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:14.092 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:14.092 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:14.092 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:14.092 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:14.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:14.092 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:14.092 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:14.092 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:14.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:14.092 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:14.092 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:14.097 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:14.112Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:14.112Z [INFO] agent.router.manager: shutting down 30:14.112 [INFO] TestAgent: consul server down 30:14.112 [INFO] TestAgent: shutdown complete 30:14.112 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=tcp 30:14.112 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=udp 30:14.112 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21233 network=tcp 30:14.616 [INFO] TestAgent: Waiting for endpoints to shut down 30:14.616 [INFO] TestAgent: Endpoints down --- PASS: TestBindingRuleDeleteCommand (1.05s) --- PASS: TestBindingRuleDeleteCommand/id_required (0.00s) --- PASS: TestBindingRuleDeleteCommand/delete_works (0.07s) --- PASS: TestBindingRuleDeleteCommand/delete_works_via_prefixes (0.03s) --- PASS: TestBindingRuleDeleteCommand/delete_fails_when_prefix_matches_more_than_one_rule (0.07s) PASS ok github.com/hashicorp/consul/command/acl/bindingrule/delete 1.185s === RUN TestBindingRuleListCommand_noTabs === PAUSE TestBindingRuleListCommand_noTabs === RUN TestBindingRuleListCommand === PAUSE TestBindingRuleListCommand === CONT TestBindingRuleListCommand_noTabs --- PASS: TestBindingRuleListCommand_noTabs (0.00s) === CONT TestBindingRuleListCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestBindingRuleListCommand/normal === RUN TestBindingRuleListCommand/filter_by_method_1 === RUN TestBindingRuleListCommand/filter_by_method_2 === RUN TestBindingRuleListCommand/normal_json_formatted 2021-10-05T16:30:21.395Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:21.419Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:21.477 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 Address:127.0.0.1:15111}]" 30:21.478 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5.dc1 127.0.0.1 30:21.479 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 127.0.0.1 2021-10-05T16:30:21.479Z [INFO] agent.router: Initializing LAN area manager 30:21.479 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=udp 30:21.479 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15111 [Follower]" leader= 30:21.479 [INFO] TestAgent.server: Adding LAN server: server="Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 30:21.479 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5.dc1 area=wan 30:21.479 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=tcp 30:21.480 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15107 network=tcp 30:21.480 [INFO] TestAgent: started state syncer 30:21.480 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15112 network=tcp 30:21.532 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:21.532 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15111 [Candidate]" term=2 30:21.532 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:21.580 [DEBUG] TestAgent.server.raft: votes: needed=1 30:21.580 [DEBUG] TestAgent.server.raft: vote granted: from=d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 term=2 tally=1 30:21.580 [INFO] TestAgent.server.raft: election won: tally=1 30:21.580 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15111 [Leader]" 30:21.581 [INFO] TestAgent.server: cluster leadership acquired 30:21.581 [INFO] TestAgent.server: New leader elected: payload=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 30:21.624 [INFO] TestAgent.server: initializing acls 30:21.633 [INFO] TestAgent.server: initializing acls 30:21.700 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 30:21.708 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:21.708 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:21.712 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:21.712 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:21.756 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:21.760 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:21.786 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:21.786 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:21.786 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:21.786 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:21.786 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 30:21.786 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5.dc1 30:21.786 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5.dc1 area=wan 30:21.786 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:21.786 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 30:21.786 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5.dc1 30:21.788 [INFO] TestAgent.server: Updating LAN server: server="Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 30:21.788 [INFO] TestAgent.server: Updating LAN server: server="Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 30:21.788 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5.dc1 area=wan 30:21.815 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:21.854 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:21.854 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:21.854 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:21.854 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:21.854 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:21.854 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 30:21.854 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 30:21.861 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 30:21.861 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d6cff4f9-f94b-87dc-cd78-486bf0ea3bd5 30:21.866 [INFO] TestAgent.server: federation state anti-entropy synced 30:21.884 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:54478 latency=7.390046ms 30:21.889 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:54478 latency=4.015192ms 30:21.893 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=3.421085ms 30:21.897 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=3.461996ms 30:21.903 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=3.241398ms 30:21.912 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=3.425165ms 30:21.936 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=20.035926ms 30:21.957 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=16.593041ms 30:21.980 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=12.627269ms 30:22.002 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=14.153184ms 30:22.010 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=7.030642ms 30:22.028 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:54478 latency=15.993427ms 30:22.033 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:54480 latency=433.99µs 30:22.044 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test-1 from=127.0.0.1:54482 latency=380.402µs 30:22.047 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test-2 from=127.0.0.1:54484 latency=281.58µs 30:22.052 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:54486 latency=342.575µs 30:22.056 [INFO] TestAgent: Requesting shutdown 30:22.057 [INFO] TestAgent.server: shutting down server 30:22.057 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:22.057 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:22.057 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:22.057 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:22.057 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:22.057 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:22.057 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:22.057 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:22.057 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:22.057 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:22.057 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:22.057 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:22.057 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:22.057 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:22.068 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:22.069Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:22.069Z [INFO] agent.router.manager: shutting down 30:22.070 [INFO] TestAgent: consul server down 30:22.070 [INFO] TestAgent: shutdown complete 30:22.070 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=tcp 30:22.070 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=udp 30:22.070 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15107 network=tcp 30:22.572 [INFO] TestAgent: Waiting for endpoints to shut down 30:22.572 [INFO] TestAgent: Endpoints down --- PASS: TestBindingRuleListCommand (1.29s) --- PASS: TestBindingRuleListCommand/normal (0.01s) --- PASS: TestBindingRuleListCommand/filter_by_method_1 (0.01s) --- PASS: TestBindingRuleListCommand/filter_by_method_2 (0.00s) --- PASS: TestBindingRuleListCommand/normal_json_formatted (0.01s) PASS ok github.com/hashicorp/consul/command/acl/bindingrule/list 1.496s === RUN TestBindingRuleReadCommand_noTabs === PAUSE TestBindingRuleReadCommand_noTabs === RUN TestBindingRuleReadCommand === PAUSE TestBindingRuleReadCommand === CONT TestBindingRuleReadCommand_noTabs --- PASS: TestBindingRuleReadCommand_noTabs (0.00s) === CONT TestBindingRuleReadCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestBindingRuleReadCommand/id_required === RUN TestBindingRuleReadCommand/read_by_id_not_found === RUN TestBindingRuleReadCommand/read_by_id === RUN TestBindingRuleReadCommand/read_by_id_prefix === RUN TestBindingRuleReadCommand/read_by_id_json_formatted 2021-10-05T16:30:23.886Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:23.907Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:23.938 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d Address:127.0.0.1:12048}]" 30:23.939 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d.dc1 127.0.0.1 30:23.940 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:12048 [Follower]" leader= 30:23.940 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d 127.0.0.1 2021-10-05T16:30:23.940Z [INFO] agent.router: Initializing LAN area manager 30:23.948 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d.dc1 area=wan 30:23.954 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=udp 30:23.954 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=tcp 30:23.955 [INFO] TestAgent.server: Adding LAN server: server="Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d (Addr: tcp/127.0.0.1:12048) (DC: dc1)" 30:23.968 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:12044 network=tcp 30:23.968 [INFO] TestAgent: started state syncer 30:23.968 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:12049 network=tcp 30:24.003 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:24.003 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:12048 [Candidate]" term=2 30:24.004 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:24.033 [DEBUG] TestAgent.server.raft: votes: needed=1 30:24.033 [DEBUG] TestAgent.server.raft: vote granted: from=4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d term=2 tally=1 30:24.033 [INFO] TestAgent.server.raft: election won: tally=1 30:24.033 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:12048 [Leader]" 30:24.033 [INFO] TestAgent.server: cluster leadership acquired 30:24.034 [INFO] TestAgent.server: New leader elected: payload=Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d 30:24.042 [INFO] TestAgent.server: initializing acls 30:24.046 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:24.046 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:24.056 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 30:24.061 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:24.088 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:24.088 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:24.088 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:24.088 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d 30:24.088 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d.dc1 30:24.089 [INFO] TestAgent.server: Updating LAN server: server="Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d (Addr: tcp/127.0.0.1:12048) (DC: dc1)" 30:24.089 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d.dc1 area=wan 30:24.118 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:24.176 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:24.176 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:24.176 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:24.176 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:24.176 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:24.176 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d 30:24.176 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d 30:24.191 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4cb6c8a9-0313-5bf2-13a6-dc177b20ab8d 30:24.200 [INFO] TestAgent.server: federation state anti-entropy synced 30:24.297 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:56730 latency=7.976275ms 30:24.302 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/f1e38026-9913-633b-69fe-64939c8490b5 from=127.0.0.1:56732 latency=197.726µs 30:24.324 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:56730 latency=16.76499ms 30:24.337 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/56aba3bb-f296-59ce-6c0e-1e731ced4123 from=127.0.0.1:56734 latency=351.085µs 30:24.364 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:56730 latency=20.149253ms 30:24.370 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:56736 latency=1.216696ms 30:24.371 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/26d3310f-d6b6-17b4-4064-2fa64954231e from=127.0.0.1:56736 latency=365.225µs 30:24.394 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:56730 latency=13.839467ms 30:24.396 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/8038af23-46b9-f8b9-e20c-2a683cef8894 from=127.0.0.1:56738 latency=331.768µs 30:24.400 [INFO] TestAgent: Requesting shutdown 30:24.400 [INFO] TestAgent.server: shutting down server 30:24.400 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:24.400 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:24.400 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:24.400 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:24.400 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:24.400 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:24.400 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:24.400 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:24.400 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:24.400 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:24.400 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:24.400 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:24.400 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:24.400 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:24.404 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:24.412Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:24.412Z [INFO] agent.router.manager: shutting down 30:24.412 [INFO] TestAgent: consul server down 30:24.412 [INFO] TestAgent: shutdown complete 30:24.412 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=tcp 30:24.412 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=udp 30:24.412 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:12044 network=tcp 30:24.913 [INFO] TestAgent: Waiting for endpoints to shut down 30:24.913 [INFO] TestAgent: Endpoints down --- PASS: TestBindingRuleReadCommand (1.16s) --- PASS: TestBindingRuleReadCommand/id_required (0.00s) --- PASS: TestBindingRuleReadCommand/read_by_id_not_found (0.00s) --- PASS: TestBindingRuleReadCommand/read_by_id (0.04s) --- PASS: TestBindingRuleReadCommand/read_by_id_prefix (0.04s) --- PASS: TestBindingRuleReadCommand/read_by_id_json_formatted (0.02s) PASS ok github.com/hashicorp/consul/command/acl/bindingrule/read 1.402s === RUN TestBindingRuleUpdateCommand_noTabs === PAUSE TestBindingRuleUpdateCommand_noTabs === RUN TestBindingRuleUpdateCommand === PAUSE TestBindingRuleUpdateCommand === RUN TestBindingRuleUpdateCommand_noMerge === PAUSE TestBindingRuleUpdateCommand_noMerge === CONT TestBindingRuleUpdateCommand_noTabs --- PASS: TestBindingRuleUpdateCommand_noTabs (0.00s) === CONT TestBindingRuleUpdateCommand_noMerge [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestBindingRuleUpdateCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestBindingRuleUpdateCommand_noMerge/rule_id_required === RUN TestBindingRuleUpdateCommand_noMerge/rule_id_partial_matches_nothing === RUN TestBindingRuleUpdateCommand_noMerge/rule_id_exact_match_doesn't_exist === RUN TestBindingRuleUpdateCommand_noMerge/rule_id_partial_matches_multiple === RUN TestBindingRuleUpdateCommand/rule_id_required === RUN TestBindingRuleUpdateCommand/rule_id_partial_matches_nothing === RUN TestBindingRuleUpdateCommand/rule_id_exact_match_doesn't_exist === RUN TestBindingRuleUpdateCommand/rule_id_partial_matches_multiple === RUN TestBindingRuleUpdateCommand/must_use_roughly_valid_selector === RUN TestBindingRuleUpdateCommand_noMerge/must_use_roughly_valid_selector === RUN TestBindingRuleUpdateCommand/update_all_fields === RUN TestBindingRuleUpdateCommand_noMerge/update_all_fields === RUN TestBindingRuleUpdateCommand_noMerge/update_all_fields_-_partial === RUN TestBindingRuleUpdateCommand/update_all_fields_-_partial === RUN TestBindingRuleUpdateCommand/update_all_fields_but_description === RUN TestBindingRuleUpdateCommand/update_all_fields_but_bind_name === RUN TestBindingRuleUpdateCommand_noMerge/update_all_fields_but_description === RUN TestBindingRuleUpdateCommand/update_all_fields_but_must_exist === RUN TestBindingRuleUpdateCommand/update_all_fields_but_selector === RUN TestBindingRuleUpdateCommand_noMerge/missing_bind_name === RUN TestBindingRuleUpdateCommand_noMerge/update_all_fields_but_selector === RUN TestBindingRuleUpdateCommand/update_all_fields_clear_selector === RUN TestBindingRuleUpdateCommand/update_all_fields_json_formatted 2021-10-05T16:30:24.604Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:24.639Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:24.709 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 Address:127.0.0.1:28384}]" 30:24.709 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5.dc1 127.0.0.1 30:24.710 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 127.0.0.1 2021-10-05T16:30:24.710Z [INFO] agent.router: Initializing LAN area manager 30:24.710 [INFO] TestAgent: Started DNS server: address=127.0.0.1:28379 network=udp 30:24.710 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:28384 [Follower]" leader= 30:24.710 [INFO] TestAgent.server: Adding LAN server: server="Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 (Addr: tcp/127.0.0.1:28384) (DC: dc1)" 30:24.710 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5.dc1 area=wan 30:24.711 [INFO] TestAgent: Started DNS server: address=127.0.0.1:28379 network=tcp 30:24.711 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:28380 network=tcp 30:24.711 [INFO] TestAgent: started state syncer 30:24.711 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:28385 network=tcp 30:24.761 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:24.763 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:24.763 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:28384 [Candidate]" term=2 30:24.792 [DEBUG] TestAgent.server.raft: votes: needed=1 30:24.792 [DEBUG] TestAgent.server.raft: vote granted: from=bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 term=2 tally=1 30:24.792 [INFO] TestAgent.server.raft: election won: tally=1 30:24.792 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:28384 [Leader]" 30:24.792 [INFO] TestAgent.server: cluster leadership acquired 30:24.792 [INFO] TestAgent.server: New leader elected: payload=Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 30:24.815 [INFO] TestAgent.server: initializing acls 30:24.822 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:24.822 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:24.832 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:24.850 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:24.850 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:24.850 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:24.850 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 30:24.850 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5.dc1 30:24.850 [INFO] TestAgent.server: Updating LAN server: server="Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 (Addr: tcp/127.0.0.1:28384) (DC: dc1)" 30:24.868 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5.dc1 area=wan 30:24.873 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:24.914 [INFO] TestAgent: Synced node info 30:24.914 [DEBUG] TestAgent: Node info in sync 30:24.928 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:24.928 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:24.928 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:24.928 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:24.928 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:24.928 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 30:24.928 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 30:24.949 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bb2d0d30-8d0a-2514-e9ac-06e530c7a8f5 30:24.954 [INFO] TestAgent.server: federation state anti-entropy synced 30:25.042 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59370 latency=6.015074ms 30:25.047 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:59372 latency=697.23µs 30:25.048 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/b0ada926-c6cf-f8ef-4444-3e8e3bc3d009 from=127.0.0.1:59374 latency=263.122µs 30:25.056 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=5.819956ms 30:25.057 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:25.058 [DEBUG] TestAgent: Node info in sync 30:25.070 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=11.474555ms 30:25.072 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=191.426µs 30:25.078 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=6.138313ms 30:25.079 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=196.927µs 30:25.083 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=4.369477ms 30:25.085 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=1.185057ms 30:25.112 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=26.235022ms 30:25.113 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=175.651µs 30:25.128 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=13.826773ms 30:25.129 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=553.879µs 30:25.136 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=6.884576ms 30:25.141 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=528.34µs 30:25.146 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:59384 latency=625.086µs 30:25.163 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=15.95146ms 30:25.184 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/2ee27ebd-c93e-1e5d-3f5d-d8144b9d290a from=127.0.0.1:59388 latency=789.493µs 30:25.185 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/binding-rule/2ee27ebd-c93e-1e5d-3f5d-d8144b9d290a from=127.0.0.1:59388 error="invalid Binding Rule: Selector is invalid: 1:4 (3): no match found, expected: "!=", ".", "==", "[", [ \t\r\n] or [a-zA-Z0-9_]" 30:25.185 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/2ee27ebd-c93e-1e5d-3f5d-d8144b9d290a from=127.0.0.1:59388 latency=606.34µs 30:25.189 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59370 latency=3.349365ms 30:25.190 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/e562a0c1-c141-2d5e-33f9-fa910349454e from=127.0.0.1:59390 latency=200.002µs 30:25.194 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/e562a0c1-c141-2d5e-33f9-fa910349454e from=127.0.0.1:59390 latency=3.655474ms 30:25.195 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/e562a0c1-c141-2d5e-33f9-fa910349454e from=127.0.0.1:59370 latency=162.287µs 30:25.195 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:59370 latency=175.899µs 30:25.210 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/2ee27ebd-c93e-1e5d-3f5d-d8144b9d290a from=127.0.0.1:59370 latency=9.876838ms 30:25.224 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/7d933d55-73c9-1c68-98f1-8925c064960f from=127.0.0.1:59392 latency=13.624044ms 30:25.235 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/ab78337e-a7b5-ac49-74f0-5dc1651779ff from=127.0.0.1:59396 latency=9.909974ms 30:25.253 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/b3530851-6cf7-3056-a086-d3cd2d5fda73 from=127.0.0.1:59400 latency=17.032219ms 30:25.263 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/b493da55-bf3f-9685-346b-556b45e5d4e8 from=127.0.0.1:59410 latency=6.981449ms 30:25.273 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/e04290f4-7f02-740e-8f67-2da91f512c26 from=127.0.0.1:59414 latency=9.01894ms 30:25.288 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/e562a0c1-c141-2d5e-33f9-fa910349454e from=127.0.0.1:59418 latency=14.84386ms 30:25.295 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/f6869b15-6e57-12a9-f43d-b4e437d7f5ed from=127.0.0.1:59420 latency=5.420392ms 30:25.313 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59422 latency=17.211801ms 30:25.317 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:59426 latency=514.753µs 30:25.321 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/d28b1f25-59ac-f425-0c97-4c2a7d318851 from=127.0.0.1:59426 latency=205.01µs 30:25.327 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/d28b1f25-59ac-f425-0c97-4c2a7d318851 from=127.0.0.1:59426 latency=6.248126ms 30:25.328 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/d28b1f25-59ac-f425-0c97-4c2a7d318851 from=127.0.0.1:59422 latency=174.415µs 30:25.343 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59422 latency=15.070937ms 30:25.349 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/e4d52d11-e451-b865-8255-794fec4882e3 from=127.0.0.1:59432 latency=193.295µs 30:25.362 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/e4d52d11-e451-b865-8255-794fec4882e3 from=127.0.0.1:59432 latency=11.731674ms 30:25.363 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/e4d52d11-e451-b865-8255-794fec4882e3 from=127.0.0.1:59422 latency=434.48µs 30:25.370 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59422 latency=6.213212ms 30:25.372 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/08fcb160-4bcc-c539-eed5-8cedacbc165e from=127.0.0.1:59436 latency=526.312µs 30:25.377 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59422 latency=4.614234ms 30:25.378 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/be9045d2-6e3b-2e02-8288-25fb11b226c8 from=127.0.0.1:59438 latency=199.122µs 30:25.401 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/be9045d2-6e3b-2e02-8288-25fb11b226c8 from=127.0.0.1:59438 latency=21.984825ms 30:25.402 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/be9045d2-6e3b-2e02-8288-25fb11b226c8 from=127.0.0.1:59422 latency=201.865µs 30:25.402 [INFO] TestAgent: Requesting shutdown 30:25.402 [INFO] TestAgent.server: shutting down server 30:25.402 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:25.402 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:25.402 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:25.402 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:25.402 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:25.402 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:25.402 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:25.402 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:25.402 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:25.402 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:25.402 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:25.402 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:25.402 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:25.402 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:25.411 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:25.419Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:25.419Z [INFO] agent.router.manager: shutting down 30:25.420 [INFO] TestAgent: consul server down 30:25.420 [INFO] TestAgent: shutdown complete 30:25.420 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:28379 network=tcp 30:25.420 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:28379 network=udp 30:25.420 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:28380 network=tcp 30:25.924 [INFO] TestAgent: Waiting for endpoints to shut down 30:25.924 [INFO] TestAgent: Endpoints down --- PASS: TestBindingRuleUpdateCommand_noMerge (1.44s) --- PASS: TestBindingRuleUpdateCommand_noMerge/rule_id_required (0.00s) --- PASS: TestBindingRuleUpdateCommand_noMerge/rule_id_partial_matches_nothing (0.00s) --- PASS: TestBindingRuleUpdateCommand_noMerge/rule_id_exact_match_doesn't_exist (0.00s) --- PASS: TestBindingRuleUpdateCommand_noMerge/rule_id_partial_matches_multiple (0.10s) --- PASS: TestBindingRuleUpdateCommand_noMerge/must_use_roughly_valid_selector (0.04s) --- PASS: TestBindingRuleUpdateCommand_noMerge/update_all_fields (0.01s) --- PASS: TestBindingRuleUpdateCommand_noMerge/update_all_fields_-_partial (0.13s) --- PASS: TestBindingRuleUpdateCommand_noMerge/update_all_fields_but_description (0.04s) --- PASS: TestBindingRuleUpdateCommand_noMerge/missing_bind_name (0.01s) --- PASS: TestBindingRuleUpdateCommand_noMerge/update_all_fields_but_selector (0.03s) 2021-10-05T16:30:24.593Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:24.635Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:24.697 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7c92acb4-2343-67d6-f69a-3496710602db Address:127.0.0.1:28391}]" 30:24.698 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:28391 [Follower]" leader= 30:24.698 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7c92acb4-2343-67d6-f69a-3496710602db.dc1 127.0.0.1 30:24.699 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7c92acb4-2343-67d6-f69a-3496710602db 127.0.0.1 2021-10-05T16:30:24.699Z [INFO] agent.router: Initializing LAN area manager 30:24.699 [INFO] TestAgent: Started DNS server: address=127.0.0.1:28386 network=udp 30:24.699 [INFO] TestAgent.server: Adding LAN server: server="Node-7c92acb4-2343-67d6-f69a-3496710602db (Addr: tcp/127.0.0.1:28391) (DC: dc1)" 30:24.699 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7c92acb4-2343-67d6-f69a-3496710602db.dc1 area=wan 30:24.699 [INFO] TestAgent: Started DNS server: address=127.0.0.1:28386 network=tcp 30:24.700 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:28387 network=tcp 30:24.700 [INFO] TestAgent: started state syncer 30:24.700 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:28392 network=tcp 30:24.750 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:24.750 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:24.750 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:28391 [Candidate]" term=2 30:24.769 [DEBUG] TestAgent.server.raft: votes: needed=1 30:24.769 [DEBUG] TestAgent.server.raft: vote granted: from=7c92acb4-2343-67d6-f69a-3496710602db term=2 tally=1 30:24.769 [INFO] TestAgent.server.raft: election won: tally=1 30:24.769 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:28391 [Leader]" 30:24.769 [INFO] TestAgent.server: cluster leadership acquired 30:24.769 [INFO] TestAgent.server: New leader elected: payload=Node-7c92acb4-2343-67d6-f69a-3496710602db 30:24.777 [INFO] TestAgent.server: initializing acls 30:24.780 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:24.780 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:24.796 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:24.820 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:24.820 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:24.820 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:24.820 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7c92acb4-2343-67d6-f69a-3496710602db 30:24.820 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7c92acb4-2343-67d6-f69a-3496710602db.dc1 30:24.824 [INFO] TestAgent.server: Updating LAN server: server="Node-7c92acb4-2343-67d6-f69a-3496710602db (Addr: tcp/127.0.0.1:28391) (DC: dc1)" 30:24.824 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7c92acb4-2343-67d6-f69a-3496710602db.dc1 area=wan 30:24.840 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:24.897 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:24.897 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:24.897 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:24.897 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:24.897 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:24.898 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7c92acb4-2343-67d6-f69a-3496710602db 30:24.898 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7c92acb4-2343-67d6-f69a-3496710602db 30:24.907 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7c92acb4-2343-67d6-f69a-3496710602db 30:24.918 [INFO] TestAgent.server: federation state anti-entropy synced 30:25.058 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:44718 latency=25.910649ms 30:25.061 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:25.065 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:44726 latency=459.361µs 30:25.067 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/5f8510a5-3641-4918-ac7d-017dce47a123 from=127.0.0.1:44728 latency=231.03µs 30:25.071 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:44718 latency=460.986µs 30:25.076 [INFO] TestAgent: Synced node info 30:25.092 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44718 latency=20.290191ms 30:25.093 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:44718 latency=305.845µs 30:25.100 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44718 latency=6.206196ms 30:25.100 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:44718 latency=161.012µs 30:25.107 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44718 latency=6.610433ms 30:25.108 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:44718 latency=312.361µs 30:25.112 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44718 latency=4.110138ms 30:25.113 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:44718 latency=145.248µs 30:25.127 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44718 latency=12.841642ms 30:25.129 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:44718 latency=196.805µs 30:25.130 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:44730 latency=407.587µs 30:25.143 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44718 latency=11.651341ms 30:25.146 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/f2256858-ef26-74e8-5feb-f7f28a2eb192 from=127.0.0.1:44732 latency=174.377µs 30:25.149 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/acl/binding-rule/f2256858-ef26-74e8-5feb-f7f28a2eb192 from=127.0.0.1:44732 error="invalid Binding Rule: Selector is invalid: 1:4 (3): no match found, expected: "!=", ".", "==", "[", [ \t\r\n] or [a-zA-Z0-9_]" 30:25.159 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/f2256858-ef26-74e8-5feb-f7f28a2eb192 from=127.0.0.1:44732 latency=11.207596ms 30:25.172 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44718 latency=6.788453ms 30:25.180 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/9f01a34b-4405-a2eb-a733-be451b7656a0 from=127.0.0.1:44736 latency=484.847µs 30:25.196 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/9f01a34b-4405-a2eb-a733-be451b7656a0 from=127.0.0.1:44736 latency=11.834645ms 30:25.200 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/9f01a34b-4405-a2eb-a733-be451b7656a0 from=127.0.0.1:44718 latency=267.037µs 30:25.201 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules?authmethod=test from=127.0.0.1:44718 latency=251.189µs 30:25.215 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/47db3aa6-51e1-94c4-5815-93a5c999c8a9 from=127.0.0.1:44718 latency=13.406433ms 30:25.226 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/67e94764-f98b-6acd-f5b0-c5848f68450e from=127.0.0.1:44744 latency=10.971586ms 30:25.236 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/77e8e39f-42f3-3a81-ad4a-860ab736cc25 from=127.0.0.1:44748 latency=9.629279ms 30:25.241 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/9f01a34b-4405-a2eb-a733-be451b7656a0 from=127.0.0.1:44752 latency=3.848956ms 30:25.245 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/cce4f155-54d8-0f2d-3caf-6b81f8485f72 from=127.0.0.1:44754 latency=4.10427ms 30:25.250 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/ce451d69-6904-88e8-613f-e471c46887cb from=127.0.0.1:44756 latency=4.188141ms 30:25.257 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/binding-rule/f2256858-ef26-74e8-5feb-f7f28a2eb192 from=127.0.0.1:44758 latency=5.890792ms 30:25.269 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44762 latency=11.579412ms 30:25.273 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rules from=127.0.0.1:44766 latency=261.908µs 30:25.274 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/c5825ead-ee38-dc87-caa0-91f68ac13283 from=127.0.0.1:44766 latency=144.725µs 30:25.285 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/c5825ead-ee38-dc87-caa0-91f68ac13283 from=127.0.0.1:44766 latency=10.760639ms 30:25.286 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/c5825ead-ee38-dc87-caa0-91f68ac13283 from=127.0.0.1:44762 latency=578.861µs 30:25.295 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44762 latency=8.527847ms 30:25.298 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/83c2504c-e91f-734d-9f4e-4191eb0e2476 from=127.0.0.1:44774 latency=960.587µs 30:25.311 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/83c2504c-e91f-734d-9f4e-4191eb0e2476 from=127.0.0.1:44774 latency=10.784969ms 30:25.312 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/83c2504c-e91f-734d-9f4e-4191eb0e2476 from=127.0.0.1:44762 latency=243.098µs 30:25.317 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44762 latency=5.13489ms 30:25.321 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/026fd178-52e2-dbe8-7e09-9186f3babc41 from=127.0.0.1:44778 latency=417.289µs 30:25.329 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/026fd178-52e2-dbe8-7e09-9186f3babc41 from=127.0.0.1:44778 latency=7.307577ms 30:25.330 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/026fd178-52e2-dbe8-7e09-9186f3babc41 from=127.0.0.1:44762 latency=134.222µs 30:25.347 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44762 latency=16.447165ms 30:25.349 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/077f0d00-f179-75d9-7222-c45b2588a3e6 from=127.0.0.1:44780 latency=267.685µs 30:25.361 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/077f0d00-f179-75d9-7222-c45b2588a3e6 from=127.0.0.1:44780 latency=11.291762ms 30:25.363 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/077f0d00-f179-75d9-7222-c45b2588a3e6 from=127.0.0.1:44762 latency=563.732µs 30:25.368 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44762 latency=4.402718ms 30:25.369 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/e472f3e8-fb06-17d4-b9f7-c69ee5d68947 from=127.0.0.1:44784 latency=292.779µs 30:25.376 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/e472f3e8-fb06-17d4-b9f7-c69ee5d68947 from=127.0.0.1:44784 latency=5.45578ms 30:25.377 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/e472f3e8-fb06-17d4-b9f7-c69ee5d68947 from=127.0.0.1:44762 latency=466.591µs 30:25.398 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44762 latency=20.560918ms 30:25.400 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/9e15f94c-f944-5ebb-aa39-a50bafa639d7 from=127.0.0.1:44790 latency=397.648µs 30:25.408 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/9e15f94c-f944-5ebb-aa39-a50bafa639d7 from=127.0.0.1:44790 latency=6.101751ms 30:25.412 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/9e15f94c-f944-5ebb-aa39-a50bafa639d7 from=127.0.0.1:44762 latency=228.059µs 30:25.417 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:44762 latency=4.518735ms 30:25.418 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/5d7905a0-4a1e-c1ec-aedd-2c95012b07b1 from=127.0.0.1:44792 latency=463.695µs 30:25.424 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule/5d7905a0-4a1e-c1ec-aedd-2c95012b07b1 from=127.0.0.1:44792 latency=5.312862ms 30:25.425 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/binding-rule/5d7905a0-4a1e-c1ec-aedd-2c95012b07b1 from=127.0.0.1:44762 latency=152.36µs 30:25.425 [INFO] TestAgent: Requesting shutdown 30:25.425 [INFO] TestAgent.server: shutting down server 30:25.425 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:25.425 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:25.425 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:25.425 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:25.425 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:25.425 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:25.425 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:25.425 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:25.425 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:25.425 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:25.425 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:25.425 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:25.425 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:25.425 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:25.431 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:25.435Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:25.435Z [INFO] agent.router.manager: shutting down 30:25.435 [INFO] TestAgent: consul server down 30:25.435 [INFO] TestAgent: shutdown complete 30:25.435 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:28386 network=tcp 30:25.435 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:28386 network=udp 30:25.435 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:28387 network=tcp 30:25.936 [INFO] TestAgent: Waiting for endpoints to shut down 30:25.936 [INFO] TestAgent: Endpoints down --- PASS: TestBindingRuleUpdateCommand (1.46s) --- PASS: TestBindingRuleUpdateCommand/rule_id_required (0.00s) --- PASS: TestBindingRuleUpdateCommand/rule_id_partial_matches_nothing (0.00s) --- PASS: TestBindingRuleUpdateCommand/rule_id_exact_match_doesn't_exist (0.00s) --- PASS: TestBindingRuleUpdateCommand/rule_id_partial_matches_multiple (0.06s) --- PASS: TestBindingRuleUpdateCommand/must_use_roughly_valid_selector (0.03s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields (0.04s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields_-_partial (0.09s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields_but_description (0.03s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields_but_bind_name (0.02s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields_but_must_exist (0.03s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields_but_selector (0.01s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields_clear_selector (0.03s) --- PASS: TestBindingRuleUpdateCommand/update_all_fields_json_formatted (0.01s) PASS ok github.com/hashicorp/consul/command/acl/bindingrule/update 1.569s === RUN TestBootstrapCommand_noTabs === PAUSE TestBootstrapCommand_noTabs === RUN TestBootstrapCommand_Pretty === PAUSE TestBootstrapCommand_Pretty === RUN TestBootstrapCommand_JSON === PAUSE TestBootstrapCommand_JSON === CONT TestBootstrapCommand_noTabs --- PASS: TestBootstrapCommand_noTabs (0.00s) === CONT TestBootstrapCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestBootstrapCommand_Pretty [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:30:32.379Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:32.419Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:32.499 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:713fbd61-00e4-41f6-f815-2221e2c78bf1 Address:127.0.0.1:25328}]" 30:32.499 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-713fbd61-00e4-41f6-f815-2221e2c78bf1.dc1 127.0.0.1 30:32.500 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:25328 [Follower]" leader= 30:32.500 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 127.0.0.1 2021-10-05T16:30:32.500Z [INFO] agent.router: Initializing LAN area manager 30:32.500 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25323 network=udp 30:32.500 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-713fbd61-00e4-41f6-f815-2221e2c78bf1.dc1 area=wan 30:32.500 [INFO] TestAgent.server: Adding LAN server: server="Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 (Addr: tcp/127.0.0.1:25328) (DC: dc1)" 30:32.500 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25323 network=tcp 30:32.501 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:25324 network=tcp 30:32.501 [INFO] TestAgent: started state syncer 30:32.501 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:25329 network=tcp 30:32.552 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:32.556 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:32.556 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:25328 [Candidate]" term=2 30:32.600 [DEBUG] TestAgent.server.raft: votes: needed=1 30:32.600 [DEBUG] TestAgent.server.raft: vote granted: from=713fbd61-00e4-41f6-f815-2221e2c78bf1 term=2 tally=1 30:32.600 [INFO] TestAgent.server.raft: election won: tally=1 30:32.600 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:25328 [Leader]" 30:32.600 [INFO] TestAgent.server: cluster leadership acquired 30:32.600 [INFO] TestAgent.server: New leader elected: payload=Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 30:32.624 [INFO] TestAgent.server: initializing acls 30:32.640 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:32.652 [INFO] TestAgent.server: initializing acls 30:32.654 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:32.654 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:32.654 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:32.654 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 30:32.655 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-713fbd61-00e4-41f6-f815-2221e2c78bf1.dc1 30:32.655 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-713fbd61-00e4-41f6-f815-2221e2c78bf1.dc1 area=wan 30:32.655 [INFO] TestAgent.server: Updating LAN server: server="Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 (Addr: tcp/127.0.0.1:25328) (DC: dc1)" 30:32.740 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:32.740 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:32.740 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 30:32.740 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-713fbd61-00e4-41f6-f815-2221e2c78bf1.dc1 30:32.740 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-713fbd61-00e4-41f6-f815-2221e2c78bf1.dc1 area=wan 30:32.741 [INFO] TestAgent.server: Updating LAN server: server="Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 (Addr: tcp/127.0.0.1:25328) (DC: dc1)" 30:32.751 [INFO] TestAgent: Synced node info 30:32.751 [DEBUG] TestAgent: Node info in sync 30:32.779 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:32.840 [WARN] TestAgent.server.acl: failed to remove bootstrap file: error="remove /tmp/consul-test/TestBootstrapCommand_Pretty-TestAgent-agent851786111/acl-bootstrap-reset: no such file or directory" 30:32.864 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:32.864 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:32.864 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:32.864 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:32.864 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:32.864 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 30:32.864 [INFO] TestAgent.server: member joined, marking health alive: member=Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 30:32.868 [INFO] TestAgent.server.acl: ACL bootstrap completed 30:32.869 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/bootstrap from=127.0.0.1:36236 latency=28.644747ms 30:32.872 [INFO] TestAgent: Requesting shutdown 30:32.872 [INFO] TestAgent.server: shutting down server 30:32.872 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:32.872 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:32.872 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:32.872 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:32.872 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:32.872 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:32.872 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:32.873 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:32.873 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:32.873 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:32.873 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:32.873 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:32.876 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:32.877 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:32.877 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-713fbd61-00e4-41f6-f815-2221e2c78bf1 30:32.884 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:32.884Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:32.884Z [INFO] agent.router.manager: shutting down 30:32.884 [INFO] TestAgent: consul server down 30:32.884 [INFO] TestAgent: shutdown complete 30:32.884 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25323 network=tcp 30:32.884 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25323 network=udp 30:32.884 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:25324 network=tcp 30:33.385 [INFO] TestAgent: Waiting for endpoints to shut down 30:33.385 [INFO] TestAgent: Endpoints down --- PASS: TestBootstrapCommand_Pretty (1.14s) 2021-10-05T16:30:32.363Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:32.406Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:32.496 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a469b4ff-6f26-0dcf-4469-63624c27ec50 Address:127.0.0.1:25321}]" 30:32.497 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a469b4ff-6f26-0dcf-4469-63624c27ec50.dc1 127.0.0.1 30:32.497 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 127.0.0.1 2021-10-05T16:30:32.497Z [INFO] agent.router: Initializing LAN area manager 30:32.498 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=udp 30:32.498 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:25321 [Follower]" leader= 30:32.498 [INFO] TestAgent.server: Adding LAN server: server="Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 30:32.498 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50.dc1 area=wan 30:32.498 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=tcp 30:32.499 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:25317 network=tcp 30:32.499 [INFO] TestAgent: started state syncer 30:32.499 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:25322 network=tcp 30:32.552 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:32.564 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:32.564 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:25321 [Candidate]" term=2 30:32.604 [DEBUG] TestAgent.server.raft: votes: needed=1 30:32.604 [DEBUG] TestAgent.server.raft: vote granted: from=a469b4ff-6f26-0dcf-4469-63624c27ec50 term=2 tally=1 30:32.604 [INFO] TestAgent.server.raft: election won: tally=1 30:32.604 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:25321 [Leader]" 30:32.608 [INFO] TestAgent.server: cluster leadership acquired 30:32.608 [INFO] TestAgent.server: New leader elected: payload=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 30:32.632 [INFO] TestAgent.server: initializing acls 30:32.648 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:32.652 [INFO] TestAgent.server: initializing acls 30:32.700 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:32.700 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:32.700 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:32.701 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 30:32.701 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a469b4ff-6f26-0dcf-4469-63624c27ec50.dc1 30:32.701 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:32.701 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:32.702 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 30:32.702 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-a469b4ff-6f26-0dcf-4469-63624c27ec50.dc1 30:32.702 [INFO] TestAgent.server: Updating LAN server: server="Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 30:32.702 [INFO] TestAgent.server: Updating LAN server: server="Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 30:32.702 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50.dc1 area=wan 30:32.702 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50.dc1 area=wan 30:32.752 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:32.854 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:32.854 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:32.854 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:32.854 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:32.854 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:32.854 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 30:32.854 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 30:32.871 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 30:32.871 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a469b4ff-6f26-0dcf-4469-63624c27ec50 30:32.871 [INFO] TestAgent.server: federation state anti-entropy synced 30:32.895 [WARN] TestAgent.server.acl: failed to remove bootstrap file: error="remove /tmp/consul-test/TestBootstrapCommand_JSON-TestAgent-agent270794501/acl-bootstrap-reset: no such file or directory" 30:32.901 [INFO] TestAgent.server.acl: ACL bootstrap completed 30:32.916 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/bootstrap from=127.0.0.1:53080 latency=21.565666ms 30:32.924 [INFO] TestAgent: Requesting shutdown 30:32.924 [INFO] TestAgent.server: shutting down server 30:32.924 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:32.924 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:32.924 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:32.924 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:32.924 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:32.924 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:32.924 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:32.924 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:32.924 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:32.924 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:32.924 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:32.924 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:32.924 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:32.924 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:32.924 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:32.929 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:32.929Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:32.929Z [INFO] agent.router.manager: shutting down 30:32.929 [INFO] TestAgent: consul server down 30:32.929 [INFO] TestAgent: shutdown complete 30:32.929 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=tcp 30:32.929 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=udp 30:32.930 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:25317 network=tcp 30:33.432 [INFO] TestAgent: Waiting for endpoints to shut down 30:33.432 [INFO] TestAgent: Endpoints down --- PASS: TestBootstrapCommand_JSON (1.19s) PASS ok github.com/hashicorp/consul/command/acl/bootstrap 1.293s ? github.com/hashicorp/consul/command/acl/policy [no test files] === RUN TestPolicyCreateCommand_noTabs === PAUSE TestPolicyCreateCommand_noTabs === RUN TestPolicyCreateCommand === PAUSE TestPolicyCreateCommand === RUN TestPolicyCreateCommand_JSON === PAUSE TestPolicyCreateCommand_JSON === CONT TestPolicyCreateCommand_noTabs --- PASS: TestPolicyCreateCommand_noTabs (0.00s) === CONT TestPolicyCreateCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestPolicyCreateCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:30:35.502Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:35.534Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:35.577 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:958161b7-5fb2-05a7-e1cd-30d8ec148e9a Address:127.0.0.1:27363}]" 30:35.578 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a.dc1 127.0.0.1 30:35.579 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 127.0.0.1 2021-10-05T16:30:35.579Z [INFO] agent.router: Initializing LAN area manager 30:35.579 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=udp 30:35.579 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 30:35.579 [INFO] TestAgent.server: Adding LAN server: server="Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 30:35.579 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a.dc1 area=wan 30:35.579 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=tcp 30:35.580 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27359 network=tcp 30:35.580 [INFO] TestAgent: started state syncer 30:35.580 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27364 network=tcp 30:35.629 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:35.636 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:35.636 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 30:35.680 [DEBUG] TestAgent.server.raft: votes: needed=1 30:35.680 [DEBUG] TestAgent.server.raft: vote granted: from=958161b7-5fb2-05a7-e1cd-30d8ec148e9a term=2 tally=1 30:35.680 [INFO] TestAgent.server.raft: election won: tally=1 30:35.680 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 30:35.688 [INFO] TestAgent.server: cluster leadership acquired 30:35.688 [INFO] TestAgent.server: New leader elected: payload=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 30:35.696 [INFO] TestAgent.server: initializing acls 30:35.698 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:35.698 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:35.707 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:35.733 [INFO] TestAgent.server: initializing acls 30:35.733 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:35.738 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:35.738 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:35.738 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:35.738 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 30:35.738 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a.dc1 30:35.738 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a.dc1 area=wan 30:35.738 [INFO] TestAgent.server: Updating LAN server: server="Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 30:35.748 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:35.748 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:35.748 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 30:35.748 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a.dc1 30:35.748 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a.dc1 area=wan 30:35.748 [INFO] TestAgent.server: Updating LAN server: server="Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 30:35.767 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:35.809 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:35.809 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:35.809 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:35.809 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:35.809 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:35.809 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 30:35.809 [INFO] TestAgent.server: member joined, marking health alive: member=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 30:35.821 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 30:35.821 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-958161b7-5fb2-05a7-e1cd-30d8ec148e9a 30:35.840 [INFO] TestAgent.server: federation state anti-entropy synced 30:35.864 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:35.872 [INFO] TestAgent: Synced node info 30:35.872 [DEBUG] TestAgent: Node info in sync 30:35.881 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:57780 latency=4.947956ms 30:35.882 [INFO] TestAgent: Requesting shutdown 30:35.882 [INFO] TestAgent.server: shutting down server 30:35.882 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:35.882 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:35.882 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:35.882 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:35.882 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:35.882 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:35.882 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:35.882 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:35.882 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:35.882 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:35.882 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:35.882 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:35.882 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:35.882 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:35.888 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:35.900Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:35.900Z [INFO] agent.router.manager: shutting down 30:35.900 [INFO] TestAgent: consul server down 30:35.900 [INFO] TestAgent: shutdown complete 30:35.900 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 30:35.900 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 30:35.900 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 30:36.402 [INFO] TestAgent: Waiting for endpoints to shut down 30:36.402 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyCreateCommand_JSON (0.99s) 2021-10-05T16:30:35.500Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:35.516Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:35.566 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ca5126e7-f8c6-5030-daf9-05341adbb47a Address:127.0.0.1:27370}]" 30:35.567 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ca5126e7-f8c6-5030-daf9-05341adbb47a.dc1 127.0.0.1 30:35.567 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 127.0.0.1 2021-10-05T16:30:35.567Z [INFO] agent.router: Initializing LAN area manager 30:35.568 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=udp 30:35.568 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27370 [Follower]" leader= 30:35.568 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=tcp 30:35.568 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a.dc1 area=wan 30:35.568 [INFO] TestAgent.server: Adding LAN server: server="Node-ca5126e7-f8c6-5030-daf9-05341adbb47a (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 30:35.569 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27366 network=tcp 30:35.569 [INFO] TestAgent: started state syncer 30:35.569 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27371 network=tcp 30:35.619 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:35.627 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:35.627 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27370 [Candidate]" term=2 30:35.668 [DEBUG] TestAgent.server.raft: votes: needed=1 30:35.668 [DEBUG] TestAgent.server.raft: vote granted: from=ca5126e7-f8c6-5030-daf9-05341adbb47a term=2 tally=1 30:35.668 [INFO] TestAgent.server.raft: election won: tally=1 30:35.668 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27370 [Leader]" 30:35.668 [INFO] TestAgent.server: cluster leadership acquired 30:35.668 [INFO] TestAgent.server: New leader elected: payload=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 30:35.694 [INFO] TestAgent.server: initializing acls 30:35.705 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:35.705 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:35.719 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:35.719 [INFO] TestAgent.server: initializing acls 30:35.719 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:35.749 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:35.749 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:35.749 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:35.749 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:35.749 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 30:35.749 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ca5126e7-f8c6-5030-daf9-05341adbb47a.dc1 30:35.749 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a.dc1 area=wan 30:35.749 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:35.750 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 30:35.750 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ca5126e7-f8c6-5030-daf9-05341adbb47a.dc1 30:35.752 [INFO] TestAgent.server: Updating LAN server: server="Node-ca5126e7-f8c6-5030-daf9-05341adbb47a (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 30:35.752 [INFO] TestAgent.server: Updating LAN server: server="Node-ca5126e7-f8c6-5030-daf9-05341adbb47a (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 30:35.752 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a.dc1 area=wan 30:35.769 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:35.822 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:35.822 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:35.822 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:35.822 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:35.822 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:35.822 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 30:35.822 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 30:35.832 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 30:35.832 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ca5126e7-f8c6-5030-daf9-05341adbb47a 30:35.844 [INFO] TestAgent.server: federation state anti-entropy synced 30:35.922 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:34070 latency=9.190131ms 30:35.929 [INFO] TestAgent: Requesting shutdown 30:35.929 [INFO] TestAgent.server: shutting down server 30:35.929 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:35.929 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:35.929 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:35.929 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:35.929 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:35.929 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:35.929 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:35.929 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:35.929 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:35.929 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:35.929 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:35.929 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:35.929 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:35.929 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:35.929 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:35.934 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:35.939Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:35.939Z [INFO] agent.router.manager: shutting down 30:35.939 [INFO] TestAgent: consul server down 30:35.939 [INFO] TestAgent: shutdown complete 30:35.939 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=tcp 30:35.939 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=udp 30:35.939 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27366 network=tcp 30:36.440 [INFO] TestAgent: Waiting for endpoints to shut down 30:36.440 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyCreateCommand (1.02s) PASS ok github.com/hashicorp/consul/command/acl/policy/create 1.109s === RUN TestPolicyDeleteCommand_noTabs === PAUSE TestPolicyDeleteCommand_noTabs === RUN TestPolicyDeleteCommand === PAUSE TestPolicyDeleteCommand === CONT TestPolicyDeleteCommand_noTabs === CONT TestPolicyDeleteCommand --- PASS: TestPolicyDeleteCommand_noTabs (0.00s) [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:30:36.178Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:36.217Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:36.277 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c3e06800-3f79-def5-5985-bc54a77d26b5 Address:127.0.0.1:26342}]" 30:36.282 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c3e06800-3f79-def5-5985-bc54a77d26b5.dc1 127.0.0.1 30:36.283 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c3e06800-3f79-def5-5985-bc54a77d26b5 127.0.0.1 2021-10-05T16:30:36.283Z [INFO] agent.router: Initializing LAN area manager 30:36.287 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=tcp 30:36.287 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26342 [Follower]" leader= 30:36.288 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=udp 30:36.289 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26338 network=tcp 30:36.289 [INFO] TestAgent: started state syncer 30:36.294 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c3e06800-3f79-def5-5985-bc54a77d26b5.dc1 area=wan 30:36.300 [INFO] TestAgent.server: Adding LAN server: server="Node-c3e06800-3f79-def5-5985-bc54a77d26b5 (Addr: tcp/127.0.0.1:26342) (DC: dc1)" 30:36.300 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26343 network=tcp 30:36.332 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:36.332 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26342 [Candidate]" term=2 30:36.338 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:36.349 [DEBUG] TestAgent.server.raft: votes: needed=1 30:36.349 [DEBUG] TestAgent.server.raft: vote granted: from=c3e06800-3f79-def5-5985-bc54a77d26b5 term=2 tally=1 30:36.349 [INFO] TestAgent.server.raft: election won: tally=1 30:36.349 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26342 [Leader]" 30:36.349 [INFO] TestAgent.server: cluster leadership acquired 30:36.349 [INFO] TestAgent.server: New leader elected: payload=Node-c3e06800-3f79-def5-5985-bc54a77d26b5 30:36.356 [INFO] TestAgent.server: initializing acls 30:36.359 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:36.359 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:36.365 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:36.393 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:36.393 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:36.393 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:36.394 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c3e06800-3f79-def5-5985-bc54a77d26b5 30:36.394 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c3e06800-3f79-def5-5985-bc54a77d26b5.dc1 30:36.395 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c3e06800-3f79-def5-5985-bc54a77d26b5.dc1 area=wan 30:36.395 [INFO] TestAgent.server: Updating LAN server: server="Node-c3e06800-3f79-def5-5985-bc54a77d26b5 (Addr: tcp/127.0.0.1:26342) (DC: dc1)" 30:36.414 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:36.434 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:36.434 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:36.434 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:36.434 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:36.434 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:36.434 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c3e06800-3f79-def5-5985-bc54a77d26b5 30:36.434 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c3e06800-3f79-def5-5985-bc54a77d26b5 30:36.439 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c3e06800-3f79-def5-5985-bc54a77d26b5 30:36.449 [INFO] TestAgent.server: federation state anti-entropy synced 30:36.624 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:56692 latency=18.454724ms 30:36.653 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/policy/925ec0c1-82bd-1b54-9eb7-26ab889f8f36 from=127.0.0.1:56694 latency=23.416961ms 30:36.659 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/policy/925ec0c1-82bd-1b54-9eb7-26ab889f8f36 from=127.0.0.1:56692 error="ACL not found" 30:36.659 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy/925ec0c1-82bd-1b54-9eb7-26ab889f8f36 from=127.0.0.1:56692 latency=532.166µs 30:36.659 [INFO] TestAgent: Requesting shutdown 30:36.659 [INFO] TestAgent.server: shutting down server 30:36.659 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:36.659 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:36.659 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:36.659 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:36.659 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:36.659 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:36.659 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:36.660 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:36.660 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:36.660 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:36.660 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:36.660 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:36.660 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:36.660 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:36.660 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:36.668 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:36.683Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:36.683Z [INFO] agent.router.manager: shutting down 30:36.683 [INFO] TestAgent: consul server down 30:36.683 [INFO] TestAgent: shutdown complete 30:36.683 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=tcp 30:36.683 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=udp 30:36.683 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26338 network=tcp 30:37.184 [INFO] TestAgent: Waiting for endpoints to shut down 30:37.184 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyDeleteCommand (1.09s) PASS ok github.com/hashicorp/consul/command/acl/policy/delete 1.176s === RUN TestPolicyListCommand_noTabs === PAUSE TestPolicyListCommand_noTabs === RUN TestPolicyListCommand === PAUSE TestPolicyListCommand === RUN TestPolicyListCommand_JSON === PAUSE TestPolicyListCommand_JSON === CONT TestPolicyListCommand_noTabs === CONT TestPolicyListCommand_JSON === CONT TestPolicyListCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestPolicyListCommand_noTabs (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:30:42.702Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:42.728Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:42.768 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f97886b1-973f-8710-ecd1-86671a7921a7 Address:127.0.0.1:21244}]" 30:42.769 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f97886b1-973f-8710-ecd1-86671a7921a7.dc1 127.0.0.1 30:42.770 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f97886b1-973f-8710-ecd1-86671a7921a7 127.0.0.1 2021-10-05T16:30:42.770Z [INFO] agent.router: Initializing LAN area manager 30:42.770 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=udp 30:42.770 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21244 [Follower]" leader= 30:42.770 [INFO] TestAgent.server: Adding LAN server: server="Node-f97886b1-973f-8710-ecd1-86671a7921a7 (Addr: tcp/127.0.0.1:21244) (DC: dc1)" 30:42.770 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f97886b1-973f-8710-ecd1-86671a7921a7.dc1 area=wan 30:42.770 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=tcp 30:42.771 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21240 network=tcp 30:42.771 [INFO] TestAgent: started state syncer 30:42.771 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21245 network=tcp 30:42.820 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:42.828 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21244 [Candidate]" term=2 30:42.832 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:42.871 [DEBUG] TestAgent.server.raft: votes: needed=1 30:42.871 [DEBUG] TestAgent.server.raft: vote granted: from=f97886b1-973f-8710-ecd1-86671a7921a7 term=2 tally=1 30:42.871 [INFO] TestAgent.server.raft: election won: tally=1 30:42.871 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21244 [Leader]" 30:42.871 [INFO] TestAgent.server: cluster leadership acquired 30:42.871 [INFO] TestAgent.server: New leader elected: payload=Node-f97886b1-973f-8710-ecd1-86671a7921a7 30:42.878 [INFO] TestAgent.server: initializing acls 30:42.882 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:42.882 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:42.893 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:42.906 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:42.906 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:42.906 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:42.906 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f97886b1-973f-8710-ecd1-86671a7921a7 30:42.906 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f97886b1-973f-8710-ecd1-86671a7921a7.dc1 30:42.907 [INFO] TestAgent.server: Updating LAN server: server="Node-f97886b1-973f-8710-ecd1-86671a7921a7 (Addr: tcp/127.0.0.1:21244) (DC: dc1)" 30:42.907 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f97886b1-973f-8710-ecd1-86671a7921a7.dc1 area=wan 30:42.921 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:42.945 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:42.945 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:42.945 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:42.945 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:42.945 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:42.945 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f97886b1-973f-8710-ecd1-86671a7921a7 30:42.945 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f97886b1-973f-8710-ecd1-86671a7921a7 30:42.977 [INFO] TestAgent.server: federation state anti-entropy synced 30:42.977 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f97886b1-973f-8710-ecd1-86671a7921a7 30:43.048 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:35066 latency=23.961507ms 30:43.072 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:35066 latency=8.652331ms 30:43.077 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:35066 latency=3.595951ms 30:43.096 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:35066 latency=16.04471ms 30:43.103 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:35066 latency=4.544007ms 30:43.104 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policies from=127.0.0.1:35070 latency=329.293µs 30:43.105 [INFO] TestAgent: Requesting shutdown 30:43.105 [INFO] TestAgent.server: shutting down server 30:43.105 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:43.105 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:43.105 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:43.105 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:43.105 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:43.105 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:43.105 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:43.105 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:43.105 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:43.105 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:43.105 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:43.105 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:43.105 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:43.105 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:43.105 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:43.111 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:43.116Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:43.116Z [INFO] agent.router.manager: shutting down 30:43.116 [INFO] TestAgent: consul server down 30:43.116 [INFO] TestAgent: shutdown complete 30:43.116 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=tcp 30:43.116 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=udp 30:43.116 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21240 network=tcp 30:43.620 [INFO] TestAgent: Waiting for endpoints to shut down 30:43.620 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyListCommand_JSON (1.03s) 2021-10-05T16:30:42.698Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:42.731Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:42.804 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3bbc2ecf-123a-2e17-5736-c0df9dc9a281 Address:127.0.0.1:21237}]" 30:42.804 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281.dc1 127.0.0.1 30:42.805 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 127.0.0.1 2021-10-05T16:30:42.805Z [INFO] agent.router: Initializing LAN area manager 30:42.805 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=udp 30:42.805 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21237 [Follower]" leader= 30:42.806 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281.dc1 area=wan 30:42.806 [INFO] TestAgent.server: Adding LAN server: server="Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 30:42.806 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=tcp 30:42.806 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21233 network=tcp 30:42.806 [INFO] TestAgent: started state syncer 30:42.806 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21238 network=tcp 30:42.844 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:42.844 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21237 [Candidate]" term=2 30:42.856 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:42.879 [DEBUG] TestAgent.server.raft: votes: needed=1 30:42.879 [DEBUG] TestAgent.server.raft: vote granted: from=3bbc2ecf-123a-2e17-5736-c0df9dc9a281 term=2 tally=1 30:42.879 [INFO] TestAgent.server.raft: election won: tally=1 30:42.879 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21237 [Leader]" 30:42.879 [INFO] TestAgent.server: cluster leadership acquired 30:42.879 [INFO] TestAgent.server: New leader elected: payload=Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 30:42.888 [INFO] TestAgent.server: initializing acls 30:42.893 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:42.894 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:42.903 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:42.916 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:42.916 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:42.916 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:42.917 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 30:42.917 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281.dc1 30:42.917 [INFO] TestAgent.server: Updating LAN server: server="Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 30:42.917 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281.dc1 area=wan 30:42.944 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:43.000 [INFO] TestAgent: Synced node info 30:43.020 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:43.020 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:43.020 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:43.020 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:43.020 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:43.020 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 30:43.020 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 30:43.060 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:33668 latency=27.782694ms 30:43.060 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3bbc2ecf-123a-2e17-5736-c0df9dc9a281 30:43.063 [INFO] TestAgent.server: federation state anti-entropy synced 30:43.092 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:33668 latency=16.382351ms 30:43.102 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:33668 latency=5.819018ms 30:43.107 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:33668 latency=5.076616ms 30:43.120 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:33668 latency=10.932441ms 30:43.129 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policies from=127.0.0.1:33672 latency=643.25µs 30:43.129 [INFO] TestAgent: Requesting shutdown 30:43.129 [INFO] TestAgent.server: shutting down server 30:43.129 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:43.129 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:43.129 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:43.129 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:43.129 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:43.129 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:43.129 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:43.130 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:43.130 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:43.130 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:43.130 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:43.130 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:43.130 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:43.130 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:43.140 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:43.145Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:43.145Z [INFO] agent.router.manager: shutting down 30:43.145 [INFO] TestAgent: consul server down 30:43.145 [INFO] TestAgent: shutdown complete 30:43.145 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=tcp 30:43.145 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=udp 30:43.145 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21233 network=tcp 30:43.646 [INFO] TestAgent: Waiting for endpoints to shut down 30:43.646 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyListCommand (1.05s) PASS ok github.com/hashicorp/consul/command/acl/policy/list 1.153s === RUN TestPolicyReadCommand_noTabs === PAUSE TestPolicyReadCommand_noTabs === RUN TestPolicyReadCommand === PAUSE TestPolicyReadCommand === RUN TestPolicyReadCommand_JSON === PAUSE TestPolicyReadCommand_JSON === CONT TestPolicyReadCommand_noTabs --- PASS: TestPolicyReadCommand_noTabs (0.00s) === CONT TestPolicyReadCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestPolicyReadCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:30:46.759Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:46.864Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:46.922 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:78b9685c-2057-f66f-b123-22d2f8d4ea48 Address:127.0.0.1:15118}]" 30:46.923 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15118 [Follower]" leader= 30:46.923 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-78b9685c-2057-f66f-b123-22d2f8d4ea48.dc1 127.0.0.1 30:46.924 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 127.0.0.1 2021-10-05T16:30:46.924Z [INFO] agent.router: Initializing LAN area manager 30:46.924 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=udp 30:46.924 [INFO] TestAgent.server: Adding LAN server: server="Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 (Addr: tcp/127.0.0.1:15118) (DC: dc1)" 30:46.924 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48.dc1 area=wan 30:46.925 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=tcp 30:46.925 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15114 network=tcp 30:46.925 [INFO] TestAgent: started state syncer 30:46.925 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15119 network=tcp 30:46.976 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:46.979 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:46.979 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15118 [Candidate]" term=2 30:47.015 [DEBUG] TestAgent.server.raft: votes: needed=1 30:47.015 [DEBUG] TestAgent.server.raft: vote granted: from=78b9685c-2057-f66f-b123-22d2f8d4ea48 term=2 tally=1 30:47.015 [INFO] TestAgent.server.raft: election won: tally=1 30:47.015 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15118 [Leader]" 30:47.016 [INFO] TestAgent.server: cluster leadership acquired 30:47.016 [INFO] TestAgent.server: New leader elected: payload=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 30:47.028 [INFO] TestAgent.server: initializing acls 30:47.036 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:47.036 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.048 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:47.078 [INFO] TestAgent.server: initializing acls 30:47.078 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.078 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:47.078 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:47.078 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:47.078 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 30:47.078 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-78b9685c-2057-f66f-b123-22d2f8d4ea48.dc1 30:47.079 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48.dc1 area=wan 30:47.079 [INFO] TestAgent.server: Updating LAN server: server="Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 (Addr: tcp/127.0.0.1:15118) (DC: dc1)" 30:47.079 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:47.080 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 30:47.080 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-78b9685c-2057-f66f-b123-22d2f8d4ea48.dc1 30:47.081 [INFO] TestAgent.server: Updating LAN server: server="Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 (Addr: tcp/127.0.0.1:15118) (DC: dc1)" 30:47.081 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48.dc1 area=wan 30:47.107 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:47.139 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:47.139 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:47.139 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:47.139 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:47.139 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:47.139 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 30:47.139 [INFO] TestAgent.server: member joined, marking health alive: member=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 30:47.161 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 30:47.162 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-78b9685c-2057-f66f-b123-22d2f8d4ea48 30:47.176 [INFO] TestAgent.server: federation state anti-entropy synced 30:47.211 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:47.222 [INFO] TestAgent: Synced node info 30:47.222 [DEBUG] TestAgent: Node info in sync 30:47.223 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:36660 latency=18.622516ms 30:47.225 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy/500d66e7-03b6-4b0e-0030-4c57358e2cd1 from=127.0.0.1:36662 latency=462.745µs 30:47.225 [INFO] TestAgent: Requesting shutdown 30:47.225 [INFO] TestAgent.server: shutting down server 30:47.225 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:47.225 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:47.225 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:47.225 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:47.225 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:47.225 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:47.225 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:47.225 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:47.225 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:47.225 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:47.225 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:47.225 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:47.225 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:47.225 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:47.237 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:47.245Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:47.245Z [INFO] agent.router.manager: shutting down 30:47.245 [INFO] TestAgent: consul server down 30:47.245 [INFO] TestAgent: shutdown complete 30:47.245 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=tcp 30:47.245 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=udp 30:47.245 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15114 network=tcp 30:47.748 [INFO] TestAgent: Waiting for endpoints to shut down 30:47.748 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyReadCommand (1.12s) 2021-10-05T16:30:46.770Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:46.849Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:46.929 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:606e5d9c-cadf-8e6f-4e99-9644882902c2 Address:127.0.0.1:15111}]" 30:46.930 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-606e5d9c-cadf-8e6f-4e99-9644882902c2.dc1 127.0.0.1 30:46.931 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 127.0.0.1 2021-10-05T16:30:46.931Z [INFO] agent.router: Initializing LAN area manager 30:46.931 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=udp 30:46.931 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15111 [Follower]" leader= 30:46.931 [INFO] TestAgent.server: Adding LAN server: server="Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 30:46.931 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-606e5d9c-cadf-8e6f-4e99-9644882902c2.dc1 area=wan 30:46.932 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=tcp 30:46.932 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15107 network=tcp 30:46.932 [INFO] TestAgent: started state syncer 30:46.932 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15112 network=tcp 30:46.976 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:46.976 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15111 [Candidate]" term=2 30:46.982 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:46.988 [DEBUG] TestAgent.server.raft: votes: needed=1 30:46.988 [DEBUG] TestAgent.server.raft: vote granted: from=606e5d9c-cadf-8e6f-4e99-9644882902c2 term=2 tally=1 30:46.988 [INFO] TestAgent.server.raft: election won: tally=1 30:46.988 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15111 [Leader]" 30:46.988 [INFO] TestAgent.server: cluster leadership acquired 30:46.988 [INFO] TestAgent.server: New leader elected: payload=Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 30:46.995 [INFO] TestAgent.server: initializing acls 30:46.999 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:46.999 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.016 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:47.040 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:47.040 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:47.040 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:47.040 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 30:47.040 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-606e5d9c-cadf-8e6f-4e99-9644882902c2.dc1 30:47.041 [INFO] TestAgent.server: Updating LAN server: server="Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 30:47.041 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-606e5d9c-cadf-8e6f-4e99-9644882902c2.dc1 area=wan 30:47.068 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:47.118 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:47.118 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:47.118 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:47.118 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:47.118 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:47.118 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 30:47.118 [INFO] TestAgent.server: member joined, marking health alive: member=Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 30:47.129 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-606e5d9c-cadf-8e6f-4e99-9644882902c2 30:47.142 [INFO] TestAgent.server: federation state anti-entropy synced 30:47.339 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:54702 latency=24.121809ms 30:47.340 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:47.345 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy/db3a47ad-fe57-a786-a892-61f70aedb0b6 from=127.0.0.1:54726 latency=1.83276ms 30:47.347 [INFO] TestAgent: Requesting shutdown 30:47.347 [INFO] TestAgent.server: shutting down server 30:47.347 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:47.347 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:47.347 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:47.347 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:47.347 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:47.347 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:47.347 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:47.347 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:47.347 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:47.347 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:47.347 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:47.347 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:47.347 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:47.347 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:47.356 [INFO] TestAgent: Synced node info 30:47.356 [DEBUG] TestAgent: Node info in sync 30:47.360 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:47.367Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:47.367Z [INFO] agent.router.manager: shutting down 30:47.367 [INFO] TestAgent: consul server down 30:47.367 [INFO] TestAgent: shutdown complete 30:47.367 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=tcp 30:47.367 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=udp 30:47.367 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15107 network=tcp 30:47.868 [INFO] TestAgent: Waiting for endpoints to shut down 30:47.868 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyReadCommand_JSON (1.24s) PASS ok github.com/hashicorp/consul/command/acl/policy/read 1.558s === RUN TestPolicyUpdateCommand_noTabs === PAUSE TestPolicyUpdateCommand_noTabs === RUN TestPolicyUpdateCommand === PAUSE TestPolicyUpdateCommand === RUN TestPolicyUpdateCommand_JSON === PAUSE TestPolicyUpdateCommand_JSON === CONT TestPolicyUpdateCommand_noTabs --- PASS: TestPolicyUpdateCommand_noTabs (0.00s) === CONT TestPolicyUpdateCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestPolicyUpdateCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:30:47.376Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:47.390Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:47.431 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:15390cc5-6d80-e55e-4abe-730910848a06 Address:127.0.0.1:31447}]" 30:47.432 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:31447 [Follower]" leader= 30:47.432 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-15390cc5-6d80-e55e-4abe-730910848a06.dc1 127.0.0.1 30:47.433 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-15390cc5-6d80-e55e-4abe-730910848a06 127.0.0.1 2021-10-05T16:30:47.433Z [INFO] agent.router: Initializing LAN area manager 30:47.433 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31442 network=udp 30:47.433 [INFO] TestAgent.server: Adding LAN server: server="Node-15390cc5-6d80-e55e-4abe-730910848a06 (Addr: tcp/127.0.0.1:31447) (DC: dc1)" 30:47.433 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-15390cc5-6d80-e55e-4abe-730910848a06.dc1 area=wan 30:47.433 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31442 network=tcp 30:47.434 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:31443 network=tcp 30:47.434 [INFO] TestAgent: started state syncer 30:47.434 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:31448 network=tcp 30:47.484 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:47.500 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:47.500 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:31447 [Candidate]" term=2 30:47.552 [DEBUG] TestAgent.server.raft: votes: needed=1 30:47.552 [DEBUG] TestAgent.server.raft: vote granted: from=15390cc5-6d80-e55e-4abe-730910848a06 term=2 tally=1 30:47.552 [INFO] TestAgent.server.raft: election won: tally=1 30:47.552 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:31447 [Leader]" 30:47.554 [INFO] TestAgent.server: cluster leadership acquired 30:47.554 [INFO] TestAgent.server: New leader elected: payload=Node-15390cc5-6d80-e55e-4abe-730910848a06 30:47.568 [INFO] TestAgent.server: initializing acls 30:47.573 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:47.573 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.580 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:47.584 [INFO] TestAgent.server: initializing acls 30:47.584 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.603 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:47.603 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:47.603 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:47.603 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:47.604 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-15390cc5-6d80-e55e-4abe-730910848a06 30:47.604 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:47.604 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-15390cc5-6d80-e55e-4abe-730910848a06.dc1 30:47.604 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-15390cc5-6d80-e55e-4abe-730910848a06.dc1 area=wan 30:47.604 [INFO] TestAgent.server: Updating LAN server: server="Node-15390cc5-6d80-e55e-4abe-730910848a06 (Addr: tcp/127.0.0.1:31447) (DC: dc1)" 30:47.604 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-15390cc5-6d80-e55e-4abe-730910848a06 30:47.604 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-15390cc5-6d80-e55e-4abe-730910848a06.dc1 30:47.604 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-15390cc5-6d80-e55e-4abe-730910848a06.dc1 area=wan 30:47.605 [INFO] TestAgent.server: Updating LAN server: server="Node-15390cc5-6d80-e55e-4abe-730910848a06 (Addr: tcp/127.0.0.1:31447) (DC: dc1)" 30:47.622 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:47.624 [INFO] TestAgent: Synced node info 30:47.666 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:47.666 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:47.666 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:47.666 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:47.666 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:47.666 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-15390cc5-6d80-e55e-4abe-730910848a06 30:47.666 [INFO] TestAgent.server: member joined, marking health alive: member=Node-15390cc5-6d80-e55e-4abe-730910848a06 30:47.672 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-15390cc5-6d80-e55e-4abe-730910848a06 30:47.672 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-15390cc5-6d80-e55e-4abe-730910848a06 30:47.680 [INFO] TestAgent.server: federation state anti-entropy synced 30:47.707 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:44854 latency=22.95165ms 30:47.711 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy/75a24662-586b-6d6f-747e-05b540f11bcc from=127.0.0.1:44978 latency=742.106µs 30:47.715 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy/75a24662-586b-6d6f-747e-05b540f11bcc from=127.0.0.1:44978 latency=3.90454ms 30:47.716 [INFO] TestAgent: Requesting shutdown 30:47.716 [INFO] TestAgent.server: shutting down server 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:47.716 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:47.716 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:47.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:47.716 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:47.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:47.716 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:47.716 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:47.716 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:47.720 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:47.727Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:47.727Z [INFO] agent.router.manager: shutting down 30:47.728 [INFO] TestAgent: consul server down 30:47.728 [INFO] TestAgent: shutdown complete 30:47.728 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31442 network=tcp 30:47.728 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31442 network=udp 30:47.728 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:31443 network=tcp 30:48.232 [INFO] TestAgent: Waiting for endpoints to shut down 30:48.232 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyUpdateCommand_JSON (0.94s) 2021-10-05T16:30:47.406Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:47.442Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:47.507 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:529bd658-c5cc-b098-ffa7-0e97d9594c64 Address:127.0.0.1:31454}]" 30:47.508 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:31454 [Follower]" leader= 30:47.508 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-529bd658-c5cc-b098-ffa7-0e97d9594c64.dc1 127.0.0.1 30:47.517 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 127.0.0.1 2021-10-05T16:30:47.517Z [INFO] agent.router: Initializing LAN area manager 30:47.523 [INFO] TestAgent.server: Adding LAN server: server="Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 (Addr: tcp/127.0.0.1:31454) (DC: dc1)" 30:47.523 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64.dc1 area=wan 30:47.523 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31449 network=tcp 30:47.524 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31449 network=udp 30:47.525 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:31450 network=tcp 30:47.525 [INFO] TestAgent: started state syncer 30:47.527 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:31455 network=tcp 30:47.560 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:47.560 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:31454 [Candidate]" term=2 30:47.572 [DEBUG] TestAgent.server.raft: votes: needed=1 30:47.572 [DEBUG] TestAgent.server.raft: vote granted: from=529bd658-c5cc-b098-ffa7-0e97d9594c64 term=2 tally=1 30:47.572 [INFO] TestAgent.server.raft: election won: tally=1 30:47.572 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:31454 [Leader]" 30:47.572 [INFO] TestAgent.server: cluster leadership acquired 30:47.572 [INFO] TestAgent.server: New leader elected: payload=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 30:47.574 [INFO] TestAgent.server: initializing acls 30:47.580 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:47.580 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.580 [INFO] TestAgent.server: initializing acls 30:47.580 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:47.590 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:47.605 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:47.610 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:47.610 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:47.610 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:47.610 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:47.611 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 30:47.611 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-529bd658-c5cc-b098-ffa7-0e97d9594c64.dc1 30:47.611 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64.dc1 area=wan 30:47.611 [INFO] TestAgent.server: Updating LAN server: server="Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 (Addr: tcp/127.0.0.1:31454) (DC: dc1)" 30:47.615 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:47.615 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 30:47.615 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-529bd658-c5cc-b098-ffa7-0e97d9594c64.dc1 30:47.615 [INFO] TestAgent.server: Updating LAN server: server="Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 (Addr: tcp/127.0.0.1:31454) (DC: dc1)" 30:47.615 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64.dc1 area=wan 30:47.630 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:47.652 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:47.652 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:47.652 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:47.652 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:47.652 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:47.652 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 30:47.652 [INFO] TestAgent.server: member joined, marking health alive: member=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 30:47.671 [INFO] TestAgent.server: federation state anti-entropy synced 30:47.679 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 30:47.679 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-529bd658-c5cc-b098-ffa7-0e97d9594c64 30:47.697 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:45112 latency=6.123685ms 30:47.703 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/policy/a4e976f7-b181-14fc-d78a-311e4024c148 from=127.0.0.1:45126 latency=1.96208ms 30:47.714 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy/a4e976f7-b181-14fc-d78a-311e4024c148 from=127.0.0.1:45126 latency=4.728397ms 30:47.716 [INFO] TestAgent: Requesting shutdown 30:47.716 [INFO] TestAgent.server: shutting down server 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:47.716 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:47.716 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:47.717 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:47.717 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:47.717 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 30:47.717 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:47.717 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:47.717 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:47.717 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:47.717 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:47.728 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:47.735Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:47.735Z [INFO] agent.router.manager: shutting down 30:47.736 [INFO] TestAgent: consul server down 30:47.736 [INFO] TestAgent: shutdown complete 30:47.736 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31449 network=tcp 30:47.736 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31449 network=udp 30:47.736 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:31450 network=tcp 30:48.240 [INFO] TestAgent: Waiting for endpoints to shut down 30:48.240 [INFO] TestAgent: Endpoints down --- PASS: TestPolicyUpdateCommand (0.95s) PASS ok github.com/hashicorp/consul/command/acl/policy/update 1.094s === RUN TestFormatRole === RUN TestFormatRole/basic === RUN TestFormatRole/basic/pretty-meta === RUN TestFormatRole/basic/json === RUN TestFormatRole/basic/pretty === RUN TestFormatRole/complex === RUN TestFormatRole/complex/json === RUN TestFormatRole/complex/pretty === RUN TestFormatRole/complex/pretty-meta --- PASS: TestFormatRole (0.00s) --- PASS: TestFormatRole/basic (0.00s) --- PASS: TestFormatRole/basic/pretty-meta (0.00s) --- PASS: TestFormatRole/basic/json (0.00s) --- PASS: TestFormatRole/basic/pretty (0.00s) --- PASS: TestFormatRole/complex (0.00s) --- PASS: TestFormatRole/complex/json (0.00s) --- PASS: TestFormatRole/complex/pretty (0.00s) --- PASS: TestFormatRole/complex/pretty-meta (0.00s) === RUN TestFormatTokenList === RUN TestFormatTokenList/basic === RUN TestFormatTokenList/basic/pretty-meta === RUN TestFormatTokenList/basic/json === RUN TestFormatTokenList/basic/pretty === RUN TestFormatTokenList/complex === RUN TestFormatTokenList/complex/pretty === RUN TestFormatTokenList/complex/pretty-meta === RUN TestFormatTokenList/complex/json --- PASS: TestFormatTokenList (0.00s) --- PASS: TestFormatTokenList/basic (0.00s) --- PASS: TestFormatTokenList/basic/pretty-meta (0.00s) --- PASS: TestFormatTokenList/basic/json (0.00s) --- PASS: TestFormatTokenList/basic/pretty (0.00s) --- PASS: TestFormatTokenList/complex (0.00s) --- PASS: TestFormatTokenList/complex/pretty (0.00s) --- PASS: TestFormatTokenList/complex/pretty-meta (0.00s) --- PASS: TestFormatTokenList/complex/json (0.00s) PASS ok github.com/hashicorp/consul/command/acl/role 0.016s === RUN TestRoleCreateCommand_noTabs === PAUSE TestRoleCreateCommand_noTabs === RUN TestRoleCreateCommand_Pretty === PAUSE TestRoleCreateCommand_Pretty === RUN TestRoleCreateCommand_JSON === PAUSE TestRoleCreateCommand_JSON === CONT TestRoleCreateCommand_noTabs === CONT TestRoleCreateCommand_JSON --- PASS: TestRoleCreateCommand_noTabs (0.00s) [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestRoleCreateCommand_Pretty [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestRoleCreateCommand_Pretty/policy-name === RUN TestRoleCreateCommand_Pretty/policy-id === RUN TestRoleCreateCommand_Pretty/service-identity === RUN TestRoleCreateCommand_Pretty/dc-scoped-service-identity === RUN TestRoleCreateCommand_Pretty/node-identity 2021-10-05T16:30:55.174Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:55.190Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:55.264 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:daba52f5-46f6-7489-a6ed-c22fb04ae340 Address:127.0.0.1:14090}]" 30:55.264 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14090 [Follower]" leader= 30:55.265 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-daba52f5-46f6-7489-a6ed-c22fb04ae340.dc1 127.0.0.1 30:55.266 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 127.0.0.1 2021-10-05T16:30:55.266Z [INFO] agent.router: Initializing LAN area manager 30:55.267 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=udp 30:55.267 [INFO] TestAgent.server: Adding LAN server: server="Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 30:55.267 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-daba52f5-46f6-7489-a6ed-c22fb04ae340.dc1 area=wan 30:55.267 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=tcp 30:55.268 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14086 network=tcp 30:55.268 [INFO] TestAgent: started state syncer 30:55.268 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14091 network=tcp 30:55.311 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:55.311 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14090 [Candidate]" term=2 30:55.318 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:55.326 [DEBUG] TestAgent.server.raft: votes: needed=1 30:55.326 [DEBUG] TestAgent.server.raft: vote granted: from=daba52f5-46f6-7489-a6ed-c22fb04ae340 term=2 tally=1 30:55.326 [INFO] TestAgent.server.raft: election won: tally=1 30:55.326 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14090 [Leader]" 30:55.326 [INFO] TestAgent.server: cluster leadership acquired 30:55.326 [INFO] TestAgent.server: New leader elected: payload=Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 30:55.343 [INFO] TestAgent.server: initializing acls 30:55.349 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:55.349 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:55.357 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:55.380 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:55.380 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:55.380 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:55.380 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 30:55.380 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-daba52f5-46f6-7489-a6ed-c22fb04ae340.dc1 30:55.384 [INFO] TestAgent.server: Updating LAN server: server="Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 30:55.384 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-daba52f5-46f6-7489-a6ed-c22fb04ae340.dc1 area=wan 30:55.444 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:55.508 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:55.508 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:55.508 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:55.508 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:55.508 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:55.508 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 30:55.508 [INFO] TestAgent.server: member joined, marking health alive: member=Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 30:55.528 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-daba52f5-46f6-7489-a6ed-c22fb04ae340 30:55.544 [INFO] TestAgent.server: federation state anti-entropy synced 30:55.544 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:55.576 [INFO] TestAgent: Synced node info 30:55.584 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:44442 latency=19.644555ms 30:55.622 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:44446 latency=29.8008ms 30:55.640 [INFO] TestAgent: Requesting shutdown 30:55.648 [INFO] TestAgent.server: shutting down server 30:55.648 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:55.648 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:55.648 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:55.648 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:55.648 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:55.648 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:55.648 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:55.648 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:55.648 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:55.648 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:55.648 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:55.648 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:55.648 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:55.648 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:55.657 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:55.658Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:55.658Z [INFO] agent.router.manager: shutting down 30:55.658 [INFO] TestAgent: consul server down 30:55.658 [INFO] TestAgent: shutdown complete 30:55.658 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=tcp 30:55.658 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=udp 30:55.658 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14086 network=tcp 30:56.159 [INFO] TestAgent: Waiting for endpoints to shut down 30:56.159 [INFO] TestAgent: Endpoints down --- PASS: TestRoleCreateCommand_JSON (1.05s) 2021-10-05T16:30:55.179Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:55.197Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:55.221 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c924c50f-b9e1-80ac-c2a1-4db36f32a8ba Address:127.0.0.1:14097}]" 30:55.221 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba.dc1 127.0.0.1 30:55.222 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba 127.0.0.1 2021-10-05T16:30:55.222Z [INFO] agent.router: Initializing LAN area manager 30:55.228 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14097 [Follower]" leader= 30:55.233 [INFO] TestAgent.server: Adding LAN server: server="Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 30:55.233 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba.dc1 area=wan 30:55.234 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=udp 30:55.234 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=tcp 30:55.235 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14093 network=tcp 30:55.235 [INFO] TestAgent: started state syncer 30:55.240 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14098 network=tcp 30:55.284 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:55.296 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:55.296 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14097 [Candidate]" term=2 30:55.305 [DEBUG] TestAgent.server.raft: votes: needed=1 30:55.305 [DEBUG] TestAgent.server.raft: vote granted: from=c924c50f-b9e1-80ac-c2a1-4db36f32a8ba term=2 tally=1 30:55.305 [INFO] TestAgent.server.raft: election won: tally=1 30:55.305 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14097 [Leader]" 30:55.305 [INFO] TestAgent.server: cluster leadership acquired 30:55.305 [INFO] TestAgent.server: New leader elected: payload=Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba 30:55.311 [INFO] TestAgent.server: initializing acls 30:55.316 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:55.316 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:55.325 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:55.345 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:55.345 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:55.345 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:55.345 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba 30:55.345 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba.dc1 30:55.345 [INFO] TestAgent.server: Updating LAN server: server="Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 30:55.345 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba.dc1 area=wan 30:55.360 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:55.416 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:55.416 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:55.416 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:55.416 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:55.416 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:55.416 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba 30:55.416 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba 30:55.481 [INFO] TestAgent.server: federation state anti-entropy synced 30:55.484 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c924c50f-b9e1-80ac-c2a1-4db36f32a8ba 30:55.524 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:55.544 [INFO] TestAgent: Synced node info 30:55.544 [DEBUG] TestAgent: Node info in sync 30:55.587 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:59764 latency=13.849974ms 30:55.597 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:59768 latency=5.348469ms 30:55.647 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:59770 latency=28.869241ms 30:55.667 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:59772 latency=14.258961ms 30:55.674 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:59774 latency=4.979876ms 30:55.696 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:59776 latency=12.694039ms 30:55.699 [INFO] TestAgent: Requesting shutdown 30:55.699 [INFO] TestAgent.server: shutting down server 30:55.699 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:55.699 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:55.699 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:55.699 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:55.699 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:55.699 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:55.699 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:55.699 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:55.699 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:55.699 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:55.699 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:55.699 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:55.699 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:55.699 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:55.704 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:55.705Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:55.705Z [INFO] agent.router.manager: shutting down 30:55.705 [INFO] TestAgent: consul server down 30:55.705 [INFO] TestAgent: shutdown complete 30:55.705 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=tcp 30:55.705 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=udp 30:55.705 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14093 network=tcp 30:56.206 [INFO] TestAgent: Waiting for endpoints to shut down 30:56.206 [INFO] TestAgent: Endpoints down --- PASS: TestRoleCreateCommand_Pretty (1.09s) --- PASS: TestRoleCreateCommand_Pretty/policy-name (0.01s) --- PASS: TestRoleCreateCommand_Pretty/policy-id (0.05s) --- PASS: TestRoleCreateCommand_Pretty/service-identity (0.02s) --- PASS: TestRoleCreateCommand_Pretty/dc-scoped-service-identity (0.01s) --- PASS: TestRoleCreateCommand_Pretty/node-identity (0.02s) PASS ok github.com/hashicorp/consul/command/acl/role/create 1.466s === RUN TestRoleDeleteCommand_noTabs === PAUSE TestRoleDeleteCommand_noTabs === RUN TestRoleDeleteCommand === PAUSE TestRoleDeleteCommand === CONT TestRoleDeleteCommand_noTabs === CONT TestRoleDeleteCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestRoleDeleteCommand_noTabs (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestRoleDeleteCommand/id_or_name_required === RUN TestRoleDeleteCommand/delete_works === RUN TestRoleDeleteCommand/delete_works_via_prefixes 2021-10-05T16:30:57.261Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:57.293Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:57.327 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c Address:127.0.0.1:13069}]" 30:57.328 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:13069 [Follower]" leader= 30:57.328 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c.dc1 127.0.0.1 30:57.329 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c 127.0.0.1 2021-10-05T16:30:57.330Z [INFO] agent.router: Initializing LAN area manager 30:57.331 [INFO] TestAgent: Started DNS server: address=127.0.0.1:13064 network=udp 30:57.331 [INFO] TestAgent.server: Adding LAN server: server="Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c (Addr: tcp/127.0.0.1:13069) (DC: dc1)" 30:57.331 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c.dc1 area=wan 30:57.331 [INFO] TestAgent: Started DNS server: address=127.0.0.1:13064 network=tcp 30:57.340 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:13065 network=tcp 30:57.340 [INFO] TestAgent: started state syncer 30:57.340 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:13070 network=tcp 30:57.382 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:57.386 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:57.386 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:13069 [Candidate]" term=2 30:57.405 [DEBUG] TestAgent.server.raft: votes: needed=1 30:57.405 [DEBUG] TestAgent.server.raft: vote granted: from=30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c term=2 tally=1 30:57.405 [INFO] TestAgent.server.raft: election won: tally=1 30:57.405 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:13069 [Leader]" 30:57.407 [INFO] TestAgent.server: cluster leadership acquired 30:57.407 [INFO] TestAgent.server: New leader elected: payload=Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c 30:57.411 [INFO] TestAgent.server: initializing acls 30:57.414 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:57.414 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:57.421 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:57.440 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:57.440 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:57.440 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:57.440 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c 30:57.440 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c.dc1 30:57.441 [INFO] TestAgent.server: Updating LAN server: server="Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c (Addr: tcp/127.0.0.1:13069) (DC: dc1)" 30:57.441 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c.dc1 area=wan 30:57.469 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:57.489 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:57.489 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:57.489 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:57.489 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:57.489 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:57.489 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c 30:57.489 [INFO] TestAgent.server: member joined, marking health alive: member=Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c 30:57.505 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-30c3e1cc-6695-5a4b-64f2-e9e1f05b5a5c 30:57.512 [INFO] TestAgent.server: federation state anti-entropy synced 30:57.637 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:57.646 [INFO] TestAgent: Synced node info 30:57.646 [DEBUG] TestAgent: Node info in sync 30:57.667 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:49752 latency=5.536997ms 30:57.693 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/role/726dbf5c-e9bf-b83c-f02b-0ac1a7d6fd3b from=127.0.0.1:49754 latency=16.776006ms 30:57.706 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/726dbf5c-e9bf-b83c-f02b-0ac1a7d6fd3b from=127.0.0.1:49752 latency=141.154µs 30:57.715 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:49752 latency=8.59584ms 30:57.721 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/roles from=127.0.0.1:49756 latency=1.495966ms 30:57.737 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/role/91aad024-4c16-206b-09d6-7b00d9a79813 from=127.0.0.1:49756 latency=12.519653ms 30:57.740 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/91aad024-4c16-206b-09d6-7b00d9a79813 from=127.0.0.1:49752 latency=119.228µs 30:57.744 [INFO] TestAgent: Requesting shutdown 30:57.744 [INFO] TestAgent.server: shutting down server 30:57.744 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:57.744 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:57.744 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:57.744 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:57.744 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:57.744 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:57.744 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:57.744 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:57.744 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:57.744 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:57.744 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:57.744 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:57.744 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:57.744 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:57.752 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:57.762Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:57.762Z [INFO] agent.router.manager: shutting down 30:57.762 [INFO] TestAgent: consul server down 30:57.762 [INFO] TestAgent: shutdown complete 30:57.762 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:13064 network=tcp 30:57.762 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:13064 network=udp 30:57.762 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:13065 network=tcp 30:58.264 [INFO] TestAgent: Waiting for endpoints to shut down 30:58.264 [INFO] TestAgent: Endpoints down --- PASS: TestRoleDeleteCommand (1.12s) --- PASS: TestRoleDeleteCommand/id_or_name_required (0.00s) --- PASS: TestRoleDeleteCommand/delete_works (0.05s) --- PASS: TestRoleDeleteCommand/delete_works_via_prefixes (0.04s) PASS ok github.com/hashicorp/consul/command/acl/role/delete 1.223s === RUN TestRoleListCommand_noTabs === PAUSE TestRoleListCommand_noTabs === RUN TestRoleListCommand === PAUSE TestRoleListCommand === RUN TestRoleListCommand_JSON === PAUSE TestRoleListCommand_JSON === CONT TestRoleListCommand_noTabs --- PASS: TestRoleListCommand_noTabs (0.00s) === CONT TestRoleListCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestRoleListCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:30:58.527Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:58.551Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:58.599 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc Address:127.0.0.1:18174}]" 30:58.600 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc.dc1 127.0.0.1 30:58.601 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 127.0.0.1 2021-10-05T16:30:58.601Z [INFO] agent.router: Initializing LAN area manager 30:58.601 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18169 network=udp 30:58.601 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:18174 [Follower]" leader= 30:58.601 [INFO] TestAgent.server: Adding LAN server: server="Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc (Addr: tcp/127.0.0.1:18174) (DC: dc1)" 30:58.602 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc.dc1 area=wan 30:58.602 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18169 network=tcp 30:58.602 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:18170 network=tcp 30:58.602 [INFO] TestAgent: started state syncer 30:58.603 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:18175 network=tcp 30:58.652 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:58.663 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:58.663 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:18174 [Candidate]" term=2 30:58.682 [DEBUG] TestAgent.server.raft: votes: needed=1 30:58.682 [DEBUG] TestAgent.server.raft: vote granted: from=04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc term=2 tally=1 30:58.682 [INFO] TestAgent.server.raft: election won: tally=1 30:58.682 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:18174 [Leader]" 30:58.684 [INFO] TestAgent.server: cluster leadership acquired 30:58.684 [INFO] TestAgent.server: New leader elected: payload=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 30:58.716 [INFO] TestAgent.server: initializing acls 30:58.725 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:58.725 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:58.737 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:58.752 [INFO] TestAgent.server: initializing acls 30:58.752 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:58.760 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:58.760 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:58.760 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:58.760 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 30:58.761 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc.dc1 30:58.761 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc.dc1 area=wan 30:58.761 [INFO] TestAgent.server: Updating LAN server: server="Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc (Addr: tcp/127.0.0.1:18174) (DC: dc1)" 30:58.776 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:58.776 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 30:58.776 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 30:58.776 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc.dc1 30:58.776 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc.dc1 area=wan 30:58.777 [INFO] TestAgent.server: Updating LAN server: server="Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc (Addr: tcp/127.0.0.1:18174) (DC: dc1)" 30:58.793 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:58.815 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:58.815 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:58.815 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:58.815 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:58.815 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:58.815 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 30:58.815 [INFO] TestAgent.server: member joined, marking health alive: member=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 30:58.819 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 30:58.819 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-04ca7e8d-166b-dce4-13bc-fbbbd8ed40cc 30:58.832 [INFO] TestAgent.server: federation state anti-entropy synced 30:58.908 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 30:58.913 [INFO] TestAgent: Synced node info 30:59.007 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:52894 latency=14.269454ms 30:59.011 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:52894 latency=4.134212ms 30:59.024 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:52894 latency=11.578257ms 30:59.048 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:52894 latency=22.685379ms 30:59.055 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:52894 latency=6.445151ms 30:59.056 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/roles from=127.0.0.1:52898 latency=344.891µs 30:59.057 [INFO] TestAgent: Requesting shutdown 30:59.057 [INFO] TestAgent.server: shutting down server 30:59.057 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:59.057 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:59.057 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:59.057 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:59.057 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:59.057 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:59.057 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:59.057 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:59.057 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:59.057 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:59.057 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:59.057 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:59.057 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:59.057 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:59.061 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:59.067Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:59.067Z [INFO] agent.router.manager: shutting down 30:59.067 [INFO] TestAgent: consul server down 30:59.067 [INFO] TestAgent: shutdown complete 30:59.067 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18169 network=tcp 30:59.067 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18169 network=udp 30:59.067 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:18170 network=tcp 30:59.568 [INFO] TestAgent: Waiting for endpoints to shut down 30:59.568 [INFO] TestAgent: Endpoints down --- PASS: TestRoleListCommand_JSON (1.12s) 2021-10-05T16:30:58.530Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:30:58.557Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 30:58.608 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:06be176c-995a-975e-9b39-45eb14b5be0e Address:127.0.0.1:18181}]" 30:58.609 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-06be176c-995a-975e-9b39-45eb14b5be0e.dc1 127.0.0.1 30:58.609 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-06be176c-995a-975e-9b39-45eb14b5be0e 127.0.0.1 2021-10-05T16:30:58.609Z [INFO] agent.router: Initializing LAN area manager 30:58.610 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18176 network=udp 30:58.610 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:18181 [Follower]" leader= 30:58.610 [INFO] TestAgent.server: Adding LAN server: server="Node-06be176c-995a-975e-9b39-45eb14b5be0e (Addr: tcp/127.0.0.1:18181) (DC: dc1)" 30:58.610 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-06be176c-995a-975e-9b39-45eb14b5be0e.dc1 area=wan 30:58.610 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18176 network=tcp 30:58.611 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:18177 network=tcp 30:58.611 [INFO] TestAgent: started state syncer 30:58.611 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:18182 network=tcp 30:58.652 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 30:58.652 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:18181 [Candidate]" term=2 30:58.663 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 30:58.681 [DEBUG] TestAgent.server.raft: votes: needed=1 30:58.681 [DEBUG] TestAgent.server.raft: vote granted: from=06be176c-995a-975e-9b39-45eb14b5be0e term=2 tally=1 30:58.681 [INFO] TestAgent.server.raft: election won: tally=1 30:58.681 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:18181 [Leader]" 30:58.684 [INFO] TestAgent.server: cluster leadership acquired 30:58.684 [INFO] TestAgent.server: New leader elected: payload=Node-06be176c-995a-975e-9b39-45eb14b5be0e 30:58.696 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 30:58.712 [INFO] TestAgent.server: initializing acls 30:58.713 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 30:58.716 [INFO] TestAgent.server: Created ACL 'global-management' policy 30:58.716 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 30:58.725 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 30:58.750 [INFO] TestAgent.server: Created ACL anonymous token from configuration 30:58.750 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 30:58.750 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 30:58.750 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-06be176c-995a-975e-9b39-45eb14b5be0e 30:58.750 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-06be176c-995a-975e-9b39-45eb14b5be0e.dc1 30:58.751 [INFO] TestAgent.server: Updating LAN server: server="Node-06be176c-995a-975e-9b39-45eb14b5be0e (Addr: tcp/127.0.0.1:18181) (DC: dc1)" 30:58.751 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-06be176c-995a-975e-9b39-45eb14b5be0e.dc1 area=wan 30:58.767 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 30:58.788 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 30:58.788 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 30:58.788 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 30:58.788 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 30:58.788 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 30:58.788 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-06be176c-995a-975e-9b39-45eb14b5be0e 30:58.788 [INFO] TestAgent.server: member joined, marking health alive: member=Node-06be176c-995a-975e-9b39-45eb14b5be0e 30:58.796 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-06be176c-995a-975e-9b39-45eb14b5be0e 30:58.812 [INFO] TestAgent.server: federation state anti-entropy synced 30:59.054 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:58464 latency=9.538874ms 30:59.072 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:58464 latency=16.180514ms 30:59.089 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:58464 latency=15.596078ms 30:59.112 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:58464 latency=16.329688ms 30:59.136 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:58464 latency=16.375233ms 30:59.141 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/roles from=127.0.0.1:58468 latency=736.828µs 30:59.142 [INFO] TestAgent: Requesting shutdown 30:59.142 [INFO] TestAgent.server: shutting down server 30:59.142 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 30:59.142 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 30:59.142 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 30:59.142 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 30:59.142 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 30:59.142 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 30:59.142 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 30:59.142 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 30:59.142 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 30:59.142 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 30:59.142 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 30:59.142 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 30:59.142 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 30:59.142 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 30:59.149 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:30:59.160Z [INFO] agent.router.manager: shutting down 2021-10-05T16:30:59.160Z [INFO] agent.router.manager: shutting down 30:59.160 [INFO] TestAgent: consul server down 30:59.160 [INFO] TestAgent: shutdown complete 30:59.160 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18176 network=tcp 30:59.160 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18176 network=udp 30:59.160 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:18177 network=tcp 30:59.664 [INFO] TestAgent: Waiting for endpoints to shut down 30:59.664 [INFO] TestAgent: Endpoints down --- PASS: TestRoleListCommand (1.21s) PASS ok github.com/hashicorp/consul/command/acl/role/list 1.323s === RUN TestRoleReadCommand_noTabs === PAUSE TestRoleReadCommand_noTabs === RUN TestRoleReadCommand === PAUSE TestRoleReadCommand === RUN TestRoleReadCommand_JSON === PAUSE TestRoleReadCommand_JSON === CONT TestRoleReadCommand_noTabs === CONT TestRoleReadCommand_JSON --- PASS: TestRoleReadCommand_noTabs (0.00s) === CONT TestRoleReadCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestRoleReadCommand_JSON/read_by_id === RUN TestRoleReadCommand/id_or_name_required === RUN TestRoleReadCommand/read_by_id_not_found === RUN TestRoleReadCommand/read_by_name_not_found === RUN TestRoleReadCommand/read_by_id === RUN TestRoleReadCommand/read_by_id_prefix === RUN TestRoleReadCommand/read_by_name 2021-10-05T16:31:05.702Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:05.762Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:05.793 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cd4d2b2d-6dd0-066c-474e-6cf07e5559ea Address:127.0.0.1:19202}]" 31:05.794 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea.dc1 127.0.0.1 31:05.795 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19202 [Follower]" leader= 31:05.795 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 127.0.0.1 2021-10-05T16:31:05.795Z [INFO] agent.router: Initializing LAN area manager 31:05.796 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea.dc1 area=wan 31:05.796 [INFO] TestAgent.server: Adding LAN server: server="Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea (Addr: tcp/127.0.0.1:19202) (DC: dc1)" 31:05.796 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19197 network=udp 31:05.796 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19197 network=tcp 31:05.797 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19198 network=tcp 31:05.797 [INFO] TestAgent: started state syncer 31:05.797 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19203 network=tcp 31:05.848 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:05.864 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:05.864 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19202 [Candidate]" term=2 31:05.912 [DEBUG] TestAgent.server.raft: votes: needed=1 31:05.912 [DEBUG] TestAgent.server.raft: vote granted: from=cd4d2b2d-6dd0-066c-474e-6cf07e5559ea term=2 tally=1 31:05.912 [INFO] TestAgent.server.raft: election won: tally=1 31:05.912 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19202 [Leader]" 31:05.912 [INFO] TestAgent.server: cluster leadership acquired 31:05.912 [INFO] TestAgent.server: New leader elected: payload=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 31:05.929 [INFO] TestAgent.server: initializing acls 31:05.935 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:05.935 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:05.943 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:05.948 [INFO] TestAgent.server: initializing acls 31:05.948 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:05.953 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:05.953 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:05.953 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:05.954 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 31:05.954 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea.dc1 31:05.954 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea.dc1 area=wan 31:05.954 [INFO] TestAgent.server: Updating LAN server: server="Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea (Addr: tcp/127.0.0.1:19202) (DC: dc1)" 31:05.961 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:05.961 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:05.962 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 31:05.962 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea.dc1 31:05.962 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea.dc1 area=wan 31:05.962 [INFO] TestAgent.server: Updating LAN server: server="Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea (Addr: tcp/127.0.0.1:19202) (DC: dc1)" 31:05.986 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:06.029 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:06.029 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:06.029 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:06.029 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:06.029 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:06.029 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 31:06.029 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 31:06.035 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 31:06.035 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cd4d2b2d-6dd0-066c-474e-6cf07e5559ea 31:06.041 [INFO] TestAgent.server: federation state anti-entropy synced 31:06.100 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:06.132 [INFO] TestAgent: Synced node info 31:06.141 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:52614 latency=52.883144ms 31:06.173 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/0b982207-7fc0-ac6e-c880-ece8988cda75 from=127.0.0.1:52626 latency=260.967µs 31:06.176 [INFO] TestAgent: Requesting shutdown 31:06.176 [INFO] TestAgent.server: shutting down server 31:06.176 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:06.176 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:06.176 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:06.176 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:06.176 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:06.176 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:06.176 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:06.176 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:06.176 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:06.176 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:06.176 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:06.176 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:06.176 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:06.176 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:06.185 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:06.196Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:06.196Z [INFO] agent.router.manager: shutting down 31:06.196 [INFO] TestAgent: consul server down 31:06.196 [INFO] TestAgent: shutdown complete 31:06.196 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19197 network=tcp 31:06.196 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19197 network=udp 31:06.196 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19198 network=tcp 31:06.700 [INFO] TestAgent: Waiting for endpoints to shut down 31:06.700 [INFO] TestAgent: Endpoints down --- PASS: TestRoleReadCommand_JSON (1.15s) --- PASS: TestRoleReadCommand_JSON/read_by_id (0.12s) 2021-10-05T16:31:05.696Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:05.713Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:05.750 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:caa3a85b-d91e-ed36-268b-cdb294f6e08e Address:127.0.0.1:19195}]" 31:05.751 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e.dc1 127.0.0.1 31:05.760 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19195 [Follower]" leader= 31:05.761 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e 127.0.0.1 2021-10-05T16:31:05.761Z [INFO] agent.router: Initializing LAN area manager 31:05.761 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19190 network=udp 31:05.761 [INFO] TestAgent.server: Adding LAN server: server="Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e (Addr: tcp/127.0.0.1:19195) (DC: dc1)" 31:05.761 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e.dc1 area=wan 31:05.761 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19190 network=tcp 31:05.762 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19191 network=tcp 31:05.762 [INFO] TestAgent: started state syncer 31:05.762 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19196 network=tcp 31:05.808 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:05.808 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19195 [Candidate]" term=2 31:05.812 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:05.832 [DEBUG] TestAgent.server.raft: votes: needed=1 31:05.832 [DEBUG] TestAgent.server.raft: vote granted: from=caa3a85b-d91e-ed36-268b-cdb294f6e08e term=2 tally=1 31:05.832 [INFO] TestAgent.server.raft: election won: tally=1 31:05.832 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19195 [Leader]" 31:05.836 [INFO] TestAgent.server: cluster leadership acquired 31:05.836 [INFO] TestAgent.server: New leader elected: payload=Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e 31:05.844 [INFO] TestAgent.server: initializing acls 31:05.846 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:05.846 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:05.868 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:05.892 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:05.892 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:05.892 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:05.892 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e 31:05.893 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e.dc1 31:05.896 [INFO] TestAgent.server: Updating LAN server: server="Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e (Addr: tcp/127.0.0.1:19195) (DC: dc1)" 31:05.896 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e.dc1 area=wan 31:05.928 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:05.955 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:05.955 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:05.955 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:05.955 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:05.955 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:05.955 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e 31:05.955 [INFO] TestAgent.server: member joined, marking health alive: member=Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e 31:05.965 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-caa3a85b-d91e-ed36-268b-cdb294f6e08e 31:05.987 [INFO] TestAgent.server: federation state anti-entropy synced 31:06.046 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:06.055 [INFO] TestAgent: Synced node info 31:06.056 [DEBUG] TestAgent: Node info in sync 31:06.090 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/46a8b2e7-9bb5-d595-9ddd-56f6b8162f69 from=127.0.0.1:49736 latency=464.538µs 31:06.096 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/name/blah from=127.0.0.1:49738 latency=160.819µs 31:06.116 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:49740 latency=19.563465ms 31:06.125 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/b67e32d0-c609-8e54-5984-3a2c0a794995 from=127.0.0.1:49742 latency=5.857189ms 31:06.144 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:49740 latency=10.13788ms 31:06.152 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/roles from=127.0.0.1:49744 latency=574.051µs 31:06.172 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/db15b7dd-213e-416e-b0e6-3b875da86206 from=127.0.0.1:49744 latency=334.275µs 31:06.192 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:49740 latency=18.182784ms 31:06.201 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/name/test-role-by-name from=127.0.0.1:49748 latency=1.264097ms 31:06.202 [INFO] TestAgent: Requesting shutdown 31:06.202 [INFO] TestAgent.server: shutting down server 31:06.202 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:06.202 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:06.202 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:06.202 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:06.202 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:06.202 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:06.202 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:06.202 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:06.202 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:06.202 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:06.202 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:06.202 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:06.202 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:06.202 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:06.216 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:06.224Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:06.224Z [INFO] agent.router.manager: shutting down 31:06.224 [INFO] TestAgent: consul server down 31:06.224 [INFO] TestAgent: shutdown complete 31:06.224 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19190 network=tcp 31:06.224 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19190 network=udp 31:06.224 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19191 network=tcp 31:06.728 [INFO] TestAgent: Waiting for endpoints to shut down 31:06.728 [INFO] TestAgent: Endpoints down --- PASS: TestRoleReadCommand (1.18s) --- PASS: TestRoleReadCommand/id_or_name_required (0.00s) --- PASS: TestRoleReadCommand/read_by_id_not_found (0.04s) --- PASS: TestRoleReadCommand/read_by_name_not_found (0.01s) --- PASS: TestRoleReadCommand/read_by_id (0.04s) --- PASS: TestRoleReadCommand/read_by_id_prefix (0.04s) --- PASS: TestRoleReadCommand/read_by_name (0.03s) PASS ok github.com/hashicorp/consul/command/acl/role/read 1.305s === RUN TestRoleUpdateCommand_noTabs === PAUSE TestRoleUpdateCommand_noTabs === RUN TestRoleUpdateCommand === PAUSE TestRoleUpdateCommand === RUN TestRoleUpdateCommand_JSON === PAUSE TestRoleUpdateCommand_JSON === RUN TestRoleUpdateCommand_noMerge === PAUSE TestRoleUpdateCommand_noMerge === CONT TestRoleUpdateCommand_noTabs --- PASS: TestRoleUpdateCommand_noTabs (0.00s) === CONT TestRoleUpdateCommand_noMerge [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestRoleUpdateCommand === CONT TestRoleUpdateCommand_JSON [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestRoleUpdateCommand_noMerge/update_a_role_that_does_not_exist === RUN TestRoleUpdateCommand_noMerge/update_with_policy_by_name === RUN TestRoleUpdateCommand_JSON/update_a_role_that_does_not_exist === RUN TestRoleUpdateCommand_noMerge/update_with_policy_by_id === RUN TestRoleUpdateCommand_JSON/update_with_policy_by_name === RUN TestRoleUpdateCommand_noMerge/update_with_service_identity === RUN TestRoleUpdateCommand_noMerge/update_with_service_identity_scoped_to_2_DCs === RUN TestRoleUpdateCommand/update_a_role_that_does_not_exist === RUN TestRoleUpdateCommand/update_with_policy_by_name === RUN TestRoleUpdateCommand/update_with_policy_by_id === RUN TestRoleUpdateCommand/update_with_service_identity === RUN TestRoleUpdateCommand/update_with_service_identity_scoped_to_2_DCs === RUN TestRoleUpdateCommand/update_with_node_identity 2021-10-05T16:31:07.668Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:07.694Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:07.746 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 Address:127.0.0.1:12062}]" 31:07.747 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752.dc1 127.0.0.1 31:07.748 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 127.0.0.1 2021-10-05T16:31:07.748Z [INFO] agent.router: Initializing LAN area manager 31:07.748 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:12062 [Follower]" leader= 31:07.748 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12057 network=tcp 31:07.759 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12057 network=udp 31:07.748 [INFO] TestAgent.server: Adding LAN server: server="Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 (Addr: tcp/127.0.0.1:12062) (DC: dc1)" 31:07.758 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752.dc1 area=wan 31:07.760 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:12058 network=tcp 31:07.760 [INFO] TestAgent: started state syncer 31:07.760 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:12063 network=tcp 31:07.798 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:07.816 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:07.816 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:12062 [Candidate]" term=2 31:07.855 [DEBUG] TestAgent.server.raft: votes: needed=1 31:07.855 [DEBUG] TestAgent.server.raft: vote granted: from=d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 term=2 tally=1 31:07.855 [INFO] TestAgent.server.raft: election won: tally=1 31:07.855 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:12062 [Leader]" 31:07.855 [INFO] TestAgent.server: cluster leadership acquired 31:07.855 [INFO] TestAgent.server: New leader elected: payload=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 31:07.869 [INFO] TestAgent.server: initializing acls 31:07.873 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:07.873 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:07.880 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:07.892 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:07.909 [INFO] TestAgent.server: initializing acls 31:07.909 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:07.938 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:07.938 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:07.938 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:07.938 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:07.938 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:07.938 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 31:07.938 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752.dc1 31:07.939 [INFO] TestAgent.server: Updating LAN server: server="Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 (Addr: tcp/127.0.0.1:12062) (DC: dc1)" 31:07.939 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 31:07.939 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752.dc1 31:07.939 [INFO] TestAgent.server: Updating LAN server: server="Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 (Addr: tcp/127.0.0.1:12062) (DC: dc1)" 31:07.939 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752.dc1 area=wan 31:07.939 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752.dc1 area=wan 31:07.954 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:07.984 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:07.984 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:07.984 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:07.984 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:07.984 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:07.984 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 31:07.984 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 31:07.988 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 31:07.988 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d6694c6b-4c25-2c8d-43d1-24b3d4e9d752 31:07.998 [INFO] TestAgent.server: federation state anti-entropy synced 31:08.055 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:60192 latency=5.875297ms 31:08.060 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:60192 latency=5.177628ms 31:08.065 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/e6c93c64-57a9-e9e6-5d27-266e2076adb9 from=127.0.0.1:60194 latency=158.91µs 31:08.066 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/29242578-e5be-5e58-0813-9afc27203402 from=127.0.0.1:60196 latency=342.902µs 31:08.072 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/29242578-e5be-5e58-0813-9afc27203402 from=127.0.0.1:60196 latency=5.375559ms 31:08.073 [INFO] TestAgent: Requesting shutdown 31:08.073 [INFO] TestAgent.server: shutting down server 31:08.073 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:08.073 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:08.073 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:08.073 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:08.073 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:08.073 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:08.073 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:08.073 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:08.073 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:08.073 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:08.073 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:08.073 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:08.073 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:08.073 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:08.078 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:08.081Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:08.081Z [INFO] agent.router.manager: shutting down 31:08.081 [INFO] TestAgent: consul server down 31:08.081 [INFO] TestAgent: shutdown complete 31:08.081 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12057 network=tcp 31:08.081 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12057 network=udp 31:08.081 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:12058 network=tcp 31:08.584 [INFO] TestAgent: Waiting for endpoints to shut down 31:08.584 [INFO] TestAgent: Endpoints down --- PASS: TestRoleUpdateCommand_JSON (1.03s) --- PASS: TestRoleUpdateCommand_JSON/update_a_role_that_does_not_exist (0.00s) --- PASS: TestRoleUpdateCommand_JSON/update_with_policy_by_name (0.01s) 2021-10-05T16:31:07.647Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:07.693Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:07.772 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8d6efbb5-60c1-97de-e213-bb72eab58956 Address:127.0.0.1:12048}]" 31:07.773 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8d6efbb5-60c1-97de-e213-bb72eab58956.dc1 127.0.0.1 31:07.773 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8d6efbb5-60c1-97de-e213-bb72eab58956 127.0.0.1 2021-10-05T16:31:07.773Z [INFO] agent.router: Initializing LAN area manager 31:07.776 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:12048 [Follower]" leader= 31:07.776 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8d6efbb5-60c1-97de-e213-bb72eab58956.dc1 area=wan 31:07.776 [INFO] TestAgent.server: Adding LAN server: server="Node-8d6efbb5-60c1-97de-e213-bb72eab58956 (Addr: tcp/127.0.0.1:12048) (DC: dc1)" 31:07.808 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=udp 31:07.808 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=tcp 31:07.809 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:12044 network=tcp 31:07.809 [INFO] TestAgent: started state syncer 31:07.809 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:12049 network=tcp 31:07.821 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:07.821 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:12048 [Candidate]" term=2 31:07.828 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:07.836 [DEBUG] TestAgent.server.raft: votes: needed=1 31:07.836 [DEBUG] TestAgent.server.raft: vote granted: from=8d6efbb5-60c1-97de-e213-bb72eab58956 term=2 tally=1 31:07.836 [INFO] TestAgent.server.raft: election won: tally=1 31:07.836 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:12048 [Leader]" 31:07.837 [INFO] TestAgent.server: cluster leadership acquired 31:07.837 [INFO] TestAgent.server: New leader elected: payload=Node-8d6efbb5-60c1-97de-e213-bb72eab58956 31:07.842 [INFO] TestAgent.server: initializing acls 31:07.847 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:07.847 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:07.856 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:07.870 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:07.870 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:07.870 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:07.870 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8d6efbb5-60c1-97de-e213-bb72eab58956 31:07.870 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8d6efbb5-60c1-97de-e213-bb72eab58956.dc1 31:07.871 [INFO] TestAgent.server: Updating LAN server: server="Node-8d6efbb5-60c1-97de-e213-bb72eab58956 (Addr: tcp/127.0.0.1:12048) (DC: dc1)" 31:07.871 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8d6efbb5-60c1-97de-e213-bb72eab58956.dc1 area=wan 31:07.885 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:07.949 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:07.949 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:07.949 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:07.949 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:07.949 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:07.949 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8d6efbb5-60c1-97de-e213-bb72eab58956 31:07.949 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8d6efbb5-60c1-97de-e213-bb72eab58956 31:07.966 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8d6efbb5-60c1-97de-e213-bb72eab58956 31:07.972 [INFO] TestAgent.server: federation state anti-entropy synced 31:08.002 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:57928 latency=12.800899ms 31:08.015 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:57928 latency=10.29144ms 31:08.030 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:57928 latency=9.292764ms 31:08.033 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/4f95804d-7ade-8b7b-0b8c-dcacf0c4325f from=127.0.0.1:57932 latency=207.187µs 31:08.038 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:57928 latency=4.728111ms 31:08.039 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/ed5f69c4-588a-126b-712f-704716ddc009 from=127.0.0.1:57934 latency=244.609µs 31:08.060 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/ed5f69c4-588a-126b-712f-704716ddc009 from=127.0.0.1:57934 latency=16.257569ms 31:08.064 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/ed5f69c4-588a-126b-712f-704716ddc009 from=127.0.0.1:57928 latency=284.569µs 31:08.070 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:57928 latency=5.358408ms 31:08.072 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/3555c7f7-c2ba-4f23-a84c-c45f17e281a4 from=127.0.0.1:57942 latency=365.01µs 31:08.077 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/3555c7f7-c2ba-4f23-a84c-c45f17e281a4 from=127.0.0.1:57942 latency=3.558393ms 31:08.081 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/3555c7f7-c2ba-4f23-a84c-c45f17e281a4 from=127.0.0.1:57928 latency=537.928µs 31:08.090 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:57928 latency=5.718367ms 31:08.092 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/e4c96b43-abba-693f-d951-339c06559510 from=127.0.0.1:57944 latency=483.937µs 31:08.095 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/e4c96b43-abba-693f-d951-339c06559510 from=127.0.0.1:57944 latency=3.052874ms 31:08.100 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/e4c96b43-abba-693f-d951-339c06559510 from=127.0.0.1:57928 latency=3.254028ms 31:08.136 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:57928 latency=16.204536ms 31:08.142 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/c4ce46f9-71fe-437f-bafe-0608d3b210ae from=127.0.0.1:57946 latency=604.809µs 31:08.149 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/c4ce46f9-71fe-437f-bafe-0608d3b210ae from=127.0.0.1:57946 latency=6.549313ms 31:08.152 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/c4ce46f9-71fe-437f-bafe-0608d3b210ae from=127.0.0.1:57928 latency=226.998µs 31:08.153 [INFO] TestAgent: Requesting shutdown 31:08.153 [INFO] TestAgent.server: shutting down server 31:08.153 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:08.153 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:08.153 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:08.153 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:08.153 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:08.153 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:08.153 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:08.153 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:08.153 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:08.153 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:08.153 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:08.153 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:08.153 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:08.153 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:08.153 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:08.160 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:08.168Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:08.168Z [INFO] agent.router.manager: shutting down 31:08.168 [INFO] TestAgent: consul server down 31:08.168 [INFO] TestAgent: shutdown complete 31:08.168 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=tcp 31:08.168 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=udp 31:08.168 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:12044 network=tcp 31:08.668 [INFO] TestAgent: Waiting for endpoints to shut down 31:08.668 [INFO] TestAgent: Endpoints down --- PASS: TestRoleUpdateCommand_noMerge (1.11s) --- PASS: TestRoleUpdateCommand_noMerge/update_a_role_that_does_not_exist (0.00s) --- PASS: TestRoleUpdateCommand_noMerge/update_with_policy_by_name (0.03s) --- PASS: TestRoleUpdateCommand_noMerge/update_with_policy_by_id (0.02s) --- PASS: TestRoleUpdateCommand_noMerge/update_with_service_identity (0.02s) --- PASS: TestRoleUpdateCommand_noMerge/update_with_service_identity_scoped_to_2_DCs (0.05s) 2021-10-05T16:31:07.654Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:07.691Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:07.772 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ecab27ea-c306-4def-13eb-349b0f58d120 Address:127.0.0.1:12055}]" 31:07.773 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ecab27ea-c306-4def-13eb-349b0f58d120.dc1 127.0.0.1 31:07.774 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:12055 [Follower]" leader= 31:07.809 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ecab27ea-c306-4def-13eb-349b0f58d120 127.0.0.1 2021-10-05T16:31:07.809Z [INFO] agent.router: Initializing LAN area manager 31:07.809 [INFO] TestAgent.server: Adding LAN server: server="Node-ecab27ea-c306-4def-13eb-349b0f58d120 (Addr: tcp/127.0.0.1:12055) (DC: dc1)" 31:07.809 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ecab27ea-c306-4def-13eb-349b0f58d120.dc1 area=wan 31:07.809 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12050 network=tcp 31:07.809 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12050 network=udp 31:07.810 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:12051 network=tcp 31:07.810 [INFO] TestAgent: started state syncer 31:07.810 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:12056 network=tcp 31:07.841 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:07.841 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:12055 [Candidate]" term=2 31:07.858 [DEBUG] TestAgent.server.raft: votes: needed=1 31:07.858 [DEBUG] TestAgent.server.raft: vote granted: from=ecab27ea-c306-4def-13eb-349b0f58d120 term=2 tally=1 31:07.858 [INFO] TestAgent.server.raft: election won: tally=1 31:07.858 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:12055 [Leader]" 31:07.859 [INFO] TestAgent.server: cluster leadership acquired 31:07.859 [INFO] TestAgent.server: New leader elected: payload=Node-ecab27ea-c306-4def-13eb-349b0f58d120 31:07.860 [INFO] TestAgent.server: initializing acls 31:07.872 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:07.872 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:07.872 [INFO] TestAgent.server: initializing acls 31:07.872 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:07.913 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:07.913 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:07.923 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:07.923 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:07.923 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:07.923 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:07.923 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ecab27ea-c306-4def-13eb-349b0f58d120 31:07.924 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ecab27ea-c306-4def-13eb-349b0f58d120.dc1 31:07.924 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ecab27ea-c306-4def-13eb-349b0f58d120.dc1 area=wan 31:07.924 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:07.924 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ecab27ea-c306-4def-13eb-349b0f58d120 31:07.924 [INFO] TestAgent.server: Updating LAN server: server="Node-ecab27ea-c306-4def-13eb-349b0f58d120 (Addr: tcp/127.0.0.1:12055) (DC: dc1)" 31:07.924 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ecab27ea-c306-4def-13eb-349b0f58d120.dc1 31:07.924 [INFO] TestAgent.server: Updating LAN server: server="Node-ecab27ea-c306-4def-13eb-349b0f58d120 (Addr: tcp/127.0.0.1:12055) (DC: dc1)" 31:07.924 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ecab27ea-c306-4def-13eb-349b0f58d120.dc1 area=wan 31:07.964 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:07.965 [INFO] TestAgent: Synced node info 31:08.003 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:08.003 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:08.003 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:08.003 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:08.003 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:08.003 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ecab27ea-c306-4def-13eb-349b0f58d120 31:08.003 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ecab27ea-c306-4def-13eb-349b0f58d120 31:08.025 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ecab27ea-c306-4def-13eb-349b0f58d120 31:08.025 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ecab27ea-c306-4def-13eb-349b0f58d120 31:08.025 [INFO] TestAgent.server: federation state anti-entropy synced 31:08.177 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:47510 latency=4.379386ms 31:08.200 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:47510 latency=16.460325ms 31:08.221 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role from=127.0.0.1:47510 latency=16.364414ms 31:08.228 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/7069e023-a311-75de-1fb2-9e3a36505b69 from=127.0.0.1:47512 latency=151.782µs 31:08.230 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47514 latency=231.007µs 31:08.248 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47514 latency=18.120786ms 31:08.260 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47510 latency=626.965µs 31:08.266 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47518 latency=614.397µs 31:08.288 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47518 latency=22.006599ms 31:08.292 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47510 latency=318.451µs 31:08.295 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47520 latency=435.791µs 31:08.312 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47520 latency=17.133261ms 31:08.317 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47510 latency=313.875µs 31:08.319 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47522 latency=247.888µs 31:08.327 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47522 latency=7.866849ms 31:08.328 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47510 latency=269.327µs 31:08.330 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47524 latency=238.379µs 31:08.338 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47524 latency=7.427992ms 31:08.339 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/role/f9df8fe7-e947-44b8-9c34-5ab067bff058 from=127.0.0.1:47510 latency=264.637µs 31:08.339 [INFO] TestAgent: Requesting shutdown 31:08.339 [INFO] TestAgent.server: shutting down server 31:08.340 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:08.340 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:08.340 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:08.340 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:08.340 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:08.340 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:08.340 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:08.340 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:08.340 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:08.340 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:08.340 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:08.340 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:08.340 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:08.340 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:08.352 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:08.357Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:08.357Z [INFO] agent.router.manager: shutting down 31:08.357 [INFO] TestAgent: consul server down 31:08.357 [INFO] TestAgent: shutdown complete 31:08.357 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12050 network=tcp 31:08.357 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12050 network=udp 31:08.357 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:12051 network=tcp 31:08.860 [INFO] TestAgent: Waiting for endpoints to shut down 31:08.860 [INFO] TestAgent: Endpoints down --- PASS: TestRoleUpdateCommand (1.30s) --- PASS: TestRoleUpdateCommand/update_a_role_that_does_not_exist (0.00s) --- PASS: TestRoleUpdateCommand/update_with_policy_by_name (0.04s) --- PASS: TestRoleUpdateCommand/update_with_policy_by_id (0.03s) --- PASS: TestRoleUpdateCommand/update_with_service_identity (0.02s) --- PASS: TestRoleUpdateCommand/update_with_service_identity_scoped_to_2_DCs (0.01s) --- PASS: TestRoleUpdateCommand/update_with_node_identity (0.01s) PASS ok github.com/hashicorp/consul/command/acl/role/update 1.414s === RUN TestRulesTranslateCommand_noTabs === PAUSE TestRulesTranslateCommand_noTabs === RUN TestRulesTranslateCommand === PAUSE TestRulesTranslateCommand === CONT TestRulesTranslateCommand_noTabs --- PASS: TestRulesTranslateCommand_noTabs (0.00s) === CONT TestRulesTranslateCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestRulesTranslateCommand/file === RUN TestRulesTranslateCommand/stdin === RUN TestRulesTranslateCommand/arg === RUN TestRulesTranslateCommand/exclusive-options 2021-10-05T16:31:10.692Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:10.731Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:10.788 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:efff4665-c598-2675-d6fd-24af24184367 Address:127.0.0.1:22258}]" 31:10.789 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-efff4665-c598-2675-d6fd-24af24184367.dc1 127.0.0.1 31:10.790 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-efff4665-c598-2675-d6fd-24af24184367 127.0.0.1 2021-10-05T16:31:10.790Z [INFO] agent.router: Initializing LAN area manager 31:10.790 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=udp 31:10.790 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:22258 [Follower]" leader= 31:10.791 [INFO] TestAgent.server: Adding LAN server: server="Node-efff4665-c598-2675-d6fd-24af24184367 (Addr: tcp/127.0.0.1:22258) (DC: dc1)" 31:10.791 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-efff4665-c598-2675-d6fd-24af24184367.dc1 area=wan 31:10.791 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=tcp 31:10.791 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:22254 network=tcp 31:10.791 [INFO] TestAgent: started state syncer 31:10.791 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:22259 network=tcp 31:10.837 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:10.837 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:22258 [Candidate]" term=2 31:10.844 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:10.855 [DEBUG] TestAgent.server.raft: votes: needed=1 31:10.855 [DEBUG] TestAgent.server.raft: vote granted: from=efff4665-c598-2675-d6fd-24af24184367 term=2 tally=1 31:10.855 [INFO] TestAgent.server.raft: election won: tally=1 31:10.855 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:22258 [Leader]" 31:10.855 [INFO] TestAgent.server: cluster leadership acquired 31:10.856 [INFO] TestAgent.server: New leader elected: payload=Node-efff4665-c598-2675-d6fd-24af24184367 31:10.862 [INFO] TestAgent.server: initializing acls 31:10.868 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:10.868 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:10.888 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:10.911 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:10.911 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:10.911 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:10.911 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-efff4665-c598-2675-d6fd-24af24184367 31:10.911 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-efff4665-c598-2675-d6fd-24af24184367.dc1 31:10.918 [INFO] TestAgent.server: Updating LAN server: server="Node-efff4665-c598-2675-d6fd-24af24184367 (Addr: tcp/127.0.0.1:22258) (DC: dc1)" 31:10.918 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-efff4665-c598-2675-d6fd-24af24184367.dc1 area=wan 31:10.936 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:11.004 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:11.004 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:11.004 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:11.004 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:11.004 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:11.004 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-efff4665-c598-2675-d6fd-24af24184367 31:11.004 [INFO] TestAgent.server: member joined, marking health alive: member=Node-efff4665-c598-2675-d6fd-24af24184367 31:11.013 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-efff4665-c598-2675-d6fd-24af24184367 31:11.028 [INFO] TestAgent.server: federation state anti-entropy synced 31:11.039 [INFO] TestAgent: Requesting shutdown 31:11.039 [INFO] TestAgent.server: shutting down server 31:11.039 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:11.039 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:11.039 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:11.039 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:11.039 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:11.039 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:11.039 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:11.039 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:11.039 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:11.039 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:11.039 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:11.039 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:11.039 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:11.039 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:11.039 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:11.052 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:11.058Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:11.058Z [INFO] agent.router.manager: shutting down 31:11.058 [INFO] TestAgent: consul server down 31:11.058 [INFO] TestAgent: shutdown complete 31:11.058 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=tcp 31:11.059 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=udp 31:11.059 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:22254 network=tcp 31:11.560 [INFO] TestAgent: Waiting for endpoints to shut down 31:11.560 [INFO] TestAgent: Endpoints down --- PASS: TestRulesTranslateCommand (1.00s) --- PASS: TestRulesTranslateCommand/file (0.00s) --- PASS: TestRulesTranslateCommand/stdin (0.00s) --- PASS: TestRulesTranslateCommand/arg (0.00s) --- PASS: TestRulesTranslateCommand/exclusive-options (0.00s) PASS ok github.com/hashicorp/consul/command/acl/rules 1.111s === RUN TestFormatToken === RUN TestFormatToken/legacy === RUN TestFormatToken/legacy/pretty === RUN TestFormatToken/legacy/pretty-meta === RUN TestFormatToken/legacy/json === RUN TestFormatToken/basic === RUN TestFormatToken/basic/pretty === RUN TestFormatToken/basic/pretty-meta === RUN TestFormatToken/basic/json === RUN TestFormatToken/complex === RUN TestFormatToken/complex/pretty === RUN TestFormatToken/complex/pretty-meta === RUN TestFormatToken/complex/json --- PASS: TestFormatToken (0.04s) --- PASS: TestFormatToken/legacy (0.01s) --- PASS: TestFormatToken/legacy/pretty (0.01s) --- PASS: TestFormatToken/legacy/pretty-meta (0.00s) --- PASS: TestFormatToken/legacy/json (0.00s) --- PASS: TestFormatToken/basic (0.01s) --- PASS: TestFormatToken/basic/pretty (0.00s) --- PASS: TestFormatToken/basic/pretty-meta (0.00s) --- PASS: TestFormatToken/basic/json (0.00s) --- PASS: TestFormatToken/complex (0.01s) --- PASS: TestFormatToken/complex/pretty (0.00s) --- PASS: TestFormatToken/complex/pretty-meta (0.00s) --- PASS: TestFormatToken/complex/json (0.00s) === RUN TestFormatTokenList === RUN TestFormatTokenList/legacy === RUN TestFormatTokenList/legacy/pretty === RUN TestFormatTokenList/legacy/pretty-meta === RUN TestFormatTokenList/legacy/json === RUN TestFormatTokenList/complex === RUN TestFormatTokenList/complex/pretty-meta === RUN TestFormatTokenList/complex/json === RUN TestFormatTokenList/complex/pretty === RUN TestFormatTokenList/basic === RUN TestFormatTokenList/basic/pretty === RUN TestFormatTokenList/basic/pretty-meta === RUN TestFormatTokenList/basic/json --- PASS: TestFormatTokenList (0.04s) --- PASS: TestFormatTokenList/legacy (0.01s) --- PASS: TestFormatTokenList/legacy/pretty (0.00s) --- PASS: TestFormatTokenList/legacy/pretty-meta (0.00s) --- PASS: TestFormatTokenList/legacy/json (0.00s) --- PASS: TestFormatTokenList/complex (0.01s) --- PASS: TestFormatTokenList/complex/pretty-meta (0.00s) --- PASS: TestFormatTokenList/complex/json (0.00s) --- PASS: TestFormatTokenList/complex/pretty (0.00s) --- PASS: TestFormatTokenList/basic (0.01s) --- PASS: TestFormatTokenList/basic/pretty (0.00s) --- PASS: TestFormatTokenList/basic/pretty-meta (0.00s) --- PASS: TestFormatTokenList/basic/json (0.00s) PASS ok github.com/hashicorp/consul/command/acl/token 0.117s === RUN TestTokenCloneCommand_noTabs === PAUSE TestTokenCloneCommand_noTabs === RUN TestTokenCloneCommand_Pretty === PAUSE TestTokenCloneCommand_Pretty === RUN TestTokenCloneCommand_JSON === PAUSE TestTokenCloneCommand_JSON === CONT TestTokenCloneCommand_noTabs --- PASS: TestTokenCloneCommand_noTabs (0.00s) === CONT TestTokenCloneCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestTokenCloneCommand_Pretty [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestTokenCloneCommand_JSON/Description === RUN TestTokenCloneCommand_Pretty/Description === RUN TestTokenCloneCommand_JSON/Without_Description === RUN TestTokenCloneCommand_Pretty/Without_Description 2021-10-05T16:31:19.984Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.063Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.154 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f8b88bf8-07de-bc66-b8ba-10cd02cc277f Address:127.0.0.1:14097}]" 31:20.154 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14097 [Follower]" leader= 31:20.154 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f.dc1 127.0.0.1 31:20.155 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f 127.0.0.1 2021-10-05T16:31:20.155Z [INFO] agent.router: Initializing LAN area manager 31:20.155 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=udp 31:20.156 [INFO] TestAgent.server: Adding LAN server: server="Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 31:20.156 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f.dc1 area=wan 31:20.156 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=tcp 31:20.156 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14093 network=tcp 31:20.156 [INFO] TestAgent: started state syncer 31:20.156 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14098 network=tcp 31:20.190 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.190 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14097 [Candidate]" term=2 31:20.207 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:20.224 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.224 [DEBUG] TestAgent.server.raft: vote granted: from=f8b88bf8-07de-bc66-b8ba-10cd02cc277f term=2 tally=1 31:20.224 [INFO] TestAgent.server.raft: election won: tally=1 31:20.224 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14097 [Leader]" 31:20.224 [INFO] TestAgent.server: cluster leadership acquired 31:20.224 [INFO] TestAgent.server: New leader elected: payload=Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f 31:20.243 [INFO] TestAgent.server: initializing acls 31:20.251 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:20.251 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.266 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:20.297 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.297 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:20.297 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:20.297 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f 31:20.297 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f.dc1 31:20.299 [INFO] TestAgent.server: Updating LAN server: server="Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 31:20.299 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f.dc1 area=wan 31:20.332 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.382 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.382 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.382 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.382 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.382 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.382 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f 31:20.382 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f 31:20.400 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f8b88bf8-07de-bc66-b8ba-10cd02cc277f 31:20.410 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.512 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.531 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:59920 latency=26.847641ms 31:20.550 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:59920 latency=19.109765ms 31:20.551 [INFO] TestAgent: Synced node info 31:20.551 [DEBUG] TestAgent: Node info in sync 31:20.564 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/abcc1f00-33d8-79ad-b362-4df71a7456a8/clone from=127.0.0.1:59966 latency=10.36737ms 31:20.568 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/9e42682a-73c8-edb5-90af-c46f3da070a6 from=127.0.0.1:59920 latency=352.184µs 31:20.583 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/abcc1f00-33d8-79ad-b362-4df71a7456a8/clone from=127.0.0.1:59970 latency=11.036905ms 31:20.585 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/8f0bbb39-e15d-9384-768e-4547cf22f725 from=127.0.0.1:59920 latency=310.407µs 31:20.588 [INFO] TestAgent: Requesting shutdown 31:20.588 [INFO] TestAgent.server: shutting down server 31:20.588 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:20.588 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:20.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.588 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.588 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.588 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.588 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.588 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.588 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:20.588 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:20.588 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.588 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.588 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.600 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.609Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.609Z [INFO] agent.router.manager: shutting down 31:20.609 [INFO] TestAgent: consul server down 31:20.609 [INFO] TestAgent: shutdown complete 31:20.609 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=tcp 31:20.609 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=udp 31:20.609 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14093 network=tcp 31:21.110 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.110 [INFO] TestAgent: Endpoints down --- PASS: TestTokenCloneCommand_Pretty (1.23s) --- PASS: TestTokenCloneCommand_Pretty/Description (0.02s) --- PASS: TestTokenCloneCommand_Pretty/Without_Description (0.02s) 2021-10-05T16:31:19.994Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.051Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.093 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:51d80ce4-e6a8-192d-4b9d-3de4a25065f9 Address:127.0.0.1:14090}]" 31:20.094 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14090 [Follower]" leader= 31:20.094 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9.dc1 127.0.0.1 31:20.095 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 127.0.0.1 2021-10-05T16:31:20.095Z [INFO] agent.router: Initializing LAN area manager 31:20.096 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=udp 31:20.096 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9.dc1 area=wan 31:20.096 [INFO] TestAgent.server: Adding LAN server: server="Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 31:20.096 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=tcp 31:20.101 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14086 network=tcp 31:20.101 [INFO] TestAgent: started state syncer 31:20.102 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14091 network=tcp 31:20.148 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.148 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14090 [Candidate]" term=2 31:20.148 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:20.203 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.203 [DEBUG] TestAgent.server.raft: vote granted: from=51d80ce4-e6a8-192d-4b9d-3de4a25065f9 term=2 tally=1 31:20.203 [INFO] TestAgent.server.raft: election won: tally=1 31:20.203 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14090 [Leader]" 31:20.204 [INFO] TestAgent.server: cluster leadership acquired 31:20.204 [INFO] TestAgent.server: New leader elected: payload=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 31:20.220 [INFO] TestAgent.server: initializing acls 31:20.234 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:20.234 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.248 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:20.249 [INFO] TestAgent.server: initializing acls 31:20.249 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.289 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.289 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:20.289 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:20.289 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:20.289 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 31:20.289 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9.dc1 31:20.289 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9.dc1 area=wan 31:20.289 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.289 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 31:20.289 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9.dc1 31:20.292 [INFO] TestAgent.server: Updating LAN server: server="Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 31:20.292 [INFO] TestAgent.server: Updating LAN server: server="Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 31:20.292 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9.dc1 area=wan 31:20.320 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.392 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.392 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.392 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.392 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.392 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.392 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 31:20.392 [INFO] TestAgent.server: member joined, marking health alive: member=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 31:20.404 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 31:20.404 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-51d80ce4-e6a8-192d-4b9d-3de4a25065f9 31:20.416 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.464 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:20.473 [INFO] TestAgent: Synced node info 31:20.529 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:44620 latency=16.156348ms 31:20.536 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:44620 latency=5.630818ms 31:20.565 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/55864ec5-fa8f-6a67-922f-504522a31853/clone from=127.0.0.1:44642 latency=13.235511ms 31:20.581 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/55864ec5-fa8f-6a67-922f-504522a31853/clone from=127.0.0.1:44648 latency=8.549621ms 31:20.584 [INFO] TestAgent: Requesting shutdown 31:20.584 [INFO] TestAgent.server: shutting down server 31:20.584 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.584 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.584 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.584 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:20.584 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:20.584 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.584 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.584 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.584 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.584 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.584 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.584 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.584 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:20.584 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:20.596 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.620Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.620Z [INFO] agent.router.manager: shutting down 31:20.620 [INFO] TestAgent: consul server down 31:20.620 [INFO] TestAgent: shutdown complete 31:20.620 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=tcp 31:20.620 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=udp 31:20.620 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14086 network=tcp 31:21.122 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.122 [INFO] TestAgent: Endpoints down --- PASS: TestTokenCloneCommand_JSON (1.25s) --- PASS: TestTokenCloneCommand_JSON/Description (0.03s) --- PASS: TestTokenCloneCommand_JSON/Without_Description (0.02s) PASS ok github.com/hashicorp/consul/command/acl/token/clone 1.520s === RUN TestTokenCreateCommand_noTabs === PAUSE TestTokenCreateCommand_noTabs === RUN TestTokenCreateCommand_Pretty === PAUSE TestTokenCreateCommand_Pretty === RUN TestTokenCreateCommand_JSON === PAUSE TestTokenCreateCommand_JSON === CONT TestTokenCreateCommand_noTabs === CONT TestTokenCreateCommand_JSON === CONT TestTokenCreateCommand_Pretty --- PASS: TestTokenCreateCommand_noTabs (0.00s) [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestTokenCreateCommand_Pretty/policy-name === RUN TestTokenCreateCommand_Pretty/policy-id === RUN TestTokenCreateCommand_Pretty/node-identity === RUN TestTokenCreateCommand_Pretty/predefined-ids 2021-10-05T16:31:20.014Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.123Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.221 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c8910cb2-88c1-9e25-6eda-23f3e2c75935 Address:127.0.0.1:25328}]" 31:20.221 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935.dc1 127.0.0.1 31:20.222 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 127.0.0.1 2021-10-05T16:31:20.222Z [INFO] agent.router: Initializing LAN area manager 31:20.222 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25323 network=udp 31:20.222 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:25328 [Follower]" leader= 31:20.228 [INFO] TestAgent.server: Adding LAN server: server="Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 (Addr: tcp/127.0.0.1:25328) (DC: dc1)" 31:20.230 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935.dc1 area=wan 31:20.230 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25323 network=tcp 31:20.231 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:25324 network=tcp 31:20.231 [INFO] TestAgent: started state syncer 31:20.231 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:25329 network=tcp 31:20.260 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.260 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:25328 [Candidate]" term=2 31:20.280 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:20.324 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.324 [DEBUG] TestAgent.server.raft: vote granted: from=c8910cb2-88c1-9e25-6eda-23f3e2c75935 term=2 tally=1 31:20.324 [INFO] TestAgent.server.raft: election won: tally=1 31:20.324 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:25328 [Leader]" 31:20.324 [INFO] TestAgent.server: cluster leadership acquired 31:20.325 [INFO] TestAgent.server: New leader elected: payload=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 31:20.356 [INFO] TestAgent.server: initializing acls 31:20.364 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:20.364 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.376 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:20.382 [INFO] TestAgent.server: initializing acls 31:20.382 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.408 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.408 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:20.408 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:20.408 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:20.409 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 31:20.409 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935.dc1 31:20.409 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935.dc1 area=wan 31:20.409 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.409 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 31:20.409 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935.dc1 31:20.409 [INFO] TestAgent.server: Updating LAN server: server="Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 (Addr: tcp/127.0.0.1:25328) (DC: dc1)" 31:20.409 [INFO] TestAgent.server: Updating LAN server: server="Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 (Addr: tcp/127.0.0.1:25328) (DC: dc1)" 31:20.409 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935.dc1 area=wan 31:20.433 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.479 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.479 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.479 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.479 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.479 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.479 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 31:20.479 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 31:20.488 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 31:20.488 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c8910cb2-88c1-9e25-6eda-23f3e2c75935 31:20.493 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.510 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:37426 latency=7.628162ms 31:20.525 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:37438 latency=11.77541ms 31:20.528 [INFO] TestAgent: Requesting shutdown 31:20.528 [INFO] TestAgent.server: shutting down server 31:20.528 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:20.528 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.528 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.528 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.528 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.528 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:20.528 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.528 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.528 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.528 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:20.528 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:20.528 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.528 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.529 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.529 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:20.539 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.547Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.547Z [INFO] agent.router.manager: shutting down 31:20.547 [INFO] TestAgent: consul server down 31:20.547 [INFO] TestAgent: shutdown complete 31:20.547 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25323 network=tcp 31:20.547 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25323 network=udp 31:20.547 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:25324 network=tcp 31:21.048 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.048 [INFO] TestAgent: Endpoints down --- PASS: TestTokenCreateCommand_JSON (1.21s) 2021-10-05T16:31:19.997Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:20.122Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:20.182 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:88cd809f-ff14-205f-6f94-7b27b05a01a2 Address:127.0.0.1:25321}]" 31:20.183 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: test-node.dc1 127.0.0.1 31:20.183 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: test-node 127.0.0.1 2021-10-05T16:31:20.183Z [INFO] agent.router: Initializing LAN area manager 31:20.184 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:25321 [Follower]" leader= 31:20.184 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=udp 31:20.184 [INFO] TestAgent.server: Adding LAN server: server="test-node (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 31:20.184 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=test-node.dc1 area=wan 31:20.185 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=tcp 31:20.185 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:25317 network=tcp 31:20.185 [INFO] TestAgent: started state syncer 31:20.185 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:25322 network=tcp 31:20.233 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:20.233 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:25321 [Candidate]" term=2 31:20.236 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:20.250 [DEBUG] TestAgent.server.raft: votes: needed=1 31:20.250 [DEBUG] TestAgent.server.raft: vote granted: from=88cd809f-ff14-205f-6f94-7b27b05a01a2 term=2 tally=1 31:20.250 [INFO] TestAgent.server.raft: election won: tally=1 31:20.250 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:25321 [Leader]" 31:20.250 [INFO] TestAgent.server: cluster leadership acquired 31:20.250 [INFO] TestAgent.server: New leader elected: payload=test-node 31:20.264 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="ACL not found" 31:20.288 [INFO] TestAgent.server: initializing acls 31:20.304 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:20.304 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.313 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:20.336 [INFO] TestAgent.server: initializing acls 31:20.336 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:20.350 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.350 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:20.350 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:20.350 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:20.351 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: test-node 31:20.351 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: test-node.dc1 31:20.351 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=test-node.dc1 area=wan 31:20.351 [INFO] TestAgent.server: Updating LAN server: server="test-node (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 31:20.351 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:20.351 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: test-node 31:20.351 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: test-node.dc1 31:20.352 [INFO] TestAgent.server: Updating LAN server: server="test-node (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 31:20.352 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=test-node.dc1 area=wan 31:20.380 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:20.430 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:20.430 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:20.430 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:20.430 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:20.430 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:20.430 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 31:20.430 [INFO] TestAgent.server: member joined, marking health alive: member=test-node 31:20.438 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 31:20.438 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=test-node 31:20.445 [INFO] TestAgent.server: federation state anti-entropy synced 31:20.524 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:54244 latency=24.081234ms 31:20.546 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:54298 latency=14.581164ms 31:20.569 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:54302 latency=16.441743ms 31:20.584 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:54310 latency=13.148434ms 31:20.589 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes from=127.0.0.1:54312 latency=626.469µs 31:20.606 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:54314 latency=6.676327ms 31:20.606 [INFO] TestAgent: Requesting shutdown 31:20.606 [INFO] TestAgent.server: shutting down server 31:20.606 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:20.606 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:20.606 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:20.606 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:20.606 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:20.606 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:20.606 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:20.606 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:20.606 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:20.606 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:20.606 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:20.606 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:20.606 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:20.606 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:20.613 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:20.617Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:20.617Z [INFO] agent.router.manager: shutting down 31:20.617 [INFO] TestAgent: consul server down 31:20.617 [INFO] TestAgent: shutdown complete 31:20.617 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=tcp 31:20.617 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=udp 31:20.617 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:25317 network=tcp 31:21.120 [INFO] TestAgent: Waiting for endpoints to shut down 31:21.120 [INFO] TestAgent: Endpoints down --- PASS: TestTokenCreateCommand_Pretty (1.28s) --- PASS: TestTokenCreateCommand_Pretty/policy-name (0.02s) --- PASS: TestTokenCreateCommand_Pretty/policy-id (0.02s) --- PASS: TestTokenCreateCommand_Pretty/node-identity (0.02s) --- PASS: TestTokenCreateCommand_Pretty/predefined-ids (0.01s) PASS ok github.com/hashicorp/consul/command/acl/token/create 1.515s === RUN TestTokenDeleteCommand_noTabs === PAUSE TestTokenDeleteCommand_noTabs === RUN TestTokenDeleteCommand === PAUSE TestTokenDeleteCommand === CONT TestTokenDeleteCommand_noTabs --- PASS: TestTokenDeleteCommand_noTabs (0.00s) === CONT TestTokenDeleteCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:31:22.114Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:22.130Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:22.166 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ea5950a8-02d5-b2aa-3b13-0acfb343b6ca Address:127.0.0.1:30426}]" 31:22.168 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca.dc1 127.0.0.1 31:22.169 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca 127.0.0.1 2021-10-05T16:31:22.169Z [INFO] agent.router: Initializing LAN area manager 31:22.172 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30426 [Follower]" leader= 31:22.175 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=udp 31:22.176 [INFO] TestAgent.server: Adding LAN server: server="Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca (Addr: tcp/127.0.0.1:30426) (DC: dc1)" 31:22.184 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca.dc1 area=wan 31:22.184 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=tcp 31:22.185 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30422 network=tcp 31:22.185 [INFO] TestAgent: started state syncer 31:22.185 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30427 network=tcp 31:22.231 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:22.236 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:22.236 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30426 [Candidate]" term=2 31:22.250 [DEBUG] TestAgent.server.raft: votes: needed=1 31:22.250 [DEBUG] TestAgent.server.raft: vote granted: from=ea5950a8-02d5-b2aa-3b13-0acfb343b6ca term=2 tally=1 31:22.250 [INFO] TestAgent.server.raft: election won: tally=1 31:22.250 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30426 [Leader]" 31:22.250 [INFO] TestAgent.server: cluster leadership acquired 31:22.250 [INFO] TestAgent.server: New leader elected: payload=Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca 31:22.260 [INFO] TestAgent.server: initializing acls 31:22.265 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:22.265 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:22.271 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:22.281 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:22.281 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:22.281 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:22.281 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca 31:22.281 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca.dc1 31:22.284 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca.dc1 area=wan 31:22.284 [INFO] TestAgent.server: Updating LAN server: server="Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca (Addr: tcp/127.0.0.1:30426) (DC: dc1)" 31:22.303 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:22.360 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:22.360 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:22.360 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:22.360 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:22.360 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:22.360 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca 31:22.360 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca 31:22.407 [INFO] TestAgent: Synced node info 31:22.408 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ea5950a8-02d5-b2aa-3b13-0acfb343b6ca 31:22.422 [INFO] TestAgent.server: federation state anti-entropy synced 31:22.441 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:54620 latency=19.322627ms 31:22.452 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/acl/token/95005098-638d-536e-8e5e-df15166c4c5a from=127.0.0.1:54622 latency=4.895034ms 31:22.454 [ERROR] TestAgent.http: Request error: method=GET url=/v1/acl/token/95005098-638d-536e-8e5e-df15166c4c5a from=127.0.0.1:54620 error="ACL not found" 31:22.455 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/95005098-638d-536e-8e5e-df15166c4c5a from=127.0.0.1:54620 latency=370.822µs 31:22.464 [INFO] TestAgent: Requesting shutdown 31:22.464 [INFO] TestAgent.server: shutting down server 31:22.464 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:22.464 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:22.464 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:22.464 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:22.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:22.464 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:22.464 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:22.464 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:22.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:22.464 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:22.464 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:22.464 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:22.464 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:22.464 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:22.476 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:22.483Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:22.483Z [INFO] agent.router.manager: shutting down 31:22.483 [INFO] TestAgent: consul server down 31:22.483 [INFO] TestAgent: shutdown complete 31:22.483 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=tcp 31:22.484 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=udp 31:22.484 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30422 network=tcp 31:22.984 [INFO] TestAgent: Waiting for endpoints to shut down 31:22.984 [INFO] TestAgent: Endpoints down --- PASS: TestTokenDeleteCommand (0.93s) PASS ok github.com/hashicorp/consul/command/acl/token/delete 1.144s === RUN TestTokenListCommand_noTabs === PAUSE TestTokenListCommand_noTabs === RUN TestTokenListCommand_Pretty === PAUSE TestTokenListCommand_Pretty === RUN TestTokenListCommand_JSON === PAUSE TestTokenListCommand_JSON === CONT TestTokenListCommand_noTabs === CONT TestTokenListCommand_JSON --- PASS: TestTokenListCommand_noTabs (0.01s) === CONT TestTokenListCommand_Pretty [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:31:32.038Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.073Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.115 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e3686018-8cb7-c3c7-2159-87c868f909f6 Address:127.0.0.1:10013}]" 31:32.116 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:10013 [Follower]" leader= 31:32.116 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e3686018-8cb7-c3c7-2159-87c868f909f6.dc1 127.0.0.1 31:32.117 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e3686018-8cb7-c3c7-2159-87c868f909f6 127.0.0.1 2021-10-05T16:31:32.117Z [INFO] agent.router: Initializing LAN area manager 31:32.117 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10008 network=udp 31:32.117 [INFO] TestAgent.server: Adding LAN server: server="Node-e3686018-8cb7-c3c7-2159-87c868f909f6 (Addr: tcp/127.0.0.1:10013) (DC: dc1)" 31:32.117 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e3686018-8cb7-c3c7-2159-87c868f909f6.dc1 area=wan 31:32.118 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10008 network=tcp 31:32.118 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:10009 network=tcp 31:32.118 [INFO] TestAgent: started state syncer 31:32.118 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:10014 network=tcp 31:32.169 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:32.176 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.176 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:10013 [Candidate]" term=2 31:32.220 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.220 [DEBUG] TestAgent.server.raft: vote granted: from=e3686018-8cb7-c3c7-2159-87c868f909f6 term=2 tally=1 31:32.220 [INFO] TestAgent.server.raft: election won: tally=1 31:32.220 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:10013 [Leader]" 31:32.224 [INFO] TestAgent.server: cluster leadership acquired 31:32.224 [INFO] TestAgent.server: New leader elected: payload=Node-e3686018-8cb7-c3c7-2159-87c868f909f6 31:32.238 [INFO] TestAgent.server: initializing acls 31:32.243 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:32.243 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:32.256 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:32.271 [INFO] TestAgent.server: initializing acls 31:32.271 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:32.294 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:32.294 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:32.294 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:32.294 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 31:32.294 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-e3686018-8cb7-c3c7-2159-87c868f909f6 31:32.294 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-e3686018-8cb7-c3c7-2159-87c868f909f6.dc1 31:32.294 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-e3686018-8cb7-c3c7-2159-87c868f909f6.dc1 area=wan 31:32.294 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:32.294 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-e3686018-8cb7-c3c7-2159-87c868f909f6 31:32.294 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-e3686018-8cb7-c3c7-2159-87c868f909f6.dc1 31:32.296 [INFO] TestAgent.server: Updating LAN server: server="Node-e3686018-8cb7-c3c7-2159-87c868f909f6 (Addr: tcp/127.0.0.1:10013) (DC: dc1)" 31:32.296 [INFO] TestAgent.server: Updating LAN server: server="Node-e3686018-8cb7-c3c7-2159-87c868f909f6 (Addr: tcp/127.0.0.1:10013) (DC: dc1)" 31:32.296 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-e3686018-8cb7-c3c7-2159-87c868f909f6.dc1 area=wan 31:32.331 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.376 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.376 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.376 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.376 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.376 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.376 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3686018-8cb7-c3c7-2159-87c868f909f6 31:32.376 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e3686018-8cb7-c3c7-2159-87c868f909f6 31:32.396 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3686018-8cb7-c3c7-2159-87c868f909f6 31:32.396 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e3686018-8cb7-c3c7-2159-87c868f909f6 31:32.404 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.448 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:32.464 [INFO] TestAgent: Synced node info 31:32.502 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:49280 latency=21.887698ms 31:32.520 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:49280 latency=11.917005ms 31:32.548 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:49280 latency=20.350825ms 31:32.573 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:49280 latency=17.435766ms 31:32.592 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:49280 latency=17.957178ms 31:32.601 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/tokens from=127.0.0.1:49284 latency=525.879µs 31:32.612 [INFO] TestAgent: Requesting shutdown 31:32.617 [INFO] TestAgent.server: shutting down server 31:32.617 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:32.617 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.617 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.617 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.617 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.617 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:32.617 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.617 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.617 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.618 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:32.618 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:32.618 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.618 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.618 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.636 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.644Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.644Z [INFO] agent.router.manager: shutting down 31:32.645 [INFO] TestAgent: consul server down 31:32.645 [INFO] TestAgent: shutdown complete 31:32.645 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10008 network=tcp 31:32.645 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10008 network=udp 31:32.645 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:10009 network=tcp 31:33.152 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.152 [INFO] TestAgent: Endpoints down --- PASS: TestTokenListCommand_JSON (1.23s) 2021-10-05T16:31:32.029Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.052Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.094 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:58b31c3b-9e62-53e4-f6b8-c393bd7bac8c Address:127.0.0.1:10006}]" 31:32.095 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c.dc1 127.0.0.1 31:32.096 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c 127.0.0.1 2021-10-05T16:31:32.096Z [INFO] agent.router: Initializing LAN area manager 31:32.096 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:10006 [Follower]" leader= 31:32.096 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10001 network=udp 31:32.096 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c.dc1 area=wan 31:32.096 [INFO] TestAgent.server: Adding LAN server: server="Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c (Addr: tcp/127.0.0.1:10006) (DC: dc1)" 31:32.096 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10001 network=tcp 31:32.097 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:10002 network=tcp 31:32.097 [INFO] TestAgent: started state syncer 31:32.097 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:10007 network=tcp 31:32.132 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.132 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:10006 [Candidate]" term=2 31:32.147 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:32.172 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.172 [DEBUG] TestAgent.server.raft: vote granted: from=58b31c3b-9e62-53e4-f6b8-c393bd7bac8c term=2 tally=1 31:32.172 [INFO] TestAgent.server.raft: election won: tally=1 31:32.172 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:10006 [Leader]" 31:32.172 [INFO] TestAgent.server: cluster leadership acquired 31:32.172 [INFO] TestAgent.server: New leader elected: payload=Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c 31:32.195 [INFO] TestAgent.server: initializing acls 31:32.215 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:32.215 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:32.222 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:32.231 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:32.231 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:32.231 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:32.232 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c 31:32.232 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c.dc1 31:32.232 [INFO] TestAgent.server: Updating LAN server: server="Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c (Addr: tcp/127.0.0.1:10006) (DC: dc1)" 31:32.232 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c.dc1 area=wan 31:32.244 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.292 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.292 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.292 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.292 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.292 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.292 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c 31:32.292 [INFO] TestAgent.server: member joined, marking health alive: member=Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c 31:32.321 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-58b31c3b-9e62-53e4-f6b8-c393bd7bac8c 31:32.329 [INFO] TestAgent.server: federation state anti-entropy synced 31:32.551 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:32.560 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:48974 latency=19.527287ms 31:32.572 [INFO] TestAgent: Synced node info 31:32.582 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:48974 latency=17.897397ms 31:32.595 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:48974 latency=11.32332ms 31:32.624 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:48974 latency=22.960764ms 31:32.634 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:48974 latency=9.030814ms 31:32.635 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/tokens from=127.0.0.1:48978 latency=554.204µs 31:32.636 [INFO] TestAgent: Requesting shutdown 31:32.636 [INFO] TestAgent.server: shutting down server 31:32.636 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:32.636 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:32.636 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:32.636 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:32.636 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:32.636 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:32.636 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:32.636 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:32.636 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:32.636 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:32.636 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:32.636 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:32.636 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:32.636 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:32.643 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:32.652Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:32.652Z [INFO] agent.router.manager: shutting down 31:32.652 [INFO] TestAgent: consul server down 31:32.652 [INFO] TestAgent: shutdown complete 31:32.652 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10001 network=tcp 31:32.652 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10001 network=udp 31:32.652 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:10002 network=tcp 31:33.154 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.154 [INFO] TestAgent: Endpoints down --- PASS: TestTokenListCommand_Pretty (1.22s) PASS ok github.com/hashicorp/consul/command/acl/token/list 1.447s === RUN TestTokenReadCommand_noTabs === PAUSE TestTokenReadCommand_noTabs === RUN TestTokenReadCommand_Pretty === PAUSE TestTokenReadCommand_Pretty === RUN TestTokenReadCommand_JSON === PAUSE TestTokenReadCommand_JSON === CONT TestTokenReadCommand_noTabs --- PASS: TestTokenReadCommand_noTabs (0.00s) === CONT TestTokenReadCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestTokenReadCommand_Pretty [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:31:32.523Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.569Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.657 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8d1ec6f4-8ae2-b951-7799-2990fd11ada3 Address:127.0.0.1:20223}]" 31:32.657 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:20223 [Follower]" leader= 31:32.658 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3.dc1 127.0.0.1 31:32.659 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 127.0.0.1 2021-10-05T16:31:32.659Z [INFO] agent.router: Initializing LAN area manager 31:32.659 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20218 network=udp 31:32.660 [INFO] TestAgent.server: Adding LAN server: server="Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 (Addr: tcp/127.0.0.1:20223) (DC: dc1)" 31:32.660 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3.dc1 area=wan 31:32.660 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20218 network=tcp 31:32.661 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:20219 network=tcp 31:32.661 [INFO] TestAgent: started state syncer 31:32.661 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:20224 network=tcp 31:32.699 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.699 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:20223 [Candidate]" term=2 31:32.710 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:32.720 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.720 [DEBUG] TestAgent.server.raft: vote granted: from=8d1ec6f4-8ae2-b951-7799-2990fd11ada3 term=2 tally=1 31:32.720 [INFO] TestAgent.server.raft: election won: tally=1 31:32.720 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:20223 [Leader]" 31:32.724 [INFO] TestAgent.server: cluster leadership acquired 31:32.724 [INFO] TestAgent.server: New leader elected: payload=Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 31:32.733 [INFO] TestAgent.server: initializing acls 31:32.742 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:32.742 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:32.760 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:32.784 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:32.784 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:32.784 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:32.784 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 31:32.784 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3.dc1 31:32.784 [INFO] TestAgent.server: Updating LAN server: server="Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 (Addr: tcp/127.0.0.1:20223) (DC: dc1)" 31:32.784 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3.dc1 area=wan 31:32.800 [INFO] TestAgent: Synced node info 31:32.810 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.838 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.838 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.838 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.838 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.838 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.838 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 31:32.838 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 31:32.851 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8d1ec6f4-8ae2-b951-7799-2990fd11ada3 31:32.870 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.002 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:46244 latency=18.076371ms 31:33.004 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/cae8a006-e448-3501-b4c7-a5f66499ca89 from=127.0.0.1:46246 latency=498.294µs 31:33.005 [INFO] TestAgent: Requesting shutdown 31:33.005 [INFO] TestAgent.server: shutting down server 31:33.005 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:33.005 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:33.005 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.005 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.005 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.005 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.005 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.005 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.005 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.005 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:33.005 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:33.005 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.005 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.005 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.010 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.019Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.019Z [INFO] agent.router.manager: shutting down 31:33.019 [INFO] TestAgent: consul server down 31:33.019 [INFO] TestAgent: shutdown complete 31:33.019 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20218 network=tcp 31:33.019 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20218 network=udp 31:33.019 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:20219 network=tcp 31:33.520 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.520 [INFO] TestAgent: Endpoints down --- PASS: TestTokenReadCommand_Pretty (1.11s) 2021-10-05T16:31:32.526Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:32.585Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:32.660 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:74abd4b2-9417-7e9b-1e69-4a29ca18e808 Address:127.0.0.1:20216}]" 31:32.660 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:20216 [Follower]" leader= 31:32.661 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808.dc1 127.0.0.1 31:32.661 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 127.0.0.1 2021-10-05T16:31:32.661Z [INFO] agent.router: Initializing LAN area manager 31:32.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20211 network=udp 31:32.662 [INFO] TestAgent.server: Adding LAN server: server="Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 (Addr: tcp/127.0.0.1:20216) (DC: dc1)" 31:32.662 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808.dc1 area=wan 31:32.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20211 network=tcp 31:32.662 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:20212 network=tcp 31:32.662 [INFO] TestAgent: started state syncer 31:32.662 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:20217 network=tcp 31:32.711 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:32.711 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:20216 [Candidate]" term=2 31:32.713 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:32.731 [DEBUG] TestAgent.server.raft: votes: needed=1 31:32.731 [DEBUG] TestAgent.server.raft: vote granted: from=74abd4b2-9417-7e9b-1e69-4a29ca18e808 term=2 tally=1 31:32.731 [INFO] TestAgent.server.raft: election won: tally=1 31:32.731 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:20216 [Leader]" 31:32.732 [INFO] TestAgent.server: cluster leadership acquired 31:32.732 [INFO] TestAgent.server: New leader elected: payload=Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 31:32.750 [INFO] TestAgent.server: initializing acls 31:32.757 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:32.757 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:32.773 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:32.797 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:32.797 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:32.797 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:32.797 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 31:32.798 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808.dc1 31:32.800 [INFO] TestAgent.server: Updating LAN server: server="Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 (Addr: tcp/127.0.0.1:20216) (DC: dc1)" 31:32.800 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808.dc1 area=wan 31:32.842 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:32.892 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:32.892 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:32.892 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:32.892 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:32.892 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:32.892 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 31:32.892 [INFO] TestAgent.server: member joined, marking health alive: member=Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 31:32.908 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-74abd4b2-9417-7e9b-1e69-4a29ca18e808 31:32.932 [INFO] TestAgent.server: federation state anti-entropy synced 31:33.020 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:33.028 [INFO] TestAgent: Synced node info 31:33.029 [DEBUG] TestAgent: Node info in sync 31:33.110 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:33454 latency=5.808409ms 31:33.111 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/7114bb8c-e119-7b89-5243-5f2da4e89d01 from=127.0.0.1:33456 latency=510.695µs 31:33.112 [INFO] TestAgent: Requesting shutdown 31:33.112 [INFO] TestAgent.server: shutting down server 31:33.112 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:33.112 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:33.112 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:33.112 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:33.112 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:33.112 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:33.112 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:33.112 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:33.112 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:33.112 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:33.112 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:33.112 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:33.112 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:33.112 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:33.116 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:33.125Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:33.125Z [INFO] agent.router.manager: shutting down 31:33.126 [INFO] TestAgent: consul server down 31:33.126 [INFO] TestAgent: shutdown complete 31:33.126 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20211 network=tcp 31:33.126 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20211 network=udp 31:33.126 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:20212 network=tcp 31:33.628 [INFO] TestAgent: Waiting for endpoints to shut down 31:33.628 [INFO] TestAgent: Endpoints down --- PASS: TestTokenReadCommand_JSON (1.22s) PASS ok github.com/hashicorp/consul/command/acl/token/read 1.490s === RUN TestTokenUpdateCommand_noTabs === PAUSE TestTokenUpdateCommand_noTabs === RUN TestTokenUpdateCommand === PAUSE TestTokenUpdateCommand === RUN TestTokenUpdateCommand_JSON === PAUSE TestTokenUpdateCommand_JSON === CONT TestTokenUpdateCommand_noTabs --- PASS: TestTokenUpdateCommand_noTabs (0.00s) === CONT TestTokenUpdateCommand_JSON [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestTokenUpdateCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestTokenUpdateCommand/node-identity === RUN TestTokenUpdateCommand/node-identity-merge === RUN TestTokenUpdateCommand_JSON/update_with_policy_by_name === RUN TestTokenUpdateCommand/policy-name === RUN TestTokenUpdateCommand/policy-id === RUN TestTokenUpdateCommand/merge-description 2021-10-05T16:31:34.311Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.339Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.393 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:49ac9b20-fb06-f13d-447d-4b90d4599a00 Address:127.0.0.1:12048}]" 31:34.393 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:12048 [Follower]" leader= 31:34.395 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-49ac9b20-fb06-f13d-447d-4b90d4599a00.dc1 127.0.0.1 31:34.395 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 127.0.0.1 2021-10-05T16:31:34.395Z [INFO] agent.router: Initializing LAN area manager 31:34.396 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=udp 31:34.396 [INFO] TestAgent.server: Adding LAN server: server="Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 (Addr: tcp/127.0.0.1:12048) (DC: dc1)" 31:34.396 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-49ac9b20-fb06-f13d-447d-4b90d4599a00.dc1 area=wan 31:34.396 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=tcp 31:34.397 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:12044 network=tcp 31:34.397 [INFO] TestAgent: started state syncer 31:34.397 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:12049 network=tcp 31:34.443 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.443 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:12048 [Candidate]" term=2 31:34.448 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:34.456 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.456 [DEBUG] TestAgent.server.raft: vote granted: from=49ac9b20-fb06-f13d-447d-4b90d4599a00 term=2 tally=1 31:34.456 [INFO] TestAgent.server.raft: election won: tally=1 31:34.456 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:12048 [Leader]" 31:34.460 [INFO] TestAgent.server: cluster leadership acquired 31:34.460 [INFO] TestAgent.server: New leader elected: payload=Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 31:34.468 [INFO] TestAgent.server: initializing acls 31:34.475 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:34.475 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:34.491 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:34.515 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:34.515 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:34.515 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:34.516 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 31:34.516 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-49ac9b20-fb06-f13d-447d-4b90d4599a00.dc1 31:34.516 [INFO] TestAgent.server: Updating LAN server: server="Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 (Addr: tcp/127.0.0.1:12048) (DC: dc1)" 31:34.516 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-49ac9b20-fb06-f13d-447d-4b90d4599a00.dc1 area=wan 31:34.545 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.586 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.586 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.586 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.586 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.586 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.592 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 31:34.592 [INFO] TestAgent.server: member joined, marking health alive: member=Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 31:34.609 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-49ac9b20-fb06-f13d-447d-4b90d4599a00 31:34.609 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.622 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:34.641 [INFO] TestAgent: Synced node info 31:34.833 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:58132 latency=10.348815ms 31:34.845 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:58132 latency=4.880356ms 31:34.851 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/2eaa63b8-237e-216c-10b6-2eb70a978a17 from=127.0.0.1:58138 latency=1.277246ms 31:34.869 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/2eaa63b8-237e-216c-10b6-2eb70a978a17 from=127.0.0.1:58138 latency=17.291492ms 31:34.873 [INFO] TestAgent: Requesting shutdown 31:34.873 [INFO] TestAgent.server: shutting down server 31:34.873 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:34.873 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:34.873 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:34.873 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:34.873 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:34.873 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:34.873 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:34.873 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:34.873 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:34.873 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:34.873 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:34.873 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:34.873 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:34.873 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:34.888 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:34.896Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:34.896Z [INFO] agent.router.manager: shutting down 31:34.896 [INFO] TestAgent: consul server down 31:34.896 [INFO] TestAgent: shutdown complete 31:34.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=tcp 31:34.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=udp 31:34.896 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:12044 network=tcp 31:35.400 [INFO] TestAgent: Waiting for endpoints to shut down 31:35.400 [INFO] TestAgent: Endpoints down --- PASS: TestTokenUpdateCommand_JSON (1.20s) --- PASS: TestTokenUpdateCommand_JSON/update_with_policy_by_name (0.02s) === RUN TestTokenUpdateCommand/legacy-upgrade 2021-10-05T16:31:34.326Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:34.375Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:34.466 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4a0a20b5-351c-1c5a-a25c-934b2cd39c66 Address:127.0.0.1:12055}]" 31:34.467 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66.dc1 127.0.0.1 31:34.467 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 127.0.0.1 2021-10-05T16:31:34.467Z [INFO] agent.router: Initializing LAN area manager 31:34.467 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12050 network=udp 31:34.467 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:12055 [Follower]" leader= 31:34.468 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66.dc1 area=wan 31:34.468 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12050 network=tcp 31:34.469 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:12051 network=tcp 31:34.470 [INFO] TestAgent.server: Adding LAN server: server="Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 (Addr: tcp/127.0.0.1:12055) (DC: dc1)" 31:34.470 [INFO] TestAgent: started state syncer 31:34.474 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:12056 network=tcp 31:34.506 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:34.506 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:12055 [Candidate]" term=2 31:34.518 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 31:34.530 [DEBUG] TestAgent.server.raft: votes: needed=1 31:34.530 [DEBUG] TestAgent.server.raft: vote granted: from=4a0a20b5-351c-1c5a-a25c-934b2cd39c66 term=2 tally=1 31:34.530 [INFO] TestAgent.server.raft: election won: tally=1 31:34.530 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:12055 [Leader]" 31:34.530 [INFO] TestAgent.server: cluster leadership acquired 31:34.531 [INFO] TestAgent.server: New leader elected: payload=Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 31:34.549 [INFO] TestAgent.server: initializing acls 31:34.553 [INFO] TestAgent.server: Created ACL 'global-management' policy 31:34.553 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 31:34.570 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 31:34.596 [INFO] TestAgent.server: Created ACL anonymous token from configuration 31:34.596 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 31:34.596 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 31:34.596 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 31:34.596 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66.dc1 31:34.597 [INFO] TestAgent.server: Updating LAN server: server="Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 (Addr: tcp/127.0.0.1:12055) (DC: dc1)" 31:34.597 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66.dc1 area=wan 31:34.641 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:34.708 [INFO] TestAgent: Synced node info 31:34.732 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:34.732 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:34.732 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:34.732 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:34.732 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:34.732 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 31:34.732 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 31:34.765 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/policy from=127.0.0.1:47692 latency=20.648153ms 31:34.765 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4a0a20b5-351c-1c5a-a25c-934b2cd39c66 31:34.780 [INFO] TestAgent.server: federation state anti-entropy synced 31:34.802 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:47692 latency=20.722882ms 31:34.823 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/create from=127.0.0.1:47692 latency=15.074531ms 31:34.830 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47696 latency=3.249505ms 31:34.838 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47696 latency=7.413206ms 31:34.842 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47698 latency=351.954µs 31:34.855 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47698 latency=6.882148ms 31:34.869 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47702 latency=597.758µs 31:34.893 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47702 latency=16.672412ms 31:34.900 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47704 latency=428.204µs 31:34.924 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47704 latency=20.043527ms 31:34.928 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47706 latency=376.104µs 31:34.937 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/0e3c6864-e6e5-fd9a-4eff-ee41e7500cc9 from=127.0.0.1:47706 latency=4.204207ms 31:34.944 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=264.136µs 31:34.973 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=1.203311ms 31:35.002 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=299.784µs 31:35.028 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=340.41µs 31:35.059 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=400.478µs 31:35.087 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=384.457µs 31:35.115 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=473.937µs 31:35.148 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=665.313µs 31:35.176 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=273.103µs 31:35.207 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=221.804µs 31:35.236 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=208.636µs 31:35.262 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=219.103µs 31:35.289 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=250.497µs 31:35.320 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=299.704µs 31:35.352 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=3.850988ms 31:35.384 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=271.22µs 31:35.412 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=248.562µs 31:35.444 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=333.551µs 31:35.472 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=327.273µs 31:35.500 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=254.835µs 31:35.532 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=241.238µs 31:35.564 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=219.879µs 31:35.596 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=263.552µs 31:35.628 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/self from=127.0.0.1:47692 latency=491.966µs 31:35.634 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/acl/token/d06d6404-c5f4-2556-a906-261bce62e03f from=127.0.0.1:47710 latency=734.723µs 31:35.652 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token/d06d6404-c5f4-2556-a906-261bce62e03f from=127.0.0.1:47710 latency=17.313047ms 31:35.654 [INFO] TestAgent: Requesting shutdown 31:35.654 [INFO] TestAgent.server: shutting down server 31:35.654 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:35.654 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 31:35.654 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 31:35.654 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:35.654 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:35.654 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:35.654 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:35.654 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:35.654 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:35.654 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:35.654 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 31:35.654 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 31:35.654 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:35.654 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:35.668 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:35.676Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:35.676Z [INFO] agent.router.manager: shutting down 31:35.676 [INFO] TestAgent: consul server down 31:35.676 [INFO] TestAgent: shutdown complete 31:35.676 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12050 network=tcp 31:35.676 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12050 network=udp 31:35.676 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:12051 network=tcp 31:36.181 [INFO] TestAgent: Waiting for endpoints to shut down 31:36.181 [INFO] TestAgent: Endpoints down --- PASS: TestTokenUpdateCommand (1.97s) --- PASS: TestTokenUpdateCommand/node-identity (0.02s) --- PASS: TestTokenUpdateCommand/node-identity-merge (0.02s) --- PASS: TestTokenUpdateCommand/policy-name (0.04s) --- PASS: TestTokenUpdateCommand/policy-id (0.03s) --- PASS: TestTokenUpdateCommand/merge-description (0.02s) --- PASS: TestTokenUpdateCommand/legacy-upgrade (0.02s) PASS ok github.com/hashicorp/consul/command/acl/token/update 2.300s === RUN TestConfigFail === PAUSE TestConfigFail === RUN TestRetryJoin [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:31:45.105Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.131Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.180 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:54399593-f2c5-35c2-9402-9739ff77248a Address:127.0.0.1:21244}]" 31:45.180 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21244 [Follower]" leader= 31:45.181 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-54399593-f2c5-35c2-9402-9739ff77248a.dc1 127.0.0.1 31:45.188 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-54399593-f2c5-35c2-9402-9739ff77248a 127.0.0.1 2021-10-05T16:31:45.188Z [INFO] agent.router: Initializing LAN area manager 31:45.189 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=udp 31:45.189 [INFO] TestAgent.server: Adding LAN server: server="Node-54399593-f2c5-35c2-9402-9739ff77248a (Addr: tcp/127.0.0.1:21244) (DC: dc1)" 31:45.189 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-54399593-f2c5-35c2-9402-9739ff77248a.dc1 area=wan 31:45.189 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=tcp 31:45.190 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21240 network=tcp 31:45.190 [INFO] TestAgent: started state syncer 31:45.190 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21245 network=tcp 31:45.190 [INFO] TestAgent: Retry join is supported for the following discovery methods: cluster=LAN discovery_methods="aliyun aws gce mdns os packet" 31:45.190 [INFO] TestAgent: Joining cluster...: cluster=LAN 31:45.190 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:21235] 31:45.190 [INFO] TestAgent: Retry join is supported for the following discovery methods: cluster=WAN discovery_methods="aliyun aws gce mdns os packet" 31:45.190 [INFO] TestAgent: Joining cluster...: cluster=WAN 31:45.190 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:21236] 31:45.192 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:21235 31:45.225 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:21236 31:45.233 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4a66d227-00e8-bbd9-83b2-416b734a84dd.dc1 127.0.0.1 31:45.233 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 31:45.233 [INFO] TestAgent: Join cluster completed. Synced with initial agents: cluster=WAN num_agents=1 31:45.233 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd.dc1 area=wan 31:45.243 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.243 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21244 [Candidate]" term=2 31:45.260 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 127.0.0.1 31:45.261 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 31:45.261 [DEBUG] TestAgent: systemd notify failed: error="No socket" 31:45.261 [INFO] TestAgent: Join cluster completed. Synced with initial agents: cluster=LAN num_agents=1 31:45.261 [INFO] TestAgent.server: Adding LAN server: server="Node-4a66d227-00e8-bbd9-83b2-416b734a84dd (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 31:45.281 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.281 [DEBUG] TestAgent.server.raft: vote granted: from=54399593-f2c5-35c2-9402-9739ff77248a term=2 tally=1 31:45.281 [INFO] TestAgent.server.raft: election won: tally=1 31:45.281 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21244 [Leader]" 31:45.281 [INFO] TestAgent.server: cluster leadership acquired 31:45.281 [INFO] TestAgent.server: New leader elected: payload=Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.304 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21244 31:45.352 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.389 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.389 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.389 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.389 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.389 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.390 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-54399593-f2c5-35c2-9402-9739ff77248a other=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 31:45.390 [INFO] TestAgent.server: member joined, marking health alive: member=Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.398 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd other=Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.398 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 31:45.404 [DEBUG] TestAgent.server.serf.lan: serf: messageUserEventType: consul:new-leader 31:45.404 [DEBUG] TestAgent.server.serf.lan: serf: messageUserEventType: consul:new-leader 31:45.404 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.421 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:45.424 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.430 [INFO] TestAgent: Synced node info 31:45.605 [DEBUG] TestAgent.server.serf.lan: serf: messageUserEventType: consul:new-leader 31:45.605 [DEBUG] TestAgent.server.serf.lan: serf: messageUserEventType: consul:new-leader 31:45.605 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.625 [INFO] TestAgent: Requesting shutdown 31:45.626 [INFO] TestAgent.server: shutting down server 31:45.626 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.626 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.626 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.626 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.626 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.626 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:45.626 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.626 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.626 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.626 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.636 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.646Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.646Z [INFO] agent.router.manager: shutting down 31:45.646 [INFO] TestAgent: consul server down 31:45.646 [INFO] TestAgent: shutdown complete 31:45.646 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=tcp 31:45.646 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=udp 31:45.646 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21240 network=tcp 31:46.147 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.147 [INFO] TestAgent: Endpoints down 2021-10-05T16:31:44.679Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:44.699Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:44.798 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4a66d227-00e8-bbd9-83b2-416b734a84dd Address:127.0.0.1:21237}]" 31:44.799 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4a66d227-00e8-bbd9-83b2-416b734a84dd.dc1 127.0.0.1 31:44.800 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21237 [Follower]" leader= 31:44.801 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 127.0.0.1 2021-10-05T16:31:44.801Z [INFO] agent.router: Initializing LAN area manager 31:44.801 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=udp 31:44.801 [INFO] TestAgent.server: Adding LAN server: server="Node-4a66d227-00e8-bbd9-83b2-416b734a84dd (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 31:44.802 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd.dc1 area=wan 31:44.802 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=tcp 31:44.803 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21233 network=tcp 31:44.803 [INFO] TestAgent: started state syncer 31:44.803 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21238 network=tcp 31:44.872 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:44.872 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21237 [Candidate]" term=2 31:44.920 [DEBUG] TestAgent.server.raft: votes: needed=1 31:44.920 [DEBUG] TestAgent.server.raft: vote granted: from=4a66d227-00e8-bbd9-83b2-416b734a84dd term=2 tally=1 31:44.920 [INFO] TestAgent.server.raft: election won: tally=1 31:44.920 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21237 [Leader]" 31:44.924 [INFO] TestAgent.server: cluster leadership acquired 31:44.924 [INFO] TestAgent.server: New leader elected: payload=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 31:44.960 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21237 31:44.988 [INFO] TestAgent: Synced node info 31:45.020 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.049 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.049 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.049 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.049 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.049 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.049 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 31:45.049 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 31:45.068 [INFO] TestAgent.server: federation state anti-entropy synced 31:45.225 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:60436 31:45.233 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-54399593-f2c5-35c2-9402-9739ff77248a.dc1 127.0.0.1 31:45.233 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-54399593-f2c5-35c2-9402-9739ff77248a.dc1 area=wan 31:45.239 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:48086 31:45.240 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-54399593-f2c5-35c2-9402-9739ff77248a 127.0.0.1 31:45.240 [INFO] TestAgent.server: Adding LAN server: server="Node-54399593-f2c5-35c2-9402-9739ff77248a (Addr: tcp/127.0.0.1:21244) (DC: dc1)" 31:45.240 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-54399593-f2c5-35c2-9402-9739ff77248a other=Node-4a66d227-00e8-bbd9-83b2-416b734a84dd 31:45.240 [INFO] TestAgent.server: member joined, marking health alive: member=Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.391 [DEBUG] TestAgent.server.serf.lan: serf: messageUserEventType: consul:new-leader 31:45.391 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.391 [INFO] TestAgent.server: New leader elected: payload=Node-54399593-f2c5-35c2-9402-9739ff77248a 31:45.597 [DEBUG] TestAgent.server.serf.lan: serf: messageUserEventType: consul:new-leader 31:45.597 [DEBUG] TestAgent.server.serf.lan: serf: messageJoinType: Node-54399593-f2c5-35c2-9402-9739ff77248a 31:46.147 [INFO] TestAgent: Requesting shutdown 31:46.147 [INFO] TestAgent.server: shutting down server 31:46.147 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:46.147 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:46.147 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:46.147 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:46.147 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:46.147 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:46.147 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:46.147 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:46.147 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:46.147 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:46.156 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:46.163Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:46.163Z [INFO] agent.router.manager: shutting down 31:46.163 [INFO] TestAgent: consul server down 31:46.163 [INFO] TestAgent: shutdown complete 31:46.163 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=tcp 31:46.163 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=udp 31:46.163 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21233 network=tcp 31:46.304 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-54399593-f2c5-35c2-9402-9739ff77248a (timeout reached) 31:46.664 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.664 [INFO] TestAgent: Endpoints down --- PASS: TestRetryJoin (2.04s) === RUN TestRetryJoinFail === PAUSE TestRetryJoinFail === RUN TestRetryJoinWanFail === PAUSE TestRetryJoinWanFail === RUN TestProtectDataDir === PAUSE TestProtectDataDir === RUN TestBadDataDirPermissions === PAUSE TestBadDataDirPermissions === CONT TestConfigFail === RUN TestConfigFail/agent_-server_-bind=10.0.0.1_-datacenter= === CONT TestProtectDataDir === CONT TestBadDataDirPermissions === CONT TestRetryJoinWanFail === CONT TestRetryJoinFail --- PASS: TestProtectDataDir (0.05s) --- PASS: TestBadDataDirPermissions (0.05s) === RUN TestConfigFail/agent_-server_-bind=10.0.0.1_-datacenter=foo_some-other-arg --- PASS: TestRetryJoinWanFail (0.13s) === RUN TestConfigFail/agent_-server_-bind=10.0.0.1 === RUN TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise_0.0.0.0_-bind_10.0.0.1 --- PASS: TestRetryJoinFail (0.64s) === RUN TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise_::_-bind_10.0.0.1 === RUN TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise_[::]_-bind_10.0.0.1 === RUN TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise-wan_0.0.0.0_-bind_10.0.0.1 === RUN TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise-wan_::_-bind_10.0.0.1 === RUN TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise-wan_[::]_-bind_10.0.0.1 --- PASS: TestConfigFail (1.51s) --- PASS: TestConfigFail/agent_-server_-bind=10.0.0.1_-datacenter= (0.12s) --- PASS: TestConfigFail/agent_-server_-bind=10.0.0.1_-datacenter=foo_some-other-arg (0.15s) --- PASS: TestConfigFail/agent_-server_-bind=10.0.0.1 (0.14s) --- PASS: TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise_0.0.0.0_-bind_10.0.0.1 (0.36s) --- PASS: TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise_::_-bind_10.0.0.1 (0.14s) --- PASS: TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise_[::]_-bind_10.0.0.1 (0.10s) --- PASS: TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise-wan_0.0.0.0_-bind_10.0.0.1 (0.08s) --- PASS: TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise-wan_::_-bind_10.0.0.1 (0.18s) --- PASS: TestConfigFail/agent_-server_-data-dir_/tmp/consul-test/TestConfigFail-consul987952697_-advertise-wan_[::]_-bind_10.0.0.1 (0.23s) PASS ok github.com/hashicorp/consul/command/agent 3.643s === RUN TestCatalogCommand_noTabs === PAUSE TestCatalogCommand_noTabs === CONT TestCatalogCommand_noTabs --- PASS: TestCatalogCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/catalog 0.059s === RUN TestCatalogListDatacentersCommand_noTabs === PAUSE TestCatalogListDatacentersCommand_noTabs === RUN TestCatalogListDatacentersCommand_Validation === PAUSE TestCatalogListDatacentersCommand_Validation === RUN TestCatalogListDatacentersCommand === PAUSE TestCatalogListDatacentersCommand === CONT TestCatalogListDatacentersCommand_noTabs --- PASS: TestCatalogListDatacentersCommand_noTabs (0.00s) === CONT TestCatalogListDatacentersCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCatalogListDatacentersCommand_Validation --- PASS: TestCatalogListDatacentersCommand_Validation (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:31:45.621Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:45.657Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:45.707 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9b398136-6ae9-8c63-e1fc-2b1239a12779 Address:127.0.0.1:31447}]" 31:45.708 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9b398136-6ae9-8c63-e1fc-2b1239a12779.dc1 127.0.0.1 31:45.708 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:31447 [Follower]" leader= 31:45.712 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9b398136-6ae9-8c63-e1fc-2b1239a12779 127.0.0.1 2021-10-05T16:31:45.712Z [INFO] agent.router: Initializing LAN area manager 31:45.713 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31442 network=udp 31:45.713 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31442 network=tcp 31:45.713 [INFO] TestAgent.server: Adding LAN server: server="Node-9b398136-6ae9-8c63-e1fc-2b1239a12779 (Addr: tcp/127.0.0.1:31447) (DC: dc1)" 31:45.714 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:31443 network=tcp 31:45.714 [INFO] TestAgent: started state syncer 31:45.714 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:31448 network=tcp 31:45.714 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9b398136-6ae9-8c63-e1fc-2b1239a12779.dc1 area=wan 31:45.760 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:45.760 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:31447 [Candidate]" term=2 31:45.788 [DEBUG] TestAgent.server.raft: votes: needed=1 31:45.788 [DEBUG] TestAgent.server.raft: vote granted: from=9b398136-6ae9-8c63-e1fc-2b1239a12779 term=2 tally=1 31:45.788 [INFO] TestAgent.server.raft: election won: tally=1 31:45.788 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:31447 [Leader]" 31:45.790 [INFO] TestAgent.server: cluster leadership acquired 31:45.790 [INFO] TestAgent.server: New leader elected: payload=Node-9b398136-6ae9-8c63-e1fc-2b1239a12779 31:45.823 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:31447 31:45.848 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:45.924 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/datacenters from=127.0.0.1:45670 latency=448.949µs 31:45.928 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:45.928 [INFO] TestAgent: Requesting shutdown 31:45.928 [INFO] TestAgent.server: shutting down server 31:45.928 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:45.928 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:45.928 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:45.928 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:45.932 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:45.932 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9b398136-6ae9-8c63-e1fc-2b1239a12779 31:45.932 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9b398136-6ae9-8c63-e1fc-2b1239a12779 31:45.936 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:45.936 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:45.936 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:45.936 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:45.928 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 31:45.936 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:45.936 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:45.936 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:45.936 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:45.936 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:45.940 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:45.945Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:45.945Z [INFO] agent.router.manager: shutting down 31:45.956 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-9b398136-6ae9-8c63-e1fc-2b1239a12779 127.0.0.1 31445 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:9b398136-6ae9-8c63-e1fc-2b1239a12779 port:31447 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:31446] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 31:45.956 [INFO] TestAgent: consul server down 31:45.956 [INFO] TestAgent: shutdown complete 31:45.956 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31442 network=tcp 31:45.956 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31442 network=udp 31:45.956 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:31443 network=tcp 31:46.460 [INFO] TestAgent: Waiting for endpoints to shut down 31:46.460 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogListDatacentersCommand (0.90s) PASS ok github.com/hashicorp/consul/command/catalog/list/dc 1.016s === RUN TestCatalogListNodesCommand_noTabs === PAUSE TestCatalogListNodesCommand_noTabs === RUN TestCatalogListNodesCommand_Validation === PAUSE TestCatalogListNodesCommand_Validation === RUN TestCatalogListNodesCommand === PAUSE TestCatalogListNodesCommand === RUN TestCatalogListNodesCommand_verticalBar catalog_list_nodes_test.go:168: DM-skipped --- SKIP: TestCatalogListNodesCommand_verticalBar (0.00s) === CONT TestCatalogListNodesCommand_noTabs === CONT TestCatalogListNodesCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestCatalogListNodesCommand_noTabs (0.00s) === CONT TestCatalogListNodesCommand_Validation --- PASS: TestCatalogListNodesCommand_Validation (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestCatalogListNodesCommand/simple === RUN TestCatalogListNodesCommand/detailed === RUN TestCatalogListNodesCommand/node-meta === RUN TestCatalogListNodesCommand/filter === RUN TestCatalogListNodesCommand/near === RUN TestCatalogListNodesCommand/service_present === RUN TestCatalogListNodesCommand/service_missing 2021-10-05T16:31:46.824Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:46.850Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:46.902 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b98eb076-3092-203a-628d-da0c02b94895 Address:127.0.0.1:25321}]" 31:46.903 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:25321 [Follower]" leader= 31:46.903 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b98eb076-3092-203a-628d-da0c02b94895.dc1 127.0.0.1 31:46.905 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b98eb076-3092-203a-628d-da0c02b94895 127.0.0.1 2021-10-05T16:31:46.905Z [INFO] agent.router: Initializing LAN area manager 31:46.906 [INFO] TestAgent.server: Adding LAN server: server="Node-b98eb076-3092-203a-628d-da0c02b94895 (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 31:46.906 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b98eb076-3092-203a-628d-da0c02b94895.dc1 area=wan 31:46.906 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=udp 31:46.906 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=tcp 31:46.907 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:25317 network=tcp 31:46.907 [INFO] TestAgent: started state syncer 31:46.907 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:25322 network=tcp 31:46.960 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:46.960 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:25321 [Candidate]" term=2 31:47.008 [DEBUG] TestAgent.server.raft: votes: needed=1 31:47.008 [DEBUG] TestAgent.server.raft: vote granted: from=b98eb076-3092-203a-628d-da0c02b94895 term=2 tally=1 31:47.008 [INFO] TestAgent.server.raft: election won: tally=1 31:47.008 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:25321 [Leader]" 31:47.012 [INFO] TestAgent.server: cluster leadership acquired 31:47.012 [INFO] TestAgent.server: New leader elected: payload=Node-b98eb076-3092-203a-628d-da0c02b94895 31:47.036 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:25321 31:47.081 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:47.106 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:47.106 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:47.106 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:47.106 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:47.106 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:47.106 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b98eb076-3092-203a-628d-da0c02b94895 31:47.106 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b98eb076-3092-203a-628d-da0c02b94895 31:47.149 [INFO] TestAgent: Synced node info 31:47.149 [DEBUG] TestAgent: Node info in sync 31:47.153 [INFO] TestAgent.server: federation state anti-entropy synced 31:47.187 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes from=127.0.0.1:54508 latency=2.74624ms 31:47.202 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes from=127.0.0.1:54510 latency=439.895µs 31:47.208 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes?node-meta=foo%3Abar from=127.0.0.1:54512 latency=396.498µs 31:47.225 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes?filter=Meta.foo+%3D%3D+bar from=127.0.0.1:54514 latency=6.851981ms 31:47.245 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes?near=_agent from=127.0.0.1:54516 latency=399.354µs 31:47.251 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/service/consul from=127.0.0.1:54518 latency=801.316µs 31:47.281 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/service/this-service-will-literally-never-exist from=127.0.0.1:54520 latency=446.044µs 31:47.281 [INFO] TestAgent: Requesting shutdown 31:47.281 [INFO] TestAgent.server: shutting down server 31:47.281 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:47.281 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:47.281 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:47.281 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:47.281 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:47.281 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:47.281 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:47.281 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:47.281 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:47.281 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:47.291 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:47.297Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:47.297Z [INFO] agent.router.manager: shutting down 31:47.297 [INFO] TestAgent: consul server down 31:47.297 [INFO] TestAgent: shutdown complete 31:47.297 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=tcp 31:47.297 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=udp 31:47.297 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:25317 network=tcp 31:47.800 [INFO] TestAgent: Waiting for endpoints to shut down 31:47.800 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogListNodesCommand (1.14s) --- PASS: TestCatalogListNodesCommand/simple (0.01s) --- PASS: TestCatalogListNodesCommand/detailed (0.01s) --- PASS: TestCatalogListNodesCommand/node-meta (0.01s) --- PASS: TestCatalogListNodesCommand/filter (0.01s) --- PASS: TestCatalogListNodesCommand/near (0.02s) --- PASS: TestCatalogListNodesCommand/service_present (0.00s) --- PASS: TestCatalogListNodesCommand/service_missing (0.03s) PASS ok github.com/hashicorp/consul/command/catalog/list/nodes 1.248s === RUN TestCatalogListServicesCommand_noTabs === PAUSE TestCatalogListServicesCommand_noTabs === RUN TestCatalogListServicesCommand_Validation === PAUSE TestCatalogListServicesCommand_Validation === RUN TestCatalogListServicesCommand === PAUSE TestCatalogListServicesCommand === CONT TestCatalogListServicesCommand_noTabs --- PASS: TestCatalogListServicesCommand_noTabs (0.00s) === CONT TestCatalogListServicesCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCatalogListServicesCommand_Validation --- PASS: TestCatalogListServicesCommand_Validation (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestCatalogListServicesCommand/simple === RUN TestCatalogListServicesCommand/tags === RUN TestCatalogListServicesCommand/node_missing === RUN TestCatalogListServicesCommand/node_present === RUN TestCatalogListServicesCommand/node-meta 2021-10-05T16:31:57.090Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.138Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.196 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 Address:127.0.0.1:22258}]" 31:57.196 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:22258 [Follower]" leader= 31:57.197 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03.dc1 127.0.0.1 31:57.198 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 127.0.0.1 2021-10-05T16:31:57.198Z [INFO] agent.router: Initializing LAN area manager 31:57.198 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=udp 31:57.198 [INFO] TestAgent.server: Adding LAN server: server="Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 (Addr: tcp/127.0.0.1:22258) (DC: dc1)" 31:57.198 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03.dc1 area=wan 31:57.198 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=tcp 31:57.199 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:22254 network=tcp 31:57.199 [INFO] TestAgent: started state syncer 31:57.199 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:22259 network=tcp 31:57.244 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.244 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:22258 [Candidate]" term=2 31:57.284 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.284 [DEBUG] TestAgent.server.raft: vote granted: from=ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 term=2 tally=1 31:57.284 [INFO] TestAgent.server.raft: election won: tally=1 31:57.284 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:22258 [Leader]" 31:57.287 [INFO] TestAgent.server: cluster leadership acquired 31:57.288 [INFO] TestAgent.server: New leader elected: payload=Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 31:57.292 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:22258 31:57.313 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.396 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.396 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.396 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.396 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.396 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.396 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 31:57.396 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 31:57.422 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.580 [INFO] TestAgent: Synced node info 31:57.588 [INFO] TestAgent: Synced service: service=testing 31:57.588 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:45738 latency=19.083978ms 31:57.588 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:57.595 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/services from=127.0.0.1:45740 latency=2.575165ms 31:57.597 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/services from=127.0.0.1:45742 latency=276.471µs 31:57.601 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/node/not-a-real-node from=127.0.0.1:45744 latency=2.756581ms 31:57.606 [INFO] TestAgent: Synced node info 31:57.612 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/node/Node-ca20fdc1-db73-a1c1-fa3b-233b52c8bf03 from=127.0.0.1:45746 latency=470.978µs 31:57.614 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/services?node-meta=foo%3Abar from=127.0.0.1:45748 latency=262.903µs 31:57.614 [INFO] TestAgent: Requesting shutdown 31:57.614 [INFO] TestAgent.server: shutting down server 31:57.614 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.614 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.614 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.614 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.614 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.614 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.614 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.614 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.614 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.614 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.620 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.628Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.628Z [INFO] agent.router.manager: shutting down 31:57.629 [WARN] TestAgent: Syncing service failed.: service=testing error="leadership lost while committing log" 31:57.629 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="leadership lost while committing log" 31:57.629 [INFO] TestAgent: consul server down 31:57.629 [INFO] TestAgent: shutdown complete 31:57.629 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=tcp 31:57.629 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=udp 31:57.629 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:22254 network=tcp 31:58.132 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.132 [INFO] TestAgent: Endpoints down --- PASS: TestCatalogListServicesCommand (1.17s) --- PASS: TestCatalogListServicesCommand/simple (0.01s) --- PASS: TestCatalogListServicesCommand/tags (0.00s) --- PASS: TestCatalogListServicesCommand/node_missing (0.01s) --- PASS: TestCatalogListServicesCommand/node_present (0.00s) --- PASS: TestCatalogListServicesCommand/node-meta (0.00s) PASS ok github.com/hashicorp/consul/command/catalog/list/services 1.277s ? github.com/hashicorp/consul/command/config [no test files] === RUN TestConfigDelete_noTabs === PAUSE TestConfigDelete_noTabs === RUN TestConfigDelete === PAUSE TestConfigDelete === RUN TestConfigDelete_InvalidArgs === PAUSE TestConfigDelete_InvalidArgs === CONT TestConfigDelete_noTabs --- PASS: TestConfigDelete_noTabs (0.00s) === CONT TestConfigDelete_InvalidArgs === RUN TestConfigDelete_InvalidArgs/no_kind === CONT TestConfigDelete === RUN TestConfigDelete_InvalidArgs/no_name [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestConfigDelete_InvalidArgs (0.01s) --- PASS: TestConfigDelete_InvalidArgs/no_kind (0.00s) --- PASS: TestConfigDelete_InvalidArgs/no_name (0.01s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:31:57.438Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:57.462Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:57.506 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2a02b37f-b5c3-c32e-5175-26d7d94d9add Address:127.0.0.1:15111}]" 31:57.507 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15111 [Follower]" leader= 31:57.507 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2a02b37f-b5c3-c32e-5175-26d7d94d9add.dc1 127.0.0.1 31:57.508 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2a02b37f-b5c3-c32e-5175-26d7d94d9add 127.0.0.1 2021-10-05T16:31:57.508Z [INFO] agent.router: Initializing LAN area manager 31:57.509 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=udp 31:57.509 [INFO] TestAgent.server: Adding LAN server: server="Node-2a02b37f-b5c3-c32e-5175-26d7d94d9add (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 31:57.509 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2a02b37f-b5c3-c32e-5175-26d7d94d9add.dc1 area=wan 31:57.509 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=tcp 31:57.509 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15107 network=tcp 31:57.509 [INFO] TestAgent: started state syncer 31:57.510 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15112 network=tcp 31:57.568 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:57.568 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15111 [Candidate]" term=2 31:57.589 [DEBUG] TestAgent.server.raft: votes: needed=1 31:57.589 [DEBUG] TestAgent.server.raft: vote granted: from=2a02b37f-b5c3-c32e-5175-26d7d94d9add term=2 tally=1 31:57.589 [INFO] TestAgent.server.raft: election won: tally=1 31:57.589 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15111 [Leader]" 31:57.589 [INFO] TestAgent.server: cluster leadership acquired 31:57.589 [INFO] TestAgent.server: New leader elected: payload=Node-2a02b37f-b5c3-c32e-5175-26d7d94d9add 31:57.620 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15111 31:57.645 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:57.696 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:57.696 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:57.696 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:57.697 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:57.697 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:57.697 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2a02b37f-b5c3-c32e-5175-26d7d94d9add 31:57.697 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2a02b37f-b5c3-c32e-5175-26d7d94d9add 31:57.710 [INFO] TestAgent.server: federation state anti-entropy synced 31:57.817 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 31:57.823 [INFO] TestAgent: Synced node info 31:57.823 [DEBUG] TestAgent: Node info in sync 31:57.858 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:56084 latency=6.882421ms 31:57.879 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/config/service-defaults/web from=127.0.0.1:56086 latency=9.400505ms 31:57.890 [ERROR] TestAgent.http: Request error: method=GET url=/v1/config/service-defaults/web from=127.0.0.1:56084 error="Config entry not found for "service-defaults" / "web"" 31:57.892 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/service-defaults/web from=127.0.0.1:56084 latency=2.69191ms 31:57.896 [INFO] TestAgent: Requesting shutdown 31:57.896 [INFO] TestAgent.server: shutting down server 31:57.896 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:57.896 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:57.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:57.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:57.896 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:57.896 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:57.896 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:57.896 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:57.896 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:57.896 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:57.908 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:57.920Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:57.920Z [INFO] agent.router.manager: shutting down 31:57.920 [INFO] TestAgent: consul server down 31:57.920 [INFO] TestAgent: shutdown complete 31:57.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=tcp 31:57.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=udp 31:57.920 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15107 network=tcp 31:58.424 [INFO] TestAgent: Waiting for endpoints to shut down 31:58.424 [INFO] TestAgent: Endpoints down --- PASS: TestConfigDelete (1.04s) PASS ok github.com/hashicorp/consul/command/config/delete 1.153s === RUN TestConfigList_noTabs === PAUSE TestConfigList_noTabs === RUN TestConfigList [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:31:58.573Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:31:58.594Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 31:58.638 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:141278bc-1a7d-93a4-4dd3-b5bebbc3c79e Address:127.0.0.1:27363}]" 31:58.639 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-141278bc-1a7d-93a4-4dd3-b5bebbc3c79e.dc1 127.0.0.1 31:58.639 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-141278bc-1a7d-93a4-4dd3-b5bebbc3c79e 127.0.0.1 2021-10-05T16:31:58.639Z [INFO] agent.router: Initializing LAN area manager 31:58.640 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=udp 31:58.640 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 31:58.640 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=tcp 31:58.640 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-141278bc-1a7d-93a4-4dd3-b5bebbc3c79e.dc1 area=wan 31:58.640 [INFO] TestAgent.server: Adding LAN server: server="Node-141278bc-1a7d-93a4-4dd3-b5bebbc3c79e (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 31:58.641 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27359 network=tcp 31:58.641 [INFO] TestAgent: started state syncer 31:58.641 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27364 network=tcp 31:58.680 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 31:58.680 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 31:58.694 [DEBUG] TestAgent.server.raft: votes: needed=1 31:58.694 [DEBUG] TestAgent.server.raft: vote granted: from=141278bc-1a7d-93a4-4dd3-b5bebbc3c79e term=2 tally=1 31:58.694 [INFO] TestAgent.server.raft: election won: tally=1 31:58.694 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 31:58.694 [INFO] TestAgent.server: cluster leadership acquired 31:58.694 [INFO] TestAgent.server: New leader elected: payload=Node-141278bc-1a7d-93a4-4dd3-b5bebbc3c79e 31:58.713 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27363 31:58.732 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 31:58.773 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 31:58.773 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 31:58.773 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 31:58.773 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 31:58.773 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 31:58.773 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-141278bc-1a7d-93a4-4dd3-b5bebbc3c79e 31:58.773 [INFO] TestAgent.server: member joined, marking health alive: member=Node-141278bc-1a7d-93a4-4dd3-b5bebbc3c79e 31:58.790 [INFO] TestAgent.server: federation state anti-entropy synced 31:58.835 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:59274 latency=11.949369ms 31:58.852 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:59274 latency=10.394039ms 31:58.873 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:59274 latency=17.121869ms 31:58.878 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/service-defaults from=127.0.0.1:59276 latency=1.249803ms 31:58.880 [INFO] TestAgent: Requesting shutdown 31:58.880 [INFO] TestAgent.server: shutting down server 31:58.880 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 31:58.880 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 31:58.880 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 31:58.880 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 31:58.880 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 31:58.880 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 31:58.880 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 31:58.880 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 31:58.880 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 31:58.880 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 31:58.880 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 31:58.887 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:31:58.891Z [INFO] agent.router.manager: shutting down 2021-10-05T16:31:58.891Z [INFO] agent.router.manager: shutting down 31:58.891 [INFO] TestAgent: consul server down 31:58.891 [INFO] TestAgent: shutdown complete 31:58.891 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 31:58.891 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 31:58.891 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 31:59.392 [INFO] TestAgent: Waiting for endpoints to shut down 31:59.392 [INFO] TestAgent: Endpoints down --- PASS: TestConfigList (0.90s) === RUN TestConfigList_InvalidArgs === PAUSE TestConfigList_InvalidArgs === CONT TestConfigList_noTabs === CONT TestConfigList_InvalidArgs === RUN TestConfigList_InvalidArgs/no_kind --- PASS: TestConfigList_noTabs (0.00s) --- PASS: TestConfigList_InvalidArgs (0.00s) --- PASS: TestConfigList_InvalidArgs/no_kind (0.00s) PASS ok github.com/hashicorp/consul/command/config/list 0.988s === RUN TestConfigRead_noTabs === PAUSE TestConfigRead_noTabs === RUN TestConfigRead === PAUSE TestConfigRead === RUN TestConfigRead_InvalidArgs === PAUSE TestConfigRead_InvalidArgs === CONT TestConfigRead_noTabs --- PASS: TestConfigRead_noTabs (0.00s) === CONT TestConfigRead_InvalidArgs === RUN TestConfigRead_InvalidArgs/no_name === CONT TestConfigRead === RUN TestConfigRead_InvalidArgs/no_kind [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestConfigRead_InvalidArgs (0.00s) --- PASS: TestConfigRead_InvalidArgs/no_name (0.00s) --- PASS: TestConfigRead_InvalidArgs/no_kind (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:09.460Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.473Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.533 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e80a50ac-a338-9356-8141-1a317cf79da1 Address:127.0.0.1:18174}]" 32:09.533 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:18174 [Follower]" leader= 32:09.541 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e80a50ac-a338-9356-8141-1a317cf79da1.dc1 127.0.0.1 32:09.546 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e80a50ac-a338-9356-8141-1a317cf79da1 127.0.0.1 2021-10-05T16:32:09.546Z [INFO] agent.router: Initializing LAN area manager 32:09.548 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e80a50ac-a338-9356-8141-1a317cf79da1.dc1 area=wan 32:09.548 [INFO] TestAgent.server: Adding LAN server: server="Node-e80a50ac-a338-9356-8141-1a317cf79da1 (Addr: tcp/127.0.0.1:18174) (DC: dc1)" 32:09.555 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18169 network=udp 32:09.555 [INFO] TestAgent: Started DNS server: address=127.0.0.1:18169 network=tcp 32:09.555 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:18170 network=tcp 32:09.556 [INFO] TestAgent: started state syncer 32:09.556 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:18175 network=tcp 32:09.602 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.602 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:18174 [Candidate]" term=2 32:09.617 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.617 [DEBUG] TestAgent.server.raft: vote granted: from=e80a50ac-a338-9356-8141-1a317cf79da1 term=2 tally=1 32:09.617 [INFO] TestAgent.server.raft: election won: tally=1 32:09.617 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:18174 [Leader]" 32:09.617 [INFO] TestAgent.server: cluster leadership acquired 32:09.617 [INFO] TestAgent.server: New leader elected: payload=Node-e80a50ac-a338-9356-8141-1a317cf79da1 32:09.636 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:18174 32:09.676 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.736 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:09.736 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:09.736 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:09.736 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:09.736 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:09.736 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e80a50ac-a338-9356-8141-1a317cf79da1 32:09.736 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e80a50ac-a338-9356-8141-1a317cf79da1 32:09.799 [INFO] TestAgent.server: federation state anti-entropy synced 32:09.907 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:09.918 [INFO] TestAgent: Synced node info 32:09.937 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:53458 latency=12.139162ms 32:09.938 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/service-defaults/web from=127.0.0.1:53460 latency=322.249µs 32:09.940 [INFO] TestAgent: Requesting shutdown 32:09.940 [INFO] TestAgent.server: shutting down server 32:09.940 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:09.940 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:09.940 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:09.940 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:09.940 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.940 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:09.940 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:09.940 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:09.940 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:09.940 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:09.948 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.952Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.952Z [INFO] agent.router.manager: shutting down 32:09.952 [INFO] TestAgent: consul server down 32:09.952 [INFO] TestAgent: shutdown complete 32:09.952 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18169 network=tcp 32:09.952 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:18169 network=udp 32:09.952 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:18170 network=tcp 32:10.453 [INFO] TestAgent: Waiting for endpoints to shut down 32:10.453 [INFO] TestAgent: Endpoints down --- PASS: TestConfigRead (1.07s) PASS ok github.com/hashicorp/consul/command/config/read 1.248s === RUN TestConfigWrite_noTabs === PAUSE TestConfigWrite_noTabs === RUN TestConfigWrite === PAUSE TestConfigWrite === RUN TestParseConfigEntry === PAUSE TestParseConfigEntry === CONT TestConfigWrite_noTabs --- PASS: TestConfigWrite_noTabs (0.00s) === CONT TestParseConfigEntry === RUN TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(hcl_snake_case) === RUN TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(hcl_camel_case) === RUN TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(json_snake_case) === RUN TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(json_camel_case) === RUN TestParseConfigEntry/proxy-defaults_(hcl_snake_case) === CONT TestConfigWrite === RUN TestParseConfigEntry/proxy-defaults_(hcl_camel_case) [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === RUN TestParseConfigEntry/proxy-defaults_(json_snake_case) === RUN TestParseConfigEntry/proxy-defaults_(json_camel_case) === RUN TestParseConfigEntry/terminating-gateway_(hcl_snake_case) === RUN TestParseConfigEntry/terminating-gateway_(hcl_camel_case) === RUN TestParseConfigEntry/terminating-gateway_(json_snake_case) === RUN TestParseConfigEntry/terminating-gateway_(json_camel_case) === RUN TestParseConfigEntry/service-defaults_(hcl_snake_case) === RUN TestParseConfigEntry/service-defaults_(hcl_camel_case) === RUN TestParseConfigEntry/service-defaults_(json_snake_case) === RUN TestParseConfigEntry/service-defaults_(json_camel_case) === RUN TestParseConfigEntry/service-router:_kitchen_sink_(hcl_snake_case) === RUN TestParseConfigEntry/service-router:_kitchen_sink_(hcl_camel_case) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestParseConfigEntry/service-router:_kitchen_sink_(json_snake_case) === RUN TestParseConfigEntry/service-router:_kitchen_sink_(json_camel_case) === RUN TestParseConfigEntry/service-splitter:_kitchen_sink_(hcl_snake_case) === RUN TestParseConfigEntry/service-splitter:_kitchen_sink_(hcl_camel_case) === RUN TestParseConfigEntry/service-splitter:_kitchen_sink_(json_snake_case) === RUN TestParseConfigEntry/service-splitter:_kitchen_sink_(json_camel_case) === RUN TestParseConfigEntry/service-resolver:_subsets_with_failover_(hcl_snake_case) === RUN TestParseConfigEntry/service-resolver:_subsets_with_failover_(hcl_camel_case) === RUN TestParseConfigEntry/service-resolver:_subsets_with_failover_(json_snake_case) === RUN TestParseConfigEntry/service-resolver:_subsets_with_failover_(json_camel_case) === RUN TestParseConfigEntry/service-resolver:_redirect_(hcl_snake_case) === RUN TestParseConfigEntry/service-resolver:_redirect_(hcl_camel_case) === RUN TestParseConfigEntry/service-resolver:_redirect_(json_snake_case) === RUN TestParseConfigEntry/service-resolver:_redirect_(json_camel_case) === RUN TestParseConfigEntry/service-resolver:_default_(hcl_snake_case) === RUN TestParseConfigEntry/service-resolver:_default_(hcl_camel_case) === RUN TestParseConfigEntry/service-resolver:_default_(json_snake_case) === RUN TestParseConfigEntry/service-resolver:_default_(json_camel_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(hcl_snake_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(hcl_camel_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(json_snake_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(json_camel_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(hcl_snake_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(hcl_camel_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(json_snake_case) === RUN TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(json_camel_case) === RUN TestParseConfigEntry/ingress-gateway:_kitchen_sink_(hcl_snake_case) === RUN TestParseConfigEntry/ingress-gateway:_kitchen_sink_(hcl_camel_case) === RUN TestParseConfigEntry/ingress-gateway:_kitchen_sink_(json_snake_case) === RUN TestParseConfigEntry/ingress-gateway:_kitchen_sink_(json_camel_case) --- PASS: TestParseConfigEntry (0.06s) --- PASS: TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/proxy-defaults:_extra_fields_or_typo_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/proxy-defaults_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/proxy-defaults_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/proxy-defaults_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/proxy-defaults_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/terminating-gateway_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/terminating-gateway_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/terminating-gateway_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/terminating-gateway_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-defaults_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-defaults_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-defaults_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-defaults_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-router:_kitchen_sink_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-router:_kitchen_sink_(hcl_camel_case) (0.01s) --- PASS: TestParseConfigEntry/service-router:_kitchen_sink_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-router:_kitchen_sink_(json_camel_case) (0.01s) --- PASS: TestParseConfigEntry/service-splitter:_kitchen_sink_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-splitter:_kitchen_sink_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-splitter:_kitchen_sink_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-splitter:_kitchen_sink_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_subsets_with_failover_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_subsets_with_failover_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_subsets_with_failover_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_subsets_with_failover_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_redirect_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_redirect_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_redirect_(json_snake_case) (0.01s) --- PASS: TestParseConfigEntry/service-resolver:_redirect_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_default_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_default_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_default_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/service-resolver:_default_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_proxy_defaults_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/expose_paths:_kitchen_sink_service_defaults_(json_camel_case) (0.00s) --- PASS: TestParseConfigEntry/ingress-gateway:_kitchen_sink_(hcl_snake_case) (0.00s) --- PASS: TestParseConfigEntry/ingress-gateway:_kitchen_sink_(hcl_camel_case) (0.00s) --- PASS: TestParseConfigEntry/ingress-gateway:_kitchen_sink_(json_snake_case) (0.00s) --- PASS: TestParseConfigEntry/ingress-gateway:_kitchen_sink_(json_camel_case) (0.00s) === RUN TestConfigWrite/File === RUN TestConfigWrite/Stdin === RUN TestConfigWrite/No_config 2021-10-05T16:32:09.450Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:09.490Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:09.538 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4e74e839-a2df-6553-d37e-157a0e1df1e6 Address:127.0.0.1:14090}]" 32:09.539 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4e74e839-a2df-6553-d37e-157a0e1df1e6.dc1 127.0.0.1 32:09.540 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4e74e839-a2df-6553-d37e-157a0e1df1e6 127.0.0.1 2021-10-05T16:32:09.540Z [INFO] agent.router: Initializing LAN area manager 32:09.540 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=udp 32:09.540 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14090 [Follower]" leader= 32:09.540 [INFO] TestAgent.server: Adding LAN server: server="Node-4e74e839-a2df-6553-d37e-157a0e1df1e6 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 32:09.540 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4e74e839-a2df-6553-d37e-157a0e1df1e6.dc1 area=wan 32:09.541 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=tcp 32:09.541 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14086 network=tcp 32:09.541 [INFO] TestAgent: started state syncer 32:09.541 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14091 network=tcp 32:09.589 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:09.589 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14090 [Candidate]" term=2 32:09.605 [DEBUG] TestAgent.server.raft: votes: needed=1 32:09.605 [DEBUG] TestAgent.server.raft: vote granted: from=4e74e839-a2df-6553-d37e-157a0e1df1e6 term=2 tally=1 32:09.605 [INFO] TestAgent.server.raft: election won: tally=1 32:09.605 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14090 [Leader]" 32:09.608 [INFO] TestAgent.server: cluster leadership acquired 32:09.608 [INFO] TestAgent.server: New leader elected: payload=Node-4e74e839-a2df-6553-d37e-157a0e1df1e6 32:09.616 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:14090 32:09.653 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:09.724 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:09.724 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:09.724 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:09.724 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:09.724 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:09.724 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4e74e839-a2df-6553-d37e-157a0e1df1e6 32:09.724 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4e74e839-a2df-6553-d37e-157a0e1df1e6 32:09.734 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:45030 latency=33.499287ms 32:09.743 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/service-defaults/web from=127.0.0.1:45032 latency=2.323496ms 32:09.775 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:45034 latency=13.788068ms 32:09.775 [INFO] TestAgent.server: federation state anti-entropy synced 32:09.776 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/proxy-defaults/global from=127.0.0.1:45032 latency=303.124µs 32:09.777 [INFO] TestAgent: Requesting shutdown 32:09.777 [INFO] TestAgent.server: shutting down server 32:09.777 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:09.777 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:09.777 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:09.777 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:09.777 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:09.777 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:09.777 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:09.777 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:09.777 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:09.777 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:09.777 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:09.804 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:09.808Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:09.808Z [INFO] agent.router.manager: shutting down 32:09.808 [INFO] TestAgent: consul server down 32:09.808 [INFO] TestAgent: shutdown complete 32:09.808 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=tcp 32:09.808 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=udp 32:09.808 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14086 network=tcp 32:10.308 [INFO] TestAgent: Waiting for endpoints to shut down 32:10.308 [INFO] TestAgent: Endpoints down --- PASS: TestConfigWrite (0.99s) --- PASS: TestConfigWrite/File (0.06s) --- PASS: TestConfigWrite/Stdin (0.02s) --- PASS: TestConfigWrite/No_config (0.00s) PASS ok github.com/hashicorp/consul/command/config/write 1.094s === RUN TestConnectCommand_noTabs === PAUSE TestConnectCommand_noTabs === CONT TestConnectCommand_noTabs --- PASS: TestConnectCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/connect 0.028s === RUN TestCatalogCommand_noTabs === PAUSE TestCatalogCommand_noTabs === CONT TestCatalogCommand_noTabs --- PASS: TestCatalogCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/connect/ca 0.051s === RUN TestConnectCAGetConfigCommand_noTabs === PAUSE TestConnectCAGetConfigCommand_noTabs === RUN TestConnectCAGetConfigCommand === PAUSE TestConnectCAGetConfigCommand === CONT TestConnectCAGetConfigCommand_noTabs --- PASS: TestConnectCAGetConfigCommand_noTabs (0.00s) === CONT TestConnectCAGetConfigCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:12.655Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:12.673Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:12.736 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9701f7d8-14cf-b4a8-c155-78c19acecd78 Address:127.0.0.1:24300}]" 32:12.737 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9701f7d8-14cf-b4a8-c155-78c19acecd78.dc1 127.0.0.1 32:12.738 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9701f7d8-14cf-b4a8-c155-78c19acecd78 127.0.0.1 2021-10-05T16:32:12.738Z [INFO] agent.router: Initializing LAN area manager 32:12.739 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:24300 [Follower]" leader= 32:12.739 [INFO] TestAgent: Started DNS server: address=127.0.0.1:24295 network=tcp 32:12.739 [INFO] TestAgent: Started DNS server: address=127.0.0.1:24295 network=udp 32:12.740 [INFO] TestAgent.server: Adding LAN server: server="Node-9701f7d8-14cf-b4a8-c155-78c19acecd78 (Addr: tcp/127.0.0.1:24300) (DC: dc1)" 32:12.740 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9701f7d8-14cf-b4a8-c155-78c19acecd78.dc1 area=wan 32:12.741 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:24296 network=tcp 32:12.741 [INFO] TestAgent: started state syncer 32:12.741 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:24301 network=tcp 32:12.800 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:12.800 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:24300 [Candidate]" term=2 32:12.836 [DEBUG] TestAgent.server.raft: votes: needed=1 32:12.836 [DEBUG] TestAgent.server.raft: vote granted: from=9701f7d8-14cf-b4a8-c155-78c19acecd78 term=2 tally=1 32:12.836 [INFO] TestAgent.server.raft: election won: tally=1 32:12.836 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:24300 [Leader]" 32:12.840 [INFO] TestAgent.server: cluster leadership acquired 32:12.840 [INFO] TestAgent.server: New leader elected: payload=Node-9701f7d8-14cf-b4a8-c155-78c19acecd78 32:12.859 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:24300 32:12.908 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:12.981 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:12.981 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:12.981 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:12.981 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:12.981 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:12.981 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9701f7d8-14cf-b4a8-c155-78c19acecd78 32:12.981 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9701f7d8-14cf-b4a8-c155-78c19acecd78 32:13.032 [INFO] TestAgent.server: federation state anti-entropy synced 32:13.135 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:13.148 [INFO] TestAgent: Synced node info 32:13.154 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/ca/configuration from=127.0.0.1:53786 latency=773.1µs 32:13.155 [INFO] TestAgent: Requesting shutdown 32:13.155 [INFO] TestAgent.server: shutting down server 32:13.155 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:13.155 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:13.155 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:13.155 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:13.155 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:13.155 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:13.155 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:13.156 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:13.156 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:13.156 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:13.162 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:13.178Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:13.178Z [INFO] agent.router.manager: shutting down 32:13.178 [INFO] TestAgent: consul server down 32:13.178 [INFO] TestAgent: shutdown complete 32:13.178 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:24295 network=tcp 32:13.178 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:24295 network=udp 32:13.178 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:24296 network=tcp 32:13.680 [INFO] TestAgent: Waiting for endpoints to shut down 32:13.680 [INFO] TestAgent: Endpoints down --- PASS: TestConnectCAGetConfigCommand (1.09s) PASS ok github.com/hashicorp/consul/command/connect/ca/get 1.245s === RUN TestConnectCASetConfigCommand_noTabs === PAUSE TestConnectCASetConfigCommand_noTabs === RUN TestConnectCASetConfigCommand === PAUSE TestConnectCASetConfigCommand === CONT TestConnectCASetConfigCommand_noTabs --- PASS: TestConnectCASetConfigCommand_noTabs (0.00s) === CONT TestConnectCASetConfigCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:21.353Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:21.386Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:21.472 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6fc4ae79-1e6d-d258-8664-b2f190dda7c5 Address:127.0.0.1:27363}]" 32:21.473 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6fc4ae79-1e6d-d258-8664-b2f190dda7c5.dc1 127.0.0.1 32:21.473 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6fc4ae79-1e6d-d258-8664-b2f190dda7c5 127.0.0.1 2021-10-05T16:32:21.473Z [INFO] agent.router: Initializing LAN area manager 32:21.474 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=udp 32:21.474 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 32:21.488 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6fc4ae79-1e6d-d258-8664-b2f190dda7c5.dc1 area=wan 32:21.488 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=tcp 32:21.488 [INFO] TestAgent.server: Adding LAN server: server="Node-6fc4ae79-1e6d-d258-8664-b2f190dda7c5 (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 32:21.493 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27359 network=tcp 32:21.493 [INFO] TestAgent: started state syncer 32:21.497 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27364 network=tcp 32:21.540 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:21.540 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 32:21.558 [DEBUG] TestAgent.server.raft: votes: needed=1 32:21.558 [DEBUG] TestAgent.server.raft: vote granted: from=6fc4ae79-1e6d-d258-8664-b2f190dda7c5 term=2 tally=1 32:21.558 [INFO] TestAgent.server.raft: election won: tally=1 32:21.558 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 32:21.558 [INFO] TestAgent.server: cluster leadership acquired 32:21.558 [INFO] TestAgent.server: New leader elected: payload=Node-6fc4ae79-1e6d-d258-8664-b2f190dda7c5 32:21.564 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27363 32:21.579 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:21.609 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:21.609 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:21.609 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:21.609 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:21.609 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:21.609 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6fc4ae79-1e6d-d258-8664-b2f190dda7c5 32:21.609 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6fc4ae79-1e6d-d258-8664-b2f190dda7c5 32:21.629 [INFO] TestAgent.server: federation state anti-entropy synced 32:21.643 [INFO] TestAgent.server.connect: CA provider config updated 32:21.643 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/ca/configuration from=127.0.0.1:59438 latency=4.268075ms 32:21.643 [INFO] TestAgent: Requesting shutdown 32:21.643 [INFO] TestAgent.server: shutting down server 32:21.643 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:21.643 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:21.643 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:21.643 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:21.643 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:21.644 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:21.644 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:21.644 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:21.644 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:21.644 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:21.644 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:21.645 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:21.656 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 32:21.656 [INFO] TestAgent: Synced node info 32:21.656 [DEBUG] TestAgent: Node info in sync 2021-10-05T16:32:21.668Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:21.668Z [INFO] agent.router.manager: shutting down 32:21.668 [INFO] TestAgent: consul server down 32:21.668 [INFO] TestAgent: shutdown complete 32:21.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 32:21.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 32:21.668 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 32:22.172 [INFO] TestAgent: Waiting for endpoints to shut down 32:22.172 [INFO] TestAgent: Endpoints down --- PASS: TestConnectCASetConfigCommand (0.93s) PASS ok github.com/hashicorp/consul/command/connect/ca/set 1.184s === RUN TestBootstrapConfig_ConfigureArgs === RUN TestBootstrapConfig_ConfigureArgs/defaults === RUN TestBootstrapConfig_ConfigureArgs/extra-stats-sinks === RUN TestBootstrapConfig_ConfigureArgs/simple-statsd-sink === RUN TestBootstrapConfig_ConfigureArgs/simple-statsd-sink-plus-extra === RUN TestBootstrapConfig_ConfigureArgs/simple-statsd-sink-env === RUN TestBootstrapConfig_ConfigureArgs/simple-dogstatsd-sink === RUN TestBootstrapConfig_ConfigureArgs/simple-dogstatsd-unix-sink === RUN TestBootstrapConfig_ConfigureArgs/simple-dogstatsd-sink-env === RUN TestBootstrapConfig_ConfigureArgs/stats-config-override === RUN TestBootstrapConfig_ConfigureArgs/simple-tags === RUN TestBootstrapConfig_ConfigureArgs/prometheus-bind-addr === RUN TestBootstrapConfig_ConfigureArgs/prometheus-bind-addr-with-overrides === RUN TestBootstrapConfig_ConfigureArgs/stats-bind-addr === RUN TestBootstrapConfig_ConfigureArgs/stats-bind-addr-with-overrides === RUN TestBootstrapConfig_ConfigureArgs/stats-flush-interval === RUN TestBootstrapConfig_ConfigureArgs/override-tracing === RUN TestBootstrapConfig_ConfigureArgs/err-bad-prometheus-addr === RUN TestBootstrapConfig_ConfigureArgs/err-bad-stats-addr === RUN TestBootstrapConfig_ConfigureArgs/err-bad-statsd-addr === RUN TestBootstrapConfig_ConfigureArgs/err-bad-dogstatsd-addr === RUN TestBootstrapConfig_ConfigureArgs/ready-bind-addr === RUN TestBootstrapConfig_ConfigureArgs/ready-bind-addr-with-overrides === RUN TestBootstrapConfig_ConfigureArgs/ready-bind-addr-and-prometheus-and-stats --- PASS: TestBootstrapConfig_ConfigureArgs (0.03s) --- PASS: TestBootstrapConfig_ConfigureArgs/defaults (0.01s) --- PASS: TestBootstrapConfig_ConfigureArgs/extra-stats-sinks (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/simple-statsd-sink (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/simple-statsd-sink-plus-extra (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/simple-statsd-sink-env (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/simple-dogstatsd-sink (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/simple-dogstatsd-unix-sink (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/simple-dogstatsd-sink-env (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/stats-config-override (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/simple-tags (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/prometheus-bind-addr (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/prometheus-bind-addr-with-overrides (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/stats-bind-addr (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/stats-bind-addr-with-overrides (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/stats-flush-interval (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/override-tracing (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/err-bad-prometheus-addr (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/err-bad-stats-addr (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/err-bad-statsd-addr (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/err-bad-dogstatsd-addr (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/ready-bind-addr (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/ready-bind-addr-with-overrides (0.00s) --- PASS: TestBootstrapConfig_ConfigureArgs/ready-bind-addr-and-prometheus-and-stats (0.00s) === RUN TestEnvoyCommand_noTabs === PAUSE TestEnvoyCommand_noTabs === RUN TestEnvoyGateway_Validation === PAUSE TestEnvoyGateway_Validation === RUN TestGenerateConfig === RUN TestGenerateConfig/no-args === RUN TestGenerateConfig/defaults { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/token-arg { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "c9a52720-bf6c-4aa6-b8bc-66881a5ade95" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/token-env { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "c9a52720-bf6c-4aa6-b8bc-66881a5ade95" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/token-file-arg { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "c9a52720-bf6c-4aa6-b8bc-66881a5ade95" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/token-file-env { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "c9a52720-bf6c-4aa6-b8bc-66881a5ade95" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/grpc-addr-flag { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 9999 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/grpc-addr-env { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 9999 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/grpc-addr-unix { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "pipe": { "path": "/var/run/consul.sock" } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/grpc-addr-config { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 9999 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/access-log-path { "admin": { "access_log_path": "/some/path/access.log", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/missing-ca-file === RUN TestGenerateConfig/existing-ca-file { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "tls_context": { "common_tls_context": { "validation_context": { "trusted_ca": { "inline_string": "-----BEGIN CERTIFICATE-----\nMIIEtzCCA5+gAwIBAgIJAIewRMI8OnvTMA0GCSqGSIb3DQEBBQUAMIGYMQswCQYD\nVQQGEwJVUzELMAkGA1UECBMCQ0ExFjAUBgNVBAcTDVNhbiBGcmFuY2lzY28xHDAa\nBgNVBAoTE0hhc2hpQ29ycCBUZXN0IENlcnQxDDAKBgNVBAsTA0RldjEWMBQGA1UE\nAxMNdGVzdC5pbnRlcm5hbDEgMB4GCSqGSIb3DQEJARYRdGVzdEBpbnRlcm5hbC5j\nb20wHhcNMTQwNDA3MTkwMTA4WhcNMjQwNDA0MTkwMTA4WjCBmDELMAkGA1UEBhMC\nVVMxCzAJBgNVBAgTAkNBMRYwFAYDVQQHEw1TYW4gRnJhbmNpc2NvMRwwGgYDVQQK\nExNIYXNoaUNvcnAgVGVzdCBDZXJ0MQwwCgYDVQQLEwNEZXYxFjAUBgNVBAMTDXRl\nc3QuaW50ZXJuYWwxIDAeBgkqhkiG9w0BCQEWEXRlc3RAaW50ZXJuYWwuY29tMIIB\nIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAxrs6JK4NpiOItxrpNR/1ppUU\nmH7p2BgLCBZ6eHdclle9J56i68adt8J85zaqphCfz6VDP58DsFx+N50PZyjQaDsU\nd0HejRqfHRMtg2O+UQkv4Z66+Vo+gc6uGuANi2xMtSYDVTAqqzF48OOPQDgYkzcG\nxcFZzTRFFZt2vPnyHj8cHcaFo/NMNVh7C3yTXevRGNm9u2mrbxCEeiHzFC2WUnvg\nU2jQuC7Fhnl33Zd3B6d3mQH6O23ncmwxTcPUJe6xZaIRrDuzwUcyhLj5Z3faag/f\npFIIcHSiHRfoqHLGsGg+3swId/zVJSSDHr7pJUu7Cre+vZa63FqDaooqvnisrQID\nAQABo4IBADCB/TAdBgNVHQ4EFgQUo/nrOfqvbee2VklVKIFlyQEbuJUwgc0GA1Ud\nIwSBxTCBwoAUo/nrOfqvbee2VklVKIFlyQEbuJWhgZ6kgZswgZgxCzAJBgNVBAYT\nAlVTMQswCQYDVQQIEwJDQTEWMBQGA1UEBxMNU2FuIEZyYW5jaXNjbzEcMBoGA1UE\nChMTSGFzaGlDb3JwIFRlc3QgQ2VydDEMMAoGA1UECxMDRGV2MRYwFAYDVQQDEw10\nZXN0LmludGVybmFsMSAwHgYJKoZIhvcNAQkBFhF0ZXN0QGludGVybmFsLmNvbYIJ\nAIewRMI8OnvTMAwGA1UdEwQFMAMBAf8wDQYJKoZIhvcNAQEFBQADggEBADa9fV9h\ngjapBlkNmu64WX0Ufub5dsJrdHS8672P30S7ILB7Mk0W8sL65IezRsZnG898yHf9\n2uzmz5OvNTM9K380g7xFlyobSVq+6yqmmSAlA/ptAcIIZT727P5jig/DB7fzJM3g\njctDlEGOmEe50GQXc25VKpcpjAsNQi5ER5gowQ0v3IXNZs+yU+LvxLHc0rUJ/XSp\nlFCAMOqd5uRoMOejnT51G6krvLNzPaQ3N9jQfNVY4Q0zfs0M+6dRWvqfqB9Vyq8/\nPOLMld+HyAZEBk9zK3ZVIXx6XS4dkDnSNR91njLq7eouf6M7+7s/oMQZZRtAfQ6r\nwlW975rYa1ZqEdA=\n-----END CERTIFICATE-----\n" } } } }, "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/missing-ca-path === RUN TestGenerateConfig/existing-ca-path { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "tls_context": { "common_tls_context": { "validation_context": { "trusted_ca": { "inline_string": "-----BEGIN CERTIFICATE-----\nMIIFADCCAuqgAwIBAgIBATALBgkqhkiG9w0BAQswEzERMA8GA1UEAxMIQ2VydEF1\ndGgwHhcNMTUwNTExMjI0NjQzWhcNMjUwNTExMjI0NjU0WjATMREwDwYDVQQDEwhD\nZXJ0QXV0aDCCAiIwDQYJKoZIhvcNAQEBBQADggIPADCCAgoCggIBALcMByyynHsA\n+K4PJwo5+XHygaEZAhPGvHiKQK2Cbc9NDm0ZTzx0rA/dRTZlvouhDyzcJHm+6R1F\nj6zQv7iaSC3qQtJiPnPsfZ+/0XhFZ3fQWMnfDiGbZpF1kJF01ofB6vnsuocFC0zG\naGC+SZiLAzs+QMP3Bebw1elCBIeoN+8NWnRYmLsYIaYGJGBSbNo/lCpLTuinofUn\nL3ehWEGv1INwpHnSVeN0Ml2GFe23d7PUlj/wNIHgUdpUR+KEJxIP3klwtsI3QpSH\nc4VjWdf4aIcka6K3IFuw+K0PUh3xAAPnMpAQOtCZk0AhF5rlvUbevC6jADxpKxLp\nOONmvCTer4LtyNURAoBH52vbK0r/DNcTpPEFV0IP66nXUFgkk0mRKsu8HTb4IOkC\nX3K4mp18EiWUUtrHZAnNct0iIniDBqKK0yhSNhztG6VakVt/1WdQY9Ey3mNtxN1O\nthqWFKdpKUzPKYC3P6PfVpiE7+VbWTLLXba+8BPe8BxWPsVkjJqGSGnCte4COusz\nM8/7bbTgifwJfsepwFtZG53tvwjWlO46Exl30VoDNTaIGvs1fO0GqJlh2A7FN5F2\nS1rS5VYHtPK8QdmUSvyq+7JDBc1HNT5I2zsIQbNcLwDTZ5EsbU6QR7NHDJKxjv/w\nbs3eTXJSSNcFD74wRU10pXjgE5wOFu9TAgMBAAGjYzBhMA4GA1UdDwEB/wQEAwIA\nBjAPBgNVHRMBAf8EBTADAQH/MB0GA1UdDgQWBBQHazgZ3Puiuc6K2LzgcX5b6fAC\nPzAfBgNVHSMEGDAWgBQHazgZ3Puiuc6K2LzgcX5b6fACPzALBgkqhkiG9w0BAQsD\nggIBAEmeNrSUhpHg1I8dtfqu9hCU/6IZThjtcFA+QcPkkMa+Z1k0SOtsgW8MdlcA\ngCf5g5yQZ0DdpWM9nDB6xDIhQdccm91idHgf8wmpEHUj0an4uyn2ESCt8eqrAWf7\nAClYORCASTYfguJCxcfvwtI1uqaOeCxSOdmFay79UVitVsWeonbCRGsVgBDifJxw\nG2oCQqoYAmXPM4J6syk5GHhB1O9MMq+g1+hOx9s+XHyTui9FL4V+IUO1ygVqEQB5\nPSiRBvcIsajSGVao+vK0gf2XfcXzqr3y3NhBky9rFMp1g+ykb2yWekV4WiROJlCj\nTsWwWZDRyjiGahDbho/XW8JciouHZhJdjhmO31rqW3HdFviCTdXMiGk3GQIzz/Jg\nP+enOaHXoY9lcxzDvY9z1BysWBgNvNrMnVge/fLP9o+a0a0PRIIVl8T0Ef3zeg1O\nCLCSy/1Vae5Tx63ZTFvGFdOSusYkG9rlAUHXZE364JRCKzM9Bz0bM+t+LaO0MaEb\nYoxcXEPU+gB2IvmARpInN3oHexR6ekuYHVTRGdWrdmuHFzc7eFwygRqTFdoCCU+G\nQZEkd+lOEyv0zvQqYg+Jp0AEGz2B2zB53uBVECtn0EqrSdPtRzUBSByXVs6QhSXn\neVmy+z3U3MecP63X6oSPXekqSyZFuegXpNNuHkjNoL4ep2ix\n-----END CERTIFICATE-----\n-----BEGIN CERTIFICATE-----\nMIIEtzCCA5+gAwIBAgIJAIewRMI8OnvTMA0GCSqGSIb3DQEBBQUAMIGYMQswCQYD\nVQQGEwJVUzELMAkGA1UECBMCQ0ExFjAUBgNVBAcTDVNhbiBGcmFuY2lzY28xHDAa\nBgNVBAoTE0hhc2hpQ29ycCBUZXN0IENlcnQxDDAKBgNVBAsTA0RldjEWMBQGA1UE\nAxMNdGVzdC5pbnRlcm5hbDEgMB4GCSqGSIb3DQEJARYRdGVzdEBpbnRlcm5hbC5j\nb20wHhcNMTQwNDA3MTkwMTA4WhcNMjQwNDA0MTkwMTA4WjCBmDELMAkGA1UEBhMC\nVVMxCzAJBgNVBAgTAkNBMRYwFAYDVQQHEw1TYW4gRnJhbmNpc2NvMRwwGgYDVQQK\nExNIYXNoaUNvcnAgVGVzdCBDZXJ0MQwwCgYDVQQLEwNEZXYxFjAUBgNVBAMTDXRl\nc3QuaW50ZXJuYWwxIDAeBgkqhkiG9w0BCQEWEXRlc3RAaW50ZXJuYWwuY29tMIIB\nIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAxrs6JK4NpiOItxrpNR/1ppUU\nmH7p2BgLCBZ6eHdclle9J56i68adt8J85zaqphCfz6VDP58DsFx+N50PZyjQaDsU\nd0HejRqfHRMtg2O+UQkv4Z66+Vo+gc6uGuANi2xMtSYDVTAqqzF48OOPQDgYkzcG\nxcFZzTRFFZt2vPnyHj8cHcaFo/NMNVh7C3yTXevRGNm9u2mrbxCEeiHzFC2WUnvg\nU2jQuC7Fhnl33Zd3B6d3mQH6O23ncmwxTcPUJe6xZaIRrDuzwUcyhLj5Z3faag/f\npFIIcHSiHRfoqHLGsGg+3swId/zVJSSDHr7pJUu7Cre+vZa63FqDaooqvnisrQID\nAQABo4IBADCB/TAdBgNVHQ4EFgQUo/nrOfqvbee2VklVKIFlyQEbuJUwgc0GA1Ud\nIwSBxTCBwoAUo/nrOfqvbee2VklVKIFlyQEbuJWhgZ6kgZswgZgxCzAJBgNVBAYT\nAlVTMQswCQYDVQQIEwJDQTEWMBQGA1UEBxMNU2FuIEZyYW5jaXNjbzEcMBoGA1UE\nChMTSGFzaGlDb3JwIFRlc3QgQ2VydDEMMAoGA1UECxMDRGV2MRYwFAYDVQQDEw10\nZXN0LmludGVybmFsMSAwHgYJKoZIhvcNAQkBFhF0ZXN0QGludGVybmFsLmNvbYIJ\nAIewRMI8OnvTMAwGA1UdEwQFMAMBAf8wDQYJKoZIhvcNAQEFBQADggEBADa9fV9h\ngjapBlkNmu64WX0Ufub5dsJrdHS8672P30S7ILB7Mk0W8sL65IezRsZnG898yHf9\n2uzmz5OvNTM9K380g7xFlyobSVq+6yqmmSAlA/ptAcIIZT727P5jig/DB7fzJM3g\njctDlEGOmEe50GQXc25VKpcpjAsNQi5ER5gowQ0v3IXNZs+yU+LvxLHc0rUJ/XSp\nlFCAMOqd5uRoMOejnT51G6krvLNzPaQ3N9jQfNVY4Q0zfs0M+6dRWvqfqB9Vyq8/\nPOLMld+HyAZEBk9zK3ZVIXx6XS4dkDnSNR91njLq7eouf6M7+7s/oMQZZRtAfQ6r\nwlW975rYa1ZqEdA=\n-----END CERTIFICATE-----\n" } } } }, "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/custom-bootstrap { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy" }, "custom_field": "foo" }=== RUN TestGenerateConfig/extra_-single { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "fake_cluster_1" } ], "listeners": [ { "name": "fake_listener_1" } ] }, "stats_sinks": [ { "name": "fake_sink_1" } ], "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/extra_-multiple { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "fake_cluster_1" }, { "name": "fake_cluster_2" } ], "listeners": [ { "name": "fake_listener_1" }, { "name": "fake_listener_2" } ] }, "stats_sinks": [ { "name": "fake_sink_1" }, { "name": "fake_sink_2" } ], "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/stats-config-override { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "name": "fake_config" }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/zipkin-tracing-config { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "zipkin", "type": "STRICT_DNS", "connect_timeout": "5s", "load_assignment": { "cluster_name": "zipkin", "endpoints": [ { "lb_endpoints": [ { "endpoint": { "address": { "socket_address": { "address": "zipkin.service.consul", "port_value": 9411 } } } } ] } ] } } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "tracing": { "http": { "name": "envoy.zipkin", "config": { "collector_cluster": "zipkin", "collector_endpoint": "/api/v1/spans" } } }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/CONSUL_HTTP_ADDR-with-https-scheme-enables-tls { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "test-proxy", "id": "test-proxy", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "tls_context": { "common_tls_context": { "validation_context": { "trusted_ca": { "inline_string": "" } } } }, "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "test-proxy" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/ingress-gateway { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "ingress-gateway-1", "id": "ingress-gateway-1", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 443 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "ingress-gateway-1" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/ingress-gateway-address-specified { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "ingress-gateway", "id": "ingress-gateway", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "1.2.3.4", "port_value": 7777 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "ingress-gateway" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/ingress-gateway-register-with-service-without-proxy-id { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "my-gateway", "id": "my-gateway", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 7777 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "my-gateway" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/ingress-gateway-register-with-service-and-proxy-id { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "my-gateway-123", "id": "my-gateway-123", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 7777 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "my-gateway-123" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestGenerateConfig/ingress-gateway-no-auto-register { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "ingress-gateway", "id": "ingress-gateway", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 8502 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 7777 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "ingress-gateway" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } --- PASS: TestGenerateConfig (0.44s) --- PASS: TestGenerateConfig/no-args (0.01s) --- PASS: TestGenerateConfig/defaults (0.02s) --- PASS: TestGenerateConfig/token-arg (0.04s) --- PASS: TestGenerateConfig/token-env (0.01s) --- PASS: TestGenerateConfig/token-file-arg (0.02s) --- PASS: TestGenerateConfig/token-file-env (0.01s) --- PASS: TestGenerateConfig/grpc-addr-flag (0.01s) --- PASS: TestGenerateConfig/grpc-addr-env (0.02s) --- PASS: TestGenerateConfig/grpc-addr-unix (0.01s) --- PASS: TestGenerateConfig/grpc-addr-config (0.05s) --- PASS: TestGenerateConfig/access-log-path (0.02s) --- PASS: TestGenerateConfig/missing-ca-file (0.00s) --- PASS: TestGenerateConfig/existing-ca-file (0.01s) --- PASS: TestGenerateConfig/missing-ca-path (0.00s) --- PASS: TestGenerateConfig/existing-ca-path (0.02s) --- PASS: TestGenerateConfig/custom-bootstrap (0.03s) --- PASS: TestGenerateConfig/extra_-single (0.01s) --- PASS: TestGenerateConfig/extra_-multiple (0.02s) --- PASS: TestGenerateConfig/stats-config-override (0.03s) --- PASS: TestGenerateConfig/zipkin-tracing-config (0.01s) --- PASS: TestGenerateConfig/CONSUL_HTTP_ADDR-with-https-scheme-enables-tls (0.01s) --- PASS: TestGenerateConfig/ingress-gateway (0.01s) --- PASS: TestGenerateConfig/ingress-gateway-address-specified (0.01s) --- PASS: TestGenerateConfig/ingress-gateway-register-with-service-without-proxy-id (0.05s) --- PASS: TestGenerateConfig/ingress-gateway-register-with-service-and-proxy-id (0.03s) --- PASS: TestGenerateConfig/ingress-gateway-no-auto-register (0.01s) === RUN TestEnvoy_GatewayRegistration === PAUSE TestEnvoy_GatewayRegistration === RUN TestEnvoyCommand_canBindInternal === PAUSE TestEnvoyCommand_canBindInternal === RUN TestExecEnvoy === RUN TestExecEnvoy/default === RUN TestExecEnvoy/hot-restart-epoch === RUN TestExecEnvoy/hot-restart-version === RUN TestExecEnvoy/hot-restart-version#01 === RUN TestExecEnvoy/hot-restart-version#02 --- PASS: TestExecEnvoy (2.20s) --- PASS: TestExecEnvoy/default (0.52s) --- PASS: TestExecEnvoy/hot-restart-epoch (0.34s) --- PASS: TestExecEnvoy/hot-restart-version (0.72s) --- PASS: TestExecEnvoy/hot-restart-version#01 (0.26s) --- PASS: TestExecEnvoy/hot-restart-version#02 (0.36s) === RUN TestHelperProcess --- PASS: TestHelperProcess (0.00s) === RUN TestServiceAddressValue_Value === RUN TestServiceAddressValue_Value/nil_receiver === RUN TestServiceAddressValue_Value/default_value === RUN TestServiceAddressValue_Value/set_value --- PASS: TestServiceAddressValue_Value (0.00s) --- PASS: TestServiceAddressValue_Value/nil_receiver (0.00s) --- PASS: TestServiceAddressValue_Value/default_value (0.00s) --- PASS: TestServiceAddressValue_Value/set_value (0.00s) === RUN TestServiceAddressValue_String === RUN TestServiceAddressValue_String/nil_receiver === RUN TestServiceAddressValue_String/default_value === RUN TestServiceAddressValue_String/set_value --- PASS: TestServiceAddressValue_String (0.00s) --- PASS: TestServiceAddressValue_String/nil_receiver (0.00s) --- PASS: TestServiceAddressValue_String/default_value (0.00s) --- PASS: TestServiceAddressValue_String/set_value (0.00s) === RUN TestServiceAddressValue_Set === RUN TestServiceAddressValue_Set/default_port === RUN TestServiceAddressValue_Set/valid_address === RUN TestServiceAddressValue_Set/address_with_no_port === RUN TestServiceAddressValue_Set/invalid_addres === RUN TestServiceAddressValue_Set/invalid_port === RUN TestServiceAddressValue_Set/invalid_address_format --- PASS: TestServiceAddressValue_Set (0.00s) --- PASS: TestServiceAddressValue_Set/default_port (0.00s) --- PASS: TestServiceAddressValue_Set/valid_address (0.00s) --- PASS: TestServiceAddressValue_Set/address_with_no_port (0.00s) --- PASS: TestServiceAddressValue_Set/invalid_addres (0.00s) --- PASS: TestServiceAddressValue_Set/invalid_port (0.00s) --- PASS: TestServiceAddressValue_Set/invalid_address_format (0.00s) === CONT TestEnvoyCommand_noTabs --- PASS: TestEnvoyCommand_noTabs (0.01s) === CONT TestEnvoyCommand_canBindInternal === RUN TestEnvoyCommand_canBindInternal/IPNet === CONT TestEnvoy_GatewayRegistration === RUN TestEnvoyCommand_canBindInternal/IPNet/ipv4 === RUN TestEnvoyCommand_canBindInternal/IPNet/secondary_ipv4 === RUN TestEnvoyCommand_canBindInternal/IPNet/ipv6 === RUN TestEnvoyCommand_canBindInternal/IPNet/ipv4_not_found === RUN TestEnvoyCommand_canBindInternal/IPNet/ipv6_not_found === RUN TestEnvoyCommand_canBindInternal/IPAddr === RUN TestEnvoyCommand_canBindInternal/IPAddr/ipv4 === RUN TestEnvoyCommand_canBindInternal/IPAddr/secondary_ipv4 === RUN TestEnvoyCommand_canBindInternal/IPAddr/ipv6 === RUN TestEnvoyCommand_canBindInternal/IPAddr/ipv4_not_found === RUN TestEnvoyCommand_canBindInternal/IPAddr/ipv6_not_found --- PASS: TestEnvoyCommand_canBindInternal (0.01s) --- PASS: TestEnvoyCommand_canBindInternal/IPNet (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPNet/ipv4 (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPNet/secondary_ipv4 (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPNet/ipv6 (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPNet/ipv4_not_found (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPNet/ipv6_not_found (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPAddr (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPAddr/ipv4 (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPAddr/secondary_ipv4 (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPAddr/ipv6 (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPAddr/ipv4_not_found (0.00s) --- PASS: TestEnvoyCommand_canBindInternal/IPAddr/ipv6_not_found (0.00s) === CONT TestEnvoyGateway_Validation === RUN TestEnvoyGateway_Validation/-register_for_non-gateway [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === RUN TestEnvoyGateway_Validation/-mesh-gateway_and_-gateway_cannot_be_combined === RUN TestEnvoyGateway_Validation/no_proxy_registration_specified_nor_discovered [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range --- PASS: TestEnvoyGateway_Validation (0.02s) --- PASS: TestEnvoyGateway_Validation/-register_for_non-gateway (0.01s) --- PASS: TestEnvoyGateway_Validation/-mesh-gateway_and_-gateway_cannot_be_combined (0.00s) --- PASS: TestEnvoyGateway_Validation/no_proxy_registration_specified_nor_discovered (0.00s) === RUN TestEnvoy_GatewayRegistration/register_gateway_with_proxy-id_and_name { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "us-ingress", "id": "us-ingress-1", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 27364 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 443 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "us-ingress" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestEnvoy_GatewayRegistration/register_gateway_without_proxy-id_with_name { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "us-ingress", "id": "us-ingress", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 27364 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 443 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "us-ingress" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestEnvoy_GatewayRegistration/register_gateway_without_proxy-id_and_without_name { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "ingress-gateway", "id": "ingress-gateway", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 27364 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 443 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "ingress-gateway" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } === RUN TestEnvoy_GatewayRegistration/register_gateway_with_proxy-id_without_name { "admin": { "access_log_path": "/dev/null", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } }, "node": { "cluster": "ingress-gateway", "id": "us-ingress-1", "metadata": { "namespace": "default", "envoy_version": "1.14.5" } }, "static_resources": { "clusters": [ { "name": "local_agent", "connect_timeout": "1s", "type": "STATIC", "http2_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 27364 } } ] }, { "name": "self_admin", "connect_timeout": "5s", "type": "STATIC", "http_protocol_options": {}, "hosts": [ { "socket_address": { "address": "127.0.0.1", "port_value": 19000 } } ] } ], "listeners": [ { "name": "envoy_ready_listener", "address": { "socket_address": { "address": "127.0.0.1", "port_value": 443 } }, "filter_chains": [ { "filters": [ { "name": "envoy.http_connection_manager", "config": { "stat_prefix": "envoy_ready", "codec_type": "HTTP1", "route_config": { "name": "self_admin_route", "virtual_hosts": [ { "name": "self_admin", "domains": [ "*" ], "routes": [ { "match": { "path": "/ready" }, "route": { "cluster": "self_admin", "prefix_rewrite": "/ready" } }, { "match": { "prefix": "/" }, "direct_response": { "status": 404 } } ] } ] }, "http_filters": [ { "name": "envoy.router" } ] } } ] } ] } ] }, "stats_config": { "stats_tags": [ { "regex": "^cluster\\.((?:([^.]+)~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.custom_hash" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:([^.]+)\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service_subset" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.service" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.namespace" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.datacenter" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.[^.]+\\.consul\\.)", "tag_name": "consul.routing_type" }, { "regex": "^cluster\\.((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.([^.]+)\\.consul\\.)", "tag_name": "consul.trust_domain" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+)\\.[^.]+\\.[^.]+\\.consul\\.)", "tag_name": "consul.target" }, { "regex": "^cluster\\.(((?:[^.]+~)?(?:[^.]+\\.)?[^.]+\\.[^.]+\\.[^.]+\\.[^.]+\\.[^.]+)\\.consul\\.)", "tag_name": "consul.full_target" }, { "tag_name": "local_cluster", "fixed_value": "ingress-gateway" } ], "use_all_default_tags": true }, "dynamic_resources": { "lds_config": { "ads": {} }, "cds_config": { "ads": {} }, "ads_config": { "api_type": "GRPC", "grpc_services": { "initial_metadata": [ { "key": "x-consul-token", "value": "" } ], "envoy_grpc": { "cluster_name": "local_agent" } } } }, "layered_runtime": { "layers": [ { "name": "static_layer", "static_layer": { "envoy.deprecated_features:envoy.api.v2.Cluster.tls_context": true, "envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1": true, "envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name": true } } ] } } 2021-10-05T16:32:25.213Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:25.227Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:25.284 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:631b5d6a-a435-620c-4e50-ef13b044b3d2 Address:127.0.0.1:27363}]" 32:25.285 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-631b5d6a-a435-620c-4e50-ef13b044b3d2.dc1 127.0.0.1 32:25.285 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-631b5d6a-a435-620c-4e50-ef13b044b3d2 127.0.0.1 2021-10-05T16:32:25.285Z [INFO] agent.router: Initializing LAN area manager 32:25.300 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=udp 32:25.300 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 32:25.301 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-631b5d6a-a435-620c-4e50-ef13b044b3d2.dc1 area=wan 32:25.301 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=tcp 32:25.301 [INFO] TestAgent.server: Adding LAN server: server="Node-631b5d6a-a435-620c-4e50-ef13b044b3d2 (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 32:25.332 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27359 network=tcp 32:25.332 [INFO] TestAgent: started state syncer 32:25.332 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27364 network=tcp 32:25.356 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:25.356 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 32:25.399 [DEBUG] TestAgent.server.raft: votes: needed=1 32:25.399 [DEBUG] TestAgent.server.raft: vote granted: from=631b5d6a-a435-620c-4e50-ef13b044b3d2 term=2 tally=1 32:25.399 [INFO] TestAgent.server.raft: election won: tally=1 32:25.399 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 32:25.400 [INFO] TestAgent.server: cluster leadership acquired 32:25.400 [INFO] TestAgent.server: New leader elected: payload=Node-631b5d6a-a435-620c-4e50-ef13b044b3d2 32:25.416 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27363 32:25.448 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:25.500 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:25.500 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:25.500 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:25.500 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:25.500 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:25.500 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-631b5d6a-a435-620c-4e50-ef13b044b3d2 32:25.500 [INFO] TestAgent.server: member joined, marking health alive: member=Node-631b5d6a-a435-620c-4e50-ef13b044b3d2 32:25.524 [INFO] TestAgent.server: federation state anti-entropy synced 32:25.670 [WARN] TestAgent.server.catalog: no terminating-gateway or ingress-gateway associated with this gateway: gateway=us-ingress 32:25.670 [WARN] TestAgent.server.catalog: no terminating-gateway or ingress-gateway associated with this gateway: gateway=us-ingress 32:25.670 [ERROR] TestAgent.proxycfg: watch error: service_id=us-ingress-1 id=gateway-config error="invalid type for config entry: " 32:25.688 [INFO] TestAgent: Synced node info 32:25.695 [INFO] TestAgent: Synced service: service=us-ingress-1 32:25.695 [DEBUG] TestAgent: Check in sync: check=service:us-ingress-1 32:25.695 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:59512 latency=26.985595ms 32:25.700 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:59512 latency=5.137056ms 32:25.710 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/us-ingress-1 from=127.0.0.1:59512 latency=325.051µs 32:25.714 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/us-ingress-1 from=127.0.0.1:59516 latency=1.226643ms 32:25.721 [ERROR] TestAgent.proxycfg: watch error: service_id=us-ingress id=gateway-config error="invalid type for config entry: " 32:25.724 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:25.724 [DEBUG] TestAgent: Node info in sync 32:25.724 [DEBUG] TestAgent: Service in sync: service=us-ingress-1 32:25.729 [INFO] TestAgent: Synced service: service=us-ingress 32:25.729 [DEBUG] TestAgent: Check in sync: check=service:us-ingress-1 32:25.729 [DEBUG] TestAgent: Check in sync: check=service:us-ingress 32:25.748 [DEBUG] TestAgent: Node info in sync 32:25.748 [DEBUG] TestAgent: Service in sync: service=us-ingress-1 32:25.748 [DEBUG] TestAgent: Service in sync: service=us-ingress 32:25.748 [DEBUG] TestAgent: Check in sync: check=service:us-ingress-1 32:25.748 [DEBUG] TestAgent: Check in sync: check=service:us-ingress 32:25.748 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:59518 latency=27.825608ms 32:25.750 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:59518 latency=1.632844ms 32:25.761 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/us-ingress from=127.0.0.1:59518 latency=2.227104ms 32:25.764 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/us-ingress from=127.0.0.1:59516 latency=207.774µs 32:25.782 [ERROR] TestAgent.proxycfg: watch error: service_id=ingress-gateway id=gateway-config error="invalid type for config entry: " 32:25.782 [WARN] TestAgent.server.catalog: no terminating-gateway or ingress-gateway associated with this gateway: gateway=ingress-gateway 32:25.782 [WARN] TestAgent.server.catalog: no terminating-gateway or ingress-gateway associated with this gateway: gateway=ingress-gateway 32:25.795 [DEBUG] TestAgent: Node info in sync 32:25.795 [DEBUG] TestAgent: Service in sync: service=us-ingress-1 32:25.795 [DEBUG] TestAgent: Service in sync: service=us-ingress 32:25.800 [INFO] TestAgent: Synced service: service=ingress-gateway 32:25.800 [DEBUG] TestAgent: Check in sync: check=service:us-ingress-1 32:25.800 [DEBUG] TestAgent: Check in sync: check=service:us-ingress 32:25.800 [DEBUG] TestAgent: Check in sync: check=service:ingress-gateway 32:25.800 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:59522 latency=20.137887ms 32:25.802 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:59522 latency=1.149667ms 32:25.816 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/ingress-gateway from=127.0.0.1:59522 latency=569.17µs 32:25.824 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/ingress-gateway from=127.0.0.1:59516 latency=493.842µs 32:25.844 [DEBUG] TestAgent: Node info in sync 32:25.865 [INFO] TestAgent: Synced service: service=us-ingress-1 32:25.865 [DEBUG] TestAgent: Service in sync: service=us-ingress 32:25.865 [DEBUG] TestAgent: Service in sync: service=ingress-gateway 32:25.865 [DEBUG] TestAgent: Check in sync: check=service:us-ingress-1 32:25.865 [DEBUG] TestAgent: Check in sync: check=service:us-ingress 32:25.865 [DEBUG] TestAgent: Check in sync: check=service:ingress-gateway 32:25.865 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:59526 latency=38.340547ms 32:25.875 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:59526 latency=3.598763ms 32:25.890 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/us-ingress-1 from=127.0.0.1:59526 latency=217.664µs 32:25.892 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/us-ingress-1 from=127.0.0.1:59516 latency=929.037µs 32:25.893 [INFO] TestAgent: Requesting shutdown 32:25.893 [INFO] TestAgent.server: shutting down server 32:25.893 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:25.893 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:25.893 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:25.893 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:25.893 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:25.893 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:25.893 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:25.893 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:25.893 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:25.894 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:25.908 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:25.916Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:25.916Z [INFO] agent.router.manager: shutting down 32:25.916 [INFO] TestAgent: consul server down 32:25.916 [INFO] TestAgent: shutdown complete 32:25.916 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 32:25.916 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 32:25.916 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 32:26.420 [INFO] TestAgent: Waiting for endpoints to shut down 32:26.420 [INFO] TestAgent: Endpoints down --- PASS: TestEnvoy_GatewayRegistration (1.32s) --- PASS: TestEnvoy_GatewayRegistration/register_gateway_with_proxy-id_and_name (0.05s) --- PASS: TestEnvoy_GatewayRegistration/register_gateway_without_proxy-id_with_name (0.05s) --- PASS: TestEnvoy_GatewayRegistration/register_gateway_without_proxy-id_and_without_name (0.05s) --- PASS: TestEnvoy_GatewayRegistration/register_gateway_with_proxy-id_without_name (0.07s) PASS ok github.com/hashicorp/consul/command/connect/envoy 4.097s === RUN TestConnectEnvoyPipeBootstrapCommand_noTabs === PAUSE TestConnectEnvoyPipeBootstrapCommand_noTabs === CONT TestConnectEnvoyPipeBootstrapCommand_noTabs --- PASS: TestConnectEnvoyPipeBootstrapCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/connect/envoy/pipe-bootstrap 0.062s === RUN TestConnectExpose === PAUSE TestConnectExpose === RUN TestConnectExpose_invalidFlags === PAUSE TestConnectExpose_invalidFlags === RUN TestConnectExpose_existingConfig === PAUSE TestConnectExpose_existingConfig === CONT TestConnectExpose [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestConnectExpose_existingConfig === CONT TestConnectExpose_invalidFlags [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestConnectExpose_invalidFlags/missing_service === RUN TestConnectExpose_invalidFlags/missing_gateway === RUN TestConnectExpose_invalidFlags/missing_port 2021-10-05T16:32:27.293Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:27.309Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:27.353 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:90d2b7d8-5d40-e582-f3b6-ed353e831bdd Address:127.0.0.1:22272}]" 32:27.354 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:22272 [Follower]" leader= 32:27.355 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-90d2b7d8-5d40-e582-f3b6-ed353e831bdd.dc1 127.0.0.1 32:27.385 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-90d2b7d8-5d40-e582-f3b6-ed353e831bdd 127.0.0.1 2021-10-05T16:32:27.385Z [INFO] agent.router: Initializing LAN area manager 32:27.385 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22267 network=udp 32:27.385 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-90d2b7d8-5d40-e582-f3b6-ed353e831bdd.dc1 area=wan 32:27.385 [INFO] TestAgent.server: Adding LAN server: server="Node-90d2b7d8-5d40-e582-f3b6-ed353e831bdd (Addr: tcp/127.0.0.1:22272) (DC: dc1)" 32:27.385 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22267 network=tcp 32:27.386 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:22268 network=tcp 32:27.386 [INFO] TestAgent: started state syncer 32:27.386 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:22273 network=tcp 32:27.399 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:27.399 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:22272 [Candidate]" term=2 32:27.413 [DEBUG] TestAgent.server.raft: votes: needed=1 32:27.413 [DEBUG] TestAgent.server.raft: vote granted: from=90d2b7d8-5d40-e582-f3b6-ed353e831bdd term=2 tally=1 32:27.413 [INFO] TestAgent.server.raft: election won: tally=1 32:27.413 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:22272 [Leader]" 32:27.413 [INFO] TestAgent.server: cluster leadership acquired 32:27.414 [INFO] TestAgent.server: New leader elected: payload=Node-90d2b7d8-5d40-e582-f3b6-ed353e831bdd 32:27.429 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:22272 32:27.456 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:27.499 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:27.499 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:27.499 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:27.499 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:27.499 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:27.499 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-90d2b7d8-5d40-e582-f3b6-ed353e831bdd 32:27.499 [INFO] TestAgent.server: member joined, marking health alive: member=Node-90d2b7d8-5d40-e582-f3b6-ed353e831bdd 32:27.528 [INFO] TestAgent.server: federation state anti-entropy synced 32:27.539 [INFO] TestAgent: Requesting shutdown 32:27.539 [INFO] TestAgent.server: shutting down server 32:27.539 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:27.539 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:27.539 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:27.539 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:27.539 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:27.539 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:27.539 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:27.539 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:27.539 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:27.539 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:27.539 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:27.548 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:27.560Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:27.560Z [INFO] agent.router.manager: shutting down 32:27.560 [INFO] TestAgent: consul server down 32:27.560 [INFO] TestAgent: shutdown complete 32:27.560 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22267 network=tcp 32:27.560 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22267 network=udp 32:27.560 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:22268 network=tcp 32:28.064 [INFO] TestAgent: Waiting for endpoints to shut down 32:28.064 [INFO] TestAgent: Endpoints down --- PASS: TestConnectExpose_invalidFlags (0.92s) --- PASS: TestConnectExpose_invalidFlags/missing_service (0.00s) --- PASS: TestConnectExpose_invalidFlags/missing_gateway (0.00s) --- PASS: TestConnectExpose_invalidFlags/missing_port (0.00s) 2021-10-05T16:32:27.235Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:27.299Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:27.353 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a789fdd9-aed1-4129-d893-cac42fb55520 Address:127.0.0.1:22258}]" 32:27.354 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:22258 [Follower]" leader= 32:27.354 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a789fdd9-aed1-4129-d893-cac42fb55520.dc1 127.0.0.1 32:27.355 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a789fdd9-aed1-4129-d893-cac42fb55520 127.0.0.1 2021-10-05T16:32:27.355Z [INFO] agent.router: Initializing LAN area manager 32:27.359 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a789fdd9-aed1-4129-d893-cac42fb55520.dc1 area=wan 32:27.359 [INFO] TestAgent.server: Adding LAN server: server="Node-a789fdd9-aed1-4129-d893-cac42fb55520 (Addr: tcp/127.0.0.1:22258) (DC: dc1)" 32:27.384 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=udp 32:27.384 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=tcp 32:27.385 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:22254 network=tcp 32:27.385 [INFO] TestAgent: started state syncer 32:27.385 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:22259 network=tcp 32:27.396 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:27.396 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:22258 [Candidate]" term=2 32:27.412 [DEBUG] TestAgent.server.raft: votes: needed=1 32:27.412 [DEBUG] TestAgent.server.raft: vote granted: from=a789fdd9-aed1-4129-d893-cac42fb55520 term=2 tally=1 32:27.412 [INFO] TestAgent.server.raft: election won: tally=1 32:27.412 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:22258 [Leader]" 32:27.413 [INFO] TestAgent.server: cluster leadership acquired 32:27.413 [INFO] TestAgent.server: New leader elected: payload=Node-a789fdd9-aed1-4129-d893-cac42fb55520 32:27.431 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:22258 32:27.447 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:27.512 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:27.512 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:27.512 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:27.512 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:27.512 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:27.512 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a789fdd9-aed1-4129-d893-cac42fb55520 32:27.512 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a789fdd9-aed1-4129-d893-cac42fb55520 32:27.526 [ERROR] TestAgent.http: Request error: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:46026 error="Config entry not found for "ingress-gateway" / "ingress"" 32:27.527 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:46026 latency=369.077µs 32:27.565 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config?cas=0 from=127.0.0.1:46026 latency=37.48587ms 32:27.565 [INFO] TestAgent.server: federation state anti-entropy synced 32:27.566 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:46026 latency=554.176µs 32:27.579 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:46026 latency=12.447123ms 32:27.581 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:46030 latency=343.534µs 32:27.583 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:46030 latency=300.013µs 32:27.590 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:46032 latency=285.679µs 32:27.599 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config?cas=12 from=127.0.0.1:46032 latency=8.456789ms 32:27.600 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:46032 latency=617.667µs 32:27.603 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:46030 latency=428.177µs 32:27.606 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:46030 latency=472.516µs 32:27.611 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:46034 latency=333.266µs 32:27.612 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:46030 latency=204.165µs 32:27.613 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:46030 latency=157.333µs 32:27.613 [INFO] TestAgent: Requesting shutdown 32:27.613 [INFO] TestAgent.server: shutting down server 32:27.613 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:27.613 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:27.613 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:27.613 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:27.613 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:27.614 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:27.614 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:27.614 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:27.614 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:27.614 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:27.614 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:27.624 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:27.631Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:27.631Z [INFO] agent.router.manager: shutting down 32:27.631 [INFO] TestAgent: consul server down 32:27.631 [INFO] TestAgent: shutdown complete 32:27.631 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=tcp 32:27.631 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=udp 32:27.631 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:22254 network=tcp 32:28.132 [INFO] TestAgent: Waiting for endpoints to shut down 32:28.132 [INFO] TestAgent: Endpoints down --- PASS: TestConnectExpose (0.99s) 2021-10-05T16:32:27.260Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:27.272Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:27.324 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:186ee0f1-907f-8fe7-9460-b3d78abbeaed Address:127.0.0.1:22265}]" 32:27.324 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:22265 [Follower]" leader= 32:27.325 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-186ee0f1-907f-8fe7-9460-b3d78abbeaed.dc1 127.0.0.1 32:27.326 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-186ee0f1-907f-8fe7-9460-b3d78abbeaed 127.0.0.1 2021-10-05T16:32:27.326Z [INFO] agent.router: Initializing LAN area manager 32:27.332 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-186ee0f1-907f-8fe7-9460-b3d78abbeaed.dc1 area=wan 32:27.332 [INFO] TestAgent.server: Adding LAN server: server="Node-186ee0f1-907f-8fe7-9460-b3d78abbeaed (Addr: tcp/127.0.0.1:22265) (DC: dc1)" 32:27.332 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22260 network=udp 32:27.332 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22260 network=tcp 32:27.336 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:22261 network=tcp 32:27.336 [INFO] TestAgent: started state syncer 32:27.337 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:22266 network=tcp 32:27.376 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:27.376 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:22265 [Candidate]" term=2 32:27.406 [DEBUG] TestAgent.server.raft: votes: needed=1 32:27.406 [DEBUG] TestAgent.server.raft: vote granted: from=186ee0f1-907f-8fe7-9460-b3d78abbeaed term=2 tally=1 32:27.406 [INFO] TestAgent.server.raft: election won: tally=1 32:27.406 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:22265 [Leader]" 32:27.406 [INFO] TestAgent.server: cluster leadership acquired 32:27.406 [INFO] TestAgent.server: New leader elected: payload=Node-186ee0f1-907f-8fe7-9460-b3d78abbeaed 32:27.416 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:22265 32:27.421 [INFO] TestAgent: Synced node info 32:27.458 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:27.465 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:55874 latency=22.577218ms 32:27.479 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:55874 latency=12.990672ms 32:27.503 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config from=127.0.0.1:55874 latency=22.220621ms 32:27.526 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:27.526 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:27.526 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:27.526 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:27.526 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:27.526 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-186ee0f1-907f-8fe7-9460-b3d78abbeaed 32:27.526 [INFO] TestAgent.server: member joined, marking health alive: member=Node-186ee0f1-907f-8fe7-9460-b3d78abbeaed 32:27.547 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:55878 latency=2.252572ms 32:27.556 [INFO] TestAgent.server: federation state anti-entropy synced 32:27.578 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config?cas=12 from=127.0.0.1:55878 latency=17.646826ms 32:27.581 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:55878 latency=362.843µs 32:27.599 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:55878 latency=15.564522ms 32:27.600 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:55874 latency=171.802µs 32:27.611 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:55886 latency=258.82µs 32:27.629 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config?cas=16 from=127.0.0.1:55886 latency=17.121507ms 32:27.630 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:55886 latency=268.875µs 32:27.635 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:55886 latency=5.048259ms 32:27.636 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:55874 latency=442.619µs 32:27.638 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:55888 latency=294.827µs 32:27.652 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/config?cas=18 from=127.0.0.1:55888 latency=13.64226ms 32:27.656 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:55888 latency=209.856µs 32:27.667 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:55888 latency=10.437673ms 32:27.676 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/config/ingress-gateway/ingress from=127.0.0.1:55874 latency=281.511µs 32:27.677 [INFO] TestAgent: Requesting shutdown 32:27.677 [INFO] TestAgent.server: shutting down server 32:27.677 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:27.677 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:27.677 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:27.677 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:27.677 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:27.677 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:27.677 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:27.677 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:27.677 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:27.677 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:27.685 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:27.685Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:27.685Z [INFO] agent.router.manager: shutting down 32:27.685 [INFO] TestAgent: consul server down 32:27.685 [INFO] TestAgent: shutdown complete 32:27.685 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22260 network=tcp 32:27.685 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22260 network=udp 32:27.685 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:22261 network=tcp 32:28.188 [INFO] TestAgent: Waiting for endpoints to shut down 32:28.188 [INFO] TestAgent: Endpoints down --- PASS: TestConnectExpose_existingConfig (1.04s) PASS ok github.com/hashicorp/consul/command/connect/expose 1.163s === RUN TestFlagUpstreams_impl --- PASS: TestFlagUpstreams_impl (0.00s) === RUN TestFlagUpstreams === RUN TestFlagUpstreams/bad_format === RUN TestFlagUpstreams/port_not_int === RUN TestFlagUpstreams/4_parts === RUN TestFlagUpstreams/single_value === RUN TestFlagUpstreams/single_value_prepared_query === RUN TestFlagUpstreams/invalid_type === RUN TestFlagUpstreams/address_specified === RUN TestFlagUpstreams/repeat_value,_overwrite --- PASS: TestFlagUpstreams (0.00s) --- PASS: TestFlagUpstreams/bad_format (0.00s) --- PASS: TestFlagUpstreams/port_not_int (0.00s) --- PASS: TestFlagUpstreams/4_parts (0.00s) --- PASS: TestFlagUpstreams/single_value (0.00s) --- PASS: TestFlagUpstreams/single_value_prepared_query (0.00s) --- PASS: TestFlagUpstreams/invalid_type (0.00s) --- PASS: TestFlagUpstreams/address_specified (0.00s) --- PASS: TestFlagUpstreams/repeat_value,_overwrite (0.00s) === RUN TestCommandConfigWatcher === PAUSE TestCommandConfigWatcher === RUN TestCatalogCommand_noTabs === PAUSE TestCatalogCommand_noTabs === RUN TestRegisterMonitor_good === PAUSE TestRegisterMonitor_good === RUN TestRegisterMonitor_heartbeat === PAUSE TestRegisterMonitor_heartbeat === CONT TestCommandConfigWatcher === RUN TestCommandConfigWatcher/-service_flag_only === CONT TestRegisterMonitor_heartbeat === CONT TestRegisterMonitor_good === CONT TestCatalogCommand_noTabs [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range --- PASS: TestCatalogCommand_noTabs (0.01s) 2021-10-05T16:32:34.123Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:34.166Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:34.219 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3b8460f2-9e03-03b3-fea3-fe6571a22d22 Address:127.0.0.1:21237}]" 32:34.219 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21237 [Follower]" leader= 32:34.221 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3b8460f2-9e03-03b3-fea3-fe6571a22d22.dc1 127.0.0.1 32:34.235 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3b8460f2-9e03-03b3-fea3-fe6571a22d22 127.0.0.1 2021-10-05T16:32:34.236Z [INFO] agent.router: Initializing LAN area manager 32:34.237 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=udp 32:34.237 [INFO] TestAgent.server: Adding LAN server: server="Node-3b8460f2-9e03-03b3-fea3-fe6571a22d22 (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 32:34.237 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3b8460f2-9e03-03b3-fea3-fe6571a22d22.dc1 area=wan 32:34.238 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=tcp 32:34.239 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21233 network=tcp 32:34.239 [INFO] TestAgent: started state syncer 32:34.252 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21238 network=tcp 32:34.281 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:34.281 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21237 [Candidate]" term=2 32:34.291 [DEBUG] TestAgent.server.raft: votes: needed=1 32:34.291 [DEBUG] TestAgent.server.raft: vote granted: from=3b8460f2-9e03-03b3-fea3-fe6571a22d22 term=2 tally=1 32:34.291 [INFO] TestAgent.server.raft: election won: tally=1 32:34.291 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21237 [Leader]" 32:34.293 [INFO] TestAgent.server: cluster leadership acquired 32:34.293 [INFO] TestAgent.server: New leader elected: payload=Node-3b8460f2-9e03-03b3-fea3-fe6571a22d22 32:34.298 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21237 32:34.319 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:34.392 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:34.392 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:34.392 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:34.392 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:34.392 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:34.392 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3b8460f2-9e03-03b3-fea3-fe6571a22d22 32:34.392 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3b8460f2-9e03-03b3-fea3-fe6571a22d22 32:34.422 [INFO] TestAgent: Requesting shutdown 32:34.423 [INFO] TestAgent.server: shutting down server 32:34.423 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:34.423 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:34.423 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:34.423 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:34.423 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:34.423 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:34.423 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:34.423 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:34.423 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:34.428 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:34.428 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:34.434 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:34.444Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:34.444Z [INFO] agent.router.manager: shutting down 32:34.444 [INFO] TestAgent: consul server down 32:34.444 [INFO] TestAgent: shutdown complete 32:34.444 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=tcp 32:34.444 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=udp 32:34.444 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21233 network=tcp 32:34.946 [INFO] TestAgent: Waiting for endpoints to shut down 32:34.946 [INFO] TestAgent: Endpoints down === RUN TestCommandConfigWatcher/-service_flag_with_upstreams 2021-10-05T16:32:34.471Z [INFO] TestRegisterMonitor_heartbeat: registered Consul service: service=foo-proxy 2021-10-05T16:32:34.572Z [INFO] TestRegisterMonitor_heartbeat: stop request received, deregistering 2021-10-05T16:32:34.126Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:34.158Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:34.220 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:61bfbfd7-ccd6-c09a-1244-07a2859ef66b Address:127.0.0.1:21244}]" 32:34.220 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21244 [Follower]" leader= 32:34.221 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-61bfbfd7-ccd6-c09a-1244-07a2859ef66b.dc1 127.0.0.1 32:34.222 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-61bfbfd7-ccd6-c09a-1244-07a2859ef66b 127.0.0.1 2021-10-05T16:32:34.222Z [INFO] agent.router: Initializing LAN area manager 32:34.236 [INFO] TestAgent.server: Adding LAN server: server="Node-61bfbfd7-ccd6-c09a-1244-07a2859ef66b (Addr: tcp/127.0.0.1:21244) (DC: dc1)" 32:34.236 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-61bfbfd7-ccd6-c09a-1244-07a2859ef66b.dc1 area=wan 32:34.237 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=tcp 32:34.270 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:34.270 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21244 [Candidate]" term=2 32:34.279 [DEBUG] TestAgent.server.raft: votes: needed=1 32:34.279 [DEBUG] TestAgent.server.raft: vote granted: from=61bfbfd7-ccd6-c09a-1244-07a2859ef66b term=2 tally=1 32:34.279 [INFO] TestAgent.server.raft: election won: tally=1 32:34.279 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21244 [Leader]" 32:34.279 [INFO] TestAgent.server: cluster leadership acquired 32:34.280 [INFO] TestAgent.server: New leader elected: payload=Node-61bfbfd7-ccd6-c09a-1244-07a2859ef66b 32:34.285 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21244 32:34.295 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=udp 32:34.295 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21240 network=tcp 32:34.295 [INFO] TestAgent: started state syncer 32:34.295 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:34.296 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21245 network=tcp 32:34.312 [INFO] TestAgent: Synced node info 32:34.312 [DEBUG] TestAgent: Node info in sync 32:34.324 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:34.324 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:34.324 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:34.324 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:34.324 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:34.324 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-61bfbfd7-ccd6-c09a-1244-07a2859ef66b 32:34.324 [INFO] TestAgent.server: member joined, marking health alive: member=Node-61bfbfd7-ccd6-c09a-1244-07a2859ef66b 32:34.366 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/service/foo-proxy?stale= from=127.0.0.1:36844 latency=15.964475ms 32:34.371 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:36842 latency=1.300881ms 32:34.378 [INFO] TestAgent.server: federation state anti-entropy synced 32:34.421 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.421 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.422 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.422 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.424 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:36842 latency=266.283µs 32:34.430 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:36842 latency=883.289µs 32:34.431 [DEBUG] TestAgent: Node info in sync 32:34.431 [DEBUG] TestAgent: Check status updated: check=foo-proxy-ttl status=critical 32:34.471 [INFO] TestAgent: Synced service: service=foo-proxy 32:34.471 [DEBUG] TestAgent: Check in sync: check=foo-proxy-ttl 32:34.471 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:36844 latency=93.086226ms 32:34.471 [DEBUG] TestAgent: Node info in sync 32:34.471 [DEBUG] TestAgent: Service in sync: service=foo-proxy 32:34.476 [INFO] TestAgent: Synced check: check=foo-proxy-ttl 32:34.476 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/fail/foo-proxy-ttl?note= from=127.0.0.1:36842 latency=44.640868ms 32:34.477 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:36842 latency=285.367µs 32:34.503 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:36842 latency=183.651µs 32:34.537 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:36842 latency=6.003708ms 32:34.541 [DEBUG] TestAgent: Check status updated: check=foo-proxy-ttl status=passing 32:34.542 [DEBUG] TestAgent: Node info in sync 32:34.542 [DEBUG] TestAgent: Service in sync: service=foo-proxy 32:34.553 [INFO] TestAgent: Synced check: check=foo-proxy-ttl 32:34.553 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/check/pass/foo-proxy-ttl?note= from=127.0.0.1:36844 latency=11.904238ms 32:34.572 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:36844 latency=267.383µs 32:34.573 [DEBUG] TestAgent: removed check: check=foo-proxy-ttl 32:34.573 [DEBUG] TestAgent: removed service: service=foo-proxy 32:34.573 [DEBUG] TestAgent: Node info in sync 32:34.587 [INFO] TestAgent: Deregistered service: service=foo-proxy 32:34.587 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/deregister/foo-proxy from=127.0.0.1:36844 latency=14.795585ms 32:34.588 [INFO] TestAgent: Requesting shutdown 32:34.588 [INFO] TestAgent.server: shutting down server 32:34.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:34.588 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:34.588 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:34.588 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:34.588 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:34.588 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:34.588 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:34.588 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:34.588 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:34.588 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:34.596 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:34.608Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:34.608Z [INFO] agent.router.manager: shutting down 32:34.608 [INFO] TestAgent: consul server down 32:34.608 [INFO] TestAgent: shutdown complete 32:34.608 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=tcp 32:34.608 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=udp 32:34.608 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21240 network=tcp 32:35.108 [INFO] TestAgent: Waiting for endpoints to shut down 32:35.108 [INFO] TestAgent: Endpoints down --- PASS: TestRegisterMonitor_heartbeat (1.09s) 2021-10-05T16:32:34.786Z [INFO] TestRegisterMonitor_good: registered Consul service: service=foo-proxy 2021-10-05T16:32:34.786Z [INFO] TestRegisterMonitor_good: stop request received, deregistering 2021-10-05T16:32:34.130Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:34.177Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:34.252 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4713e837-0231-c2f6-5fa8-2f874f857056 Address:127.0.0.1:21251}]" 32:34.252 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21251 [Follower]" leader= 32:34.300 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4713e837-0231-c2f6-5fa8-2f874f857056.dc1 127.0.0.1 32:34.301 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4713e837-0231-c2f6-5fa8-2f874f857056 127.0.0.1 2021-10-05T16:32:34.301Z [INFO] agent.router: Initializing LAN area manager 32:34.302 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21246 network=udp 32:34.302 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4713e837-0231-c2f6-5fa8-2f874f857056.dc1 area=wan 32:34.302 [INFO] TestAgent.server: Adding LAN server: server="Node-4713e837-0231-c2f6-5fa8-2f874f857056 (Addr: tcp/127.0.0.1:21251) (DC: dc1)" 32:34.302 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21246 network=tcp 32:34.302 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21247 network=tcp 32:34.302 [INFO] TestAgent: started state syncer 32:34.303 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21252 network=tcp 32:34.308 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:34.312 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21251 [Candidate]" term=2 32:34.335 [DEBUG] TestAgent.server.raft: votes: needed=1 32:34.335 [DEBUG] TestAgent.server.raft: vote granted: from=4713e837-0231-c2f6-5fa8-2f874f857056 term=2 tally=1 32:34.335 [INFO] TestAgent.server.raft: election won: tally=1 32:34.335 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21251 [Leader]" 32:34.336 [INFO] TestAgent.server: cluster leadership acquired 32:34.336 [INFO] TestAgent.server: New leader elected: payload=Node-4713e837-0231-c2f6-5fa8-2f874f857056 32:34.372 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21251 32:34.441 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:34.501 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:34.501 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:34.501 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:34.501 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:34.501 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:34.501 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4713e837-0231-c2f6-5fa8-2f874f857056 32:34.501 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4713e837-0231-c2f6-5fa8-2f874f857056 32:34.514 [INFO] TestAgent.server: federation state anti-entropy synced 32:34.638 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:34.643 [INFO] TestAgent: Synced node info 32:34.749 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/service/foo-proxy?stale= from=127.0.0.1:33216 latency=563.416µs 32:34.749 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:33214 latency=85.905µs 32:34.752 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.752 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.752 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.752 [ERROR] TestAgent.proxycfg: watch error: service_id=foo-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 32:34.764 [DEBUG] TestAgent: Node info in sync 32:34.784 [INFO] TestAgent: Synced service: service=foo-proxy 32:34.784 [DEBUG] TestAgent: Check in sync: check=foo-proxy-ttl 32:34.784 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:33216 latency=34.261818ms 32:34.785 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:33214 latency=9.332787ms 32:34.789 [DEBUG] TestAgent: removed check: check=foo-proxy-ttl 32:34.789 [DEBUG] TestAgent: removed service: service=foo-proxy 32:34.789 [DEBUG] TestAgent: Node info in sync 32:34.792 [INFO] TestAgent: Deregistered service: service=foo-proxy 32:34.792 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/deregister/foo-proxy from=127.0.0.1:33214 latency=3.448483ms 32:34.793 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:33214 latency=142.246µs 32:34.796 [INFO] TestAgent: Requesting shutdown 32:34.796 [INFO] TestAgent.server: shutting down server 32:34.796 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:34.796 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:34.796 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:34.796 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:34.796 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:34.796 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:34.796 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:34.796 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:34.796 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:34.796 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:34.804 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:34.811Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:34.811Z [INFO] agent.router.manager: shutting down 32:34.811 [INFO] TestAgent: consul server down 32:34.811 [INFO] TestAgent: shutdown complete 32:34.811 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21246 network=tcp 32:34.811 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21246 network=udp 32:34.811 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21247 network=tcp 32:35.316 [INFO] TestAgent: Waiting for endpoints to shut down 32:35.316 [INFO] TestAgent: Endpoints down --- PASS: TestRegisterMonitor_good (1.29s) 2021-10-05T16:32:34.978Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:34.993Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:35.048 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2860544c-c1ab-a129-15f3-9f3e13a85d76 Address:127.0.0.1:21258}]" 32:35.049 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2860544c-c1ab-a129-15f3-9f3e13a85d76.dc1 127.0.0.1 32:35.049 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2860544c-c1ab-a129-15f3-9f3e13a85d76 127.0.0.1 2021-10-05T16:32:35.049Z [INFO] agent.router: Initializing LAN area manager 32:35.050 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21253 network=udp 32:35.050 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21258 [Follower]" leader= 32:35.050 [INFO] TestAgent.server: Adding LAN server: server="Node-2860544c-c1ab-a129-15f3-9f3e13a85d76 (Addr: tcp/127.0.0.1:21258) (DC: dc1)" 32:35.050 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2860544c-c1ab-a129-15f3-9f3e13a85d76.dc1 area=wan 32:35.051 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21253 network=tcp 32:35.051 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21254 network=tcp 32:35.051 [INFO] TestAgent: started state syncer 32:35.052 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21259 network=tcp 32:35.114 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:35.114 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21258 [Candidate]" term=2 32:35.158 [DEBUG] TestAgent.server.raft: votes: needed=1 32:35.158 [DEBUG] TestAgent.server.raft: vote granted: from=2860544c-c1ab-a129-15f3-9f3e13a85d76 term=2 tally=1 32:35.158 [INFO] TestAgent.server.raft: election won: tally=1 32:35.158 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21258 [Leader]" 32:35.158 [INFO] TestAgent.server: cluster leadership acquired 32:35.158 [INFO] TestAgent.server: New leader elected: payload=Node-2860544c-c1ab-a129-15f3-9f3e13a85d76 32:35.167 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21258 32:35.208 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:35.260 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:35.260 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:35.260 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:35.260 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:35.260 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:35.260 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2860544c-c1ab-a129-15f3-9f3e13a85d76 32:35.260 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2860544c-c1ab-a129-15f3-9f3e13a85d76 32:35.320 [INFO] TestAgent.server: federation state anti-entropy synced 32:35.335 [INFO] TestAgent: Requesting shutdown 32:35.338 [INFO] TestAgent.server: shutting down server 32:35.338 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:35.338 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:35.338 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:35.338 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:35.338 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:35.338 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:35.338 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:35.338 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:35.338 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:35.338 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:35.338 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:35.347 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:35.350Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:35.350Z [INFO] agent.router.manager: shutting down 32:35.350 [INFO] TestAgent: consul server down 32:35.350 [INFO] TestAgent: shutdown complete 32:35.350 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21253 network=tcp 32:35.350 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21253 network=udp 32:35.351 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21254 network=tcp 32:35.852 [INFO] TestAgent: Waiting for endpoints to shut down 32:35.852 [INFO] TestAgent: Endpoints down === RUN TestCommandConfigWatcher/-service_flag_with_-service-addr 2021-10-05T16:32:35.890Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:35.926Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:36.009 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:768009a7-4bac-b0e1-ba72-fdb1a760a6f3 Address:127.0.0.1:21265}]" 32:36.010 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-768009a7-4bac-b0e1-ba72-fdb1a760a6f3.dc1 127.0.0.1 32:36.010 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21265 [Follower]" leader= 32:36.010 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-768009a7-4bac-b0e1-ba72-fdb1a760a6f3 127.0.0.1 2021-10-05T16:32:36.010Z [INFO] agent.router: Initializing LAN area manager 32:36.011 [INFO] TestAgent.server: Adding LAN server: server="Node-768009a7-4bac-b0e1-ba72-fdb1a760a6f3 (Addr: tcp/127.0.0.1:21265) (DC: dc1)" 32:36.011 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-768009a7-4bac-b0e1-ba72-fdb1a760a6f3.dc1 area=wan 32:36.011 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21260 network=udp 32:36.011 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21260 network=tcp 32:36.012 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21261 network=tcp 32:36.012 [INFO] TestAgent: started state syncer 32:36.012 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21266 network=tcp 32:36.054 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:36.054 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21265 [Candidate]" term=2 32:36.062 [DEBUG] TestAgent.server.raft: votes: needed=1 32:36.062 [DEBUG] TestAgent.server.raft: vote granted: from=768009a7-4bac-b0e1-ba72-fdb1a760a6f3 term=2 tally=1 32:36.062 [INFO] TestAgent.server.raft: election won: tally=1 32:36.062 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21265 [Leader]" 32:36.063 [INFO] TestAgent.server: cluster leadership acquired 32:36.063 [INFO] TestAgent.server: New leader elected: payload=Node-768009a7-4bac-b0e1-ba72-fdb1a760a6f3 32:36.069 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21265 32:36.070 [INFO] TestAgent: Requesting shutdown 32:36.070 [INFO] TestAgent.server: shutting down server 32:36.070 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:36.070 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:36.073 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:36.078Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:36.078Z [INFO] agent.router.manager: shutting down 32:36.080 [INFO] TestAgent: consul server down 32:36.080 [INFO] TestAgent: shutdown complete 32:36.080 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21260 network=tcp 32:36.080 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21260 network=udp 32:36.080 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21261 network=tcp 32:36.080 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 32:36.080 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:36.584 [INFO] TestAgent: Waiting for endpoints to shut down 32:36.584 [INFO] TestAgent: Endpoints down === RUN TestCommandConfigWatcher/-service,_-service-addr,_-listen 2021-10-05T16:32:36.615Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:36.662Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:36.701 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:944c3ed4-0b35-bfd8-5393-d565ff65e3f9 Address:127.0.0.1:21272}]" 32:36.702 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-944c3ed4-0b35-bfd8-5393-d565ff65e3f9.dc1 127.0.0.1 32:36.703 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-944c3ed4-0b35-bfd8-5393-d565ff65e3f9 127.0.0.1 2021-10-05T16:32:36.703Z [INFO] agent.router: Initializing LAN area manager 32:36.703 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21267 network=udp 32:36.703 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21272 [Follower]" leader= 32:36.704 [INFO] TestAgent.server: Adding LAN server: server="Node-944c3ed4-0b35-bfd8-5393-d565ff65e3f9 (Addr: tcp/127.0.0.1:21272) (DC: dc1)" 32:36.704 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-944c3ed4-0b35-bfd8-5393-d565ff65e3f9.dc1 area=wan 32:36.704 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21267 network=tcp 32:36.704 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21268 network=tcp 32:36.704 [INFO] TestAgent: started state syncer 32:36.704 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21273 network=tcp 32:36.764 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:36.764 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21272 [Candidate]" term=2 32:36.803 [DEBUG] TestAgent.server.raft: votes: needed=1 32:36.803 [DEBUG] TestAgent.server.raft: vote granted: from=944c3ed4-0b35-bfd8-5393-d565ff65e3f9 term=2 tally=1 32:36.803 [INFO] TestAgent.server.raft: election won: tally=1 32:36.803 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21272 [Leader]" 32:36.803 [INFO] TestAgent.server: cluster leadership acquired 32:36.803 [INFO] TestAgent.server: New leader elected: payload=Node-944c3ed4-0b35-bfd8-5393-d565ff65e3f9 32:36.835 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21272 32:36.855 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:36.884 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:36.884 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:36.884 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:36.884 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:36.884 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:36.884 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-944c3ed4-0b35-bfd8-5393-d565ff65e3f9 32:36.884 [INFO] TestAgent.server: member joined, marking health alive: member=Node-944c3ed4-0b35-bfd8-5393-d565ff65e3f9 32:36.932 [INFO] TestAgent.server: federation state anti-entropy synced 32:36.960 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:36.975 [INFO] TestAgent: Synced node info 32:36.977 [INFO] TestAgent: Requesting shutdown 32:36.992 [INFO] TestAgent: Synced service: service=two-sidecars-sidecar-proxy 32:37.012 [INFO] TestAgent: Synced service: service=other-sidecar-for-two-sidecars 32:37.027 [INFO] TestAgent: Synced service: service=no-sidecar 32:37.031 [INFO] TestAgent: Synced service: service=one-sidecar 32:37.043 [INFO] TestAgent: Synced service: service=one-sidecar-sidecar-proxy 32:37.047 [INFO] TestAgent: Synced service: service=two-sidecars 32:37.047 [DEBUG] TestAgent: Check in sync: check=service:one-sidecar-sidecar-proxy:1 32:37.047 [DEBUG] TestAgent: Check in sync: check=service:one-sidecar-sidecar-proxy:2 32:37.047 [DEBUG] TestAgent: Check in sync: check=service:two-sidecars-sidecar-proxy:1 32:37.047 [DEBUG] TestAgent: Check in sync: check=service:two-sidecars-sidecar-proxy:2 32:37.047 [INFO] TestAgent.server: shutting down server 32:37.047 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:37.047 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:37.047 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:37.047 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:37.047 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:37.048 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:37.048 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:37.048 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:37.051 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 32:37.051 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:37.052 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:37.052Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:37.052Z [INFO] agent.router.manager: shutting down 32:37.052 [INFO] TestAgent: consul server down 32:37.052 [INFO] TestAgent: shutdown complete 32:37.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21267 network=tcp 32:37.052 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21267 network=udp 32:37.052 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21268 network=tcp 32:37.555 [INFO] TestAgent: Waiting for endpoints to shut down 32:37.555 [INFO] TestAgent: Endpoints down === RUN TestCommandConfigWatcher/-sidecar-for,_no_sidecar 2021-10-05T16:32:37.580Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:37.618Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:37.666 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:07ee413d-1369-2e97-c565-3d706a34587b Address:127.0.0.1:21279}]" 32:37.667 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-07ee413d-1369-2e97-c565-3d706a34587b.dc1 127.0.0.1 32:37.667 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-07ee413d-1369-2e97-c565-3d706a34587b 127.0.0.1 2021-10-05T16:32:37.667Z [INFO] agent.router: Initializing LAN area manager 32:37.668 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21274 network=udp 32:37.668 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21279 [Follower]" leader= 32:37.668 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-07ee413d-1369-2e97-c565-3d706a34587b.dc1 area=wan 32:37.668 [INFO] TestAgent.server: Adding LAN server: server="Node-07ee413d-1369-2e97-c565-3d706a34587b (Addr: tcp/127.0.0.1:21279) (DC: dc1)" 32:37.668 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21274 network=tcp 32:37.669 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21275 network=tcp 32:37.669 [INFO] TestAgent: started state syncer 32:37.669 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21280 network=tcp 32:37.728 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:37.728 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21279 [Candidate]" term=2 32:37.758 [DEBUG] TestAgent.server.raft: votes: needed=1 32:37.758 [DEBUG] TestAgent.server.raft: vote granted: from=07ee413d-1369-2e97-c565-3d706a34587b term=2 tally=1 32:37.758 [INFO] TestAgent.server.raft: election won: tally=1 32:37.758 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21279 [Leader]" 32:37.760 [INFO] TestAgent.server: cluster leadership acquired 32:37.760 [INFO] TestAgent.server: New leader elected: payload=Node-07ee413d-1369-2e97-c565-3d706a34587b 32:37.766 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21279 32:37.783 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:37.832 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:45228 latency=433.856µs 32:37.836 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:37.836 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:37.836 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:37.836 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:37.836 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:37.836 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-07ee413d-1369-2e97-c565-3d706a34587b 32:37.836 [INFO] TestAgent.server: member joined, marking health alive: member=Node-07ee413d-1369-2e97-c565-3d706a34587b 32:37.836 [INFO] TestAgent: Requesting shutdown 32:37.836 [INFO] TestAgent.server: shutting down server 32:37.836 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:37.836 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:37.836 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:37.836 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:37.836 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:37.836 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:37.838 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:37.838 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:37.838 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:37.838 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:37.841 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:37.843Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:37.843Z [INFO] agent.router.manager: shutting down 32:37.856 [INFO] TestAgent: consul server down 32:37.856 [INFO] TestAgent: shutdown complete 32:37.856 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21274 network=tcp 32:37.856 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21274 network=udp 32:37.856 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21275 network=tcp 32:37.856 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-07ee413d-1369-2e97-c565-3d706a34587b 127.0.0.1 21277 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:07ee413d-1369-2e97-c565-3d706a34587b port:21279 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:21278] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 32:38.359 [INFO] TestAgent: Waiting for endpoints to shut down 32:38.359 [INFO] TestAgent: Endpoints down === RUN TestCommandConfigWatcher/-sidecar-for,_multiple_sidecars 2021-10-05T16:32:38.389Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:38.425Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:38.484 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:88e3f93a-5dd8-5406-e313-f0f878feafe4 Address:127.0.0.1:21286}]" 32:38.485 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-88e3f93a-5dd8-5406-e313-f0f878feafe4.dc1 127.0.0.1 32:38.486 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-88e3f93a-5dd8-5406-e313-f0f878feafe4 127.0.0.1 2021-10-05T16:32:38.486Z [INFO] agent.router: Initializing LAN area manager 32:38.486 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21281 network=udp 32:38.486 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21286 [Follower]" leader= 32:38.486 [INFO] TestAgent.server: Adding LAN server: server="Node-88e3f93a-5dd8-5406-e313-f0f878feafe4 (Addr: tcp/127.0.0.1:21286) (DC: dc1)" 32:38.486 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-88e3f93a-5dd8-5406-e313-f0f878feafe4.dc1 area=wan 32:38.487 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21281 network=tcp 32:38.487 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21282 network=tcp 32:38.487 [INFO] TestAgent: started state syncer 32:38.488 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21287 network=tcp 32:38.552 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:38.552 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21286 [Candidate]" term=2 32:38.577 [DEBUG] TestAgent.server.raft: votes: needed=1 32:38.577 [DEBUG] TestAgent.server.raft: vote granted: from=88e3f93a-5dd8-5406-e313-f0f878feafe4 term=2 tally=1 32:38.578 [INFO] TestAgent.server.raft: election won: tally=1 32:38.578 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21286 [Leader]" 32:38.578 [INFO] TestAgent.server: cluster leadership acquired 32:38.578 [INFO] TestAgent.server: New leader elected: payload=Node-88e3f93a-5dd8-5406-e313-f0f878feafe4 32:38.584 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21286 32:38.597 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:38.633 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:38.633 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:38.633 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:38.633 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:38.633 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:38.633 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-88e3f93a-5dd8-5406-e313-f0f878feafe4 32:38.633 [INFO] TestAgent.server: member joined, marking health alive: member=Node-88e3f93a-5dd8-5406-e313-f0f878feafe4 32:38.650 [INFO] TestAgent.server: federation state anti-entropy synced 32:38.694 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:38.698 [INFO] TestAgent: Synced node info 32:38.716 [INFO] TestAgent: Synced service: service=two-sidecars-sidecar-proxy 32:38.729 [INFO] TestAgent: Synced service: service=other-sidecar-for-two-sidecars 32:38.736 [INFO] TestAgent: Synced service: service=no-sidecar 32:38.745 [INFO] TestAgent: Synced service: service=one-sidecar 32:38.764 [INFO] TestAgent: Synced service: service=one-sidecar-sidecar-proxy 32:38.769 [INFO] TestAgent: Synced service: service=two-sidecars 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:one-sidecar-sidecar-proxy:1 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:one-sidecar-sidecar-proxy:2 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:two-sidecars-sidecar-proxy:1 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:two-sidecars-sidecar-proxy:2 32:38.769 [DEBUG] TestAgent: Node info in sync 32:38.769 [DEBUG] TestAgent: Service in sync: service=no-sidecar 32:38.769 [DEBUG] TestAgent: Service in sync: service=one-sidecar 32:38.769 [DEBUG] TestAgent: Service in sync: service=one-sidecar-sidecar-proxy 32:38.769 [DEBUG] TestAgent: Service in sync: service=two-sidecars 32:38.769 [DEBUG] TestAgent: Service in sync: service=two-sidecars-sidecar-proxy 32:38.769 [DEBUG] TestAgent: Service in sync: service=other-sidecar-for-two-sidecars 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:one-sidecar-sidecar-proxy:1 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:one-sidecar-sidecar-proxy:2 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:two-sidecars-sidecar-proxy:1 32:38.769 [DEBUG] TestAgent: Check in sync: check=service:two-sidecars-sidecar-proxy:2 32:38.913 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:57996 latency=757.741µs 32:38.914 [INFO] TestAgent: Requesting shutdown 32:38.914 [INFO] TestAgent.server: shutting down server 32:38.914 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:38.914 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:38.914 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:38.914 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:38.914 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:38.914 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:38.914 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:38.914 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:38.914 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:38.914 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:38.937 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:38.938Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:38.938Z [INFO] agent.router.manager: shutting down 32:38.938 [INFO] TestAgent: consul server down 32:38.938 [INFO] TestAgent: shutdown complete 32:38.938 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21281 network=tcp 32:38.938 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21281 network=udp 32:38.938 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21282 network=tcp 32:39.445 [INFO] TestAgent: Waiting for endpoints to shut down 32:39.445 [INFO] TestAgent: Endpoints down === RUN TestCommandConfigWatcher/-sidecar-for,_non-existent 2021-10-05T16:32:39.475Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.491Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:39.553 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f6524e07-6891-5d0a-8d57-72c2597009c9 Address:127.0.0.1:21293}]" 32:39.554 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f6524e07-6891-5d0a-8d57-72c2597009c9.dc1 127.0.0.1 32:39.555 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f6524e07-6891-5d0a-8d57-72c2597009c9 127.0.0.1 2021-10-05T16:32:39.555Z [INFO] agent.router: Initializing LAN area manager 32:39.563 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21288 network=tcp 32:39.563 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21293 [Follower]" leader= 32:39.563 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f6524e07-6891-5d0a-8d57-72c2597009c9.dc1 area=wan 32:39.564 [INFO] TestAgent.server: Adding LAN server: server="Node-f6524e07-6891-5d0a-8d57-72c2597009c9 (Addr: tcp/127.0.0.1:21293) (DC: dc1)" 32:39.567 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21288 network=udp 32:39.568 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21289 network=tcp 32:39.568 [INFO] TestAgent: started state syncer 32:39.568 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21294 network=tcp 32:39.608 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:39.608 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21293 [Candidate]" term=2 32:39.622 [DEBUG] TestAgent.server.raft: votes: needed=1 32:39.622 [DEBUG] TestAgent.server.raft: vote granted: from=f6524e07-6891-5d0a-8d57-72c2597009c9 term=2 tally=1 32:39.622 [INFO] TestAgent.server.raft: election won: tally=1 32:39.622 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21293 [Leader]" 32:39.624 [INFO] TestAgent.server: cluster leadership acquired 32:39.624 [INFO] TestAgent.server: New leader elected: payload=Node-f6524e07-6891-5d0a-8d57-72c2597009c9 32:39.630 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21293 32:39.646 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:39.697 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:39.697 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:39.697 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:39.697 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:39.697 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:39.697 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-f6524e07-6891-5d0a-8d57-72c2597009c9 32:39.697 [INFO] TestAgent.server: member joined, marking health alive: member=Node-f6524e07-6891-5d0a-8d57-72c2597009c9 32:39.719 [INFO] TestAgent.server: federation state anti-entropy synced 32:39.829 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:49346 latency=403.013µs 32:39.830 [INFO] TestAgent: Requesting shutdown 32:39.830 [INFO] TestAgent.server: shutting down server 32:39.830 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:39.830 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:39.830 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:39.830 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:39.830 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:39.830 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:39.830 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:39.830 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:39.830 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:39.830 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:39.830 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:39.840 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:39.848Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:39.848Z [INFO] agent.router.manager: shutting down 32:39.848 [INFO] TestAgent: consul server down 32:39.848 [INFO] TestAgent: shutdown complete 32:39.848 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21288 network=tcp 32:39.848 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21288 network=udp 32:39.848 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21289 network=tcp 32:40.352 [INFO] TestAgent: Waiting for endpoints to shut down 32:40.352 [INFO] TestAgent: Endpoints down === RUN TestCommandConfigWatcher/-sidecar-for,_one_sidecar 2021-10-05T16:32:40.382Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:40.400Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:40.457 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:96b873bb-be58-5f95-14c1-987f60ecc582 Address:127.0.0.1:21300}]" 32:40.458 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-96b873bb-be58-5f95-14c1-987f60ecc582.dc1 127.0.0.1 32:40.459 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21300 [Follower]" leader= 32:40.460 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-96b873bb-be58-5f95-14c1-987f60ecc582 127.0.0.1 2021-10-05T16:32:40.460Z [INFO] agent.router: Initializing LAN area manager 32:40.460 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21295 network=udp 32:40.460 [INFO] TestAgent.server: Adding LAN server: server="Node-96b873bb-be58-5f95-14c1-987f60ecc582 (Addr: tcp/127.0.0.1:21300) (DC: dc1)" 32:40.461 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-96b873bb-be58-5f95-14c1-987f60ecc582.dc1 area=wan 32:40.461 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21295 network=tcp 32:40.462 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21296 network=tcp 32:40.462 [INFO] TestAgent: started state syncer 32:40.462 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21301 network=tcp 32:40.496 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.496 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21300 [Candidate]" term=2 32:40.513 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.513 [DEBUG] TestAgent.server.raft: vote granted: from=96b873bb-be58-5f95-14c1-987f60ecc582 term=2 tally=1 32:40.513 [INFO] TestAgent.server.raft: election won: tally=1 32:40.513 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21300 [Leader]" 32:40.514 [INFO] TestAgent.server: cluster leadership acquired 32:40.514 [INFO] TestAgent.server: New leader elected: payload=Node-96b873bb-be58-5f95-14c1-987f60ecc582 32:40.520 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:50046 latency=1.334304ms 32:40.527 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21300 32:40.535 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/one-sidecar-sidecar-proxy from=127.0.0.1:50048 latency=1.537971ms 32:40.536 [INFO] TestAgent: Requesting shutdown 32:40.536 [INFO] TestAgent.server: shutting down server 32:40.536 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:40.537 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:40.543 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 32:40.547 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/one-sidecar-sidecar-proxy from=127.0.0.1:50046 latency=1.167826ms 2021-10-05T16:32:40.547Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:40.548Z [INFO] agent.router.manager: shutting down 32:40.552 [INFO] TestAgent: consul server down 32:40.552 [INFO] TestAgent: shutdown complete 32:40.552 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21295 network=tcp 32:40.552 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21295 network=udp 32:40.552 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21296 network=tcp 32:40.552 [ERROR] TestAgent.server: failed to establish leadership: error="error configuring provider: leadership lost while committing log" 32:40.552 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:40.552 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/service/one-sidecar-sidecar-proxy?hash=3bafbcac3734b91 from=127.0.0.1:50048 latency=14.422618ms 32:41.056 [INFO] TestAgent: Waiting for endpoints to shut down 32:41.056 [INFO] TestAgent: Endpoints down --- PASS: TestCommandConfigWatcher (7.03s) --- PASS: TestCommandConfigWatcher/-service_flag_only (0.92s) --- PASS: TestCommandConfigWatcher/-service_flag_with_upstreams (0.91s) --- PASS: TestCommandConfigWatcher/-service_flag_with_-service-addr (0.73s) --- PASS: TestCommandConfigWatcher/-service,_-service-addr,_-listen (0.97s) --- PASS: TestCommandConfigWatcher/-sidecar-for,_no_sidecar (0.80s) --- PASS: TestCommandConfigWatcher/-sidecar-for,_multiple_sidecars (1.09s) --- PASS: TestCommandConfigWatcher/-sidecar-for,_non-existent (0.91s) --- PASS: TestCommandConfigWatcher/-sidecar-for,_one_sidecar (0.70s) PASS ok github.com/hashicorp/consul/command/connect/proxy 7.117s === RUN TestEventCommand_noTabs === PAUSE TestEventCommand_noTabs === RUN TestEventCommand === PAUSE TestEventCommand === CONT TestEventCommand_noTabs --- PASS: TestEventCommand_noTabs (0.00s) === CONT TestEventCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:37.117Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:37.152Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:37.177 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:edf8ca1a-814e-8181-f007-63501671d7ca Address:127.0.0.1:11027}]" 32:37.177 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:11027 [Follower]" leader= 32:37.178 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-edf8ca1a-814e-8181-f007-63501671d7ca.dc1 127.0.0.1 32:37.179 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-edf8ca1a-814e-8181-f007-63501671d7ca 127.0.0.1 2021-10-05T16:32:37.179Z [INFO] agent.router: Initializing LAN area manager 32:37.179 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11022 network=udp 32:37.180 [INFO] TestAgent.server: Adding LAN server: server="Node-edf8ca1a-814e-8181-f007-63501671d7ca (Addr: tcp/127.0.0.1:11027) (DC: dc1)" 32:37.180 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-edf8ca1a-814e-8181-f007-63501671d7ca.dc1 area=wan 32:37.180 [INFO] TestAgent: Started DNS server: address=127.0.0.1:11022 network=tcp 32:37.180 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:11023 network=tcp 32:37.180 [INFO] TestAgent: started state syncer 32:37.180 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:11028 network=tcp 32:37.237 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:37.237 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:11027 [Candidate]" term=2 32:37.245 [DEBUG] TestAgent.server.raft: votes: needed=1 32:37.245 [DEBUG] TestAgent.server.raft: vote granted: from=edf8ca1a-814e-8181-f007-63501671d7ca term=2 tally=1 32:37.245 [INFO] TestAgent.server.raft: election won: tally=1 32:37.245 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:11027 [Leader]" 32:37.246 [INFO] TestAgent.server: cluster leadership acquired 32:37.246 [INFO] TestAgent.server: New leader elected: payload=Node-edf8ca1a-814e-8181-f007-63501671d7ca 32:37.251 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:11027 32:37.261 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:37.287 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:37.287 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:37.287 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:37.287 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:37.287 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:37.287 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-edf8ca1a-814e-8181-f007-63501671d7ca 32:37.287 [INFO] TestAgent.server: member joined, marking health alive: member=Node-edf8ca1a-814e-8181-f007-63501671d7ca 32:37.316 [INFO] TestAgent.server: federation state anti-entropy synced 32:37.525 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:37.529 [INFO] TestAgent: Synced node info 32:37.529 [DEBUG] TestAgent: Node info in sync 32:37.542 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:33536 latency=2.52724ms 32:37.561 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/event/fire/cmd from=127.0.0.1:33536 latency=1.470746ms 32:37.566 [DEBUG] TestAgent.server: User event: event=cmd 32:37.566 [DEBUG] TestAgent: new event: event_name=cmd event_id=f4c44b65-e2f9-7c5d-3e4f-38224525d497 32:37.566 [INFO] TestAgent: Requesting shutdown 32:37.566 [INFO] TestAgent.server: shutting down server 32:37.566 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:37.566 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:37.566 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:37.566 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:37.567 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:37.567 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:37.567 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:37.567 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:37.567 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:37.567 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:37.571 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:37.575Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:37.575Z [INFO] agent.router.manager: shutting down 32:37.575 [INFO] TestAgent: consul server down 32:37.575 [INFO] TestAgent: shutdown complete 32:37.575 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11022 network=tcp 32:37.575 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:11022 network=udp 32:37.575 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:11023 network=tcp 32:38.076 [INFO] TestAgent: Waiting for endpoints to shut down 32:38.076 [INFO] TestAgent: Endpoints down --- PASS: TestEventCommand (1.01s) PASS ok github.com/hashicorp/consul/command/event 1.287s === RUN TestExecCommand_noTabs === PAUSE TestExecCommand_noTabs === RUN TestExecCommand === PAUSE TestExecCommand === RUN TestExecCommand_NoShell === PAUSE TestExecCommand_NoShell === RUN TestExecCommand_CrossDC === PAUSE TestExecCommand_CrossDC === RUN TestExecCommand_Validate === PAUSE TestExecCommand_Validate === RUN TestExecCommand_Sessions === PAUSE TestExecCommand_Sessions === RUN TestExecCommand_Sessions_Foreign === PAUSE TestExecCommand_Sessions_Foreign === RUN TestExecCommand_UploadDestroy === PAUSE TestExecCommand_UploadDestroy === RUN TestExecCommand_StreamResults === PAUSE TestExecCommand_StreamResults === CONT TestExecCommand_noTabs === CONT TestExecCommand_Sessions_Foreign === CONT TestExecCommand_CrossDC [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestExecCommand_StreamResults === CONT TestExecCommand_Sessions === CONT TestExecCommand_NoShell === CONT TestExecCommand_Validate === CONT TestExecCommand_UploadDestroy === CONT TestExecCommand --- PASS: TestExecCommand_noTabs (0.01s) --- PASS: TestExecCommand_Validate (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:39.897Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.927Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:40.002 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dc817e0b-f9e2-5974-d219-453264f6a229 Address:127.0.0.1:23314}]" 32:40.003 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dc817e0b-f9e2-5974-d219-453264f6a229.dc1 127.0.0.1 32:40.003 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dc817e0b-f9e2-5974-d219-453264f6a229 127.0.0.1 2021-10-05T16:32:40.003Z [INFO] agent.router: Initializing LAN area manager 32:40.003 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23309 network=udp 32:40.003 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23314 [Follower]" leader= 32:40.004 [INFO] TestAgent.server: Adding LAN server: server="Node-dc817e0b-f9e2-5974-d219-453264f6a229 (Addr: tcp/127.0.0.1:23314) (DC: dc1)" 32:40.004 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dc817e0b-f9e2-5974-d219-453264f6a229.dc1 area=wan 32:40.004 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23309 network=tcp 32:40.004 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23310 network=tcp 32:40.004 [INFO] TestAgent: started state syncer 32:40.005 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23315 network=tcp 32:40.056 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.060 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23314 [Candidate]" term=2 32:40.089 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.089 [DEBUG] TestAgent.server.raft: vote granted: from=dc817e0b-f9e2-5974-d219-453264f6a229 term=2 tally=1 32:40.089 [INFO] TestAgent.server.raft: election won: tally=1 32:40.089 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23314 [Leader]" 32:40.089 [INFO] TestAgent.server: cluster leadership acquired 32:40.089 [INFO] TestAgent.server: New leader elected: payload=Node-dc817e0b-f9e2-5974-d219-453264f6a229 32:40.112 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23314 32:40.141 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.221 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.221 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.221 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.221 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.221 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.221 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dc817e0b-f9e2-5974-d219-453264f6a229 32:40.221 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dc817e0b-f9e2-5974-d219-453264f6a229 32:40.236 [INFO] TestAgent.server: federation state anti-entropy synced 32:40.245 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:48658 latency=5.919223ms 32:40.247 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/info/bdd9a06f-51a5-3313-6bec-b772096f4275 from=127.0.0.1:48660 latency=1.190318ms 32:40.251 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/bdd9a06f-51a5-3313-6bec-b772096f4275 from=127.0.0.1:48658 latency=2.883621ms 32:40.252 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/info/bdd9a06f-51a5-3313-6bec-b772096f4275 from=127.0.0.1:48662 latency=212.907µs 32:40.256 [INFO] TestAgent: Requesting shutdown 32:40.256 [INFO] TestAgent.server: shutting down server 32:40.256 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:40.256 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:40.256 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:40.256 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:40.256 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:40.256 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:40.256 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:40.256 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:40.256 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:40.256 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:40.256 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:40.263 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:40.266Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:40.266Z [INFO] agent.router.manager: shutting down 32:40.266 [INFO] TestAgent: consul server down 32:40.266 [INFO] TestAgent: shutdown complete 32:40.266 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23309 network=tcp 32:40.266 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23309 network=udp 32:40.266 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23310 network=tcp 32:40.773 [INFO] TestAgent: Waiting for endpoints to shut down 32:40.773 [INFO] TestAgent: Endpoints down --- PASS: TestExecCommand_Sessions (1.13s) 2021-10-05T16:32:39.743Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.835Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:39.905 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ee925226-c7c4-33d7-f21e-925f200e05ff Address:127.0.0.1:23321}]" 32:39.906 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ee925226-c7c4-33d7-f21e-925f200e05ff.dc1 127.0.0.1 32:39.906 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ee925226-c7c4-33d7-f21e-925f200e05ff 127.0.0.1 2021-10-05T16:32:39.906Z [INFO] agent.router: Initializing LAN area manager 32:39.907 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23316 network=udp 32:39.907 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23321 [Follower]" leader= 32:39.907 [INFO] TestAgent.server: Adding LAN server: server="Node-ee925226-c7c4-33d7-f21e-925f200e05ff (Addr: tcp/127.0.0.1:23321) (DC: dc1)" 32:39.907 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ee925226-c7c4-33d7-f21e-925f200e05ff.dc1 area=wan 32:39.907 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23316 network=tcp 32:39.915 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23317 network=tcp 32:39.915 [INFO] TestAgent: started state syncer 32:39.915 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23322 network=tcp 32:39.968 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:39.968 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23321 [Candidate]" term=2 32:40.016 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.016 [DEBUG] TestAgent.server.raft: vote granted: from=ee925226-c7c4-33d7-f21e-925f200e05ff term=2 tally=1 32:40.016 [INFO] TestAgent.server.raft: election won: tally=1 32:40.016 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23321 [Leader]" 32:40.016 [INFO] TestAgent.server: cluster leadership acquired 32:40.016 [INFO] TestAgent.server: New leader elected: payload=Node-ee925226-c7c4-33d7-f21e-925f200e05ff 32:40.032 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23321 32:40.053 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.105 [INFO] TestAgent: Synced node info 32:40.105 [DEBUG] TestAgent: Node info in sync 32:40.117 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.117 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.117 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.117 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.117 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.117 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ee925226-c7c4-33d7-f21e-925f200e05ff 32:40.117 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ee925226-c7c4-33d7-f21e-925f200e05ff 32:40.137 [INFO] TestAgent.server: federation state anti-entropy synced 32:40.310 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/service/consul?passing=1 from=127.0.0.1:42888 latency=1.057248ms 32:40.337 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:42888 latency=14.960777ms 32:40.342 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/info/1b742fe6-f795-b183-77a0-bdaec8163da9 from=127.0.0.1:42894 latency=513.166µs 32:40.358 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/1b742fe6-f795-b183-77a0-bdaec8163da9 from=127.0.0.1:42888 latency=14.74053ms 32:40.362 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/session/info/1b742fe6-f795-b183-77a0-bdaec8163da9 from=127.0.0.1:42896 latency=165.843µs 32:40.362 [INFO] TestAgent: Requesting shutdown 32:40.362 [INFO] TestAgent.server: shutting down server 32:40.362 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:40.362 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:40.362 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:40.362 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:40.362 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:40.363 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:40.363 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:40.363 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:40.363 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:40.363 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:40.376 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:40.384Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:40.384Z [INFO] agent.router.manager: shutting down 32:40.384 [INFO] TestAgent: consul server down 32:40.384 [INFO] TestAgent: shutdown complete 32:40.384 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23316 network=tcp 32:40.384 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23316 network=udp 32:40.384 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23317 network=tcp 32:40.884 [INFO] TestAgent: Waiting for endpoints to shut down 32:40.884 [INFO] TestAgent: Endpoints down --- PASS: TestExecCommand_Sessions_Foreign (1.25s) 2021-10-05T16:32:39.812Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.863Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:39.931 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9d3b55f2-9d91-e699-f57c-06777bff409f Address:127.0.0.1:23286}]" 32:39.932 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23286 [Follower]" leader= 32:39.932 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9d3b55f2-9d91-e699-f57c-06777bff409f.dc1 127.0.0.1 32:39.974 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9d3b55f2-9d91-e699-f57c-06777bff409f 127.0.0.1 2021-10-05T16:32:39.974Z [INFO] agent.router: Initializing LAN area manager 32:39.982 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9d3b55f2-9d91-e699-f57c-06777bff409f.dc1 area=wan 32:39.982 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23281 network=udp 32:39.982 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23281 network=tcp 32:39.983 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23282 network=tcp 32:39.983 [INFO] TestAgent: started state syncer 32:39.983 [INFO] TestAgent.server: Adding LAN server: server="Node-9d3b55f2-9d91-e699-f57c-06777bff409f (Addr: tcp/127.0.0.1:23286) (DC: dc1)" 32:39.983 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23287 network=tcp 32:40.000 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.000 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23286 [Candidate]" term=2 32:40.029 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.029 [DEBUG] TestAgent.server.raft: vote granted: from=9d3b55f2-9d91-e699-f57c-06777bff409f term=2 tally=1 32:40.029 [INFO] TestAgent.server.raft: election won: tally=1 32:40.029 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23286 [Leader]" 32:40.029 [INFO] TestAgent.server: cluster leadership acquired 32:40.029 [INFO] TestAgent.server: New leader elected: payload=Node-9d3b55f2-9d91-e699-f57c-06777bff409f 32:40.040 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23286 32:40.064 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.110 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.110 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.110 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.110 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.110 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.110 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9d3b55f2-9d91-e699-f57c-06777bff409f 32:40.110 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9d3b55f2-9d91-e699-f57c-06777bff409f 32:40.136 [INFO] TestAgent.server: federation state anti-entropy synced 32:40.184 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:40.213 [INFO] TestAgent: Synced node info 32:40.213 [DEBUG] TestAgent: Node info in sync 32:40.360 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:44672 latency=35.278128ms 32:40.362 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/?keys=&wait=2000ms from=127.0.0.1:44672 latency=64.56µs 32:40.367 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/ack?acquire=cf931db4-6f85-b8ae-187f-96337daf684d from=127.0.0.1:44680 latency=5.229745ms 32:40.367 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/?index=1&keys=&wait=2000ms from=127.0.0.1:44672 latency=4.556464ms 32:40.375 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/exit?acquire=cf931db4-6f85-b8ae-187f-96337daf684d from=127.0.0.1:44682 latency=6.053716ms 32:40.375 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/?index=14&keys=&wait=2000ms from=127.0.0.1:44672 latency=7.414787ms 32:40.378 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/exit from=127.0.0.1:44672 latency=1.538146ms 32:40.394 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/random?acquire=cf931db4-6f85-b8ae-187f-96337daf684d from=127.0.0.1:44684 latency=9.395302ms 32:40.394 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/?index=15&keys=&wait=2000ms from=127.0.0.1:44672 latency=15.38349ms 32:40.402 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/out/00000?acquire=cf931db4-6f85-b8ae-187f-96337daf684d from=127.0.0.1:44688 latency=7.099895ms 32:40.403 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/?index=16&keys=&wait=2000ms from=127.0.0.1:44672 latency=7.523601ms 32:40.408 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/out/00000 from=127.0.0.1:44672 latency=198.814µs 32:40.418 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/out/00001?acquire=cf931db4-6f85-b8ae-187f-96337daf684d from=127.0.0.1:44692 latency=5.420451ms 32:40.420 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/?index=17&keys=&wait=2000ms from=127.0.0.1:44672 latency=8.037533ms 32:40.430 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/foo/out/00001 from=127.0.0.1:44672 latency=329.616µs 32:40.431 [INFO] TestAgent: Requesting shutdown 32:40.431 [INFO] TestAgent.server: shutting down server 32:40.431 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:40.431 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:40.431 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:40.431 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:40.431 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:40.431 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:40.431 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:40.431 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:40.431 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:40.431 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:40.432 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/cf931db4-6f85-b8ae-187f-96337daf684d/?index=18&keys=&wait=2000ms from=127.0.0.1:44672 latency=406.843µs 32:40.444 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:40.452Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:40.452Z [INFO] agent.router.manager: shutting down 32:40.452 [INFO] TestAgent: consul server down 32:40.452 [INFO] TestAgent: shutdown complete 32:40.452 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23281 network=tcp 32:40.452 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23281 network=udp 32:40.452 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23282 network=tcp 32:40.953 [INFO] TestAgent: Waiting for endpoints to shut down 32:40.953 [INFO] TestAgent: Endpoints down --- PASS: TestExecCommand_StreamResults (1.31s) 2021-10-05T16:32:39.915Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.974Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:40.014 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0b3b3277-4c56-52f3-5315-58a546d6e29c Address:127.0.0.1:23300}]" 32:40.014 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0b3b3277-4c56-52f3-5315-58a546d6e29c.dc1 127.0.0.1 32:40.015 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0b3b3277-4c56-52f3-5315-58a546d6e29c 127.0.0.1 2021-10-05T16:32:40.015Z [INFO] agent.router: Initializing LAN area manager 32:40.015 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23295 network=udp 32:40.015 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23300 [Follower]" leader= 32:40.016 [INFO] TestAgent.server: Adding LAN server: server="Node-0b3b3277-4c56-52f3-5315-58a546d6e29c (Addr: tcp/127.0.0.1:23300) (DC: dc1)" 32:40.016 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23295 network=tcp 32:40.016 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0b3b3277-4c56-52f3-5315-58a546d6e29c.dc1 area=wan 32:40.017 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23296 network=tcp 32:40.017 [INFO] TestAgent: started state syncer 32:40.017 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23301 network=tcp 32:40.064 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.064 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23300 [Candidate]" term=2 32:40.094 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.094 [DEBUG] TestAgent.server.raft: vote granted: from=0b3b3277-4c56-52f3-5315-58a546d6e29c term=2 tally=1 32:40.094 [INFO] TestAgent.server.raft: election won: tally=1 32:40.094 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23300 [Leader]" 32:40.094 [INFO] TestAgent.server: cluster leadership acquired 32:40.094 [INFO] TestAgent.server: New leader elected: payload=Node-0b3b3277-4c56-52f3-5315-58a546d6e29c 32:40.124 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23300 32:40.149 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.176 [INFO] TestAgent: Synced node info 32:40.187 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.187 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.187 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.187 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.190 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.205 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0b3b3277-4c56-52f3-5315-58a546d6e29c 32:40.205 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0b3b3277-4c56-52f3-5315-58a546d6e29c 32:40.391 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:46442 latency=6.595686ms 32:40.402 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/2504c512-98ce-38c7-37e6-185bb1a048f9/job?acquire=2504c512-98ce-38c7-37e6-185bb1a048f9 from=127.0.0.1:46442 latency=9.861437ms 32:40.408 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/2504c512-98ce-38c7-37e6-185bb1a048f9/job from=127.0.0.1:46446 latency=397.245µs 32:40.432 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/_rexec/2504c512-98ce-38c7-37e6-185bb1a048f9?recurse= from=127.0.0.1:46442 latency=17.221651ms 32:40.434 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/2504c512-98ce-38c7-37e6-185bb1a048f9/job from=127.0.0.1:46450 latency=82.566µs 32:40.436 [INFO] TestAgent: Requesting shutdown 32:40.436 [INFO] TestAgent.server: shutting down server 32:40.436 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:40.436 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:40.436 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:40.436 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:40.436 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:40.436 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="shutdown waiting for leader" 32:40.436 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:40.436 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:40.436 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:40.436 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:40.449 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:40.459Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:40.459Z [INFO] agent.router.manager: shutting down 32:40.459 [INFO] TestAgent: consul server down 32:40.459 [INFO] TestAgent: shutdown complete 32:40.459 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23295 network=tcp 32:40.459 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23295 network=udp 32:40.459 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23296 network=tcp 32:40.960 [INFO] TestAgent: Waiting for endpoints to shut down 32:40.960 [INFO] TestAgent: Endpoints down --- PASS: TestExecCommand_UploadDestroy (1.31s) 2021-10-05T16:32:39.833Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.862Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:39.984 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2c47baa2-dce5-be9d-5bf7-a1570e66da7b Address:127.0.0.1:23293}]" 32:39.984 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23293 [Follower]" leader= 32:39.985 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b.dc1 127.0.0.1 32:39.997 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b 127.0.0.1 2021-10-05T16:32:39.997Z [INFO] agent.router: Initializing LAN area manager 32:39.997 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23288 network=udp 32:39.997 [INFO] TestAgent.server: Adding LAN server: server="Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b (Addr: tcp/127.0.0.1:23293) (DC: dc1)" 32:39.997 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b.dc1 area=wan 32:39.997 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23288 network=tcp 32:39.998 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23289 network=tcp 32:39.998 [INFO] TestAgent: started state syncer 32:39.998 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23294 network=tcp 32:40.024 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.024 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23293 [Candidate]" term=2 32:40.039 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.039 [DEBUG] TestAgent.server.raft: vote granted: from=2c47baa2-dce5-be9d-5bf7-a1570e66da7b term=2 tally=1 32:40.039 [INFO] TestAgent.server.raft: election won: tally=1 32:40.039 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23293 [Leader]" 32:40.039 [INFO] TestAgent.server: cluster leadership acquired 32:40.039 [INFO] TestAgent.server: New leader elected: payload=Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b 32:40.050 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23293 32:40.106 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.144 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.144 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.144 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.144 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.144 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.144 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b 32:40.144 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b 32:40.165 [INFO] TestAgent.server: federation state anti-entropy synced 32:40.216 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:49028 latency=27.627508ms 32:40.241 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:49028 latency=12.819991ms 32:40.246 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/job?acquire=3551ea35-eb25-446e-8ad6-faec14dd4ae6 from=127.0.0.1:49028 latency=5.334986ms 32:40.352 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:40.360 [INFO] TestAgent: Synced node info 32:40.360 [DEBUG] TestAgent: Node info in sync 32:40.454 [DEBUG] TestAgent.server: User event: event=_rexec 32:40.454 [DEBUG] TestAgent: received remote exec event: id=5ebc5956-67db-ff21-8da3-c579b2ecdfc6 32:40.454 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/event/fire/_rexec from=127.0.0.1:49028 latency=330.318µs 32:40.456 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/?keys=&wait=1000ms from=127.0.0.1:49028 latency=237.96µs 32:40.463 [INFO] TestAgent: remote exec script: script= 32:40.466 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/?index=13&keys=&wait=1000ms from=127.0.0.1:49028 latency=10.077769ms 32:40.482 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/?index=15&keys=&wait=1000ms from=127.0.0.1:49028 latency=12.72644ms 32:40.483 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b/out/00000 from=127.0.0.1:49028 latency=230.69µs 32:40.487 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/?index=16&keys=&wait=1000ms from=127.0.0.1:49028 latency=3.063326ms 32:40.487 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/Node-2c47baa2-dce5-be9d-5bf7-a1570e66da7b/exit from=127.0.0.1:49028 latency=173.162µs 32:41.505 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6/?index=17&keys=&wait=1000ms from=127.0.0.1:49028 latency=1.016871041s 32:41.667 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/3551ea35-eb25-446e-8ad6-faec14dd4ae6 from=127.0.0.1:49080 latency=169.179983ms 32:41.675 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/_rexec/3551ea35-eb25-446e-8ad6-faec14dd4ae6?recurse= from=127.0.0.1:49080 latency=5.689034ms 32:41.680 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/3551ea35-eb25-446e-8ad6-faec14dd4ae6 from=127.0.0.1:49080 latency=4.916424ms 32:41.680 [INFO] TestAgent: Requesting shutdown 32:41.681 [INFO] TestAgent.server: shutting down server 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:41.681 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:41.681 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:41.686 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:41.693Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:41.693Z [INFO] agent.router.manager: shutting down 32:41.693 [INFO] TestAgent: consul server down 32:41.693 [INFO] TestAgent: shutdown complete 32:41.693 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23288 network=tcp 32:41.693 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23288 network=udp 32:41.693 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23289 network=tcp 32:42.193 [INFO] TestAgent: Waiting for endpoints to shut down 32:42.193 [INFO] TestAgent: Endpoints down --- PASS: TestExecCommand_NoShell (2.55s) 2021-10-05T16:32:39.858Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.906Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:39.988 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:eff9f8c3-b081-531c-0999-bef62eecc5d2 Address:127.0.0.1:23307}]" 32:39.992 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23307 [Follower]" leader= 32:40.000 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-eff9f8c3-b081-531c-0999-bef62eecc5d2.dc1 127.0.0.1 32:40.001 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-eff9f8c3-b081-531c-0999-bef62eecc5d2 127.0.0.1 2021-10-05T16:32:40.001Z [INFO] agent.router: Initializing LAN area manager 32:40.001 [INFO] TestAgent.server: Adding LAN server: server="Node-eff9f8c3-b081-531c-0999-bef62eecc5d2 (Addr: tcp/127.0.0.1:23307) (DC: dc1)" 32:40.001 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23302 network=udp 32:40.001 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-eff9f8c3-b081-531c-0999-bef62eecc5d2.dc1 area=wan 32:40.001 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23302 network=tcp 32:40.002 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23303 network=tcp 32:40.002 [INFO] TestAgent: started state syncer 32:40.002 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23308 network=tcp 32:40.041 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.041 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23307 [Candidate]" term=2 32:40.067 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.067 [DEBUG] TestAgent.server.raft: vote granted: from=eff9f8c3-b081-531c-0999-bef62eecc5d2 term=2 tally=1 32:40.067 [INFO] TestAgent.server.raft: election won: tally=1 32:40.067 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23307 [Leader]" 32:40.067 [INFO] TestAgent.server: cluster leadership acquired 32:40.068 [INFO] TestAgent.server: New leader elected: payload=Node-eff9f8c3-b081-531c-0999-bef62eecc5d2 32:40.076 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23307 32:40.103 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.145 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.145 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.145 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.145 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.145 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.145 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-eff9f8c3-b081-531c-0999-bef62eecc5d2 32:40.145 [INFO] TestAgent.server: member joined, marking health alive: member=Node-eff9f8c3-b081-531c-0999-bef62eecc5d2 32:40.167 [INFO] TestAgent.server: federation state anti-entropy synced 32:40.178 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:40.223 [INFO] TestAgent: Synced node info 32:40.223 [DEBUG] TestAgent: Node info in sync 32:40.336 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:41146 latency=8.563372ms 32:40.361 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:41146 latency=19.007602ms 32:40.376 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/job?acquire=9f4e8daf-f448-e133-43ab-263d061b2cc9 from=127.0.0.1:41146 latency=13.907415ms 32:40.580 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/event/fire/_rexec from=127.0.0.1:41146 latency=363.294µs 32:40.580 [DEBUG] TestAgent.server: User event: event=_rexec 32:40.580 [DEBUG] TestAgent: received remote exec event: id=9b558ba6-b2b6-b953-9467-4f5573e944dc 32:40.582 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/?keys=&wait=1000ms from=127.0.0.1:41146 latency=252.807µs 32:40.594 [INFO] TestAgent: remote exec script: script=uptime 32:40.598 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/?index=14&keys=&wait=1000ms from=127.0.0.1:41146 latency=14.39328ms 32:40.632 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/?index=15&keys=&wait=1000ms from=127.0.0.1:41146 latency=32.408672ms 32:40.640 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/Node-eff9f8c3-b081-531c-0999-bef62eecc5d2/out/00000 from=127.0.0.1:41146 latency=251.933µs 32:40.653 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/?index=16&keys=&wait=1000ms from=127.0.0.1:41146 latency=12.240679ms 32:40.654 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/Node-eff9f8c3-b081-531c-0999-bef62eecc5d2/exit from=127.0.0.1:41146 latency=177.398µs 32:41.666 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/9f4e8daf-f448-e133-43ab-263d061b2cc9 from=127.0.0.1:41190 latency=9.065854ms 32:41.666 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9/?index=17&keys=&wait=1000ms from=127.0.0.1:41146 latency=1.011606938s 32:41.684 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/_rexec/9f4e8daf-f448-e133-43ab-263d061b2cc9?recurse= from=127.0.0.1:41190 latency=14.295609ms 32:41.702 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/9f4e8daf-f448-e133-43ab-263d061b2cc9 from=127.0.0.1:41190 latency=14.617292ms 32:41.703 [INFO] TestAgent: Requesting shutdown 32:41.703 [INFO] TestAgent.server: shutting down server 32:41.703 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:41.703 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:41.703 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:41.703 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:41.703 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:41.703 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:41.703 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:41.703 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:41.703 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:41.703 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:41.707 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:41.710Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:41.710Z [INFO] agent.router.manager: shutting down 32:41.710 [INFO] TestAgent: consul server down 32:41.710 [INFO] TestAgent: shutdown complete 32:41.710 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23302 network=tcp 32:41.711 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23302 network=udp 32:41.711 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23303 network=tcp 32:42.212 [INFO] TestAgent: Waiting for endpoints to shut down 32:42.212 [INFO] TestAgent: Endpoints down --- PASS: TestExecCommand (2.56s) 2021-10-05T16:32:40.185Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:40.231Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:40.271 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7a864460-268a-1a92-c2f3-ac27d97b8545 Address:127.0.0.1:23328}]" 32:40.272 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23328 [Follower]" leader= 32:40.272 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 127.0.0.1 32:40.273 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7a864460-268a-1a92-c2f3-ac27d97b8545 127.0.0.1 2021-10-05T16:32:40.273Z [INFO] agent.router: Initializing LAN area manager 32:40.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23323 network=udp 32:40.273 [INFO] TestAgent.server: Adding LAN server: server="Node-7a864460-268a-1a92-c2f3-ac27d97b8545 (Addr: tcp/127.0.0.1:23328) (DC: dc2)" 32:40.274 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 area=wan 32:40.274 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23323 network=tcp 32:40.274 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23324 network=tcp 32:40.274 [INFO] TestAgent: started state syncer 32:40.274 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23329 network=tcp 32:40.331 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.331 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23328 [Candidate]" term=2 32:40.352 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.352 [DEBUG] TestAgent.server.raft: vote granted: from=7a864460-268a-1a92-c2f3-ac27d97b8545 term=2 tally=1 32:40.352 [INFO] TestAgent.server.raft: election won: tally=1 32:40.352 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23328 [Leader]" 32:40.352 [INFO] TestAgent.server: cluster leadership acquired 32:40.352 [INFO] TestAgent.server: New leader elected: payload=Node-7a864460-268a-1a92-c2f3-ac27d97b8545 32:40.362 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23328 32:40.381 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.412 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.412 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.412 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.412 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.412 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.412 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7a864460-268a-1a92-c2f3-ac27d97b8545 32:40.412 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7a864460-268a-1a92-c2f3-ac27d97b8545 32:40.430 [INFO] TestAgent.server: federation state anti-entropy synced 32:40.651 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:40.659 [INFO] TestAgent: Synced node info 32:40.659 [DEBUG] TestAgent: Node info in sync 32:40.712 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:23278] 32:40.713 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:23278 32:40.715 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502.dc1 127.0.0.1 32:40.715 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 32:40.715 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502.dc1 area=wan 32:40.945 [DEBUG] TestAgent.server: User event: event=_rexec 32:40.945 [DEBUG] TestAgent: received remote exec event: id=f29432d9-e789-6964-9962-43a5915acba7 32:40.963 [INFO] TestAgent: remote exec script: script=uptime 32:41.004 [DEBUG] TestAgent.server.serf.wan: serf: messageJoinType: Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 32:41.501 [DEBUG] TestAgent.server.serf.wan: serf: messageJoinType: Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 32:41.681 [INFO] TestAgent: Requesting shutdown 32:41.681 [INFO] TestAgent.server: shutting down server 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:41.681 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:41.681 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:41.681 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:41.681 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:41.686 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:41.689Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:41.689Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:41.689Z [INFO] agent.router.manager: shutting down 32:41.689 [INFO] TestAgent: consul server down 32:41.689 [INFO] TestAgent: shutdown complete 32:41.689 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23323 network=tcp 32:41.689 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23323 network=udp 32:41.689 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23324 network=tcp 32:42.192 [INFO] TestAgent: Waiting for endpoints to shut down 32:42.192 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:39.802Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:39.925Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:39.990 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3ae4ca34-099f-f8d4-66c7-f6c3a6c70502 Address:127.0.0.1:23279}]" 32:39.998 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502.dc1 127.0.0.1 32:39.999 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502 127.0.0.1 2021-10-05T16:32:39.999Z [INFO] agent.router: Initializing LAN area manager 32:39.999 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=udp 32:39.999 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23279 [Follower]" leader= 32:40.000 [INFO] TestAgent.server: Adding LAN server: server="Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502 (Addr: tcp/127.0.0.1:23279) (DC: dc1)" 32:40.000 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502.dc1 area=wan 32:40.000 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=tcp 32:40.000 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23275 network=tcp 32:40.000 [INFO] TestAgent: started state syncer 32:40.001 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23280 network=tcp 32:40.036 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:40.036 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23279 [Candidate]" term=2 32:40.050 [DEBUG] TestAgent.server.raft: votes: needed=1 32:40.050 [DEBUG] TestAgent.server.raft: vote granted: from=3ae4ca34-099f-f8d4-66c7-f6c3a6c70502 term=2 tally=1 32:40.050 [INFO] TestAgent.server.raft: election won: tally=1 32:40.050 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23279 [Leader]" 32:40.050 [INFO] TestAgent.server: cluster leadership acquired 32:40.050 [INFO] TestAgent.server: New leader elected: payload=Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502 32:40.072 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23279 32:40.093 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:40.123 [INFO] TestAgent: Synced node info 32:40.141 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:40.141 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:40.141 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:40.141 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:40.141 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:40.141 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502 32:40.141 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3ae4ca34-099f-f8d4-66c7-f6c3a6c70502 32:40.158 [INFO] TestAgent.server: federation state anti-entropy synced 32:40.713 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:42120 32:40.714 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 127.0.0.1 32:40.715 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 area=wan 32:40.718 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self?dc=dc2 from=127.0.0.1:36768 latency=2.1946ms 32:40.726 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/health/service/consul?dc=dc2&passing=1 from=127.0.0.1:36768 latency=2.555103ms 32:40.736 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create?dc=dc2 from=127.0.0.1:36768 latency=8.755921ms 32:40.740 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/job?acquire=0ea66e86-e192-53b2-1231-80778d011b83&dc=dc2 from=127.0.0.1:36768 latency=3.324799ms 32:40.774 [DEBUG] TestAgent.server.serf.wan: serf: messageJoinType: Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 32:40.948 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/event/fire/_rexec?dc=dc2 from=127.0.0.1:36768 latency=3.547323ms 32:40.953 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/?dc=dc2&keys=&wait=500ms from=127.0.0.1:36768 latency=484.643µs 32:40.970 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/?dc=dc2&index=14&keys=&wait=500ms from=127.0.0.1:36768 latency=16.389958ms 32:40.993 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/?dc=dc2&index=15&keys=&wait=500ms from=127.0.0.1:36768 latency=22.563252ms 32:41.005 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/Node-7a864460-268a-1a92-c2f3-ac27d97b8545/out/00000?dc=dc2 from=127.0.0.1:36768 latency=5.012547ms 32:41.011 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/?dc=dc2&index=16&keys=&wait=500ms from=127.0.0.1:36768 latency=505.354µs 32:41.011 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/Node-7a864460-268a-1a92-c2f3-ac27d97b8545/exit?dc=dc2 from=127.0.0.1:36768 latency=290.177µs 32:41.280 [DEBUG] TestAgent.server.serf.wan: serf: messageJoinType: Node-7a864460-268a-1a92-c2f3-ac27d97b8545.dc2 32:41.521 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83/?dc=dc2&index=17&keys=&wait=500ms from=127.0.0.1:36768 latency=504.895149ms 32:41.669 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/0ea66e86-e192-53b2-1231-80778d011b83?dc=dc2 from=127.0.0.1:36780 latency=155.982109ms 32:41.674 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/_rexec/0ea66e86-e192-53b2-1231-80778d011b83?dc=dc2&recurse= from=127.0.0.1:36780 latency=4.35895ms 32:41.680 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/0ea66e86-e192-53b2-1231-80778d011b83?dc=dc2 from=127.0.0.1:36780 latency=5.614553ms 32:42.192 [INFO] TestAgent: Requesting shutdown 32:42.192 [INFO] TestAgent.server: shutting down server 32:42.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:42.192 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:42.192 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:42.192 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:42.192 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:42.192 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:42.192 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:42.192 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:42.192 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:42.192 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:42.204 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:42.212Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:42.212Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:42.212Z [INFO] agent.router.manager: shutting down 32:42.212 [INFO] TestAgent: consul server down 32:42.212 [INFO] TestAgent: shutdown complete 32:42.212 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=tcp 32:42.212 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=udp 32:42.212 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23275 network=tcp 32:42.716 [INFO] TestAgent: Waiting for endpoints to shut down 32:42.716 [INFO] TestAgent: Endpoints down --- PASS: TestExecCommand_CrossDC (3.08s) PASS ok github.com/hashicorp/consul/command/exec 3.296s === RUN TestForceLeaveCommand_noTabs === PAUSE TestForceLeaveCommand_noTabs === RUN TestForceLeaveCommand === PAUSE TestForceLeaveCommand === RUN TestForceLeaveCommand_NoNodeWithName === PAUSE TestForceLeaveCommand_NoNodeWithName === RUN TestForceLeaveCommand_prune === PAUSE TestForceLeaveCommand_prune === RUN TestForceLeaveCommand_noAddrs === PAUSE TestForceLeaveCommand_noAddrs === CONT TestForceLeaveCommand_noTabs --- PASS: TestForceLeaveCommand_noTabs (0.00s) === CONT TestForceLeaveCommand_noAddrs --- PASS: TestForceLeaveCommand_noAddrs (0.00s) === CONT TestForceLeaveCommand_prune [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestForceLeaveCommand_NoNodeWithName === CONT TestForceLeaveCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:50.336Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:50.420Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:50.542 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0bff7d34-5243-cbd4-31d5-6f2a232f886e Address:127.0.0.1:19202}]" 32:50.542 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19202 [Follower]" leader= 32:50.542 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0bff7d34-5243-cbd4-31d5-6f2a232f886e.dc1 127.0.0.1 32:50.543 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0bff7d34-5243-cbd4-31d5-6f2a232f886e 127.0.0.1 2021-10-05T16:32:50.543Z [INFO] agent.router: Initializing LAN area manager 32:50.543 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19197 network=udp 32:50.543 [INFO] TestAgent.server: Adding LAN server: server="Node-0bff7d34-5243-cbd4-31d5-6f2a232f886e (Addr: tcp/127.0.0.1:19202) (DC: dc1)" 32:50.543 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0bff7d34-5243-cbd4-31d5-6f2a232f886e.dc1 area=wan 32:50.544 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19197 network=tcp 32:50.552 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19198 network=tcp 32:50.552 [INFO] TestAgent: started state syncer 32:50.552 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19203 network=tcp 32:50.582 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:50.582 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19202 [Candidate]" term=2 32:50.624 [DEBUG] TestAgent.server.raft: votes: needed=1 32:50.624 [DEBUG] TestAgent.server.raft: vote granted: from=0bff7d34-5243-cbd4-31d5-6f2a232f886e term=2 tally=1 32:50.624 [INFO] TestAgent.server.raft: election won: tally=1 32:50.624 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19202 [Leader]" 32:50.624 [INFO] TestAgent.server: cluster leadership acquired 32:50.624 [INFO] TestAgent.server: New leader elected: payload=Node-0bff7d34-5243-cbd4-31d5-6f2a232f886e 32:50.638 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19202 32:50.654 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:50.683 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:50.683 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:50.683 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:50.683 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:50.683 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:50.683 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0bff7d34-5243-cbd4-31d5-6f2a232f886e 32:50.683 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0bff7d34-5243-cbd4-31d5-6f2a232f886e 32:50.697 [INFO] TestAgent.server: federation state anti-entropy synced 32:50.892 [INFO] TestAgent: Force leaving node: node=garbage-name 32:50.892 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/agent/force-leave/garbage-name from=127.0.0.1:53500 error="agent: No node found with name 'garbage-name'" 32:50.893 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/force-leave/garbage-name from=127.0.0.1:53500 latency=962.275µs 32:50.896 [INFO] TestAgent: Requesting shutdown 32:50.896 [INFO] TestAgent.server: shutting down server 32:50.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:50.896 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:50.896 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:50.896 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:50.896 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:50.896 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:50.896 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:50.897 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:50.897 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:50.897 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:50.897 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:50.912 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:50.920Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:50.920Z [INFO] agent.router.manager: shutting down 32:50.920 [INFO] TestAgent: consul server down 32:50.920 [INFO] TestAgent: shutdown complete 32:50.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19197 network=tcp 32:50.920 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19197 network=udp 32:50.920 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19198 network=tcp 32:51.421 [INFO] TestAgent: Waiting for endpoints to shut down 32:51.421 [INFO] TestAgent: Endpoints down --- PASS: TestForceLeaveCommand_NoNodeWithName (1.17s) 2021-10-05T16:32:50.929Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:50.993Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:51.081 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1a4bff87-3311-01d9-8f26-927cd155c523 Address:127.0.0.1:19223}]" 32:51.082 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1a4bff87-3311-01d9-8f26-927cd155c523.dc1 127.0.0.1 32:51.082 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1a4bff87-3311-01d9-8f26-927cd155c523 127.0.0.1 2021-10-05T16:32:51.082Z [INFO] agent.router: Initializing LAN area manager 32:51.082 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19218 network=udp 32:51.082 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19223 [Follower]" leader= 32:51.083 [INFO] TestAgent.server: Adding LAN server: server="Node-1a4bff87-3311-01d9-8f26-927cd155c523 (Addr: tcp/127.0.0.1:19223) (DC: dc1)" 32:51.083 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1a4bff87-3311-01d9-8f26-927cd155c523.dc1 area=wan 32:51.083 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19218 network=tcp 32:51.083 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19219 network=tcp 32:51.084 [INFO] TestAgent: started state syncer 32:51.084 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19224 network=tcp 32:51.135 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:51.135 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19223 [Candidate]" term=2 32:51.149 [DEBUG] TestAgent.server.raft: votes: needed=1 32:51.149 [DEBUG] TestAgent.server.raft: vote granted: from=1a4bff87-3311-01d9-8f26-927cd155c523 term=2 tally=1 32:51.150 [INFO] TestAgent.server.raft: election won: tally=1 32:51.150 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19223 [Leader]" 32:51.151 [INFO] TestAgent.server: cluster leadership acquired 32:51.151 [INFO] TestAgent.server: New leader elected: payload=Node-1a4bff87-3311-01d9-8f26-927cd155c523 32:51.177 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19223 32:51.207 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:51.218 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:19207] 32:51.224 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:19207 32:51.229 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:51.229 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:51.229 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:51.229 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:51.229 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:51.229 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1a4bff87-3311-01d9-8f26-927cd155c523 32:51.229 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1a4bff87-3311-01d9-8f26-927cd155c523 32:51.232 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:50416 32:51.236 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4add2533-d712-c1c1-59e0-3dcfff85cc99.dc1 127.0.0.1 32:51.236 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4add2533-d712-c1c1-59e0-3dcfff85cc99.dc1 area=wan 32:51.241 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4add2533-d712-c1c1-59e0-3dcfff85cc99 127.0.0.1 32:51.241 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 32:51.241 [DEBUG] TestAgent: systemd notify failed: error="No socket" 32:51.241 [INFO] TestAgent: Requesting shutdown 32:51.241 [INFO] TestAgent.server: shutting down server 32:51.241 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:51.241 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:51.241 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:51.241 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:51.241 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:51.241 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:51.241 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:51.241 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:51.241 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:51.248 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:51.248 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:51.252 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:51.260Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:51.260Z [INFO] agent.router.manager: shutting down 32:51.260 [INFO] TestAgent: consul server down 32:51.260 [INFO] TestAgent: shutdown complete 32:51.260 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19218 network=tcp 32:51.260 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19218 network=udp 32:51.260 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19219 network=tcp 32:51.764 [INFO] TestAgent: Waiting for endpoints to shut down 32:51.764 [INFO] TestAgent: Endpoints down 2021-10-05T16:32:50.333Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:50.358Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:50.468 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4add2533-d712-c1c1-59e0-3dcfff85cc99 Address:127.0.0.1:19209}]" 32:50.469 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4add2533-d712-c1c1-59e0-3dcfff85cc99.dc1 127.0.0.1 32:50.469 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19209 [Follower]" leader= 32:50.475 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4add2533-d712-c1c1-59e0-3dcfff85cc99 127.0.0.1 2021-10-05T16:32:50.475Z [INFO] agent.router: Initializing LAN area manager 32:50.475 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19204 network=udp 32:50.475 [INFO] TestAgent.server: Adding LAN server: server="Node-4add2533-d712-c1c1-59e0-3dcfff85cc99 (Addr: tcp/127.0.0.1:19209) (DC: dc1)" 32:50.475 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4add2533-d712-c1c1-59e0-3dcfff85cc99.dc1 area=wan 32:50.476 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19204 network=tcp 32:50.476 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19205 network=tcp 32:50.476 [INFO] TestAgent: started state syncer 32:50.476 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19210 network=tcp 32:50.536 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:50.536 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19209 [Candidate]" term=2 32:50.584 [DEBUG] TestAgent.server.raft: votes: needed=1 32:50.584 [DEBUG] TestAgent.server.raft: vote granted: from=4add2533-d712-c1c1-59e0-3dcfff85cc99 term=2 tally=1 32:50.584 [INFO] TestAgent.server.raft: election won: tally=1 32:50.584 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19209 [Leader]" 32:50.588 [INFO] TestAgent.server: cluster leadership acquired 32:50.588 [INFO] TestAgent.server: New leader elected: payload=Node-4add2533-d712-c1c1-59e0-3dcfff85cc99 32:50.612 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19209 32:50.663 [INFO] TestAgent: Synced node info 32:50.663 [DEBUG] TestAgent: Node info in sync 32:50.663 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:50.686 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:50.686 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:50.686 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:50.686 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:50.686 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:50.686 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4add2533-d712-c1c1-59e0-3dcfff85cc99 32:50.686 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4add2533-d712-c1c1-59e0-3dcfff85cc99 32:50.701 [INFO] TestAgent.server: federation state anti-entropy synced 32:51.224 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:50072 32:51.229 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1a4bff87-3311-01d9-8f26-927cd155c523 127.0.0.1 32:51.229 [INFO] TestAgent.server: Adding LAN server: server="Node-1a4bff87-3311-01d9-8f26-927cd155c523 (Addr: tcp/127.0.0.1:19223) (DC: dc1)" 32:51.229 [INFO] TestAgent.server: New leader elected: payload=Node-1a4bff87-3311-01d9-8f26-927cd155c523 32:51.229 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-1a4bff87-3311-01d9-8f26-927cd155c523 other=Node-4add2533-d712-c1c1-59e0-3dcfff85cc99 32:51.229 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1a4bff87-3311-01d9-8f26-927cd155c523 32:51.232 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-1a4bff87-3311-01d9-8f26-927cd155c523.dc1 127.0.0.1:19222 32:51.240 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1a4bff87-3311-01d9-8f26-927cd155c523.dc1 127.0.0.1 32:51.240 [DEBUG] TestAgent.server: Successfully performed flood-join for server at address: server=Node-1a4bff87-3311-01d9-8f26-927cd155c523.dc1 address=127.0.0.1:19222 32:51.240 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1a4bff87-3311-01d9-8f26-927cd155c523.dc1 area=wan 32:51.768 [INFO] TestAgent: Force leaving node: node=Node-1a4bff87-3311-01d9-8f26-927cd155c523 32:51.768 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/force-leave/Node-1a4bff87-3311-01d9-8f26-927cd155c523 from=127.0.0.1:39116 latency=30.143µs 32:51.981 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-1a4bff87-3311-01d9-8f26-927cd155c523 (timeout reached) 32:52.484 [INFO] TestAgent.server.memberlist.lan: memberlist: Suspect Node-1a4bff87-3311-01d9-8f26-927cd155c523 has failed, no acks received 32:52.628 [WARN] TestAgent: error getting server health from server: server=Node-1a4bff87-3311-01d9-8f26-927cd155c523 error="rpc error getting client: failed to get conn: dial tcp 127.0.0.1:0->127.0.0.1:19223: connect: connection refused" 32:53.138 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:53.138 [DEBUG] TestAgent: Node info in sync 32:53.628 [WARN] TestAgent: error getting server health from server: server=Node-1a4bff87-3311-01d9-8f26-927cd155c523 error="context deadline exceeded" 32:53.980 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-1a4bff87-3311-01d9-8f26-927cd155c523 (timeout reached) 32:54.088 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:54.088 [DEBUG] TestAgent: Node info in sync 32:54.628 [WARN] TestAgent: error getting server health from server: server=Node-1a4bff87-3311-01d9-8f26-927cd155c523 error="rpc error getting client: failed to get conn: dial tcp 127.0.0.1:0->127.0.0.1:19223: connect: connection refused" 32:55.480 [INFO] TestAgent.server.memberlist.lan: memberlist: Suspect Node-1a4bff87-3311-01d9-8f26-927cd155c523 has failed, no acks received 32:55.629 [WARN] TestAgent: error getting server health from server: server=Node-1a4bff87-3311-01d9-8f26-927cd155c523 error="context deadline exceeded" 32:56.488 [INFO] TestAgent.server.memberlist.lan: memberlist: Marking Node-1a4bff87-3311-01d9-8f26-927cd155c523 as failed, suspect timeout reached (0 peer confirmations) 32:56.488 [INFO] TestAgent.server.serf.lan: serf: EventMemberLeave: Node-1a4bff87-3311-01d9-8f26-927cd155c523 127.0.0.1 32:56.488 [INFO] TestAgent.server: Removing LAN server: server="Node-1a4bff87-3311-01d9-8f26-927cd155c523 (Addr: tcp/127.0.0.1:19223) (DC: dc1)" 32:56.488 [INFO] TestAgent.server: deregistering member: member=Node-1a4bff87-3311-01d9-8f26-927cd155c523 reason=left 32:56.508 [INFO] TestAgent: Requesting shutdown 32:56.508 [INFO] TestAgent.server: shutting down server 32:56.508 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:56.508 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:56.508 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:56.508 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:56.508 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:56.508 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:56.508 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:56.508 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:56.508 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:56.508 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:56.520 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:56.520Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:56.520Z [INFO] agent.router.manager: shutting down 32:56.520 [INFO] TestAgent: consul server down 32:56.520 [INFO] TestAgent: shutdown complete 32:56.520 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19204 network=tcp 32:56.520 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19204 network=udp 32:56.520 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19205 network=tcp 32:56.977 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-1a4bff87-3311-01d9-8f26-927cd155c523 (timeout reached) 32:57.021 [INFO] TestAgent: Waiting for endpoints to shut down 32:57.021 [INFO] TestAgent: Endpoints down --- PASS: TestForceLeaveCommand (6.77s) 2021-10-05T16:32:50.801Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:50.831Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:50.920 [INFO] Agent2.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d9f3d23b-bfde-515d-8446-6415a9580675 Address:127.0.0.1:19216}]" 32:50.921 [INFO] Agent2.server.raft: entering follower state: follower="Node at 127.0.0.1:19216 [Follower]" leader= 32:50.921 [INFO] Agent2.server.serf.wan: serf: EventMemberJoin: Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 127.0.0.1 32:50.921 [INFO] Agent2.server.serf.lan: serf: EventMemberJoin: Node-d9f3d23b-bfde-515d-8446-6415a9580675 127.0.0.1 2021-10-05T16:32:50.921Z [INFO] agent.router: Initializing LAN area manager 32:50.922 [INFO] Agent2: Started DNS server: address=127.0.0.1:19211 network=udp 32:50.922 [INFO] Agent2.server: Handled event for server in area: event=member-join server=Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 area=wan 32:50.922 [INFO] Agent2.server: Adding LAN server: server="Node-d9f3d23b-bfde-515d-8446-6415a9580675 (Addr: tcp/127.0.0.1:19216) (DC: dc1)" 32:50.922 [INFO] Agent2: Started DNS server: address=127.0.0.1:19211 network=tcp 32:50.922 [INFO] Agent2: Started HTTP server: address=127.0.0.1:19212 network=tcp 32:50.922 [INFO] Agent2: started state syncer 32:50.922 [INFO] Agent2: Started gRPC server: address=127.0.0.1:19217 network=tcp 32:50.960 [WARN] Agent2.server.raft: heartbeat timeout reached, starting election: last-leader= 32:50.960 [INFO] Agent2.server.raft: entering candidate state: node="Node at 127.0.0.1:19216 [Candidate]" term=2 32:51.028 [DEBUG] Agent2.server.raft: votes: needed=1 32:51.028 [DEBUG] Agent2.server.raft: vote granted: from=d9f3d23b-bfde-515d-8446-6415a9580675 term=2 tally=1 32:51.028 [INFO] Agent2.server.raft: election won: tally=1 32:51.028 [INFO] Agent2.server.raft: entering leader state: leader="Node at 127.0.0.1:19216 [Leader]" 32:51.029 [INFO] Agent2.server: cluster leadership acquired 32:51.029 [INFO] Agent2.server: New leader elected: payload=Node-d9f3d23b-bfde-515d-8446-6415a9580675 32:51.057 [DEBUG] Agent2.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19216 32:51.108 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:51.150 [INFO] Agent2.server.connect: initialized primary datacenter CA with provider: provider=consul 32:51.150 [INFO] Agent2.leader: started routine: routine="federation state anti-entropy" 32:51.150 [INFO] Agent2.leader: started routine: routine="federation state pruning" 32:51.150 [INFO] Agent2.leader: started routine: routine="intermediate cert renew watch" 32:51.150 [INFO] Agent2.leader: started routine: routine="CA root pruning" 32:51.150 [DEBUG] Agent2.server: Skipping self join check for node since the cluster is too small: node=Node-d9f3d23b-bfde-515d-8446-6415a9580675 32:51.150 [INFO] Agent2.server: member joined, marking health alive: member=Node-d9f3d23b-bfde-515d-8446-6415a9580675 32:51.185 [INFO] Agent2.server: federation state anti-entropy synced 32:51.192 [INFO] Agent2: (LAN) joining: lan_addresses=[127.0.0.1:19193] 32:51.196 [DEBUG] Agent2.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:19193 32:51.198 [INFO] Agent2.server.serf.lan: serf: EventMemberJoin: Node-daa82dd6-56d4-0bbd-9f53-badbdf966324 127.0.0.1 32:51.198 [INFO] Agent2: (LAN) joined: number_of_nodes=1 32:51.198 [DEBUG] Agent2: systemd notify failed: error="No socket" 32:51.198 [INFO] Agent2: Requesting shutdown 32:51.198 [INFO] Agent2.server: shutting down server 32:51.198 [DEBUG] Agent2.leader: stopping routine: routine="federation state pruning" 32:51.198 [DEBUG] Agent2.leader: stopping routine: routine="intermediate cert renew watch" 32:51.198 [DEBUG] Agent2.leader: stopping routine: routine="CA root pruning" 32:51.198 [DEBUG] Agent2.leader: stopping routine: routine="federation state anti-entropy" 32:51.198 [WARN] Agent2.server.serf.lan: serf: Shutdown without a Leave 32:51.198 [ERROR] Agent2.server: error performing anti-entropy sync of federation state: error="context canceled" 32:51.198 [DEBUG] Agent2.leader: stopped routine: routine="federation state anti-entropy" 32:51.198 [ERROR] Agent2.anti_entropy: failed to sync remote state: error="No cluster leader" 32:51.198 [DEBUG] Agent2.leader: stopped routine: routine="federation state pruning" 32:51.198 [DEBUG] Agent2.leader: stopped routine: routine="intermediate cert renew watch" 32:51.198 [DEBUG] Agent2.leader: stopped routine: routine="CA root pruning" 32:51.199 [DEBUG] Agent2.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:50494 32:51.204 [WARN] Agent2.server.serf.wan: serf: Shutdown without a Leave 32:51.205 [INFO] Agent2.server.serf.wan: serf: EventMemberJoin: Node-daa82dd6-56d4-0bbd-9f53-badbdf966324.dc1 127.0.0.1 2021-10-05T16:32:51.212Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:51.212Z [INFO] agent.router.manager: shutting down 32:51.212 [INFO] Agent2: consul server down 32:51.212 [INFO] Agent2: shutdown complete 32:51.212 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:19211 network=tcp 32:51.212 [INFO] Agent2: Stopping server: protocol=DNS address=127.0.0.1:19211 network=udp 32:51.212 [INFO] Agent2: Stopping server: protocol=HTTP address=127.0.0.1:19212 network=tcp 32:51.712 [INFO] Agent2: Waiting for endpoints to shut down 32:51.712 [INFO] Agent2: Endpoints down 2021-10-05T16:32:50.328Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:50.412Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:50.495 [INFO] Agent1.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:daa82dd6-56d4-0bbd-9f53-badbdf966324 Address:127.0.0.1:19195}]" 32:50.496 [INFO] Agent1.server.raft: entering follower state: follower="Node at 127.0.0.1:19195 [Follower]" leader= 32:50.496 [INFO] Agent1.server.serf.wan: serf: EventMemberJoin: Node-daa82dd6-56d4-0bbd-9f53-badbdf966324.dc1 127.0.0.1 32:50.497 [INFO] Agent1.server.serf.lan: serf: EventMemberJoin: Node-daa82dd6-56d4-0bbd-9f53-badbdf966324 127.0.0.1 2021-10-05T16:32:50.498Z [INFO] agent.router: Initializing LAN area manager 32:50.498 [INFO] Agent1: Started DNS server: address=127.0.0.1:19190 network=udp 32:50.498 [INFO] Agent1.server: Adding LAN server: server="Node-daa82dd6-56d4-0bbd-9f53-badbdf966324 (Addr: tcp/127.0.0.1:19195) (DC: dc1)" 32:50.498 [INFO] Agent1.server: Handled event for server in area: event=member-join server=Node-daa82dd6-56d4-0bbd-9f53-badbdf966324.dc1 area=wan 32:50.498 [INFO] Agent1: Started DNS server: address=127.0.0.1:19190 network=tcp 32:50.499 [INFO] Agent1: Started HTTP server: address=127.0.0.1:19191 network=tcp 32:50.536 [WARN] Agent1.server.raft: heartbeat timeout reached, starting election: last-leader= 32:50.536 [INFO] Agent1.server.raft: entering candidate state: node="Node at 127.0.0.1:19195 [Candidate]" term=2 32:50.542 [INFO] Agent1: started state syncer 32:50.542 [INFO] Agent1: Started gRPC server: address=127.0.0.1:19196 network=tcp 32:50.557 [DEBUG] Agent1.server.raft: votes: needed=1 32:50.557 [DEBUG] Agent1.server.raft: vote granted: from=daa82dd6-56d4-0bbd-9f53-badbdf966324 term=2 tally=1 32:50.557 [INFO] Agent1.server.raft: election won: tally=1 32:50.557 [INFO] Agent1.server.raft: entering leader state: leader="Node at 127.0.0.1:19195 [Leader]" 32:50.557 [INFO] Agent1.server: cluster leadership acquired 32:50.558 [INFO] Agent1.server: New leader elected: payload=Node-daa82dd6-56d4-0bbd-9f53-badbdf966324 32:50.571 [DEBUG] Agent1.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19195 32:50.583 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:50.640 [INFO] Agent1.server.connect: initialized primary datacenter CA with provider: provider=consul 32:50.640 [INFO] Agent1.leader: started routine: routine="federation state anti-entropy" 32:50.640 [INFO] Agent1.leader: started routine: routine="federation state pruning" 32:50.640 [INFO] Agent1.leader: started routine: routine="intermediate cert renew watch" 32:50.640 [INFO] Agent1.leader: started routine: routine="CA root pruning" 32:50.640 [DEBUG] Agent1.server: Skipping self join check for node since the cluster is too small: node=Node-daa82dd6-56d4-0bbd-9f53-badbdf966324 32:50.640 [INFO] Agent1.server: member joined, marking health alive: member=Node-daa82dd6-56d4-0bbd-9f53-badbdf966324 32:50.680 [INFO] Agent1.server: federation state anti-entropy synced 32:50.988 [DEBUG] Agent1: Skipping remote check since it is managed automatically: check=serfHealth 32:51.012 [INFO] Agent1: Synced node info 32:51.012 [DEBUG] Agent1: Node info in sync 32:51.196 [DEBUG] Agent1.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:34870 32:51.197 [INFO] Agent1.server.serf.lan: serf: EventMemberJoin: Node-d9f3d23b-bfde-515d-8446-6415a9580675 127.0.0.1 32:51.197 [INFO] Agent1.server: Adding LAN server: server="Node-d9f3d23b-bfde-515d-8446-6415a9580675 (Addr: tcp/127.0.0.1:19216) (DC: dc1)" 32:51.197 [INFO] Agent1.server: New leader elected: payload=Node-d9f3d23b-bfde-515d-8446-6415a9580675 32:51.197 [ERROR] Agent1.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-d9f3d23b-bfde-515d-8446-6415a9580675 other=Node-daa82dd6-56d4-0bbd-9f53-badbdf966324 32:51.197 [INFO] Agent1.server: member joined, marking health alive: member=Node-d9f3d23b-bfde-515d-8446-6415a9580675 32:51.199 [DEBUG] Agent1.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 127.0.0.1:19215 32:51.206 [INFO] Agent1.server.serf.wan: serf: EventMemberJoin: Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 127.0.0.1 32:51.206 [DEBUG] Agent1.server: Successfully performed flood-join for server at address: server=Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 address=127.0.0.1:19215 32:51.206 [INFO] Agent1.server: Handled event for server in area: event=member-join server=Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 area=wan 32:51.388 [DEBUG] Agent1: Skipping remote check since it is managed automatically: check=serfHealth 32:51.388 [DEBUG] Agent1: Node info in sync 32:51.716 [INFO] Agent1: Force leaving node: node=Node-d9f3d23b-bfde-515d-8446-6415a9580675 32:52.008 [DEBUG] Agent1.server.memberlist.lan: memberlist: Failed ping: Node-d9f3d23b-bfde-515d-8446-6415a9580675 (timeout reached) 32:52.500 [INFO] Agent1.server.memberlist.lan: memberlist: Suspect Node-d9f3d23b-bfde-515d-8446-6415a9580675 has failed, no acks received 32:54.002 [DEBUG] Agent1.server.memberlist.lan: memberlist: Failed ping: Node-d9f3d23b-bfde-515d-8446-6415a9580675 (timeout reached) 32:55.500 [INFO] Agent1.server.memberlist.lan: memberlist: Suspect Node-d9f3d23b-bfde-515d-8446-6415a9580675 has failed, no acks received 32:56.504 [INFO] Agent1.server.memberlist.lan: memberlist: Marking Node-d9f3d23b-bfde-515d-8446-6415a9580675 as failed, suspect timeout reached (0 peer confirmations) 32:57.000 [DEBUG] Agent1.server.memberlist.lan: memberlist: Failed ping: Node-d9f3d23b-bfde-515d-8446-6415a9580675 (timeout reached) 32:58.504 [DEBUG] Agent1.server.memberlist.wan: memberlist: Failed ping: Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 (timeout reached) 32:59.720 [INFO] Agent1.server.serf.lan: serf: EventMemberReap (forced): Node-d9f3d23b-bfde-515d-8446-6415a9580675 127.0.0.1 32:59.720 [INFO] Agent1.server: Removing LAN server: server="Node-d9f3d23b-bfde-515d-8446-6415a9580675 (Addr: tcp/127.0.0.1:19216) (DC: dc1)" 32:59.720 [INFO] Agent1.server: deregistering member: member=Node-d9f3d23b-bfde-515d-8446-6415a9580675 reason=reaped 32:59.724 [DEBUG] Agent1: Skipping remote check since it is managed automatically: check=serfHealth 32:59.724 [DEBUG] Agent1: Node info in sync 32:59.725 [INFO] Agent1.server.memberlist.lan: memberlist: Suspect Node-d9f3d23b-bfde-515d-8446-6415a9580675 has failed, no acks received 33:00.501 [INFO] Agent1.server.memberlist.wan: memberlist: Suspect Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 has failed, no acks received 33:07.724 [INFO] Agent1.server.serf.wan: serf: EventMemberReap (forced): Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 127.0.0.1 33:07.724 [DEBUG] Agent1.http: Request finished: method=PUT url=/v1/agent/force-leave/Node-d9f3d23b-bfde-515d-8446-6415a9580675?prune=1 from=127.0.0.1:50632 latency=16.007566534s 33:07.724 [INFO] Agent1.server: Handled event for server in area: event=member-reap server=Node-d9f3d23b-bfde-515d-8446-6415a9580675.dc1 area=wan 33:07.724 [INFO] Agent1: Requesting shutdown 33:07.724 [INFO] Agent1.server: shutting down server 33:07.724 [DEBUG] Agent1.leader: stopping routine: routine="federation state anti-entropy" 33:07.724 [DEBUG] Agent1.leader: stopping routine: routine="federation state pruning" 33:07.724 [DEBUG] Agent1.leader: stopping routine: routine="intermediate cert renew watch" 33:07.724 [DEBUG] Agent1.leader: stopping routine: routine="CA root pruning" 33:07.724 [WARN] Agent1.server.serf.lan: serf: Shutdown without a Leave 33:07.724 [ERROR] Agent1.server: error performing anti-entropy sync of federation state: error="context canceled" 33:07.724 [DEBUG] Agent1.leader: stopped routine: routine="federation state anti-entropy" 33:07.724 [DEBUG] Agent1.leader: stopped routine: routine="federation state pruning" 33:07.724 [DEBUG] Agent1.leader: stopped routine: routine="intermediate cert renew watch" 33:07.724 [DEBUG] Agent1.leader: stopped routine: routine="CA root pruning" 33:07.726 [WARN] Agent1.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:07.727Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:07.727Z [INFO] agent.router.manager: shutting down 33:07.728 [INFO] Agent1: consul server down 33:07.728 [INFO] Agent1: shutdown complete 33:07.728 [INFO] Agent1: Stopping server: protocol=DNS address=127.0.0.1:19190 network=tcp 33:07.728 [INFO] Agent1: Stopping server: protocol=DNS address=127.0.0.1:19190 network=udp 33:07.728 [INFO] Agent1: Stopping server: protocol=HTTP address=127.0.0.1:19191 network=tcp 33:08.232 [INFO] Agent1: Waiting for endpoints to shut down 33:08.232 [INFO] Agent1: Endpoints down --- PASS: TestForceLeaveCommand_prune (17.99s) PASS ok github.com/hashicorp/consul/command/forceleave 18.132s ? github.com/hashicorp/consul/command/helpers [no test files] === RUN TestInfoCommand_noTabs === PAUSE TestInfoCommand_noTabs === RUN TestInfoCommand === PAUSE TestInfoCommand === CONT TestInfoCommand_noTabs --- PASS: TestInfoCommand_noTabs (0.00s) === CONT TestInfoCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:51.615Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:51.648Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:51.719 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:00d6b490-3eb2-a74e-5634-ee8ab24192f0 Address:127.0.0.1:16132}]" 32:51.720 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:16132 [Follower]" leader= 32:51.721 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-00d6b490-3eb2-a74e-5634-ee8ab24192f0.dc1 127.0.0.1 32:51.721 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-00d6b490-3eb2-a74e-5634-ee8ab24192f0 127.0.0.1 2021-10-05T16:32:51.721Z [INFO] agent.router: Initializing LAN area manager 32:51.722 [INFO] TestAgent: Started DNS server: address=127.0.0.1:16127 network=udp 32:51.722 [INFO] TestAgent.server: Adding LAN server: server="Node-00d6b490-3eb2-a74e-5634-ee8ab24192f0 (Addr: tcp/127.0.0.1:16132) (DC: dc1)" 32:51.722 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-00d6b490-3eb2-a74e-5634-ee8ab24192f0.dc1 area=wan 32:51.722 [INFO] TestAgent: Started DNS server: address=127.0.0.1:16127 network=tcp 32:51.723 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:16128 network=tcp 32:51.723 [INFO] TestAgent: started state syncer 32:51.723 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:16133 network=tcp 32:51.777 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:51.777 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:16132 [Candidate]" term=2 32:51.791 [DEBUG] TestAgent.server.raft: votes: needed=1 32:51.792 [DEBUG] TestAgent.server.raft: vote granted: from=00d6b490-3eb2-a74e-5634-ee8ab24192f0 term=2 tally=1 32:51.792 [INFO] TestAgent.server.raft: election won: tally=1 32:51.792 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:16132 [Leader]" 32:51.792 [INFO] TestAgent.server: cluster leadership acquired 32:51.792 [INFO] TestAgent.server: New leader elected: payload=Node-00d6b490-3eb2-a74e-5634-ee8ab24192f0 32:51.798 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:16132 32:51.858 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:51.891 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:51.891 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:51.891 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:51.891 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:51.891 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:51.891 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-00d6b490-3eb2-a74e-5634-ee8ab24192f0 32:51.891 [INFO] TestAgent.server: member joined, marking health alive: member=Node-00d6b490-3eb2-a74e-5634-ee8ab24192f0 32:51.920 [INFO] TestAgent.server: federation state anti-entropy synced 32:52.072 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:52.088 [INFO] TestAgent: Synced node info 32:52.088 [DEBUG] TestAgent: Node info in sync 32:52.102 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:48768 latency=1.603993ms 32:52.108 [INFO] TestAgent: Requesting shutdown 32:52.108 [INFO] TestAgent.server: shutting down server 32:52.108 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:52.108 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:52.108 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:52.108 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:52.108 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:52.108 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:52.108 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:52.109 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:52.109 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:52.109 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:52.122 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:52.122Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:52.122Z [INFO] agent.router.manager: shutting down 32:52.122 [INFO] TestAgent: consul server down 32:52.122 [INFO] TestAgent: shutdown complete 32:52.122 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:16127 network=tcp 32:52.123 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:16127 network=udp 32:52.123 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:16128 network=tcp 32:52.624 [INFO] TestAgent: Waiting for endpoints to shut down 32:52.624 [INFO] TestAgent: Endpoints down --- PASS: TestInfoCommand (1.07s) PASS ok github.com/hashicorp/consul/command/info 1.306s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/intention 0.060s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === RUN TestCommand_Validation === PAUSE TestCommand_Validation === RUN TestCommand === PAUSE TestCommand === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) === CONT TestCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCommand_Validation === RUN TestCommand_Validation/0_args === RUN TestCommand_Validation/1_args === RUN TestCommand_Validation/3_args --- PASS: TestCommand_Validation (0.00s) --- PASS: TestCommand_Validation/0_args (0.00s) --- PASS: TestCommand_Validation/1_args (0.00s) --- PASS: TestCommand_Validation/3_args (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:53.288Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:53.314Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:53.346 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:70efa02f-8f28-fbc7-31e9-5eef978d7f65 Address:127.0.0.1:10006}]" 32:53.347 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-70efa02f-8f28-fbc7-31e9-5eef978d7f65.dc1 127.0.0.1 32:53.347 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-70efa02f-8f28-fbc7-31e9-5eef978d7f65 127.0.0.1 2021-10-05T16:32:53.348Z [INFO] agent.router: Initializing LAN area manager 32:53.348 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:10006 [Follower]" leader= 32:53.348 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10001 network=udp 32:53.348 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-70efa02f-8f28-fbc7-31e9-5eef978d7f65.dc1 area=wan 32:53.348 [INFO] TestAgent: Started DNS server: address=127.0.0.1:10001 network=tcp 32:53.348 [INFO] TestAgent.server: Adding LAN server: server="Node-70efa02f-8f28-fbc7-31e9-5eef978d7f65 (Addr: tcp/127.0.0.1:10006) (DC: dc1)" 32:53.349 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:10002 network=tcp 32:53.349 [INFO] TestAgent: started state syncer 32:53.349 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:10007 network=tcp 32:53.402 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:53.402 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:10006 [Candidate]" term=2 32:53.411 [DEBUG] TestAgent.server.raft: votes: needed=1 32:53.411 [DEBUG] TestAgent.server.raft: vote granted: from=70efa02f-8f28-fbc7-31e9-5eef978d7f65 term=2 tally=1 32:53.411 [INFO] TestAgent.server.raft: election won: tally=1 32:53.411 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:10006 [Leader]" 32:53.412 [INFO] TestAgent.server: cluster leadership acquired 32:53.412 [INFO] TestAgent.server: New leader elected: payload=Node-70efa02f-8f28-fbc7-31e9-5eef978d7f65 32:53.419 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:10006 32:53.442 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:53.500 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:53.500 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:53.500 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:53.500 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:53.500 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:53.500 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-70efa02f-8f28-fbc7-31e9-5eef978d7f65 32:53.500 [INFO] TestAgent.server: member joined, marking health alive: member=Node-70efa02f-8f28-fbc7-31e9-5eef978d7f65 32:53.513 [INFO] TestAgent.server: federation state anti-entropy synced 32:53.747 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:53.764 [INFO] TestAgent: Synced node info 32:53.764 [DEBUG] TestAgent: Node info in sync 32:53.797 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:49690 latency=21.057406ms 32:53.829 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/check?destination=db&source=foo&source-type=consul from=127.0.0.1:49692 latency=512.045µs 32:53.830 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/check?destination=db&source=web&source-type=consul from=127.0.0.1:49694 latency=431.632µs 32:53.832 [INFO] TestAgent: Requesting shutdown 32:53.832 [INFO] TestAgent.server: shutting down server 32:53.832 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:53.832 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:53.832 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:53.832 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:53.832 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:53.832 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:53.832 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:53.832 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:53.832 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:53.832 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:53.839 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:53.844Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:53.844Z [INFO] agent.router.manager: shutting down 32:53.844 [INFO] TestAgent: consul server down 32:53.844 [INFO] TestAgent: shutdown complete 32:53.844 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10001 network=tcp 32:53.844 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:10001 network=udp 32:53.844 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:10002 network=tcp 32:54.348 [INFO] TestAgent: Waiting for endpoints to shut down 32:54.348 [INFO] TestAgent: Endpoints down --- PASS: TestCommand (1.13s) PASS ok github.com/hashicorp/consul/command/intention/check 1.300s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === RUN TestCommand_Validation === PAUSE TestCommand_Validation === RUN TestCommand === PAUSE TestCommand === RUN TestCommand_deny === PAUSE TestCommand_deny === RUN TestCommand_meta === PAUSE TestCommand_meta === RUN TestCommand_File === PAUSE TestCommand_File === RUN TestCommand_FileNoExist === PAUSE TestCommand_FileNoExist === RUN TestCommand_replace === PAUSE TestCommand_replace === CONT TestCommand_noTabs === CONT TestCommand_deny === CONT TestCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestCommand_noTabs (0.00s) === CONT TestCommand_FileNoExist === CONT TestCommand_File === CONT TestCommand_Validation === RUN TestCommand_Validation/-allow_and_-deny === CONT TestCommand_replace === CONT TestCommand_meta --- PASS: TestCommand_Validation (0.00s) --- PASS: TestCommand_Validation/-allow_and_-deny (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:32:54.724Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:54.808Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:54.887 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8f41510b-775e-1a5c-8eb5-8e5554c12c8b Address:127.0.0.1:17160}]" 32:54.887 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17160 [Follower]" leader= 32:54.888 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8f41510b-775e-1a5c-8eb5-8e5554c12c8b.dc1 127.0.0.1 32:54.888 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8f41510b-775e-1a5c-8eb5-8e5554c12c8b 127.0.0.1 2021-10-05T16:32:54.889Z [INFO] agent.router: Initializing LAN area manager 32:54.889 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8f41510b-775e-1a5c-8eb5-8e5554c12c8b.dc1 area=wan 32:54.889 [INFO] TestAgent.server: Adding LAN server: server="Node-8f41510b-775e-1a5c-8eb5-8e5554c12c8b (Addr: tcp/127.0.0.1:17160) (DC: dc1)" 32:54.889 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17155 network=udp 32:54.889 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17155 network=tcp 32:54.890 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17156 network=tcp 32:54.890 [INFO] TestAgent: started state syncer 32:54.890 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17161 network=tcp 32:54.958 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:54.958 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17160 [Candidate]" term=2 32:54.972 [DEBUG] TestAgent.server.raft: votes: needed=1 32:54.972 [DEBUG] TestAgent.server.raft: vote granted: from=8f41510b-775e-1a5c-8eb5-8e5554c12c8b term=2 tally=1 32:54.972 [INFO] TestAgent.server.raft: election won: tally=1 32:54.972 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17160 [Leader]" 32:54.972 [INFO] TestAgent.server: cluster leadership acquired 32:54.972 [INFO] TestAgent.server: New leader elected: payload=Node-8f41510b-775e-1a5c-8eb5-8e5554c12c8b 32:54.982 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17160 32:55.002 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:55.007 [INFO] TestAgent: Requesting shutdown 32:55.008 [INFO] TestAgent.server: shutting down server 32:55.008 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:55.008 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:55.014 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:55.015Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:55.015Z [INFO] agent.router.manager: shutting down 32:55.019 [INFO] TestAgent: consul server down 32:55.019 [INFO] TestAgent: shutdown complete 32:55.019 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17155 network=tcp 32:55.019 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17155 network=udp 32:55.019 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17156 network=tcp 32:55.019 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 32:55.019 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 32:55.520 [INFO] TestAgent: Waiting for endpoints to shut down 32:55.520 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_FileNoExist (1.05s) 2021-10-05T16:32:54.758Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:54.815Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:54.936 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:fba2629e-4620-0f13-0285-e2ff569f5b58 Address:127.0.0.1:17188}]" 32:54.937 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-fba2629e-4620-0f13-0285-e2ff569f5b58.dc1 127.0.0.1 32:54.938 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-fba2629e-4620-0f13-0285-e2ff569f5b58 127.0.0.1 2021-10-05T16:32:54.938Z [INFO] agent.router: Initializing LAN area manager 32:54.944 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17188 [Follower]" leader= 32:54.948 [INFO] TestAgent.server: Adding LAN server: server="Node-fba2629e-4620-0f13-0285-e2ff569f5b58 (Addr: tcp/127.0.0.1:17188) (DC: dc1)" 32:54.957 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-fba2629e-4620-0f13-0285-e2ff569f5b58.dc1 area=wan 32:54.957 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17183 network=tcp 32:54.958 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17183 network=udp 32:54.959 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17184 network=tcp 32:54.959 [INFO] TestAgent: started state syncer 32:54.959 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17189 network=tcp 32:54.981 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:54.981 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17188 [Candidate]" term=2 32:54.993 [DEBUG] TestAgent.server.raft: votes: needed=1 32:54.993 [DEBUG] TestAgent.server.raft: vote granted: from=fba2629e-4620-0f13-0285-e2ff569f5b58 term=2 tally=1 32:54.993 [INFO] TestAgent.server.raft: election won: tally=1 32:54.993 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17188 [Leader]" 32:54.995 [INFO] TestAgent.server: cluster leadership acquired 32:54.995 [INFO] TestAgent.server: New leader elected: payload=Node-fba2629e-4620-0f13-0285-e2ff569f5b58 32:55.007 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17188 32:55.034 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:55.065 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:59484 latency=8.124128ms 32:55.068 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:59486 latency=1.194714ms 32:55.069 [INFO] TestAgent: Requesting shutdown 32:55.069 [INFO] TestAgent.server: shutting down server 32:55.069 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:55.069 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 32:55.076 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:55.084Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:55.084Z [INFO] agent.router.manager: shutting down 32:55.092 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 32:55.096 [INFO] TestAgent: consul server down 32:55.096 [INFO] TestAgent: shutdown complete 32:55.096 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17183 network=tcp 32:55.096 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17183 network=udp 32:55.096 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17184 network=tcp 32:55.604 [INFO] TestAgent: Waiting for endpoints to shut down 32:55.604 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_deny (1.13s) 2021-10-05T16:32:54.701Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:54.804Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:54.928 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:156f9021-0d7c-0027-4d08-4296c4dcd2bf Address:127.0.0.1:17174}]" 32:54.929 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-156f9021-0d7c-0027-4d08-4296c4dcd2bf.dc1 127.0.0.1 32:54.930 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17174 [Follower]" leader= 32:54.943 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-156f9021-0d7c-0027-4d08-4296c4dcd2bf 127.0.0.1 2021-10-05T16:32:54.943Z [INFO] agent.router: Initializing LAN area manager 32:54.956 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-156f9021-0d7c-0027-4d08-4296c4dcd2bf.dc1 area=wan 32:54.957 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17169 network=tcp 32:54.957 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17169 network=udp 32:54.958 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17170 network=tcp 32:54.958 [INFO] TestAgent: started state syncer 32:54.958 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17175 network=tcp 32:54.958 [INFO] TestAgent.server: Adding LAN server: server="Node-156f9021-0d7c-0027-4d08-4296c4dcd2bf (Addr: tcp/127.0.0.1:17174) (DC: dc1)" 32:54.999 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:54.999 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17174 [Candidate]" term=2 32:55.030 [DEBUG] TestAgent.server.raft: votes: needed=1 32:55.030 [DEBUG] TestAgent.server.raft: vote granted: from=156f9021-0d7c-0027-4d08-4296c4dcd2bf term=2 tally=1 32:55.030 [INFO] TestAgent.server.raft: election won: tally=1 32:55.030 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17174 [Leader]" 32:55.031 [INFO] TestAgent.server: cluster leadership acquired 32:55.031 [INFO] TestAgent.server: New leader elected: payload=Node-156f9021-0d7c-0027-4d08-4296c4dcd2bf 32:55.075 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:49576 latency=20.305743ms 32:55.075 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17174 32:55.085 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:49582 latency=6.917373ms 32:55.144 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:55.167 [ERROR] TestAgent.http: Request error: method=POST url=/v1/connect/intentions from=127.0.0.1:49584 error="duplicate intention found: ALLOW default/foo => default/bar (ID: 99dfa392-a0d2-1f0e-3f1a-05e204a5c3b3, Precedence: 9)" 32:55.170 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:49584 latency=38.533827ms 32:55.177 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:49586 latency=492.259µs 32:55.200 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:55.200 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:55.200 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:55.200 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:55.200 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:55.200 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-156f9021-0d7c-0027-4d08-4296c4dcd2bf 32:55.200 [INFO] TestAgent.server: member joined, marking health alive: member=Node-156f9021-0d7c-0027-4d08-4296c4dcd2bf 32:55.208 [INFO] TestAgent: Synced node info 32:55.209 [DEBUG] TestAgent: Node info in sync 32:55.209 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/connect/intentions/99dfa392-a0d2-1f0e-3f1a-05e204a5c3b3 from=127.0.0.1:49586 latency=24.931767ms 32:55.210 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:49582 latency=502.256µs 32:55.210 [INFO] TestAgent: Requesting shutdown 32:55.210 [INFO] TestAgent.server: shutting down server 32:55.210 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:55.210 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:55.210 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:55.210 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:55.210 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:55.210 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:55.210 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:55.210 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:55.211 [INFO] TestAgent.server: federation state anti-entropy synced 32:55.211 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:55.214 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:55.218Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:55.218Z [INFO] agent.router.manager: shutting down 32:55.218 [INFO] TestAgent: consul server down 32:55.218 [INFO] TestAgent: shutdown complete 32:55.218 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17169 network=tcp 32:55.218 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17169 network=udp 32:55.218 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17170 network=tcp 32:55.719 [INFO] TestAgent: Waiting for endpoints to shut down 32:55.719 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_replace (1.24s) 2021-10-05T16:32:54.669Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:54.728Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:54.891 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:903300e4-3f5f-9cf7-eea1-2664f699005e Address:127.0.0.1:17167}]" 32:54.891 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17167 [Follower]" leader= 32:54.892 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-903300e4-3f5f-9cf7-eea1-2664f699005e.dc1 127.0.0.1 32:54.928 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-903300e4-3f5f-9cf7-eea1-2664f699005e 127.0.0.1 2021-10-05T16:32:54.929Z [INFO] agent.router: Initializing LAN area manager 32:54.929 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17162 network=udp 32:54.929 [INFO] TestAgent.server: Adding LAN server: server="Node-903300e4-3f5f-9cf7-eea1-2664f699005e (Addr: tcp/127.0.0.1:17167) (DC: dc1)" 32:54.929 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-903300e4-3f5f-9cf7-eea1-2664f699005e.dc1 area=wan 32:54.943 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17162 network=tcp 32:54.944 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17163 network=tcp 32:54.944 [INFO] TestAgent: started state syncer 32:54.944 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17168 network=tcp 32:54.956 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:54.956 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17167 [Candidate]" term=2 32:54.970 [DEBUG] TestAgent.server.raft: votes: needed=1 32:54.970 [DEBUG] TestAgent.server.raft: vote granted: from=903300e4-3f5f-9cf7-eea1-2664f699005e term=2 tally=1 32:54.970 [INFO] TestAgent.server.raft: election won: tally=1 32:54.970 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17167 [Leader]" 32:54.972 [INFO] TestAgent.server: cluster leadership acquired 32:54.972 [INFO] TestAgent.server: New leader elected: payload=Node-903300e4-3f5f-9cf7-eea1-2664f699005e 32:54.980 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17167 32:55.016 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:55.070 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:55.070 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:55.070 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:55.070 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:55.070 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:55.071 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-903300e4-3f5f-9cf7-eea1-2664f699005e 32:55.071 [INFO] TestAgent.server: member joined, marking health alive: member=Node-903300e4-3f5f-9cf7-eea1-2664f699005e 32:55.097 [INFO] TestAgent.server: federation state anti-entropy synced 32:55.296 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:55.311 [INFO] TestAgent: Synced node info 32:55.311 [DEBUG] TestAgent: Node info in sync 32:55.322 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:40684 latency=20.81185ms 32:55.323 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:40690 latency=260.943µs 32:55.324 [INFO] TestAgent: Requesting shutdown 32:55.324 [INFO] TestAgent.server: shutting down server 32:55.324 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:55.324 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:55.324 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:55.324 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:55.324 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:55.324 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:55.324 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:55.324 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:55.324 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:55.324 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:55.329 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:55.330Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:55.330Z [INFO] agent.router.manager: shutting down 32:55.330 [INFO] TestAgent: consul server down 32:55.330 [INFO] TestAgent: shutdown complete 32:55.330 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17162 network=tcp 32:55.330 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17162 network=udp 32:55.330 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17163 network=tcp 32:55.830 [INFO] TestAgent: Waiting for endpoints to shut down 32:55.830 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_File (1.35s) 2021-10-05T16:32:54.741Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:54.806Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:54.942 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ad29110c-7010-bf18-5d3a-041c4123be18 Address:127.0.0.1:17181}]" 32:54.943 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ad29110c-7010-bf18-5d3a-041c4123be18.dc1 127.0.0.1 32:54.944 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ad29110c-7010-bf18-5d3a-041c4123be18 127.0.0.1 2021-10-05T16:32:54.944Z [INFO] agent.router: Initializing LAN area manager 32:54.944 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17176 network=udp 32:54.944 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17176 network=tcp 32:54.950 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17181 [Follower]" leader= 32:54.957 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ad29110c-7010-bf18-5d3a-041c4123be18.dc1 area=wan 32:54.957 [INFO] TestAgent.server: Adding LAN server: server="Node-ad29110c-7010-bf18-5d3a-041c4123be18 (Addr: tcp/127.0.0.1:17181) (DC: dc1)" 32:54.958 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17177 network=tcp 32:54.958 [INFO] TestAgent: started state syncer 32:54.958 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17182 network=tcp 32:55.017 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:55.017 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17181 [Candidate]" term=2 32:55.065 [DEBUG] TestAgent.server.raft: votes: needed=1 32:55.065 [DEBUG] TestAgent.server.raft: vote granted: from=ad29110c-7010-bf18-5d3a-041c4123be18 term=2 tally=1 32:55.065 [INFO] TestAgent.server.raft: election won: tally=1 32:55.065 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17181 [Leader]" 32:55.065 [INFO] TestAgent.server: cluster leadership acquired 32:55.065 [INFO] TestAgent.server: New leader elected: payload=Node-ad29110c-7010-bf18-5d3a-041c4123be18 32:55.090 [INFO] TestAgent: Synced node info 32:55.090 [DEBUG] TestAgent: Node info in sync 32:55.090 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17181 32:55.160 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:55.185 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:55.185 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:55.185 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:55.185 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:55.185 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:55.185 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ad29110c-7010-bf18-5d3a-041c4123be18 32:55.185 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ad29110c-7010-bf18-5d3a-041c4123be18 32:55.200 [INFO] TestAgent.server: federation state anti-entropy synced 32:55.319 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:45790 latency=9.791232ms 32:55.320 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:45792 latency=298.205µs 32:55.320 [INFO] TestAgent: Requesting shutdown 32:55.320 [INFO] TestAgent.server: shutting down server 32:55.320 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:55.320 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:55.320 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:55.320 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:55.320 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:55.320 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:55.320 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:55.321 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:55.321 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:55.321 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:55.328 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:55.332Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:55.332Z [INFO] agent.router.manager: shutting down 32:55.332 [INFO] TestAgent: consul server down 32:55.332 [INFO] TestAgent: shutdown complete 32:55.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17176 network=tcp 32:55.332 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17176 network=udp 32:55.332 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17177 network=tcp 32:55.833 [INFO] TestAgent: Waiting for endpoints to shut down 32:55.833 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_meta (1.35s) 2021-10-05T16:32:54.613Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:32:54.707Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 32:54.928 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cd3df830-ee9e-15fc-0c7f-619fb238e16f Address:127.0.0.1:17153}]" 32:54.929 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cd3df830-ee9e-15fc-0c7f-619fb238e16f.dc1 127.0.0.1 32:54.929 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cd3df830-ee9e-15fc-0c7f-619fb238e16f 127.0.0.1 2021-10-05T16:32:54.929Z [INFO] agent.router: Initializing LAN area manager 32:54.929 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17153 [Follower]" leader= 32:54.930 [INFO] TestAgent.server: Adding LAN server: server="Node-cd3df830-ee9e-15fc-0c7f-619fb238e16f (Addr: tcp/127.0.0.1:17153) (DC: dc1)" 32:54.930 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cd3df830-ee9e-15fc-0c7f-619fb238e16f.dc1 area=wan 32:54.940 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17148 network=udp 32:54.940 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17148 network=tcp 32:54.941 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17149 network=tcp 32:54.942 [INFO] TestAgent: started state syncer 32:54.942 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17154 network=tcp 32:54.985 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 32:54.985 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17153 [Candidate]" term=2 32:55.000 [DEBUG] TestAgent.server.raft: votes: needed=1 32:55.000 [DEBUG] TestAgent.server.raft: vote granted: from=cd3df830-ee9e-15fc-0c7f-619fb238e16f term=2 tally=1 32:55.000 [INFO] TestAgent.server.raft: election won: tally=1 32:55.000 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17153 [Leader]" 32:55.004 [INFO] TestAgent.server: cluster leadership acquired 32:55.004 [INFO] TestAgent.server: New leader elected: payload=Node-cd3df830-ee9e-15fc-0c7f-619fb238e16f 32:55.014 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17153 32:55.044 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 32:55.095 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 32:55.096 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 32:55.096 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 32:55.096 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 32:55.096 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 32:55.096 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cd3df830-ee9e-15fc-0c7f-619fb238e16f 32:55.096 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cd3df830-ee9e-15fc-0c7f-619fb238e16f 32:55.126 [INFO] TestAgent.server: federation state anti-entropy synced 32:55.328 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:55.344 [INFO] TestAgent: Synced node info 32:55.380 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 32:55.380 [DEBUG] TestAgent: Node info in sync 32:55.380 [DEBUG] TestAgent: Node info in sync 32:55.396 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:47400 latency=23.418708ms 32:55.404 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:47402 latency=316.423µs 32:55.405 [INFO] TestAgent: Requesting shutdown 32:55.405 [INFO] TestAgent.server: shutting down server 32:55.405 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 32:55.405 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 32:55.405 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 32:55.405 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 32:55.405 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 32:55.405 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 32:55.405 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 32:55.405 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 32:55.405 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 32:55.405 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 32:55.416 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:32:55.424Z [INFO] agent.router.manager: shutting down 2021-10-05T16:32:55.424Z [INFO] agent.router.manager: shutting down 32:55.424 [INFO] TestAgent: consul server down 32:55.424 [INFO] TestAgent: shutdown complete 32:55.424 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17148 network=tcp 32:55.424 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17148 network=udp 32:55.424 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17149 network=tcp 32:55.928 [INFO] TestAgent: Waiting for endpoints to shut down 32:55.928 [INFO] TestAgent: Endpoints down --- PASS: TestCommand (1.45s) PASS ok github.com/hashicorp/consul/command/intention/create 1.562s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === RUN TestCommand_Validation === PAUSE TestCommand_Validation === RUN TestCommand === PAUSE TestCommand === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) === CONT TestCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCommand_Validation === RUN TestCommand_Validation/3_args === RUN TestCommand_Validation/0_args [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range --- PASS: TestCommand_Validation (0.01s) --- PASS: TestCommand_Validation/3_args (0.00s) --- PASS: TestCommand_Validation/0_args (0.00s) 2021-10-05T16:33:03.727Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:03.750Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:03.811 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:707552f4-5307-2b5a-0dad-abaf06ee3684 Address:127.0.0.1:25321}]" 33:03.812 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-707552f4-5307-2b5a-0dad-abaf06ee3684.dc1 127.0.0.1 33:03.813 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-707552f4-5307-2b5a-0dad-abaf06ee3684 127.0.0.1 2021-10-05T16:33:03.813Z [INFO] agent.router: Initializing LAN area manager 33:03.813 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=udp 33:03.814 [INFO] TestAgent.server: Adding LAN server: server="Node-707552f4-5307-2b5a-0dad-abaf06ee3684 (Addr: tcp/127.0.0.1:25321) (DC: dc1)" 33:03.814 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-707552f4-5307-2b5a-0dad-abaf06ee3684.dc1 area=wan 33:03.814 [INFO] TestAgent: Started DNS server: address=127.0.0.1:25316 network=tcp 33:03.814 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:25317 network=tcp 33:03.815 [INFO] TestAgent: started state syncer 33:03.815 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:25322 network=tcp 33:03.815 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:25321 [Follower]" leader= 33:03.860 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:03.860 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:25321 [Candidate]" term=2 33:03.872 [DEBUG] TestAgent.server.raft: votes: needed=1 33:03.872 [DEBUG] TestAgent.server.raft: vote granted: from=707552f4-5307-2b5a-0dad-abaf06ee3684 term=2 tally=1 33:03.872 [INFO] TestAgent.server.raft: election won: tally=1 33:03.872 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:25321 [Leader]" 33:03.873 [INFO] TestAgent.server: cluster leadership acquired 33:03.874 [INFO] TestAgent.server: New leader elected: payload=Node-707552f4-5307-2b5a-0dad-abaf06ee3684 33:03.881 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:25321 33:03.896 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:03.916 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:03.916 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:03.916 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:03.916 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:03.916 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:03.916 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-707552f4-5307-2b5a-0dad-abaf06ee3684 33:03.916 [INFO] TestAgent.server: member joined, marking health alive: member=Node-707552f4-5307-2b5a-0dad-abaf06ee3684 33:03.931 [INFO] TestAgent.server: federation state anti-entropy synced 33:04.068 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:55134 latency=11.215548ms 33:04.075 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:55136 latency=686.707µs 33:04.081 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/connect/intentions/63bfeb5d-73b1-8da1-3655-2b23eaae7b62 from=127.0.0.1:55136 latency=5.362846ms 33:04.082 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:55134 latency=187.776µs 33:04.082 [INFO] TestAgent: Requesting shutdown 33:04.082 [INFO] TestAgent.server: shutting down server 33:04.082 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:04.082 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:04.082 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:04.082 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:04.082 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:04.083 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:04.083 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:04.083 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:04.083 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:04.083 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:04.083 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:04.088 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:04.091Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:04.091Z [INFO] agent.router.manager: shutting down 33:04.091 [INFO] TestAgent: consul server down 33:04.091 [INFO] TestAgent: shutdown complete 33:04.091 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=tcp 33:04.091 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:25316 network=udp 33:04.092 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:25317 network=tcp 33:04.592 [INFO] TestAgent: Waiting for endpoints to shut down 33:04.592 [INFO] TestAgent: Endpoints down --- PASS: TestCommand (0.94s) PASS ok github.com/hashicorp/consul/command/intention/delete 1.135s === RUN TestFinder === PAUSE TestFinder === CONT TestFinder [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:04.154Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:04.168Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:04.199 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5ce5b782-64d8-fb9c-2fbc-ec01d05b150c Address:127.0.0.1:23279}]" 33:04.200 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5ce5b782-64d8-fb9c-2fbc-ec01d05b150c.dc1 127.0.0.1 33:04.200 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5ce5b782-64d8-fb9c-2fbc-ec01d05b150c 127.0.0.1 2021-10-05T16:33:04.200Z [INFO] agent.router: Initializing LAN area manager 33:04.201 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=udp 33:04.201 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23279 [Follower]" leader= 33:04.201 [INFO] TestAgent.server: Adding LAN server: server="Node-5ce5b782-64d8-fb9c-2fbc-ec01d05b150c (Addr: tcp/127.0.0.1:23279) (DC: dc1)" 33:04.201 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5ce5b782-64d8-fb9c-2fbc-ec01d05b150c.dc1 area=wan 33:04.202 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=tcp 33:04.211 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23275 network=tcp 33:04.211 [INFO] TestAgent: started state syncer 33:04.211 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23280 network=tcp 33:04.245 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:04.245 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23279 [Candidate]" term=2 33:04.255 [DEBUG] TestAgent.server.raft: votes: needed=1 33:04.255 [DEBUG] TestAgent.server.raft: vote granted: from=5ce5b782-64d8-fb9c-2fbc-ec01d05b150c term=2 tally=1 33:04.255 [INFO] TestAgent.server.raft: election won: tally=1 33:04.255 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23279 [Leader]" 33:04.255 [INFO] TestAgent.server: cluster leadership acquired 33:04.255 [INFO] TestAgent.server: New leader elected: payload=Node-5ce5b782-64d8-fb9c-2fbc-ec01d05b150c 33:04.265 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23279 33:04.283 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:04.304 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:04.304 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:04.304 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:04.304 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:04.304 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:04.304 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5ce5b782-64d8-fb9c-2fbc-ec01d05b150c 33:04.304 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5ce5b782-64d8-fb9c-2fbc-ec01d05b150c 33:04.314 [INFO] TestAgent.server: federation state anti-entropy synced 33:04.596 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:04.605 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:36914 latency=20.431369ms 33:04.606 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:36914 latency=337.544µs 33:04.606 [INFO] TestAgent: Requesting shutdown 33:04.606 [INFO] TestAgent.server: shutting down server 33:04.606 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:04.606 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:04.606 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:04.606 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:04.606 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:04.606 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:04.607 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:04.607 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:04.607 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:04.607 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:04.610 [INFO] TestAgent: Synced node info 33:04.610 [DEBUG] TestAgent: Node info in sync 33:04.612 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:04.618Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:04.618Z [INFO] agent.router.manager: shutting down 33:04.618 [INFO] TestAgent: consul server down 33:04.618 [INFO] TestAgent: shutdown complete 33:04.618 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=tcp 33:04.618 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=udp 33:04.618 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23275 network=tcp 33:05.120 [INFO] TestAgent: Waiting for endpoints to shut down 33:05.120 [INFO] TestAgent: Endpoints down --- PASS: TestFinder (1.07s) PASS ok github.com/hashicorp/consul/command/intention/finder 1.182s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === RUN TestCommand_Validation === PAUSE TestCommand_Validation === RUN TestCommand_id === PAUSE TestCommand_id === RUN TestCommand_srcDst === PAUSE TestCommand_srcDst === RUN TestCommand_verticalBar === PAUSE TestCommand_verticalBar === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) === CONT TestCommand_verticalBar [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCommand_id === CONT TestCommand_Validation === CONT TestCommand_srcDst === RUN TestCommand_Validation/0_args === RUN TestCommand_Validation/3_args --- PASS: TestCommand_Validation (0.00s) --- PASS: TestCommand_Validation/0_args (0.00s) --- PASS: TestCommand_Validation/3_args (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:06.297Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:06.354Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:06.398 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2a43f8d5-6964-8d52-56a1-13feeb076fb4 Address:127.0.0.1:31447}]" 33:06.398 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2a43f8d5-6964-8d52-56a1-13feeb076fb4.dc1 127.0.0.1 33:06.399 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2a43f8d5-6964-8d52-56a1-13feeb076fb4 127.0.0.1 2021-10-05T16:33:06.399Z [INFO] agent.router: Initializing LAN area manager 33:06.399 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31442 network=udp 33:06.399 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:31447 [Follower]" leader= 33:06.400 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2a43f8d5-6964-8d52-56a1-13feeb076fb4.dc1 area=wan 33:06.400 [INFO] TestAgent.server: Adding LAN server: server="Node-2a43f8d5-6964-8d52-56a1-13feeb076fb4 (Addr: tcp/127.0.0.1:31447) (DC: dc1)" 33:06.400 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31442 network=tcp 33:06.400 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:31443 network=tcp 33:06.400 [INFO] TestAgent: started state syncer 33:06.401 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:31448 network=tcp 33:06.448 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:06.448 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:31447 [Candidate]" term=2 33:06.490 [DEBUG] TestAgent.server.raft: votes: needed=1 33:06.490 [DEBUG] TestAgent.server.raft: vote granted: from=2a43f8d5-6964-8d52-56a1-13feeb076fb4 term=2 tally=1 33:06.490 [INFO] TestAgent.server.raft: election won: tally=1 33:06.490 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:31447 [Leader]" 33:06.490 [INFO] TestAgent.server: cluster leadership acquired 33:06.490 [INFO] TestAgent.server: New leader elected: payload=Node-2a43f8d5-6964-8d52-56a1-13feeb076fb4 33:06.502 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:31447 33:06.521 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:06.560 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:06.560 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:06.560 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:06.560 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:06.560 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:06.560 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2a43f8d5-6964-8d52-56a1-13feeb076fb4 33:06.560 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2a43f8d5-6964-8d52-56a1-13feeb076fb4 33:06.580 [INFO] TestAgent.server: federation state anti-entropy synced 33:06.585 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:06.591 [INFO] TestAgent: Synced node info 33:06.591 [DEBUG] TestAgent: Node info in sync 33:06.603 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:46324 latency=4.053101ms 33:06.606 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/aa9a21ca-fd36-5f2f-facf-1b4109c01b51 from=127.0.0.1:46326 latency=1.409328ms 33:06.613 [INFO] TestAgent: Requesting shutdown 33:06.613 [INFO] TestAgent.server: shutting down server 33:06.613 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:06.613 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:06.613 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:06.613 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:06.613 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:06.613 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:06.613 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:06.613 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:06.613 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:06.613 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:06.619 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:06.623Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:06.623Z [INFO] agent.router.manager: shutting down 33:06.624 [INFO] TestAgent: consul server down 33:06.624 [INFO] TestAgent: shutdown complete 33:06.624 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31442 network=tcp 33:06.624 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31442 network=udp 33:06.624 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:31443 network=tcp 33:07.128 [INFO] TestAgent: Waiting for endpoints to shut down 33:07.128 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_verticalBar (0.93s) 2021-10-05T16:33:06.306Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:06.371Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:06.416 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:08ce6db4-ed40-f653-566b-915a1df1414e Address:127.0.0.1:31461}]" 33:06.416 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-08ce6db4-ed40-f653-566b-915a1df1414e.dc1 127.0.0.1 33:06.417 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-08ce6db4-ed40-f653-566b-915a1df1414e 127.0.0.1 2021-10-05T16:33:06.417Z [INFO] agent.router: Initializing LAN area manager 33:06.417 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31456 network=udp 33:06.417 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:31461 [Follower]" leader= 33:06.428 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-08ce6db4-ed40-f653-566b-915a1df1414e.dc1 area=wan 33:06.428 [INFO] TestAgent.server: Adding LAN server: server="Node-08ce6db4-ed40-f653-566b-915a1df1414e (Addr: tcp/127.0.0.1:31461) (DC: dc1)" 33:06.452 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31456 network=tcp 33:06.460 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:31457 network=tcp 33:06.460 [INFO] TestAgent: started state syncer 33:06.460 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:31462 network=tcp 33:06.461 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:06.461 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:31461 [Candidate]" term=2 33:06.482 [DEBUG] TestAgent.server.raft: votes: needed=1 33:06.482 [DEBUG] TestAgent.server.raft: vote granted: from=08ce6db4-ed40-f653-566b-915a1df1414e term=2 tally=1 33:06.482 [INFO] TestAgent.server.raft: election won: tally=1 33:06.482 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:31461 [Leader]" 33:06.483 [INFO] TestAgent.server: cluster leadership acquired 33:06.483 [INFO] TestAgent.server: New leader elected: payload=Node-08ce6db4-ed40-f653-566b-915a1df1414e 33:06.497 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:31461 33:06.516 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:06.559 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:06.559 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:06.559 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:06.559 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:06.559 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:06.559 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-08ce6db4-ed40-f653-566b-915a1df1414e 33:06.560 [INFO] TestAgent.server: member joined, marking health alive: member=Node-08ce6db4-ed40-f653-566b-915a1df1414e 33:06.575 [INFO] TestAgent.server: federation state anti-entropy synced 33:06.680 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:49788 latency=5.141703ms 33:06.685 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions from=127.0.0.1:49790 latency=340.788µs 33:06.692 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/3ead9351-cc0d-8413-ccb7-85c03607ff2a from=127.0.0.1:49790 latency=233.945µs 33:06.696 [INFO] TestAgent: Requesting shutdown 33:06.696 [INFO] TestAgent.server: shutting down server 33:06.696 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:06.696 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:06.696 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:06.696 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:06.696 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:06.696 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:06.696 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:06.696 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:06.696 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:06.696 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:06.696 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:06.707 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:06.716Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:06.716Z [INFO] agent.router.manager: shutting down 33:06.716 [INFO] TestAgent: consul server down 33:06.716 [INFO] TestAgent: shutdown complete 33:06.716 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31456 network=tcp 33:06.716 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31456 network=udp 33:06.716 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:31457 network=tcp 33:07.220 [INFO] TestAgent: Waiting for endpoints to shut down 33:07.220 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_srcDst (1.02s) 2021-10-05T16:33:06.309Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:06.379Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:06.424 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5c6a5595-b156-6778-3929-a2e9b2fc090d Address:127.0.0.1:31454}]" 33:06.428 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:31454 [Follower]" leader= 33:06.452 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5c6a5595-b156-6778-3929-a2e9b2fc090d.dc1 127.0.0.1 33:06.460 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5c6a5595-b156-6778-3929-a2e9b2fc090d 127.0.0.1 2021-10-05T16:33:06.460Z [INFO] agent.router: Initializing LAN area manager 33:06.461 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31449 network=udp 33:06.461 [INFO] TestAgent.server: Adding LAN server: server="Node-5c6a5595-b156-6778-3929-a2e9b2fc090d (Addr: tcp/127.0.0.1:31454) (DC: dc1)" 33:06.461 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5c6a5595-b156-6778-3929-a2e9b2fc090d.dc1 area=wan 33:06.461 [INFO] TestAgent: Started DNS server: address=127.0.0.1:31449 network=tcp 33:06.461 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:31450 network=tcp 33:06.461 [INFO] TestAgent: started state syncer 33:06.461 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:31455 network=tcp 33:06.472 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:06.472 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:31454 [Candidate]" term=2 33:06.502 [DEBUG] TestAgent.server.raft: votes: needed=1 33:06.502 [DEBUG] TestAgent.server.raft: vote granted: from=5c6a5595-b156-6778-3929-a2e9b2fc090d term=2 tally=1 33:06.502 [INFO] TestAgent.server.raft: election won: tally=1 33:06.502 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:31454 [Leader]" 33:06.504 [INFO] TestAgent.server: cluster leadership acquired 33:06.504 [INFO] TestAgent.server: New leader elected: payload=Node-5c6a5595-b156-6778-3929-a2e9b2fc090d 33:06.515 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:31454 33:06.538 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:06.572 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:06.572 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:06.572 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:06.572 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:06.572 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:06.573 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5c6a5595-b156-6778-3929-a2e9b2fc090d 33:06.573 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5c6a5595-b156-6778-3929-a2e9b2fc090d 33:06.590 [INFO] TestAgent.server: federation state anti-entropy synced 33:06.808 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:46498 latency=8.777302ms 33:06.810 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/9f62fd09-64b6-cc40-af40-119d8c482378 from=127.0.0.1:46500 latency=264.345µs 33:06.810 [INFO] TestAgent: Requesting shutdown 33:06.810 [INFO] TestAgent.server: shutting down server 33:06.810 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:06.810 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:06.810 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:06.810 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:06.810 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:06.810 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:06.810 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:06.810 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:06.810 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:06.810 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:06.810 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:06.816 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:06.824Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:06.824Z [INFO] agent.router.manager: shutting down 33:06.824 [INFO] TestAgent: consul server down 33:06.824 [INFO] TestAgent: shutdown complete 33:06.824 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31449 network=tcp 33:06.824 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:31449 network=udp 33:06.824 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:31450 network=tcp 33:07.328 [INFO] TestAgent: Waiting for endpoints to shut down 33:07.328 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_id (1.13s) PASS ok github.com/hashicorp/consul/command/intention/get 1.235s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === RUN TestCommand_Validation === PAUSE TestCommand_Validation === RUN TestCommand_matchDst === PAUSE TestCommand_matchDst === RUN TestCommand_matchSource === PAUSE TestCommand_matchSource === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) === CONT TestCommand_matchSource [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCommand_matchDst === CONT TestCommand_Validation === RUN TestCommand_Validation/0_args === RUN TestCommand_Validation/3_args === RUN TestCommand_Validation/both_source_and_dest --- PASS: TestCommand_Validation (0.01s) --- PASS: TestCommand_Validation/0_args (0.00s) --- PASS: TestCommand_Validation/3_args (0.00s) --- PASS: TestCommand_Validation/both_source_and_dest (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:16.186Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:16.243Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:16.299 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:902e3671-8b7a-4e65-696f-9cf95e2ac89d Address:127.0.0.1:15118}]" 33:16.299 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15118 [Follower]" leader= 33:16.299 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-902e3671-8b7a-4e65-696f-9cf95e2ac89d.dc1 127.0.0.1 33:16.300 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-902e3671-8b7a-4e65-696f-9cf95e2ac89d 127.0.0.1 2021-10-05T16:33:16.300Z [INFO] agent.router: Initializing LAN area manager 33:16.301 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=udp 33:16.301 [INFO] TestAgent.server: Adding LAN server: server="Node-902e3671-8b7a-4e65-696f-9cf95e2ac89d (Addr: tcp/127.0.0.1:15118) (DC: dc1)" 33:16.301 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=tcp 33:16.301 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-902e3671-8b7a-4e65-696f-9cf95e2ac89d.dc1 area=wan 33:16.301 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15114 network=tcp 33:16.301 [INFO] TestAgent: started state syncer 33:16.302 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15119 network=tcp 33:16.360 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:16.360 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15118 [Candidate]" term=2 33:16.374 [DEBUG] TestAgent.server.raft: votes: needed=1 33:16.374 [DEBUG] TestAgent.server.raft: vote granted: from=902e3671-8b7a-4e65-696f-9cf95e2ac89d term=2 tally=1 33:16.374 [INFO] TestAgent.server.raft: election won: tally=1 33:16.374 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15118 [Leader]" 33:16.375 [INFO] TestAgent.server: cluster leadership acquired 33:16.375 [INFO] TestAgent.server: New leader elected: payload=Node-902e3671-8b7a-4e65-696f-9cf95e2ac89d 33:16.388 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15118 33:16.405 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:16.417 [INFO] TestAgent: Synced node info 33:16.420 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:38712 latency=8.230728ms 33:16.437 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:38712 latency=13.417019ms 33:16.437 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:16.437 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:16.437 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:16.437 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:16.437 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:16.437 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-902e3671-8b7a-4e65-696f-9cf95e2ac89d 33:16.438 [INFO] TestAgent.server: member joined, marking health alive: member=Node-902e3671-8b7a-4e65-696f-9cf95e2ac89d 33:16.445 [INFO] TestAgent.server: federation state anti-entropy synced 33:16.460 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:38712 latency=12.31934ms 33:16.463 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/match?by=destination&name=db from=127.0.0.1:38716 latency=989.285µs 33:16.463 [INFO] TestAgent: Requesting shutdown 33:16.463 [INFO] TestAgent.server: shutting down server 33:16.463 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:16.463 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:16.463 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:16.463 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:16.463 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:16.463 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:16.463 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:16.463 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:16.463 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:16.463 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:16.467 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:16.470Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:16.470Z [INFO] agent.router.manager: shutting down 33:16.470 [INFO] TestAgent: consul server down 33:16.470 [INFO] TestAgent: shutdown complete 33:16.470 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=tcp 33:16.470 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=udp 33:16.470 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15114 network=tcp 33:16.971 [INFO] TestAgent: Waiting for endpoints to shut down 33:16.971 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_matchDst (0.85s) 2021-10-05T16:33:16.215Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:16.231Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:16.263 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6075e30e-3897-d70e-5ed0-dc5b60219842 Address:127.0.0.1:15111}]" 33:16.264 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15111 [Follower]" leader= 33:16.264 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-6075e30e-3897-d70e-5ed0-dc5b60219842.dc1 127.0.0.1 33:16.265 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-6075e30e-3897-d70e-5ed0-dc5b60219842 127.0.0.1 2021-10-05T16:33:16.265Z [INFO] agent.router: Initializing LAN area manager 33:16.265 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=udp 33:16.265 [INFO] TestAgent.server: Adding LAN server: server="Node-6075e30e-3897-d70e-5ed0-dc5b60219842 (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 33:16.265 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-6075e30e-3897-d70e-5ed0-dc5b60219842.dc1 area=wan 33:16.265 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=tcp 33:16.266 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15107 network=tcp 33:16.266 [INFO] TestAgent: started state syncer 33:16.266 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15112 network=tcp 33:16.318 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:16.318 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15111 [Candidate]" term=2 33:16.331 [DEBUG] TestAgent.server.raft: votes: needed=1 33:16.331 [DEBUG] TestAgent.server.raft: vote granted: from=6075e30e-3897-d70e-5ed0-dc5b60219842 term=2 tally=1 33:16.331 [INFO] TestAgent.server.raft: election won: tally=1 33:16.331 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15111 [Leader]" 33:16.332 [INFO] TestAgent.server: cluster leadership acquired 33:16.332 [INFO] TestAgent.server: New leader elected: payload=Node-6075e30e-3897-d70e-5ed0-dc5b60219842 33:16.337 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15111 33:16.351 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:16.360 [INFO] TestAgent: Synced node info 33:16.360 [DEBUG] TestAgent: Node info in sync 33:16.385 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:16.385 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:16.385 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:16.385 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:16.385 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:16.385 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-6075e30e-3897-d70e-5ed0-dc5b60219842 33:16.385 [INFO] TestAgent.server: member joined, marking health alive: member=Node-6075e30e-3897-d70e-5ed0-dc5b60219842 33:16.402 [INFO] TestAgent.server: federation state anti-entropy synced 33:16.642 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:56710 latency=4.309488ms 33:16.649 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:56710 latency=6.528321ms 33:16.672 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:56710 latency=7.90288ms 33:16.683 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/connect/intentions/match?by=source&name=foo from=127.0.0.1:56712 latency=2.223201ms 33:16.684 [INFO] TestAgent: Requesting shutdown 33:16.684 [INFO] TestAgent.server: shutting down server 33:16.684 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:16.684 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:16.684 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:16.684 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:16.684 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:16.684 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:16.684 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:16.684 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:16.684 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:16.684 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:16.687 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:16.694Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:16.694Z [INFO] agent.router.manager: shutting down 33:16.694 [INFO] TestAgent: consul server down 33:16.694 [INFO] TestAgent: shutdown complete 33:16.694 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=tcp 33:16.694 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=udp 33:16.694 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15107 network=tcp 33:17.194 [INFO] TestAgent: Waiting for endpoints to shut down 33:17.194 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_matchSource (1.08s) PASS ok github.com/hashicorp/consul/command/intention/match 1.160s === RUN TestJoinCommand_noTabs === PAUSE TestJoinCommand_noTabs === RUN TestJoinCommandJoin_lan === PAUSE TestJoinCommandJoin_lan === RUN TestJoinCommand_wan === PAUSE TestJoinCommand_wan === RUN TestJoinCommand_noAddrs === PAUSE TestJoinCommand_noAddrs === CONT TestJoinCommand_noTabs --- PASS: TestJoinCommand_noTabs (0.00s) === CONT TestJoinCommand_noAddrs --- PASS: TestJoinCommand_noAddrs (0.00s) === CONT TestJoinCommand_wan [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestJoinCommandJoin_lan [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:16.870Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:16.883Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:16.919 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:84fa357a-2943-b6a3-f616-563e117d4fad Address:127.0.0.1:17174}]" 33:16.920 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17174 [Follower]" leader= 33:16.920 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-84fa357a-2943-b6a3-f616-563e117d4fad.dc1 127.0.0.1 33:16.921 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-84fa357a-2943-b6a3-f616-563e117d4fad 127.0.0.1 2021-10-05T16:33:16.921Z [INFO] agent.router: Initializing LAN area manager 33:16.921 [INFO] TestAgent.server: Adding LAN server: server="Node-84fa357a-2943-b6a3-f616-563e117d4fad (Addr: tcp/127.0.0.1:17174) (DC: dc1)" 33:16.921 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-84fa357a-2943-b6a3-f616-563e117d4fad.dc1 area=wan 33:16.921 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17169 network=tcp 33:16.921 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17169 network=udp 33:16.922 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17170 network=tcp 33:16.922 [INFO] TestAgent: started state syncer 33:16.922 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17175 network=tcp 33:16.989 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:16.989 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17174 [Candidate]" term=2 33:17.002 [DEBUG] TestAgent.server.raft: votes: needed=1 33:17.002 [DEBUG] TestAgent.server.raft: vote granted: from=84fa357a-2943-b6a3-f616-563e117d4fad term=2 tally=1 33:17.002 [INFO] TestAgent.server.raft: election won: tally=1 33:17.002 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17174 [Leader]" 33:17.004 [INFO] TestAgent.server: cluster leadership acquired 33:17.004 [INFO] TestAgent.server: New leader elected: payload=Node-84fa357a-2943-b6a3-f616-563e117d4fad 33:17.013 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17174 33:17.048 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:17.080 [INFO] TestAgent: Synced node info 33:17.080 [DEBUG] TestAgent: Node info in sync 33:17.112 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:17.112 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:17.112 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:17.112 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:17.112 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:17.112 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-84fa357a-2943-b6a3-f616-563e117d4fad 33:17.112 [INFO] TestAgent.server: member joined, marking health alive: member=Node-84fa357a-2943-b6a3-f616-563e117d4fad 33:17.125 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Stream connection from=127.0.0.1:45176 33:17.126 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 127.0.0.1 33:17.126 [INFO] TestAgent.server: Adding LAN server: server="Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 (Addr: tcp/127.0.0.1:17160) (DC: dc1)" 33:17.126 [INFO] TestAgent.server: New leader elected: payload=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 33:17.127 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12.dc1 127.0.0.1:17159 33:17.128 [INFO] TestAgent: Requesting shutdown 33:17.128 [INFO] TestAgent.server: shutting down server 33:17.128 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:17.128 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:17.128 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:17.128 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:17.128 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:17.128 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:17.128 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:17.128 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:17.141 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 other=Node-84fa357a-2943-b6a3-f616-563e117d4fad 33:17.141 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 33:17.142 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12.dc1 127.0.0.1 33:17.142 [DEBUG] TestAgent.server: Successfully performed flood-join for server at address: server=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12.dc1 address=127.0.0.1:17159 33:17.143 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12.dc1 area=wan 33:17.144 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 33:17.144 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:17.144 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:33:17.172Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:17.172Z [INFO] agent.router.manager: shutting down 33:17.188 [INFO] TestAgent: consul server down 33:17.188 [INFO] TestAgent: shutdown complete 33:17.188 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17169 network=tcp 33:17.188 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17169 network=udp 33:17.188 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17170 network=tcp 33:17.188 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 127.0.0.1 17158 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:5162f780-b159-6ff9-01d8-7b7a30a3cc12 port:17160 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:17159] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 33:17.692 [INFO] TestAgent: Waiting for endpoints to shut down 33:17.692 [INFO] TestAgent: Endpoints down 2021-10-05T16:33:16.470Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:16.488Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:16.528 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5162f780-b159-6ff9-01d8-7b7a30a3cc12 Address:127.0.0.1:17160}]" 33:16.529 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12.dc1 127.0.0.1 33:16.530 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 127.0.0.1 2021-10-05T16:33:16.530Z [INFO] agent.router: Initializing LAN area manager 33:16.530 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17155 network=udp 33:16.530 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17160 [Follower]" leader= 33:16.530 [INFO] TestAgent.server: Adding LAN server: server="Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 (Addr: tcp/127.0.0.1:17160) (DC: dc1)" 33:16.530 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12.dc1 area=wan 33:16.530 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17155 network=tcp 33:16.531 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17156 network=tcp 33:16.531 [INFO] TestAgent: started state syncer 33:16.531 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17161 network=tcp 33:16.580 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:16.580 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17160 [Candidate]" term=2 33:16.587 [DEBUG] TestAgent.server.raft: votes: needed=1 33:16.587 [DEBUG] TestAgent.server.raft: vote granted: from=5162f780-b159-6ff9-01d8-7b7a30a3cc12 term=2 tally=1 33:16.587 [INFO] TestAgent.server.raft: election won: tally=1 33:16.587 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17160 [Leader]" 33:16.588 [INFO] TestAgent.server: cluster leadership acquired 33:16.588 [INFO] TestAgent.server: New leader elected: payload=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 33:16.592 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17160 33:16.606 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:16.637 [INFO] TestAgent: Synced node info 33:16.665 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:16.665 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:16.665 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:16.665 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:16.665 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:16.665 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 33:16.665 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 33:16.684 [INFO] TestAgent.server: federation state anti-entropy synced 33:17.125 [INFO] TestAgent: (LAN) joining: lan_addresses=[127.0.0.1:17172] 33:17.125 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Initiating push/pull sync with: 127.0.0.1:17172 33:17.127 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:38308 33:17.127 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-84fa357a-2943-b6a3-f616-563e117d4fad 127.0.0.1 33:17.127 [INFO] TestAgent: (LAN) joined: number_of_nodes=1 33:17.127 [DEBUG] TestAgent: systemd notify failed: error="No socket" 33:17.127 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/join/127.0.0.1:17172 from=127.0.0.1:57334 latency=2.09233ms 33:17.127 [INFO] TestAgent.server: Adding LAN server: server="Node-84fa357a-2943-b6a3-f616-563e117d4fad (Addr: tcp/127.0.0.1:17174) (DC: dc1)" 33:17.127 [ERROR] TestAgent.server: Two nodes are in bootstrap mode. Only one node should be in bootstrap mode, not adding Raft peer.: node_to_add=Node-84fa357a-2943-b6a3-f616-563e117d4fad other=Node-5162f780-b159-6ff9-01d8-7b7a30a3cc12 33:17.127 [INFO] TestAgent.server: member joined, marking health alive: member=Node-84fa357a-2943-b6a3-f616-563e117d4fad 33:17.128 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-84fa357a-2943-b6a3-f616-563e117d4fad.dc1 127.0.0.1 33:17.128 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-84fa357a-2943-b6a3-f616-563e117d4fad.dc1 area=wan 33:17.471 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:17.471 [DEBUG] TestAgent: Node info in sync 33:17.471 [DEBUG] TestAgent: Node info in sync 33:17.692 [INFO] TestAgent: Requesting shutdown 33:17.692 [INFO] TestAgent.server: shutting down server 33:17.692 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:17.692 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:17.692 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:17.692 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:17.692 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:17.692 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:17.692 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:17.692 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:17.692 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:17.692 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:17.768 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:17.772Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:17.772Z [INFO] agent.router.manager: shutting down 33:17.772 [INFO] TestAgent: consul server down 33:17.772 [INFO] TestAgent: shutdown complete 33:17.772 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17155 network=tcp 33:17.772 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17155 network=udp 33:17.772 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17156 network=tcp 33:18.031 [DEBUG] TestAgent.server.memberlist.lan: memberlist: Failed ping: Node-84fa357a-2943-b6a3-f616-563e117d4fad (timeout reached) 33:18.273 [INFO] TestAgent: Waiting for endpoints to shut down 33:18.273 [INFO] TestAgent: Endpoints down --- PASS: TestJoinCommandJoin_lan (1.90s) 2021-10-05T16:33:16.757Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:16.815Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:16.898 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:49effe1b-69ef-dbdb-32b1-c3b237d1496b Address:127.0.0.1:17167}]" 33:16.899 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17167 [Follower]" leader= 33:16.899 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b.dc1 127.0.0.1 33:16.900 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b 127.0.0.1 2021-10-05T16:33:16.900Z [INFO] agent.router: Initializing LAN area manager 33:16.900 [INFO] TestAgent.server: Adding LAN server: server="Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b (Addr: tcp/127.0.0.1:17167) (DC: dc1)" 33:16.900 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b.dc1 area=wan 33:16.911 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17162 network=udp 33:16.911 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17162 network=tcp 33:16.912 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17163 network=tcp 33:16.912 [INFO] TestAgent: started state syncer 33:16.912 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17168 network=tcp 33:16.956 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:16.956 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17167 [Candidate]" term=2 33:16.968 [DEBUG] TestAgent.server.raft: votes: needed=1 33:16.969 [DEBUG] TestAgent.server.raft: vote granted: from=49effe1b-69ef-dbdb-32b1-c3b237d1496b term=2 tally=1 33:16.969 [INFO] TestAgent.server.raft: election won: tally=1 33:16.969 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17167 [Leader]" 33:16.969 [INFO] TestAgent.server: cluster leadership acquired 33:16.969 [INFO] TestAgent.server: New leader elected: payload=Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b 33:16.975 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17167 33:16.998 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:17.036 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:17.036 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:17.036 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:17.036 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:17.036 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:17.036 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b 33:17.036 [INFO] TestAgent.server: member joined, marking health alive: member=Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b 33:17.096 [INFO] TestAgent.server: federation state anti-entropy synced 33:17.096 [INFO] TestAgent: Synced node info 33:17.096 [DEBUG] TestAgent: Node info in sync 33:17.126 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Stream connection from=127.0.0.1:37892 33:17.126 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5.dc1 127.0.0.1 33:17.126 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5.dc1 area=wan 33:17.127 [INFO] TestAgent: Requesting shutdown 33:17.127 [INFO] TestAgent.server: shutting down server 33:17.127 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:17.127 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:17.127 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:17.127 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:17.127 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:17.128 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:17.128 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:17.128 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:17.128 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:17.128 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:17.143 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:17.172Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:17.172Z [INFO] agent.router.manager: shutting down 33:17.172 [INFO] TestAgent: consul server down 33:17.172 [INFO] TestAgent: shutdown complete 33:17.172 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17162 network=tcp 33:17.172 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17162 network=udp 33:17.172 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17163 network=tcp 33:17.676 [INFO] TestAgent: Waiting for endpoints to shut down 33:17.676 [INFO] TestAgent: Endpoints down 2021-10-05T16:33:16.490Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:16.525Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:16.566 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:8f1936c0-e338-d3f4-b23c-f1e08387cef5 Address:127.0.0.1:17153}]" 33:16.567 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5.dc1 127.0.0.1 33:16.567 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5 127.0.0.1 2021-10-05T16:33:16.567Z [INFO] agent.router: Initializing LAN area manager 33:16.567 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:17153 [Follower]" leader= 33:16.568 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17148 network=udp 33:16.568 [INFO] TestAgent: Started DNS server: address=127.0.0.1:17148 network=tcp 33:16.568 [INFO] TestAgent.server: Adding LAN server: server="Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5 (Addr: tcp/127.0.0.1:17153) (DC: dc1)" 33:16.568 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5.dc1 area=wan 33:16.568 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:17149 network=tcp 33:16.568 [INFO] TestAgent: started state syncer 33:16.568 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:17154 network=tcp 33:16.612 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:16.612 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:17153 [Candidate]" term=2 33:16.644 [DEBUG] TestAgent.server.raft: votes: needed=1 33:16.644 [DEBUG] TestAgent.server.raft: vote granted: from=8f1936c0-e338-d3f4-b23c-f1e08387cef5 term=2 tally=1 33:16.644 [INFO] TestAgent.server.raft: election won: tally=1 33:16.644 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:17153 [Leader]" 33:16.644 [INFO] TestAgent.server: cluster leadership acquired 33:16.644 [INFO] TestAgent.server: New leader elected: payload=Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5 33:16.663 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:17153 33:16.693 [INFO] TestAgent: Synced node info 33:16.693 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:16.708 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:16.708 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:16.708 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:16.708 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:16.708 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:16.708 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5 33:16.708 [INFO] TestAgent.server: member joined, marking health alive: member=Node-8f1936c0-e338-d3f4-b23c-f1e08387cef5 33:16.752 [INFO] TestAgent.server: federation state anti-entropy synced 33:17.125 [INFO] TestAgent: (WAN) joining: wan_addresses=[127.0.0.1:17166] 33:17.126 [DEBUG] TestAgent.server.memberlist.wan: memberlist: Initiating push/pull sync with: 127.0.0.1:17166 33:17.127 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b.dc1 127.0.0.1 33:17.127 [INFO] TestAgent: (WAN) joined: number_of_nodes=1 33:17.127 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/join/127.0.0.1:17166?wan=1 from=127.0.0.1:47506 latency=1.657666ms 33:17.127 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-49effe1b-69ef-dbdb-32b1-c3b237d1496b.dc1 area=wan 33:17.676 [INFO] TestAgent: Requesting shutdown 33:17.676 [INFO] TestAgent.server: shutting down server 33:17.676 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:17.676 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:17.676 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:17.676 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:17.676 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:17.676 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:17.676 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:17.676 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:17.676 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:17.676 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:17.768 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:17.782Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:17.782Z [INFO] agent.router.manager: shutting down 33:17.782 [INFO] TestAgent: consul server down 33:17.782 [INFO] TestAgent: shutdown complete 33:17.782 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17148 network=tcp 33:17.782 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:17148 network=udp 33:17.782 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:17149 network=tcp 33:18.283 [INFO] TestAgent: Waiting for endpoints to shut down 33:18.283 [INFO] TestAgent: Endpoints down --- PASS: TestJoinCommand_wan (1.91s) PASS ok github.com/hashicorp/consul/command/join 1.999s === RUN TestKeygenCommand_noTabs === PAUSE TestKeygenCommand_noTabs === RUN TestKeygenCommand === PAUSE TestKeygenCommand === CONT TestKeygenCommand_noTabs --- PASS: TestKeygenCommand_noTabs (0.00s) === CONT TestKeygenCommand --- PASS: TestKeygenCommand (0.00s) PASS ok github.com/hashicorp/consul/command/keygen 0.066s === RUN TestKeyringCommand_noTabs === PAUSE TestKeyringCommand_noTabs === RUN TestKeyringCommand === PAUSE TestKeyringCommand === RUN TestKeyringCommand_help === PAUSE TestKeyringCommand_help === RUN TestKeyringCommand_failedConnection === PAUSE TestKeyringCommand_failedConnection === RUN TestKeyringCommand_invalidLocalOnly === PAUSE TestKeyringCommand_invalidLocalOnly === RUN TestKeyringCommand_invalidRelayFactor === PAUSE TestKeyringCommand_invalidRelayFactor === RUN TestKeyringCommand_poolName --- PASS: TestKeyringCommand_poolName (0.00s) === RUN TestKeyringCommand_formatKeys --- PASS: TestKeyringCommand_formatKeys (0.00s) === RUN TestKeyringCommand_formatMessages --- PASS: TestKeyringCommand_formatMessages (0.00s) === RUN TestKeyringCommand_formatResponse --- PASS: TestKeyringCommand_formatResponse (0.00s) === RUN TestKeyringCommand_numActions --- PASS: TestKeyringCommand_numActions (0.00s) === CONT TestKeyringCommand_noTabs === CONT TestKeyringCommand_invalidLocalOnly --- PASS: TestKeyringCommand_noTabs (0.00s) === CONT TestKeyringCommand_failedConnection === CONT TestKeyringCommand_help --- PASS: TestKeyringCommand_invalidLocalOnly (0.00s) === CONT TestKeyringCommand_invalidRelayFactor --- PASS: TestKeyringCommand_help (0.00s) === CONT TestKeyringCommand --- PASS: TestKeyringCommand_invalidRelayFactor (0.00s) --- PASS: TestKeyringCommand_failedConnection (0.00s) [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:20.892Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:20.916Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:20.954 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:4b37bedc-0d46-96bc-bea9-c637603e1c63 Address:127.0.0.1:30426}]" 33:20.955 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 127.0.0.1 33:20.956 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30426 [Follower]" leader= 33:20.956 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 127.0.0.1 2021-10-05T16:33:20.956Z [INFO] agent.router: Initializing LAN area manager 33:20.956 [INFO] TestAgent.server: Adding LAN server: server="Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 (Addr: tcp/127.0.0.1:30426) (DC: dc1)" 33:20.956 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 area=wan 33:20.957 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=tcp 33:20.957 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=udp 33:20.957 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30422 network=tcp 33:20.957 [INFO] TestAgent: started state syncer 33:20.958 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30427 network=tcp 33:21.003 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:21.004 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30426 [Candidate]" term=2 33:21.020 [DEBUG] TestAgent.server.raft: votes: needed=1 33:21.020 [DEBUG] TestAgent.server.raft: vote granted: from=4b37bedc-0d46-96bc-bea9-c637603e1c63 term=2 tally=1 33:21.020 [INFO] TestAgent.server.raft: election won: tally=1 33:21.020 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30426 [Leader]" 33:21.024 [INFO] TestAgent.server: cluster leadership acquired 33:21.024 [INFO] TestAgent.server: New leader elected: payload=Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.030 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30426 33:21.051 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:21.085 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 33:21.085 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 33:21.086 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 33:21.086 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.096 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/keyring from=127.0.0.1:55526 latency=11.695191ms 33:21.098 [INFO] TestAgent.server.serf.wan: serf: Received install-key query 33:21.099 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 33:21.099 [INFO] TestAgent.server.serf.lan: serf: Received install-key query 33:21.099 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.099 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/operator/keyring from=127.0.0.1:55528 latency=1.076412ms 33:21.104 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 33:21.105 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 33:21.105 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 33:21.105 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.106 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/keyring from=127.0.0.1:55530 latency=1.651048ms 33:21.113 [INFO] TestAgent.server.serf.wan: serf: Received use-key query 33:21.114 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 33:21.114 [INFO] TestAgent.server.serf.lan: serf: Received use-key query 33:21.114 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.114 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/operator/keyring from=127.0.0.1:55532 latency=1.10662ms 33:21.115 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 33:21.115 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 33:21.116 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 33:21.125 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.126 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/keyring from=127.0.0.1:55534 latency=11.403694ms 33:21.128 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:21.128 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:21.128 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:21.128 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:21.128 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:21.128 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.128 [INFO] TestAgent.server: member joined, marking health alive: member=Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.157 [INFO] TestAgent.server.serf.wan: serf: Received remove-key query 33:21.159 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 33:21.159 [INFO] TestAgent.server.serf.lan: serf: Received remove-key query 33:21.159 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.159 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/keyring from=127.0.0.1:55536 latency=1.988636ms 33:21.162 [INFO] TestAgent.server: federation state anti-entropy synced 33:21.197 [INFO] TestAgent.server.serf.wan: serf: Received list-keys query 33:21.200 [DEBUG] TestAgent.server.serf.wan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63.dc1 33:21.200 [INFO] TestAgent.server.serf.lan: serf: Received list-keys query 33:21.200 [DEBUG] TestAgent.server.serf.lan: serf: messageQueryResponseType: Node-4b37bedc-0d46-96bc-bea9-c637603e1c63 33:21.200 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/keyring from=127.0.0.1:55538 latency=3.922783ms 33:21.201 [INFO] TestAgent: Requesting shutdown 33:21.201 [INFO] TestAgent.server: shutting down server 33:21.201 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:21.201 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:21.201 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:21.201 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:21.201 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:21.201 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:21.201 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:21.201 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:21.201 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:21.201 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:21.201 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:21.212 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:21.220Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:21.220Z [INFO] agent.router.manager: shutting down 33:21.220 [INFO] TestAgent: consul server down 33:21.220 [INFO] TestAgent: shutdown complete 33:21.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=tcp 33:21.220 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=udp 33:21.220 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30422 network=tcp 33:21.724 [INFO] TestAgent: Waiting for endpoints to shut down 33:21.724 [INFO] TestAgent: Endpoints down --- PASS: TestKeyringCommand (0.93s) PASS ok github.com/hashicorp/consul/command/keyring 1.139s === RUN TestKVCommand_noTabs === PAUSE TestKVCommand_noTabs === CONT TestKVCommand_noTabs --- PASS: TestKVCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/kv 0.060s === RUN TestKVDeleteCommand_noTabs === PAUSE TestKVDeleteCommand_noTabs === RUN TestKVDeleteCommand_Validation === PAUSE TestKVDeleteCommand_Validation === RUN TestKVDeleteCommand === PAUSE TestKVDeleteCommand === RUN TestKVDeleteCommand_Recurse === PAUSE TestKVDeleteCommand_Recurse === RUN TestKVDeleteCommand_CAS === PAUSE TestKVDeleteCommand_CAS === CONT TestKVDeleteCommand_noTabs === CONT TestKVDeleteCommand_CAS === CONT TestKVDeleteCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestKVDeleteCommand_Recurse === CONT TestKVDeleteCommand_Validation --- PASS: TestKVDeleteCommand_noTabs (0.01s) --- PASS: TestKVDeleteCommand_Validation (0.01s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:20.785Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:20.810Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:20.889 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3782e10d-22f1-6b78-85b7-90b874b15f33 Address:127.0.0.1:29405}]" 33:20.889 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3782e10d-22f1-6b78-85b7-90b874b15f33.dc1 127.0.0.1 33:20.890 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3782e10d-22f1-6b78-85b7-90b874b15f33 127.0.0.1 2021-10-05T16:33:20.890Z [INFO] agent.router: Initializing LAN area manager 33:20.890 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29405 [Follower]" leader= 33:20.891 [INFO] TestAgent.server: Adding LAN server: server="Node-3782e10d-22f1-6b78-85b7-90b874b15f33 (Addr: tcp/127.0.0.1:29405) (DC: dc1)" 33:20.891 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3782e10d-22f1-6b78-85b7-90b874b15f33.dc1 area=wan 33:20.891 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=tcp 33:20.891 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=udp 33:20.892 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29401 network=tcp 33:20.895 [INFO] TestAgent: started state syncer 33:20.895 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29406 network=tcp 33:20.932 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:20.932 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29405 [Candidate]" term=2 33:20.947 [DEBUG] TestAgent.server.raft: votes: needed=1 33:20.947 [DEBUG] TestAgent.server.raft: vote granted: from=3782e10d-22f1-6b78-85b7-90b874b15f33 term=2 tally=1 33:20.947 [INFO] TestAgent.server.raft: election won: tally=1 33:20.947 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29405 [Leader]" 33:20.947 [INFO] TestAgent.server: cluster leadership acquired 33:20.947 [INFO] TestAgent.server: New leader elected: payload=Node-3782e10d-22f1-6b78-85b7-90b874b15f33 33:20.956 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29405 33:20.980 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:20.999 [INFO] TestAgent: Synced node info 33:21.015 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:21.016 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:21.016 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:21.016 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:21.016 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:21.016 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3782e10d-22f1-6b78-85b7-90b874b15f33 33:21.016 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3782e10d-22f1-6b78-85b7-90b874b15f33 33:21.037 [INFO] TestAgent.server: federation state anti-entropy synced 33:21.199 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:34954 latency=6.907639ms 33:21.208 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/foo?cas=1 from=127.0.0.1:34956 latency=4.160213ms 33:21.212 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:34954 latency=375.495µs 33:21.217 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/foo?cas=13 from=127.0.0.1:34958 latency=3.976113ms 33:21.235 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:34954 latency=81.998µs 33:21.235 [INFO] TestAgent: Requesting shutdown 33:21.235 [INFO] TestAgent.server: shutting down server 33:21.235 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:21.235 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:21.235 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:21.235 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:21.235 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:21.235 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:21.235 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:21.236 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:21.236 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:21.236 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:21.240 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:21.244Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:21.244Z [INFO] agent.router.manager: shutting down 33:21.244 [INFO] TestAgent: consul server down 33:21.244 [INFO] TestAgent: shutdown complete 33:21.244 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=tcp 33:21.244 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=udp 33:21.244 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29401 network=tcp 33:21.748 [INFO] TestAgent: Waiting for endpoints to shut down 33:21.748 [INFO] TestAgent: Endpoints down --- PASS: TestKVDeleteCommand_CAS (1.15s) 2021-10-05T16:33:20.737Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:20.788Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:20.962 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:73e113ac-1f6a-42de-4c19-aae54bb9cd6d Address:127.0.0.1:29419}]" 33:20.963 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-73e113ac-1f6a-42de-4c19-aae54bb9cd6d.dc1 127.0.0.1 33:20.963 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-73e113ac-1f6a-42de-4c19-aae54bb9cd6d 127.0.0.1 2021-10-05T16:33:20.963Z [INFO] agent.router: Initializing LAN area manager 33:20.964 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29419 [Follower]" leader= 33:20.964 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29414 network=udp 33:20.964 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-73e113ac-1f6a-42de-4c19-aae54bb9cd6d.dc1 area=wan 33:20.964 [INFO] TestAgent.server: Adding LAN server: server="Node-73e113ac-1f6a-42de-4c19-aae54bb9cd6d (Addr: tcp/127.0.0.1:29419) (DC: dc1)" 33:20.964 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29414 network=tcp 33:20.965 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29415 network=tcp 33:20.965 [INFO] TestAgent: started state syncer 33:20.965 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29420 network=tcp 33:21.030 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:21.030 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29419 [Candidate]" term=2 33:21.046 [DEBUG] TestAgent.server.raft: votes: needed=1 33:21.046 [DEBUG] TestAgent.server.raft: vote granted: from=73e113ac-1f6a-42de-4c19-aae54bb9cd6d term=2 tally=1 33:21.046 [INFO] TestAgent.server.raft: election won: tally=1 33:21.046 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29419 [Leader]" 33:21.048 [INFO] TestAgent.server: cluster leadership acquired 33:21.048 [INFO] TestAgent.server: New leader elected: payload=Node-73e113ac-1f6a-42de-4c19-aae54bb9cd6d 33:21.055 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29419 33:21.085 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:21.129 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:21.130 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:21.130 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:21.130 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:21.130 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:21.130 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-73e113ac-1f6a-42de-4c19-aae54bb9cd6d 33:21.130 [INFO] TestAgent.server: member joined, marking health alive: member=Node-73e113ac-1f6a-42de-4c19-aae54bb9cd6d 33:21.141 [INFO] TestAgent.server: federation state anti-entropy synced 33:21.267 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/a from=127.0.0.1:45364 latency=6.246951ms 33:21.272 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/b from=127.0.0.1:45364 latency=4.582326ms 33:21.277 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/food from=127.0.0.1:45364 latency=4.214781ms 33:21.281 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/foo?recurse= from=127.0.0.1:45370 latency=3.624968ms 33:21.284 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo/a from=127.0.0.1:45364 latency=50.134µs 33:21.284 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo/b from=127.0.0.1:45364 latency=31.026µs 33:21.284 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/food from=127.0.0.1:45364 latency=28.131µs 33:21.285 [INFO] TestAgent: Requesting shutdown 33:21.285 [INFO] TestAgent.server: shutting down server 33:21.285 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:21.285 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:21.285 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:21.285 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:21.285 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:21.285 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:21.285 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:21.285 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:21.285 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:21.285 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:21.285 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:21.291 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:21.295Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:21.295Z [INFO] agent.router.manager: shutting down 33:21.295 [INFO] TestAgent: consul server down 33:21.295 [INFO] TestAgent: shutdown complete 33:21.295 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29414 network=tcp 33:21.295 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29414 network=udp 33:21.295 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29415 network=tcp 33:21.796 [INFO] TestAgent: Waiting for endpoints to shut down 33:21.796 [INFO] TestAgent: Endpoints down --- PASS: TestKVDeleteCommand_Recurse (1.20s) 2021-10-05T16:33:20.761Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:20.805Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:20.892 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:895ffced-97d5-78bd-389b-23bb0d896495 Address:127.0.0.1:29412}]" 33:20.893 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-895ffced-97d5-78bd-389b-23bb0d896495.dc1 127.0.0.1 33:20.893 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-895ffced-97d5-78bd-389b-23bb0d896495 127.0.0.1 2021-10-05T16:33:20.893Z [INFO] agent.router: Initializing LAN area manager 33:20.894 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=udp 33:20.894 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29412 [Follower]" leader= 33:20.894 [INFO] TestAgent.server: Adding LAN server: server="Node-895ffced-97d5-78bd-389b-23bb0d896495 (Addr: tcp/127.0.0.1:29412) (DC: dc1)" 33:20.894 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-895ffced-97d5-78bd-389b-23bb0d896495.dc1 area=wan 33:20.894 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=tcp 33:20.895 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29408 network=tcp 33:20.936 [INFO] TestAgent: started state syncer 33:20.936 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29413 network=tcp 33:20.964 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:20.964 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29412 [Candidate]" term=2 33:20.982 [DEBUG] TestAgent.server.raft: votes: needed=1 33:20.982 [DEBUG] TestAgent.server.raft: vote granted: from=895ffced-97d5-78bd-389b-23bb0d896495 term=2 tally=1 33:20.982 [INFO] TestAgent.server.raft: election won: tally=1 33:20.982 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29412 [Leader]" 33:20.982 [INFO] TestAgent.server: cluster leadership acquired 33:20.982 [INFO] TestAgent.server: New leader elected: payload=Node-895ffced-97d5-78bd-389b-23bb0d896495 33:21.002 [INFO] TestAgent: Synced node info 33:21.002 [DEBUG] TestAgent: Node info in sync 33:21.002 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29412 33:21.031 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:21.057 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:21.057 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:21.057 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:21.057 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:21.057 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:21.057 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-895ffced-97d5-78bd-389b-23bb0d896495 33:21.057 [INFO] TestAgent.server: member joined, marking health alive: member=Node-895ffced-97d5-78bd-389b-23bb0d896495 33:21.085 [INFO] TestAgent.server: federation state anti-entropy synced 33:21.276 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:44460 latency=4.86681ms 33:21.291 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/foo from=127.0.0.1:44462 latency=14.011579ms 33:21.292 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:44460 latency=42.122µs 33:21.296 [INFO] TestAgent: Requesting shutdown 33:21.296 [INFO] TestAgent.server: shutting down server 33:21.296 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:21.296 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:21.296 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:21.296 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:21.296 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:21.296 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:21.296 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:21.296 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:21.296 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:21.296 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:21.301 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:21.320Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:21.320Z [INFO] agent.router.manager: shutting down 33:21.320 [INFO] TestAgent: consul server down 33:21.320 [INFO] TestAgent: shutdown complete 33:21.320 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=tcp 33:21.320 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=udp 33:21.320 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29408 network=tcp 33:21.824 [INFO] TestAgent: Waiting for endpoints to shut down 33:21.824 [INFO] TestAgent: Endpoints down --- PASS: TestKVDeleteCommand (1.22s) PASS ok github.com/hashicorp/consul/command/kv/del 1.648s === RUN TestKVExportCommand_noTabs === PAUSE TestKVExportCommand_noTabs === RUN TestKVExportCommand === PAUSE TestKVExportCommand === CONT TestKVExportCommand_noTabs --- PASS: TestKVExportCommand_noTabs (0.00s) === CONT TestKVExportCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:27.070Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:27.109Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:27.218 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a2d12ab6-b524-acf6-d1f9-bf75a687da39 Address:127.0.0.1:28384}]" 33:27.218 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-a2d12ab6-b524-acf6-d1f9-bf75a687da39.dc1 127.0.0.1 33:27.219 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-a2d12ab6-b524-acf6-d1f9-bf75a687da39 127.0.0.1 2021-10-05T16:33:27.219Z [INFO] agent.router: Initializing LAN area manager 33:27.219 [INFO] TestAgent: Started DNS server: address=127.0.0.1:28379 network=udp 33:27.219 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:28384 [Follower]" leader= 33:27.220 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-a2d12ab6-b524-acf6-d1f9-bf75a687da39.dc1 area=wan 33:27.220 [INFO] TestAgent: Started DNS server: address=127.0.0.1:28379 network=tcp 33:27.224 [INFO] TestAgent.server: Adding LAN server: server="Node-a2d12ab6-b524-acf6-d1f9-bf75a687da39 (Addr: tcp/127.0.0.1:28384) (DC: dc1)" 33:27.224 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:28380 network=tcp 33:27.224 [INFO] TestAgent: started state syncer 33:27.224 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:28385 network=tcp 33:27.280 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:27.280 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:28384 [Candidate]" term=2 33:27.328 [DEBUG] TestAgent.server.raft: votes: needed=1 33:27.328 [DEBUG] TestAgent.server.raft: vote granted: from=a2d12ab6-b524-acf6-d1f9-bf75a687da39 term=2 tally=1 33:27.328 [INFO] TestAgent.server.raft: election won: tally=1 33:27.328 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:28384 [Leader]" 33:27.332 [INFO] TestAgent.server: cluster leadership acquired 33:27.332 [INFO] TestAgent.server: New leader elected: payload=Node-a2d12ab6-b524-acf6-d1f9-bf75a687da39 33:27.363 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:28384 33:27.420 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/a from=127.0.0.1:33420 latency=35.255351ms 33:27.456 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:27.456 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/b from=127.0.0.1:33420 latency=34.528529ms 33:27.512 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/c from=127.0.0.1:33420 latency=54.686995ms 33:27.514 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:27.514 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:27.514 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:27.514 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:27.514 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:27.514 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-a2d12ab6-b524-acf6-d1f9-bf75a687da39 33:27.514 [INFO] TestAgent.server: member joined, marking health alive: member=Node-a2d12ab6-b524-acf6-d1f9-bf75a687da39 33:27.552 [INFO] TestAgent.server: federation state anti-entropy synced 33:27.555 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/bar from=127.0.0.1:33420 latency=34.890891ms 33:27.572 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:27.581 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo?recurse= from=127.0.0.1:33422 latency=21.520625ms 33:27.584 [INFO] TestAgent: Requesting shutdown 33:27.584 [INFO] TestAgent.server: shutting down server 33:27.584 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:27.584 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:27.584 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:27.584 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:27.584 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:27.584 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:27.584 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:27.584 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:27.584 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:27.584 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:27.596 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 33:27.596 [INFO] TestAgent: Synced node info 33:27.596 [DEBUG] TestAgent: Node info in sync 2021-10-05T16:33:27.624Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:27.624Z [INFO] agent.router.manager: shutting down 33:27.624 [INFO] TestAgent: consul server down 33:27.624 [INFO] TestAgent: shutdown complete 33:27.624 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:28379 network=tcp 33:27.624 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:28379 network=udp 33:27.624 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:28380 network=tcp 33:28.128 [INFO] TestAgent: Waiting for endpoints to shut down 33:28.128 [INFO] TestAgent: Endpoints down --- PASS: TestKVExportCommand (1.11s) PASS ok github.com/hashicorp/consul/command/kv/exp 1.225s === RUN TestKVGetCommand_noTabs === PAUSE TestKVGetCommand_noTabs === RUN TestKVGetCommand_Validation === PAUSE TestKVGetCommand_Validation === RUN TestKVGetCommand === PAUSE TestKVGetCommand === RUN TestKVGetCommand_Base64 === PAUSE TestKVGetCommand_Base64 === RUN TestKVGetCommand_Missing === PAUSE TestKVGetCommand_Missing === RUN TestKVGetCommand_Empty === PAUSE TestKVGetCommand_Empty === RUN TestKVGetCommand_Detailed === PAUSE TestKVGetCommand_Detailed === RUN TestKVGetCommand_Keys === PAUSE TestKVGetCommand_Keys === RUN TestKVGetCommand_Recurse === PAUSE TestKVGetCommand_Recurse === RUN TestKVGetCommand_RecurseBase64 === PAUSE TestKVGetCommand_RecurseBase64 === RUN TestKVGetCommand_DetailedBase64 === PAUSE TestKVGetCommand_DetailedBase64 === CONT TestKVGetCommand_noTabs --- PASS: TestKVGetCommand_noTabs (0.00s) === CONT TestKVGetCommand_DetailedBase64 [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestKVGetCommand_Empty === CONT TestKVGetCommand_Base64 === CONT TestKVGetCommand_Missing === CONT TestKVGetCommand_Keys === CONT TestKVGetCommand_Recurse === CONT TestKVGetCommand === CONT TestKVGetCommand_Validation --- PASS: TestKVGetCommand_Validation (0.00s) === CONT TestKVGetCommand_RecurseBase64 === CONT TestKVGetCommand_Detailed [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:29.670Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.720Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.276 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:47ec7649-ccf1-f14f-fce6-789015870f9b Address:127.0.0.1:19244}]" 33:30.276 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19244 [Follower]" leader= 33:30.277 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-47ec7649-ccf1-f14f-fce6-789015870f9b.dc1 127.0.0.1 33:30.277 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-47ec7649-ccf1-f14f-fce6-789015870f9b 127.0.0.1 2021-10-05T16:33:30.278Z [INFO] agent.router: Initializing LAN area manager 33:30.279 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19239 network=udp 33:30.279 [INFO] TestAgent.server: Adding LAN server: server="Node-47ec7649-ccf1-f14f-fce6-789015870f9b (Addr: tcp/127.0.0.1:19244) (DC: dc1)" 33:30.279 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-47ec7649-ccf1-f14f-fce6-789015870f9b.dc1 area=wan 33:30.279 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19239 network=tcp 33:30.280 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19240 network=tcp 33:30.284 [INFO] TestAgent: started state syncer 33:30.284 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19245 network=tcp 33:30.336 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.336 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19244 [Candidate]" term=2 33:30.392 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.392 [DEBUG] TestAgent.server.raft: vote granted: from=47ec7649-ccf1-f14f-fce6-789015870f9b term=2 tally=1 33:30.392 [INFO] TestAgent.server.raft: election won: tally=1 33:30.392 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19244 [Leader]" 33:30.393 [INFO] TestAgent.server: cluster leadership acquired 33:30.393 [INFO] TestAgent.server: New leader elected: payload=Node-47ec7649-ccf1-f14f-fce6-789015870f9b 33:30.572 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19244 33:30.589 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:59938 latency=49.276624ms 33:30.591 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:59942 latency=328.043µs 33:30.591 [INFO] TestAgent: Requesting shutdown 33:30.591 [INFO] TestAgent.server: shutting down server 33:30.591 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.591 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:30.672 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.678Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.678Z [INFO] agent.router.manager: shutting down 33:30.678 [WARN] TestAgent: Syncing node info failed.: error="raft is already shutdown" 33:30.678 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="raft is already shutdown" 33:30.716 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 33:30.726 [INFO] TestAgent: consul server down 33:30.726 [INFO] TestAgent: shutdown complete 33:30.726 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19239 network=tcp 33:30.733 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19239 network=udp 33:30.733 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19240 network=tcp 33:31.233 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.234 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_Detailed (1.72s) 2021-10-05T16:33:29.804Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.849Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.243 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:929dcfbb-ff98-d9ba-a316-8197430fe588 Address:127.0.0.1:19209}]" 33:30.251 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19209 [Follower]" leader= 33:30.275 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-929dcfbb-ff98-d9ba-a316-8197430fe588.dc1 127.0.0.1 33:30.275 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-929dcfbb-ff98-d9ba-a316-8197430fe588 127.0.0.1 2021-10-05T16:33:30.275Z [INFO] agent.router: Initializing LAN area manager 33:30.276 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-929dcfbb-ff98-d9ba-a316-8197430fe588.dc1 area=wan 33:30.276 [INFO] TestAgent.server: Adding LAN server: server="Node-929dcfbb-ff98-d9ba-a316-8197430fe588 (Addr: tcp/127.0.0.1:19209) (DC: dc1)" 33:30.277 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19204 network=udp 33:30.277 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19204 network=tcp 33:30.277 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19205 network=tcp 33:30.277 [INFO] TestAgent: started state syncer 33:30.277 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19210 network=tcp 33:30.288 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.288 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19209 [Candidate]" term=2 33:30.396 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.396 [DEBUG] TestAgent.server.raft: vote granted: from=929dcfbb-ff98-d9ba-a316-8197430fe588 term=2 tally=1 33:30.396 [INFO] TestAgent.server.raft: election won: tally=1 33:30.396 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19209 [Leader]" 33:30.396 [INFO] TestAgent.server: cluster leadership acquired 33:30.396 [INFO] TestAgent.server: New leader elected: payload=Node-929dcfbb-ff98-d9ba-a316-8197430fe588 33:30.440 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19209 33:30.569 [INFO] TestAgent: Synced node info 33:30.590 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/not-a-real-key from=127.0.0.1:39356 latency=143.906µs 33:30.590 [INFO] TestAgent: Requesting shutdown 33:30.590 [INFO] TestAgent.server: shutting down server 33:30.590 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.672 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.673Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.673Z [INFO] agent.router.manager: shutting down 33:30.701 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 33:30.726 [INFO] TestAgent: consul server down 33:30.726 [INFO] TestAgent: shutdown complete 33:30.726 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19204 network=tcp 33:30.734 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19204 network=udp 33:30.734 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19205 network=tcp 33:31.234 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.234 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_Missing (1.72s) 2021-10-05T16:33:29.751Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.892Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.241 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1d03f50c-9afe-1f97-3728-c3302c76763f Address:127.0.0.1:19251}]" 33:30.242 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1d03f50c-9afe-1f97-3728-c3302c76763f.dc1 127.0.0.1 33:30.243 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1d03f50c-9afe-1f97-3728-c3302c76763f 127.0.0.1 2021-10-05T16:33:30.243Z [INFO] agent.router: Initializing LAN area manager 33:30.243 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19246 network=udp 33:30.243 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19251 [Follower]" leader= 33:30.250 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19246 network=tcp 33:30.251 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19247 network=tcp 33:30.251 [INFO] TestAgent: started state syncer 33:30.251 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1d03f50c-9afe-1f97-3728-c3302c76763f.dc1 area=wan 33:30.272 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19252 network=tcp 33:30.276 [INFO] TestAgent.server: Adding LAN server: server="Node-1d03f50c-9afe-1f97-3728-c3302c76763f (Addr: tcp/127.0.0.1:19251) (DC: dc1)" 33:30.280 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.280 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19251 [Candidate]" term=2 33:30.388 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.388 [DEBUG] TestAgent.server.raft: vote granted: from=1d03f50c-9afe-1f97-3728-c3302c76763f term=2 tally=1 33:30.388 [INFO] TestAgent.server.raft: election won: tally=1 33:30.388 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19251 [Leader]" 33:30.391 [INFO] TestAgent.server: cluster leadership acquired 33:30.391 [INFO] TestAgent.server: New leader elected: payload=Node-1d03f50c-9afe-1f97-3728-c3302c76763f 33:30.439 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19251 33:30.673 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/empty from=127.0.0.1:46802 latency=141.091468ms 33:30.720 [INFO] TestAgent: Synced node info 33:30.733 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/empty from=127.0.0.1:46812 latency=52.389008ms 33:30.734 [INFO] TestAgent: Requesting shutdown 33:30.734 [INFO] TestAgent.server: shutting down server 33:30.734 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.780 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:30.801 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.802Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.802Z [INFO] agent.router.manager: shutting down 33:30.819 [INFO] TestAgent: consul server down 33:30.819 [INFO] TestAgent: shutdown complete 33:30.819 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19246 network=tcp 33:30.819 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19246 network=udp 33:30.819 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19247 network=tcp 33:30.819 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 33:30.819 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 33:31.323 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.323 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_Empty (1.81s) 2021-10-05T16:33:29.800Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.922Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.372 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c30aa3d5-55ed-8464-991a-d1d64e069fea Address:127.0.0.1:19230}]" 33:30.373 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c30aa3d5-55ed-8464-991a-d1d64e069fea.dc1 127.0.0.1 33:30.373 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c30aa3d5-55ed-8464-991a-d1d64e069fea 127.0.0.1 2021-10-05T16:33:30.373Z [INFO] agent.router: Initializing LAN area manager 33:30.373 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19225 network=udp 33:30.373 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19230 [Follower]" leader= 33:30.374 [INFO] TestAgent.server: Adding LAN server: server="Node-c30aa3d5-55ed-8464-991a-d1d64e069fea (Addr: tcp/127.0.0.1:19230) (DC: dc1)" 33:30.374 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c30aa3d5-55ed-8464-991a-d1d64e069fea.dc1 area=wan 33:30.374 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19225 network=tcp 33:30.374 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19226 network=tcp 33:30.374 [INFO] TestAgent: started state syncer 33:30.375 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19231 network=tcp 33:30.435 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.435 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19230 [Candidate]" term=2 33:30.695 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.695 [DEBUG] TestAgent.server.raft: vote granted: from=c30aa3d5-55ed-8464-991a-d1d64e069fea term=2 tally=1 33:30.695 [INFO] TestAgent.server.raft: election won: tally=1 33:30.695 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19230 [Leader]" 33:30.705 [INFO] TestAgent.server: cluster leadership acquired 33:30.733 [INFO] TestAgent.server: New leader elected: payload=Node-c30aa3d5-55ed-8464-991a-d1d64e069fea 33:30.783 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19230 33:30.821 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:54994 latency=75.542256ms 33:30.822 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:54996 latency=246.148µs 33:30.822 [INFO] TestAgent: Requesting shutdown 33:30.822 [INFO] TestAgent.server: shutting down server 33:30.822 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.829 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.831Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.831Z [INFO] agent.router.manager: shutting down 33:30.837 [INFO] TestAgent: consul server down 33:30.837 [INFO] TestAgent: shutdown complete 33:30.837 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19225 network=tcp 33:30.837 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19225 network=udp 33:30.837 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19226 network=tcp 33:30.838 [ERROR] TestAgent.server.autopilot: failed to initialize config: error="leadership lost while committing log" 33:30.838 [ERROR] TestAgent.server: failed to establish leadership: error="raft is already shutdown" 33:30.838 [WARN] TestAgent: Syncing node info failed.: error="leadership lost while committing log" 33:30.838 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="leadership lost while committing log" 33:31.340 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.340 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand (1.83s) 2021-10-05T16:33:29.723Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.850Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.164 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:77364fb1-f114-54d1-d290-07c63f1be7b4 Address:127.0.0.1:19202}]" 33:30.165 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19202 [Follower]" leader= 33:30.165 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-77364fb1-f114-54d1-d290-07c63f1be7b4.dc1 127.0.0.1 33:30.166 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-77364fb1-f114-54d1-d290-07c63f1be7b4 127.0.0.1 2021-10-05T16:33:30.166Z [INFO] agent.router: Initializing LAN area manager 33:30.167 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19197 network=udp 33:30.167 [INFO] TestAgent.server: Adding LAN server: server="Node-77364fb1-f114-54d1-d290-07c63f1be7b4 (Addr: tcp/127.0.0.1:19202) (DC: dc1)" 33:30.167 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-77364fb1-f114-54d1-d290-07c63f1be7b4.dc1 area=wan 33:30.239 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.239 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19202 [Candidate]" term=2 33:30.244 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19197 network=tcp 33:30.245 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19198 network=tcp 33:30.245 [INFO] TestAgent: started state syncer 33:30.246 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19203 network=tcp 33:30.372 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.372 [DEBUG] TestAgent.server.raft: vote granted: from=77364fb1-f114-54d1-d290-07c63f1be7b4 term=2 tally=1 33:30.372 [INFO] TestAgent.server.raft: election won: tally=1 33:30.372 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19202 [Leader]" 33:30.375 [INFO] TestAgent.server: cluster leadership acquired 33:30.375 [INFO] TestAgent.server: New leader elected: payload=Node-77364fb1-f114-54d1-d290-07c63f1be7b4 33:30.412 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19202 33:30.828 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:30.829 [INFO] TestAgent: Synced node info 33:30.839 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:53762 latency=106.270349ms 33:30.845 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:53772 latency=257.373µs 33:30.845 [INFO] TestAgent: Requesting shutdown 33:30.845 [INFO] TestAgent.server: shutting down server 33:30.845 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.852 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.853Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.853Z [INFO] agent.router.manager: shutting down 33:30.853 [INFO] TestAgent: consul server down 33:30.853 [INFO] TestAgent: shutdown complete 33:30.853 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19197 network=tcp 33:30.853 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19197 network=udp 33:30.853 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19198 network=tcp 33:30.853 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: raft is already shutdown" 33:31.356 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.356 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_Base64 (1.84s) 2021-10-05T16:33:29.705Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.870Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.212 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c6a5d279-0e76-cd4c-f224-9c1e0f7a1c22 Address:127.0.0.1:19195}]" 33:30.247 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c6a5d279-0e76-cd4c-f224-9c1e0f7a1c22.dc1 127.0.0.1 33:30.274 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c6a5d279-0e76-cd4c-f224-9c1e0f7a1c22 127.0.0.1 2021-10-05T16:33:30.274Z [INFO] agent.router: Initializing LAN area manager 33:30.275 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19190 network=udp 33:30.275 [INFO] TestAgent.server: Adding LAN server: server="Node-c6a5d279-0e76-cd4c-f224-9c1e0f7a1c22 (Addr: tcp/127.0.0.1:19195) (DC: dc1)" 33:30.275 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c6a5d279-0e76-cd4c-f224-9c1e0f7a1c22.dc1 area=wan 33:30.276 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19195 [Follower]" leader= 33:30.276 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19190 network=tcp 33:30.277 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19191 network=tcp 33:30.277 [INFO] TestAgent: started state syncer 33:30.277 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19196 network=tcp 33:30.316 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.316 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19195 [Candidate]" term=2 33:30.428 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.428 [DEBUG] TestAgent.server.raft: vote granted: from=c6a5d279-0e76-cd4c-f224-9c1e0f7a1c22 term=2 tally=1 33:30.428 [INFO] TestAgent.server.raft: election won: tally=1 33:30.428 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19195 [Leader]" 33:30.428 [INFO] TestAgent.server: cluster leadership acquired 33:30.428 [INFO] TestAgent.server: New leader elected: payload=Node-c6a5d279-0e76-cd4c-f224-9c1e0f7a1c22 33:30.619 [INFO] TestAgent: Synced node info 33:30.619 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19195 33:30.842 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:50884 latency=97.241647ms 33:30.845 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:50892 latency=348.225µs 33:30.845 [INFO] TestAgent: Requesting shutdown 33:30.845 [INFO] TestAgent.server: shutting down server 33:30.845 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.852 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.852Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.852Z [INFO] agent.router.manager: shutting down 33:30.858 [INFO] TestAgent: consul server down 33:30.858 [INFO] TestAgent: shutdown complete 33:30.858 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19190 network=tcp 33:30.858 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19190 network=udp 33:30.858 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19191 network=tcp 33:30.859 [ERROR] TestAgent.server: failed to establish leadership: error="error configuring provider: leadership lost while committing log" 33:31.359 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.359 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_DetailedBase64 (1.85s) 2021-10-05T16:33:29.709Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.845Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.244 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:70970fc3-0839-3d19-a499-29f33b011dc8 Address:127.0.0.1:19237}]" 33:30.245 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-70970fc3-0839-3d19-a499-29f33b011dc8.dc1 127.0.0.1 33:30.246 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-70970fc3-0839-3d19-a499-29f33b011dc8 127.0.0.1 2021-10-05T16:33:30.246Z [INFO] agent.router: Initializing LAN area manager 33:30.246 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19232 network=udp 33:30.246 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19237 [Follower]" leader= 33:30.273 [INFO] TestAgent.server: Adding LAN server: server="Node-70970fc3-0839-3d19-a499-29f33b011dc8 (Addr: tcp/127.0.0.1:19237) (DC: dc1)" 33:30.273 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-70970fc3-0839-3d19-a499-29f33b011dc8.dc1 area=wan 33:30.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19232 network=tcp 33:30.274 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19233 network=tcp 33:30.274 [INFO] TestAgent: started state syncer 33:30.274 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19238 network=tcp 33:30.300 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.300 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19237 [Candidate]" term=2 33:30.396 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.396 [DEBUG] TestAgent.server.raft: vote granted: from=70970fc3-0839-3d19-a499-29f33b011dc8 term=2 tally=1 33:30.396 [INFO] TestAgent.server.raft: election won: tally=1 33:30.396 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19237 [Leader]" 33:30.396 [INFO] TestAgent.server: cluster leadership acquired 33:30.397 [INFO] TestAgent.server: New leader elected: payload=Node-70970fc3-0839-3d19-a499-29f33b011dc8 33:30.444 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19237 33:30.448 [INFO] TestAgent: Synced node info 33:30.618 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/a from=127.0.0.1:59778 latency=112.992302ms 33:30.763 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:30.764 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/b from=127.0.0.1:59778 latency=143.88202ms 33:30.830 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/c from=127.0.0.1:59778 latency=64.568281ms 33:30.837 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo?recurse= from=127.0.0.1:59800 latency=306.784µs 33:30.837 [INFO] TestAgent: Requesting shutdown 33:30.837 [INFO] TestAgent.server: shutting down server 33:30.837 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.848 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.851Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.851Z [INFO] agent.router.manager: shutting down 33:30.859 [INFO] TestAgent: consul server down 33:30.859 [INFO] TestAgent: shutdown complete 33:30.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19232 network=tcp 33:30.859 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19232 network=udp 33:30.859 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19233 network=tcp 33:30.859 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: leadership lost while committing log" 33:31.360 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.360 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_RecurseBase64 (1.85s) 2021-10-05T16:33:29.603Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.759Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.212 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bb74c76a-e1d5-1a5b-d0ec-e0c15a7da9b8 Address:127.0.0.1:19223}]" 33:30.213 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19223 [Follower]" leader= 33:30.255 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bb74c76a-e1d5-1a5b-d0ec-e0c15a7da9b8.dc1 127.0.0.1 33:30.273 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bb74c76a-e1d5-1a5b-d0ec-e0c15a7da9b8 127.0.0.1 2021-10-05T16:33:30.273Z [INFO] agent.router: Initializing LAN area manager 33:30.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19218 network=udp 33:30.273 [INFO] TestAgent.server: Adding LAN server: server="Node-bb74c76a-e1d5-1a5b-d0ec-e0c15a7da9b8 (Addr: tcp/127.0.0.1:19223) (DC: dc1)" 33:30.273 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bb74c76a-e1d5-1a5b-d0ec-e0c15a7da9b8.dc1 area=wan 33:30.273 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19218 network=tcp 33:30.274 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19219 network=tcp 33:30.274 [INFO] TestAgent: started state syncer 33:30.274 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19224 network=tcp 33:30.324 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.324 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19223 [Candidate]" term=2 33:30.392 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.392 [DEBUG] TestAgent.server.raft: vote granted: from=bb74c76a-e1d5-1a5b-d0ec-e0c15a7da9b8 term=2 tally=1 33:30.392 [INFO] TestAgent.server.raft: election won: tally=1 33:30.392 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19223 [Leader]" 33:30.392 [INFO] TestAgent.server: cluster leadership acquired 33:30.392 [INFO] TestAgent.server: New leader elected: payload=Node-bb74c76a-e1d5-1a5b-d0ec-e0c15a7da9b8 33:30.564 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/a from=127.0.0.1:55718 latency=131.982561ms 33:30.564 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19223 33:30.680 [INFO] TestAgent: Synced node info 33:30.680 [DEBUG] TestAgent: Node info in sync 33:30.726 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/b from=127.0.0.1:55718 latency=157.220556ms 33:30.846 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/c from=127.0.0.1:55718 latency=111.881827ms 33:30.849 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo?recurse= from=127.0.0.1:55746 latency=310.565µs 33:30.850 [INFO] TestAgent: Requesting shutdown 33:30.850 [INFO] TestAgent.server: shutting down server 33:30.850 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.856 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:30.859 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.860Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.860Z [INFO] agent.router.manager: shutting down 33:30.863 [INFO] TestAgent: consul server down 33:30.863 [INFO] TestAgent: shutdown complete 33:30.863 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19218 network=tcp 33:30.863 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19218 network=udp 33:30.863 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19219 network=tcp 33:30.863 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 33:31.364 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.364 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_Recurse (1.85s) 2021-10-05T16:33:29.725Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:29.781Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:30.208 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bf53eb54-1c80-954e-cefd-bca98a5b9a77 Address:127.0.0.1:19216}]" 33:30.210 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bf53eb54-1c80-954e-cefd-bca98a5b9a77.dc1 127.0.0.1 33:30.210 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bf53eb54-1c80-954e-cefd-bca98a5b9a77 127.0.0.1 2021-10-05T16:33:30.210Z [INFO] agent.router: Initializing LAN area manager 33:30.211 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19211 network=udp 33:30.211 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:19216 [Follower]" leader= 33:30.211 [INFO] TestAgent.server: Adding LAN server: server="Node-bf53eb54-1c80-954e-cefd-bca98a5b9a77 (Addr: tcp/127.0.0.1:19216) (DC: dc1)" 33:30.211 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bf53eb54-1c80-954e-cefd-bca98a5b9a77.dc1 area=wan 33:30.211 [INFO] TestAgent: Started DNS server: address=127.0.0.1:19211 network=tcp 33:30.212 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:19212 network=tcp 33:30.213 [INFO] TestAgent: started state syncer 33:30.272 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:19217 network=tcp 33:30.276 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:30.276 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:19216 [Candidate]" term=2 33:30.384 [DEBUG] TestAgent.server.raft: votes: needed=1 33:30.384 [DEBUG] TestAgent.server.raft: vote granted: from=bf53eb54-1c80-954e-cefd-bca98a5b9a77 term=2 tally=1 33:30.384 [INFO] TestAgent.server.raft: election won: tally=1 33:30.384 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:19216 [Leader]" 33:30.384 [INFO] TestAgent.server: cluster leadership acquired 33:30.384 [INFO] TestAgent.server: New leader elected: payload=Node-bf53eb54-1c80-954e-cefd-bca98a5b9a77 33:30.408 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:19216 33:30.673 [INFO] TestAgent: Synced node info 33:30.673 [DEBUG] TestAgent: Node info in sync 33:30.779 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:30.783 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/bar from=127.0.0.1:52748 latency=162.403512ms 33:30.832 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/baz from=127.0.0.1:52748 latency=49.444824ms 33:30.868 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:30.868 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:30.868 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:30.868 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:30.868 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:30.869 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bf53eb54-1c80-954e-cefd-bca98a5b9a77 33:30.869 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bf53eb54-1c80-954e-cefd-bca98a5b9a77 33:30.872 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/zip from=127.0.0.1:52748 latency=35.573856ms 33:30.876 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo/?keys=&separator=%2F from=127.0.0.1:52766 latency=286.338µs 33:30.880 [INFO] TestAgent: Requesting shutdown 33:30.880 [INFO] TestAgent.server: shutting down server 33:30.880 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:30.880 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:30.880 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:30.880 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:30.880 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:30.880 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:30.880 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:30.880 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:30.886 [INFO] TestAgent.server: federation state anti-entropy synced 33:30.886 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:30.892 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:30.896Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:30.896Z [INFO] agent.router.manager: shutting down 33:30.896 [INFO] TestAgent: consul server down 33:30.896 [INFO] TestAgent: shutdown complete 33:30.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19211 network=tcp 33:30.896 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:19211 network=udp 33:30.896 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:19212 network=tcp 33:31.396 [INFO] TestAgent: Waiting for endpoints to shut down 33:31.396 [INFO] TestAgent: Endpoints down --- PASS: TestKVGetCommand_Keys (1.88s) PASS ok github.com/hashicorp/consul/command/kv/get 2.398s === RUN TestKVImportCommand_noTabs === PAUSE TestKVImportCommand_noTabs === RUN TestKVImportCommand === PAUSE TestKVImportCommand === CONT TestKVImportCommand_noTabs --- PASS: TestKVImportCommand_noTabs (0.00s) === CONT TestKVImportCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:33.666Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.709Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:33.802 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:457e0594-24a8-d041-6134-fef29c9b44d5 Address:127.0.0.1:23279}]" 33:33.802 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23279 [Follower]" leader= 33:33.803 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-457e0594-24a8-d041-6134-fef29c9b44d5.dc1 127.0.0.1 33:33.805 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-457e0594-24a8-d041-6134-fef29c9b44d5 127.0.0.1 2021-10-05T16:33:33.805Z [INFO] agent.router: Initializing LAN area manager 33:33.805 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=udp 33:33.805 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-457e0594-24a8-d041-6134-fef29c9b44d5.dc1 area=wan 33:33.806 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=tcp 33:33.806 [INFO] TestAgent.server: Adding LAN server: server="Node-457e0594-24a8-d041-6134-fef29c9b44d5 (Addr: tcp/127.0.0.1:23279) (DC: dc1)" 33:33.806 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23275 network=tcp 33:33.806 [INFO] TestAgent: started state syncer 33:33.807 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23280 network=tcp 33:33.850 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:33.851 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23279 [Candidate]" term=2 33:33.885 [DEBUG] TestAgent.server.raft: votes: needed=1 33:33.885 [DEBUG] TestAgent.server.raft: vote granted: from=457e0594-24a8-d041-6134-fef29c9b44d5 term=2 tally=1 33:33.885 [INFO] TestAgent.server.raft: election won: tally=1 33:33.885 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23279 [Leader]" 33:33.886 [INFO] TestAgent.server: cluster leadership acquired 33:33.886 [INFO] TestAgent.server: New leader elected: payload=Node-457e0594-24a8-d041-6134-fef29c9b44d5 33:33.897 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23279 33:33.943 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:33.983 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:33.983 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:33.983 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:33.983 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:33.983 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:33.983 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-457e0594-24a8-d041-6134-fef29c9b44d5 33:33.983 [INFO] TestAgent.server: member joined, marking health alive: member=Node-457e0594-24a8-d041-6134-fef29c9b44d5 33:33.989 [INFO] TestAgent: Synced node info 33:33.997 [INFO] TestAgent.server: federation state anti-entropy synced 33:34.042 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:37104 latency=24.34322ms 33:34.077 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo/a from=127.0.0.1:37104 latency=29.000479ms 33:34.082 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:37108 latency=759.186µs 33:34.084 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo/a from=127.0.0.1:37108 latency=454.121µs 33:34.084 [INFO] TestAgent: Requesting shutdown 33:34.085 [INFO] TestAgent.server: shutting down server 33:34.085 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:34.085 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:34.085 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:34.085 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:34.085 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.085 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:34.085 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:34.085 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:34.085 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:34.085 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:34.096 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.108Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.108Z [INFO] agent.router.manager: shutting down 33:34.108 [INFO] TestAgent: consul server down 33:34.108 [INFO] TestAgent: shutdown complete 33:34.108 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=tcp 33:34.108 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=udp 33:34.108 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23275 network=tcp 33:34.612 [INFO] TestAgent: Waiting for endpoints to shut down 33:34.612 [INFO] TestAgent: Endpoints down --- PASS: TestKVImportCommand (1.07s) PASS ok github.com/hashicorp/consul/command/kv/imp 1.222s ? github.com/hashicorp/consul/command/kv/impexp [no test files] === RUN TestKVPutCommand_noTabs === PAUSE TestKVPutCommand_noTabs === RUN TestKVPutCommand_Validation === PAUSE TestKVPutCommand_Validation === RUN TestKVPutCommand === PAUSE TestKVPutCommand === RUN TestKVPutCommand_EmptyDataQuoted === PAUSE TestKVPutCommand_EmptyDataQuoted === RUN TestKVPutCommand_Base64 === PAUSE TestKVPutCommand_Base64 === RUN TestKVPutCommand_File === PAUSE TestKVPutCommand_File === RUN TestKVPutCommand_FileNoExist === PAUSE TestKVPutCommand_FileNoExist === RUN TestKVPutCommand_Stdin === PAUSE TestKVPutCommand_Stdin === RUN TestKVPutCommand_NegativeVal === PAUSE TestKVPutCommand_NegativeVal === RUN TestKVPutCommand_Flags === PAUSE TestKVPutCommand_Flags === RUN TestKVPutCommand_CAS === PAUSE TestKVPutCommand_CAS === CONT TestKVPutCommand_noTabs --- PASS: TestKVPutCommand_noTabs (0.00s) === CONT TestKVPutCommand_CAS === CONT TestKVPutCommand_File [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestKVPutCommand_Flags === CONT TestKVPutCommand_NegativeVal === CONT TestKVPutCommand_Stdin === CONT TestKVPutCommand_FileNoExist === CONT TestKVPutCommand_EmptyDataQuoted --- PASS: TestKVPutCommand_FileNoExist (0.00s) === CONT TestKVPutCommand === CONT TestKVPutCommand_Base64 === CONT TestKVPutCommand_Validation --- PASS: TestKVPutCommand_Validation (0.01s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:33.631Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.826Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:33.961 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:651cd9f3-5c9d-994f-7ee8-3c45c2db31a8 Address:127.0.0.1:21237}]" 33:33.962 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-651cd9f3-5c9d-994f-7ee8-3c45c2db31a8.dc1 127.0.0.1 33:33.962 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-651cd9f3-5c9d-994f-7ee8-3c45c2db31a8 127.0.0.1 2021-10-05T16:33:33.962Z [INFO] agent.router: Initializing LAN area manager 33:33.963 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=udp 33:33.963 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21237 [Follower]" leader= 33:33.972 [INFO] TestAgent.server: Adding LAN server: server="Node-651cd9f3-5c9d-994f-7ee8-3c45c2db31a8 (Addr: tcp/127.0.0.1:21237) (DC: dc1)" 33:33.972 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21232 network=tcp 33:33.976 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-651cd9f3-5c9d-994f-7ee8-3c45c2db31a8.dc1 area=wan 33:33.976 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21233 network=tcp 33:34.016 [INFO] TestAgent: started state syncer 33:34.030 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.030 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21237 [Candidate]" term=2 33:34.033 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21238 network=tcp 33:34.055 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.055 [DEBUG] TestAgent.server.raft: vote granted: from=651cd9f3-5c9d-994f-7ee8-3c45c2db31a8 term=2 tally=1 33:34.056 [INFO] TestAgent.server.raft: election won: tally=1 33:34.056 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21237 [Leader]" 33:34.056 [INFO] TestAgent.server: cluster leadership acquired 33:34.056 [INFO] TestAgent.server: New leader elected: payload=Node-651cd9f3-5c9d-994f-7ee8-3c45c2db31a8 33:34.089 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:35876 latency=29.210223ms 33:34.089 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21237 33:34.107 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo?cas=123 from=127.0.0.1:35880 latency=12.77499ms 33:34.109 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:35876 latency=1.198701ms 33:34.159 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo?cas=4 from=127.0.0.1:35882 latency=45.44335ms 33:34.161 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:35876 latency=538.759µs 33:34.162 [INFO] TestAgent: Requesting shutdown 33:34.162 [INFO] TestAgent.server: shutting down server 33:34.162 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.162 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:34.174 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:34.176 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.204Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.204Z [INFO] agent.router.manager: shutting down 33:34.214 [INFO] TestAgent: consul server down 33:34.214 [INFO] TestAgent: shutdown complete 33:34.214 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=tcp 33:34.214 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21232 network=udp 33:34.214 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21233 network=tcp 33:34.214 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 33:34.214 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 33:34.716 [INFO] TestAgent: Waiting for endpoints to shut down 33:34.716 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand_CAS (1.21s) 2021-10-05T16:33:33.778Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.932Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:34.075 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d67e30ba-d320-dd1c-9906-8b4bb1937be5 Address:127.0.0.1:21272}]" 33:34.076 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d67e30ba-d320-dd1c-9906-8b4bb1937be5.dc1 127.0.0.1 33:34.076 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21272 [Follower]" leader= 33:34.077 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d67e30ba-d320-dd1c-9906-8b4bb1937be5 127.0.0.1 2021-10-05T16:33:34.077Z [INFO] agent.router: Initializing LAN area manager 33:34.078 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21267 network=udp 33:34.078 [INFO] TestAgent.server: Adding LAN server: server="Node-d67e30ba-d320-dd1c-9906-8b4bb1937be5 (Addr: tcp/127.0.0.1:21272) (DC: dc1)" 33:34.078 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d67e30ba-d320-dd1c-9906-8b4bb1937be5.dc1 area=wan 33:34.078 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21267 network=tcp 33:34.079 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21268 network=tcp 33:34.079 [INFO] TestAgent: started state syncer 33:34.080 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21273 network=tcp 33:34.129 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.129 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21272 [Candidate]" term=2 33:34.169 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.169 [DEBUG] TestAgent.server.raft: vote granted: from=d67e30ba-d320-dd1c-9906-8b4bb1937be5 term=2 tally=1 33:34.169 [INFO] TestAgent.server.raft: election won: tally=1 33:34.169 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21272 [Leader]" 33:34.172 [INFO] TestAgent.server: cluster leadership acquired 33:34.174 [INFO] TestAgent.server: New leader elected: payload=Node-d67e30ba-d320-dd1c-9906-8b4bb1937be5 33:34.214 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21272 33:34.246 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:37708 latency=12.493831ms 33:34.247 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:37710 latency=500.848µs 33:34.248 [INFO] TestAgent: Requesting shutdown 33:34.248 [INFO] TestAgent.server: shutting down server 33:34.248 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.248 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:34.255 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.267Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.267Z [INFO] agent.router.manager: shutting down 33:34.282 [ERROR] TestAgent.server: failed to establish leadership: error="error configuring provider: leadership lost while committing log" 33:34.292 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 33:34.292 [INFO] TestAgent: consul server down 33:34.292 [INFO] TestAgent: shutdown complete 33:34.292 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21267 network=tcp 33:34.292 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21267 network=udp 33:34.292 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21268 network=tcp 33:34.796 [INFO] TestAgent: Waiting for endpoints to shut down 33:34.796 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand_EmptyDataQuoted (1.28s) 2021-10-05T16:33:33.858Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.931Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:34.059 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:f7e52f82-b835-fbd3-6286-e9aafca0e354 Address:127.0.0.1:21279}]" 33:34.060 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21279 [Follower]" leader= 33:34.060 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-f7e52f82-b835-fbd3-6286-e9aafca0e354.dc1 127.0.0.1 33:34.060 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-f7e52f82-b835-fbd3-6286-e9aafca0e354 127.0.0.1 2021-10-05T16:33:34.060Z [INFO] agent.router: Initializing LAN area manager 33:34.061 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21274 network=udp 33:34.061 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-f7e52f82-b835-fbd3-6286-e9aafca0e354.dc1 area=wan 33:34.061 [INFO] TestAgent.server: Adding LAN server: server="Node-f7e52f82-b835-fbd3-6286-e9aafca0e354 (Addr: tcp/127.0.0.1:21279) (DC: dc1)" 33:34.061 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21274 network=tcp 33:34.073 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21275 network=tcp 33:34.074 [INFO] TestAgent: started state syncer 33:34.074 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21280 network=tcp 33:34.113 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.113 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21279 [Candidate]" term=2 33:34.160 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.160 [DEBUG] TestAgent.server.raft: vote granted: from=f7e52f82-b835-fbd3-6286-e9aafca0e354 term=2 tally=1 33:34.160 [INFO] TestAgent.server.raft: election won: tally=1 33:34.160 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21279 [Leader]" 33:34.161 [INFO] TestAgent.server: cluster leadership acquired 33:34.161 [INFO] TestAgent.server: New leader elected: payload=Node-f7e52f82-b835-fbd3-6286-e9aafca0e354 33:34.193 [INFO] TestAgent: Synced node info 33:34.193 [DEBUG] TestAgent: Node info in sync 33:34.193 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21279 33:34.272 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:34.272 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:45644 latency=11.880871ms 33:34.278 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:45648 latency=464.172µs 33:34.296 [INFO] TestAgent: Requesting shutdown 33:34.296 [INFO] TestAgent.server: shutting down server 33:34.296 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.308 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.324Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.324Z [INFO] agent.router.manager: shutting down 33:34.324 [INFO] TestAgent: consul server down 33:34.324 [INFO] TestAgent: shutdown complete 33:34.324 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21274 network=tcp 33:34.324 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21274 network=udp 33:34.324 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21275 network=tcp 33:34.324 [ERROR] TestAgent.server.connect: Raft apply failed: error="raft is already shutdown" 33:34.324 [ERROR] TestAgent.server: failed to establish leadership: error="raft is already shutdown" 33:34.324 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 33:34.826 [INFO] TestAgent: Waiting for endpoints to shut down 33:34.826 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand_Base64 (1.31s) 2021-10-05T16:33:33.678Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.898Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:34.012 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 Address:127.0.0.1:21265}]" 33:34.032 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1.dc1 127.0.0.1 33:34.032 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21265 [Follower]" leader= 33:34.032 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 127.0.0.1 2021-10-05T16:33:34.032Z [INFO] agent.router: Initializing LAN area manager 33:34.033 [INFO] TestAgent.server: Adding LAN server: server="Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 (Addr: tcp/127.0.0.1:21265) (DC: dc1)" 33:34.033 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1.dc1 area=wan 33:34.033 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21260 network=tcp 33:34.033 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21260 network=udp 33:34.034 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21261 network=tcp 33:34.034 [INFO] TestAgent: started state syncer 33:34.034 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21266 network=tcp 33:34.078 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.078 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21265 [Candidate]" term=2 33:34.111 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.111 [DEBUG] TestAgent.server.raft: vote granted: from=9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 term=2 tally=1 33:34.111 [INFO] TestAgent.server.raft: election won: tally=1 33:34.111 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21265 [Leader]" 33:34.111 [INFO] TestAgent.server: cluster leadership acquired 33:34.111 [INFO] TestAgent.server: New leader elected: payload=Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 33:34.151 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21265 33:34.276 [INFO] TestAgent: Synced node info 33:34.276 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:34.313 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:34370 latency=84.373122ms 33:34.317 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:34.317 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:34.317 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:34.317 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:34.317 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:34.320 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 33:34.320 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 33:34.321 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:34382 latency=4.367406ms 33:34.321 [INFO] TestAgent: Requesting shutdown 33:34.321 [INFO] TestAgent.server: shutting down server 33:34.321 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:34.321 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:34.321 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:34.321 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:34.321 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.321 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:34.321 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:34.324 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:34.327 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.336Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.336Z [INFO] agent.router.manager: shutting down 33:34.368 [INFO] TestAgent: consul server down 33:34.368 [INFO] TestAgent: shutdown complete 33:34.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21260 network=tcp 33:34.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21260 network=udp 33:34.368 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21261 network=tcp 33:34.368 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 127.0.0.1 21263 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:9880dcf0-c7b5-d875-a34b-5b618d0f6bb1 port:21265 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:21264] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 33:34.368 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="error performing federation state anti-entropy sync: leadership lost while committing log" 33:34.368 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:34.870 [INFO] TestAgent: Waiting for endpoints to shut down 33:34.870 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand_Stdin (1.36s) 2021-10-05T16:33:33.676Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.768Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:34.013 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0116787e-d8d3-5c6a-ab87-93c60836507d Address:127.0.0.1:21244}]" 33:34.032 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0116787e-d8d3-5c6a-ab87-93c60836507d.dc1 127.0.0.1 33:34.033 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0116787e-d8d3-5c6a-ab87-93c60836507d 127.0.0.1 2021-10-05T16:33:34.033Z [INFO] agent.router: Initializing LAN area manager 33:34.033 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=udp 33:34.033 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21244 [Follower]" leader= 33:34.034 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21239 network=tcp 33:34.034 [INFO] TestAgent.server: Adding LAN server: server="Node-0116787e-d8d3-5c6a-ab87-93c60836507d (Addr: tcp/127.0.0.1:21244) (DC: dc1)" 33:34.034 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0116787e-d8d3-5c6a-ab87-93c60836507d.dc1 area=wan 33:34.034 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21240 network=tcp 33:34.035 [INFO] TestAgent: started state syncer 33:34.035 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21245 network=tcp 33:34.077 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.077 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21244 [Candidate]" term=2 33:34.109 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.109 [DEBUG] TestAgent.server.raft: vote granted: from=0116787e-d8d3-5c6a-ab87-93c60836507d term=2 tally=1 33:34.109 [INFO] TestAgent.server.raft: election won: tally=1 33:34.109 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21244 [Leader]" 33:34.109 [INFO] TestAgent.server: cluster leadership acquired 33:34.109 [INFO] TestAgent.server: New leader elected: payload=Node-0116787e-d8d3-5c6a-ab87-93c60836507d 33:34.132 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21244 33:34.172 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:34.268 [INFO] TestAgent: Synced node info 33:34.268 [DEBUG] TestAgent: Node info in sync 33:34.284 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:34.284 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:34.284 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:34.284 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:34.284 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:34.284 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0116787e-d8d3-5c6a-ab87-93c60836507d 33:34.286 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0116787e-d8d3-5c6a-ab87-93c60836507d 33:34.286 [DEBUG] TestAgent: Node info in sync 33:34.341 [INFO] TestAgent.server: federation state anti-entropy synced 33:34.341 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:37292 latency=65.105797ms 33:34.363 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:37298 latency=239.183µs 33:34.363 [INFO] TestAgent: Requesting shutdown 33:34.363 [INFO] TestAgent.server: shutting down server 33:34.363 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:34.363 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:34.363 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:34.363 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:34.363 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.363 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:34.363 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:34.363 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:34.363 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:34.363 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:34.371 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.379Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.379Z [INFO] agent.router.manager: shutting down 33:34.379 [INFO] TestAgent: consul server down 33:34.379 [INFO] TestAgent: shutdown complete 33:34.379 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=tcp 33:34.379 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21239 network=udp 33:34.379 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21240 network=tcp 33:34.884 [INFO] TestAgent: Waiting for endpoints to shut down 33:34.884 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand_File (1.38s) 2021-10-05T16:33:33.769Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.879Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:33.972 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9f212213-c039-dd31-cfc2-16b770421ba0 Address:127.0.0.1:21258}]" 33:33.972 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21258 [Follower]" leader= 33:33.973 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9f212213-c039-dd31-cfc2-16b770421ba0.dc1 127.0.0.1 33:34.030 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.031 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21258 [Candidate]" term=2 33:34.034 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9f212213-c039-dd31-cfc2-16b770421ba0 127.0.0.1 2021-10-05T16:33:34.034Z [INFO] agent.router: Initializing LAN area manager 33:34.034 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21253 network=udp 33:34.034 [INFO] TestAgent.server: Adding LAN server: server="Node-9f212213-c039-dd31-cfc2-16b770421ba0 (Addr: tcp/127.0.0.1:21258) (DC: dc1)" 33:34.034 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9f212213-c039-dd31-cfc2-16b770421ba0.dc1 area=wan 33:34.034 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21253 network=tcp 33:34.035 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21254 network=tcp 33:34.035 [INFO] TestAgent: started state syncer 33:34.035 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21259 network=tcp 33:34.055 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.055 [DEBUG] TestAgent.server.raft: vote granted: from=9f212213-c039-dd31-cfc2-16b770421ba0 term=2 tally=1 33:34.055 [INFO] TestAgent.server.raft: election won: tally=1 33:34.055 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21258 [Leader]" 33:34.055 [INFO] TestAgent.server: cluster leadership acquired 33:34.056 [INFO] TestAgent.server: New leader elected: payload=Node-9f212213-c039-dd31-cfc2-16b770421ba0 33:34.076 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21258 33:34.132 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:34.180 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:34.180 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:34.180 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:34.180 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:34.180 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:34.180 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9f212213-c039-dd31-cfc2-16b770421ba0 33:34.180 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9f212213-c039-dd31-cfc2-16b770421ba0 33:34.244 [INFO] TestAgent: Synced node info 33:34.244 [DEBUG] TestAgent: Node info in sync 33:34.244 [INFO] TestAgent.server: federation state anti-entropy synced 33:34.418 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:59636 latency=6.326173ms 33:34.420 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:59638 latency=219.98µs 33:34.421 [INFO] TestAgent: Requesting shutdown 33:34.421 [INFO] TestAgent.server: shutting down server 33:34.421 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:34.421 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:34.421 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:34.421 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:34.421 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.421 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:34.421 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:34.421 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:34.421 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:34.421 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:34.428 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.435Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.435Z [INFO] agent.router.manager: shutting down 33:34.435 [INFO] TestAgent: consul server down 33:34.435 [INFO] TestAgent: shutdown complete 33:34.435 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21253 network=tcp 33:34.435 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21253 network=udp 33:34.435 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21254 network=tcp 33:34.936 [INFO] TestAgent: Waiting for endpoints to shut down 33:34.936 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand_NegativeVal (1.43s) 2021-10-05T16:33:33.930Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.962Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:34.089 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:34227373-eb46-397d-7067-7ae4611ab7a3 Address:127.0.0.1:21286}]" 33:34.090 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-34227373-eb46-397d-7067-7ae4611ab7a3.dc1 127.0.0.1 33:34.090 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-34227373-eb46-397d-7067-7ae4611ab7a3 127.0.0.1 2021-10-05T16:33:34.090Z [INFO] agent.router: Initializing LAN area manager 33:34.091 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21281 network=udp 33:34.091 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21286 [Follower]" leader= 33:34.091 [INFO] TestAgent.server: Adding LAN server: server="Node-34227373-eb46-397d-7067-7ae4611ab7a3 (Addr: tcp/127.0.0.1:21286) (DC: dc1)" 33:34.091 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-34227373-eb46-397d-7067-7ae4611ab7a3.dc1 area=wan 33:34.091 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21281 network=tcp 33:34.092 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21282 network=tcp 33:34.092 [INFO] TestAgent: started state syncer 33:34.092 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21287 network=tcp 33:34.161 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.161 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21286 [Candidate]" term=2 33:34.215 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.215 [DEBUG] TestAgent.server.raft: vote granted: from=34227373-eb46-397d-7067-7ae4611ab7a3 term=2 tally=1 33:34.215 [INFO] TestAgent.server.raft: election won: tally=1 33:34.215 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21286 [Leader]" 33:34.216 [INFO] TestAgent.server: cluster leadership acquired 33:34.216 [INFO] TestAgent.server: New leader elected: payload=Node-34227373-eb46-397d-7067-7ae4611ab7a3 33:34.245 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21286 33:34.275 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:34.333 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:34.333 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:34.333 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:34.333 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:34.333 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:34.333 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-34227373-eb46-397d-7067-7ae4611ab7a3 33:34.333 [INFO] TestAgent.server: member joined, marking health alive: member=Node-34227373-eb46-397d-7067-7ae4611ab7a3 33:34.405 [INFO] TestAgent.server: federation state anti-entropy synced 33:34.406 [INFO] TestAgent: Synced node info 33:34.460 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:34.460 [DEBUG] TestAgent: Node info in sync 33:34.460 [DEBUG] TestAgent: Node info in sync 33:34.484 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo from=127.0.0.1:58416 latency=4.340599ms 33:34.489 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:58418 latency=290.847µs 33:34.490 [INFO] TestAgent: Requesting shutdown 33:34.490 [INFO] TestAgent.server: shutting down server 33:34.490 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:34.490 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:34.490 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:34.490 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:34.490 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.490 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:34.490 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:34.490 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:34.490 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:34.490 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:34.494 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.498Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.498Z [INFO] agent.router.manager: shutting down 33:34.498 [INFO] TestAgent: consul server down 33:34.498 [INFO] TestAgent: shutdown complete 33:34.498 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21281 network=tcp 33:34.498 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21281 network=udp 33:34.498 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21282 network=tcp 33:35.000 [INFO] TestAgent: Waiting for endpoints to shut down 33:35.000 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand (1.49s) 2021-10-05T16:33:33.875Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:33.960Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:34.114 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8 Address:127.0.0.1:21251}]" 33:34.115 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8.dc1 127.0.0.1 33:34.116 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8 127.0.0.1 2021-10-05T16:33:34.116Z [INFO] agent.router: Initializing LAN area manager 33:34.116 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21246 network=udp 33:34.116 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:21251 [Follower]" leader= 33:34.116 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8.dc1 area=wan 33:34.116 [INFO] TestAgent.server: Adding LAN server: server="Node-e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8 (Addr: tcp/127.0.0.1:21251) (DC: dc1)" 33:34.117 [INFO] TestAgent: Started DNS server: address=127.0.0.1:21246 network=tcp 33:34.117 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:21247 network=tcp 33:34.117 [INFO] TestAgent: started state syncer 33:34.117 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:21252 network=tcp 33:34.156 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:34.157 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:21251 [Candidate]" term=2 33:34.234 [DEBUG] TestAgent.server.raft: votes: needed=1 33:34.234 [DEBUG] TestAgent.server.raft: vote granted: from=e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8 term=2 tally=1 33:34.234 [INFO] TestAgent.server.raft: election won: tally=1 33:34.234 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:21251 [Leader]" 33:34.235 [INFO] TestAgent.server: cluster leadership acquired 33:34.235 [INFO] TestAgent.server: New leader elected: payload=Node-e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8 33:34.248 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:21251 33:34.281 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:34.410 [INFO] TestAgent: Synced node info 33:34.419 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:34.419 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:34.419 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:34.419 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:34.419 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:34.419 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8 33:34.419 [INFO] TestAgent.server: member joined, marking health alive: member=Node-e0789ff8-a8fa-dfe5-116d-60f4d7edd1b8 33:34.434 [INFO] TestAgent.server: federation state anti-entropy synced 33:34.545 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/foo?flags=12345 from=127.0.0.1:33676 latency=24.101241ms 33:34.552 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/foo from=127.0.0.1:33678 latency=257.005µs 33:34.556 [INFO] TestAgent: Requesting shutdown 33:34.556 [INFO] TestAgent.server: shutting down server 33:34.556 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:34.556 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:34.556 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:34.556 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:34.556 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:34.556 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:34.556 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:34.556 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:34.556 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:34.556 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:34.564 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:34.572Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:34.572Z [INFO] agent.router.manager: shutting down 33:34.572 [INFO] TestAgent: consul server down 33:34.572 [INFO] TestAgent: shutdown complete 33:34.572 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21246 network=tcp 33:34.572 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:21246 network=udp 33:34.572 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:21247 network=tcp 33:35.076 [INFO] TestAgent: Waiting for endpoints to shut down 33:35.076 [INFO] TestAgent: Endpoints down --- PASS: TestKVPutCommand_Flags (1.57s) PASS ok github.com/hashicorp/consul/command/kv/put 1.775s === RUN TestLeaveCommand_noTabs === PAUSE TestLeaveCommand_noTabs === RUN TestLeaveCommand === PAUSE TestLeaveCommand === RUN TestLeaveCommand_FailOnNonFlagArgs === PAUSE TestLeaveCommand_FailOnNonFlagArgs === CONT TestLeaveCommand_noTabs --- PASS: TestLeaveCommand_noTabs (0.00s) === CONT TestLeaveCommand_FailOnNonFlagArgs [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestLeaveCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:39.555Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:39.602Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:39.688 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bbc3cdd1-3d60-8589-09f6-82c53014594d Address:127.0.0.1:14090}]" 33:39.689 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bbc3cdd1-3d60-8589-09f6-82c53014594d.dc1 127.0.0.1 33:39.689 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14090 [Follower]" leader= 33:39.689 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bbc3cdd1-3d60-8589-09f6-82c53014594d 127.0.0.1 2021-10-05T16:33:39.690Z [INFO] agent.router: Initializing LAN area manager 33:39.690 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=udp 33:39.690 [INFO] TestAgent.server: Adding LAN server: server="Node-bbc3cdd1-3d60-8589-09f6-82c53014594d (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 33:39.690 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bbc3cdd1-3d60-8589-09f6-82c53014594d.dc1 area=wan 33:39.691 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=tcp 33:39.691 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14086 network=tcp 33:39.691 [INFO] TestAgent: started state syncer 33:39.691 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14091 network=tcp 33:39.736 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:39.736 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14090 [Candidate]" term=2 33:39.761 [DEBUG] TestAgent.server.raft: votes: needed=1 33:39.761 [DEBUG] TestAgent.server.raft: vote granted: from=bbc3cdd1-3d60-8589-09f6-82c53014594d term=2 tally=1 33:39.761 [INFO] TestAgent.server.raft: election won: tally=1 33:39.761 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14090 [Leader]" 33:39.761 [INFO] TestAgent.server: cluster leadership acquired 33:39.761 [INFO] TestAgent.server: New leader elected: payload=Node-bbc3cdd1-3d60-8589-09f6-82c53014594d 33:39.767 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:14090 33:39.824 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:39.873 [INFO] TestAgent: Synced node info 33:39.873 [DEBUG] TestAgent: Node info in sync 33:39.897 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:39.897 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:39.897 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:39.897 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:39.897 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:39.897 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bbc3cdd1-3d60-8589-09f6-82c53014594d 33:39.897 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bbc3cdd1-3d60-8589-09f6-82c53014594d 33:39.917 [INFO] TestAgent.server: federation state anti-entropy synced 33:40.028 [INFO] TestAgent: Requesting shutdown 33:40.029 [INFO] TestAgent.server: shutting down server 33:40.029 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:40.029 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:40.029 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:40.029 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:40.029 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:40.029 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:40.029 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:40.029 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:40.029 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:40.029 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:40.040 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:40.040Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:40.040Z [INFO] agent.router.manager: shutting down 33:40.040 [INFO] TestAgent: consul server down 33:40.040 [INFO] TestAgent: shutdown complete 33:40.040 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=tcp 33:40.040 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=udp 33:40.040 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14086 network=tcp 33:40.544 [INFO] TestAgent: Waiting for endpoints to shut down 33:40.544 [INFO] TestAgent: Endpoints down --- PASS: TestLeaveCommand_FailOnNonFlagArgs (1.09s) 2021-10-05T16:33:39.562Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:39.630Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:39.712 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:09828261-2155-52e8-91d8-8f6111edbb2c Address:127.0.0.1:14097}]" 33:39.712 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-09828261-2155-52e8-91d8-8f6111edbb2c.dc1 127.0.0.1 33:39.713 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-09828261-2155-52e8-91d8-8f6111edbb2c 127.0.0.1 2021-10-05T16:33:39.713Z [INFO] agent.router: Initializing LAN area manager 33:39.713 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=udp 33:39.713 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14097 [Follower]" leader= 33:39.713 [INFO] TestAgent.server: Adding LAN server: server="Node-09828261-2155-52e8-91d8-8f6111edbb2c (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 33:39.713 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-09828261-2155-52e8-91d8-8f6111edbb2c.dc1 area=wan 33:39.714 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14092 network=tcp 33:39.714 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14093 network=tcp 33:39.714 [INFO] TestAgent: started state syncer 33:39.714 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14098 network=tcp 33:39.782 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:39.782 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14097 [Candidate]" term=2 33:39.791 [DEBUG] TestAgent.server.raft: votes: needed=1 33:39.791 [DEBUG] TestAgent.server.raft: vote granted: from=09828261-2155-52e8-91d8-8f6111edbb2c term=2 tally=1 33:39.791 [INFO] TestAgent.server.raft: election won: tally=1 33:39.791 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14097 [Leader]" 33:39.794 [INFO] TestAgent.server: cluster leadership acquired 33:39.796 [INFO] TestAgent.server: New leader elected: payload=Node-09828261-2155-52e8-91d8-8f6111edbb2c 33:39.796 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:14097 33:39.811 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:39.839 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:39.839 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:39.839 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:39.839 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:39.839 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:39.839 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-09828261-2155-52e8-91d8-8f6111edbb2c 33:39.839 [INFO] TestAgent.server: member joined, marking health alive: member=Node-09828261-2155-52e8-91d8-8f6111edbb2c 33:39.872 [INFO] TestAgent: Synced node info 33:39.872 [DEBUG] TestAgent: Node info in sync 33:39.890 [INFO] TestAgent.server: federation state anti-entropy synced 33:40.049 [INFO] TestAgent.server: server starting leave 33:40.049 [INFO] TestAgent.server.serf.wan: serf: EventMemberLeave: Node-09828261-2155-52e8-91d8-8f6111edbb2c.dc1 127.0.0.1 33:40.049 [INFO] TestAgent.server: Handled event for server in area: event=member-leave server=Node-09828261-2155-52e8-91d8-8f6111edbb2c.dc1 area=wan 2021-10-05T16:33:40.049Z [INFO] agent.router.manager: shutting down 33:41.328 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:41.328 [DEBUG] TestAgent: Node info in sync 33:43.052 [INFO] TestAgent.server.serf.lan: serf: EventMemberLeave: Node-09828261-2155-52e8-91d8-8f6111edbb2c 127.0.0.1 33:43.052 [INFO] TestAgent.server: Removing LAN server: server="Node-09828261-2155-52e8-91d8-8f6111edbb2c (Addr: tcp/127.0.0.1:14097) (DC: dc1)" 33:43.052 [WARN] TestAgent.server: deregistering self should be done by follower: name=Node-09828261-2155-52e8-91d8-8f6111edbb2c 33:43.801 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 33:45.801 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 33:46.056 [INFO] TestAgent.server: Waiting to drain RPC traffic: drain_time=5s 33:47.800 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 33:49.804 [ERROR] TestAgent.server.autopilot: Error promoting servers: error="error getting server raft protocol versions: No servers found" 33:49.804 [ERROR] TestAgent.server.autopilot: Error updating cluster health: error="error getting server raft protocol versions: No servers found" 33:51.060 [INFO] TestAgent: Requesting shutdown 33:51.060 [INFO] TestAgent.server: shutting down server 33:51.060 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:51.060 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:51.060 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:51.060 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:51.060 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:51.060 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:51.060 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:51.060 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:51.060 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 2021-10-05T16:33:51.073Z [INFO] agent.router.manager: shutting down 33:51.074 [INFO] TestAgent: consul server down 33:51.074 [INFO] TestAgent: shutdown complete 33:51.074 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/leave from=127.0.0.1:32836 latency=11.024774113s 33:51.076 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=tcp 33:51.076 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14092 network=udp 33:51.076 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14093 network=tcp 33:51.576 [INFO] TestAgent: Waiting for endpoints to shut down 33:51.576 [INFO] TestAgent: Endpoints down --- PASS: TestLeaveCommand (12.12s) PASS ok github.com/hashicorp/consul/command/leave 12.216s === RUN TestLockCommand_noTabs === PAUSE TestLockCommand_noTabs === RUN TestLockCommand_BadArgs === PAUSE TestLockCommand_BadArgs === RUN TestLockCommand === PAUSE TestLockCommand === RUN TestLockCommand_NoShell === PAUSE TestLockCommand_NoShell === RUN TestLockCommand_TryLock === PAUSE TestLockCommand_TryLock === RUN TestLockCommand_TrySemaphore === PAUSE TestLockCommand_TrySemaphore === RUN TestLockCommand_MonitorRetry_Lock_Default === PAUSE TestLockCommand_MonitorRetry_Lock_Default === RUN TestLockCommand_MonitorRetry_Semaphore_Default === PAUSE TestLockCommand_MonitorRetry_Semaphore_Default === RUN TestLockCommand_MonitorRetry_Lock_Arg === PAUSE TestLockCommand_MonitorRetry_Lock_Arg === RUN TestLockCommand_MonitorRetry_Semaphore_Arg === PAUSE TestLockCommand_MonitorRetry_Semaphore_Arg === RUN TestLockCommand_ChildExitCode === PAUSE TestLockCommand_ChildExitCode === CONT TestLockCommand_noTabs === CONT TestLockCommand_MonitorRetry_Semaphore_Default === CONT TestLockCommand_TryLock === CONT TestLockCommand === CONT TestLockCommand_NoShell === CONT TestLockCommand_ChildExitCode [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... --- PASS: TestLockCommand_noTabs (0.00s) === CONT TestLockCommand_BadArgs === CONT TestLockCommand_MonitorRetry_Lock_Default === CONT TestLockCommand_TrySemaphore === CONT TestLockCommand_MonitorRetry_Semaphore_Arg === CONT TestLockCommand_MonitorRetry_Lock_Arg --- PASS: TestLockCommand_BadArgs (0.02s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestLockCommand_ChildExitCode/clean_exit === RUN TestLockCommand_ChildExitCode/error_exit === RUN TestLockCommand_ChildExitCode/not_propagated 2021-10-05T16:33:43.131Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.249Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.413 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:54bed6f3-748e-af67-8b07-d7a6cd9d6c14 Address:127.0.0.1:30426}]" 33:43.414 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-54bed6f3-748e-af67-8b07-d7a6cd9d6c14.dc1 127.0.0.1 33:43.415 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-54bed6f3-748e-af67-8b07-d7a6cd9d6c14 127.0.0.1 2021-10-05T16:33:43.415Z [INFO] agent.router: Initializing LAN area manager 33:43.428 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=udp 33:43.428 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30426 [Follower]" leader= 33:43.429 [INFO] TestAgent.server: Adding LAN server: server="Node-54bed6f3-748e-af67-8b07-d7a6cd9d6c14 (Addr: tcp/127.0.0.1:30426) (DC: dc1)" 33:43.429 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-54bed6f3-748e-af67-8b07-d7a6cd9d6c14.dc1 area=wan 33:43.429 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=tcp 33:43.430 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30422 network=tcp 33:43.430 [INFO] TestAgent: started state syncer 33:43.432 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30427 network=tcp 33:43.500 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.500 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30426 [Candidate]" term=2 33:43.520 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.520 [DEBUG] TestAgent.server.raft: vote granted: from=54bed6f3-748e-af67-8b07-d7a6cd9d6c14 term=2 tally=1 33:43.520 [INFO] TestAgent.server.raft: election won: tally=1 33:43.520 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30426 [Leader]" 33:43.521 [INFO] TestAgent.server: cluster leadership acquired 33:43.521 [INFO] TestAgent.server: New leader elected: payload=Node-54bed6f3-748e-af67-8b07-d7a6cd9d6c14 33:43.527 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30426 33:43.568 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.639 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.639 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.639 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.639 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.639 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.639 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-54bed6f3-748e-af67-8b07-d7a6cd9d6c14 33:43.639 [INFO] TestAgent.server: member joined, marking health alive: member=Node-54bed6f3-748e-af67-8b07-d7a6cd9d6c14 33:43.680 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:55718 latency=1.905695ms 33:43.684 [INFO] TestAgent.server: federation state anti-entropy synced 33:43.700 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:55718 latency=17.214908ms 33:43.710 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:43.718 [INFO] TestAgent: Synced node info 33:43.730 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/68043c89-232f-e79f-af6e-d7deb215de45?acquire=68043c89-232f-e79f-af6e-d7deb215de45&flags=16210313421097356768 from=127.0.0.1:55718 latency=17.825566ms 33:43.731 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?recurse=&wait=15000ms from=127.0.0.1:55718 latency=338.365µs 33:43.750 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?cas=0&flags=16210313421097356768 from=127.0.0.1:55718 latency=14.577235ms 33:43.758 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?consistent=&recurse= from=127.0.0.1:55718 latency=6.812617ms 33:43.761 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:55718 latency=1.352036ms 33:43.778 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?cas=15&flags=16210313421097356768 from=127.0.0.1:55718 latency=12.354382ms 33:43.778 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?consistent=&index=15&recurse= from=127.0.0.1:55720 latency=18.821933ms 33:43.794 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/68043c89-232f-e79f-af6e-d7deb215de45 from=127.0.0.1:55718 latency=8.567678ms 33:43.796 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?recurse= from=127.0.0.1:55718 latency=610.527µs 33:43.821 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=16 from=127.0.0.1:55718 latency=22.289242ms 33:43.822 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/68043c89-232f-e79f-af6e-d7deb215de45 from=127.0.0.1:55720 latency=27.733461ms 33:43.823 [INFO] TestAgent: Requesting shutdown 33:43.823 [INFO] TestAgent.server: shutting down server 33:43.823 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:43.823 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:43.823 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:43.823 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:43.823 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:43.823 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:43.823 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:43.823 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:43.823 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:43.823 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:43.831 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:43.839Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:43.839Z [INFO] agent.router.manager: shutting down 33:43.839 [INFO] TestAgent: consul server down 33:43.839 [INFO] TestAgent: shutdown complete 33:43.839 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=tcp 33:43.839 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=udp 33:43.839 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30422 network=tcp 33:44.340 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.340 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_MonitorRetry_Semaphore_Default (1.31s) 2021-10-05T16:33:43.254Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.299Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.490 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:95204445-fc8e-d776-cb30-43827310c65d Address:127.0.0.1:30447}]" 33:43.512 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30447 [Follower]" leader= 33:43.547 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-95204445-fc8e-d776-cb30-43827310c65d.dc1 127.0.0.1 33:43.547 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-95204445-fc8e-d776-cb30-43827310c65d 127.0.0.1 2021-10-05T16:33:43.547Z [INFO] agent.router: Initializing LAN area manager 33:43.547 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30442 network=udp 33:43.564 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30442 network=tcp 33:43.565 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30443 network=tcp 33:43.565 [INFO] TestAgent: started state syncer 33:43.565 [INFO] TestAgent.server: Adding LAN server: server="Node-95204445-fc8e-d776-cb30-43827310c65d (Addr: tcp/127.0.0.1:30447) (DC: dc1)" 33:43.565 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30448 network=tcp 33:43.565 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-95204445-fc8e-d776-cb30-43827310c65d.dc1 area=wan 33:43.580 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.580 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30447 [Candidate]" term=2 33:43.636 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.636 [DEBUG] TestAgent.server.raft: vote granted: from=95204445-fc8e-d776-cb30-43827310c65d term=2 tally=1 33:43.636 [INFO] TestAgent.server.raft: election won: tally=1 33:43.636 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30447 [Leader]" 33:43.638 [INFO] TestAgent.server: cluster leadership acquired 33:43.639 [INFO] TestAgent.server: New leader elected: payload=Node-95204445-fc8e-d776-cb30-43827310c65d 33:43.655 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30447 33:43.707 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.786 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.786 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.786 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.786 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.786 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.786 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-95204445-fc8e-d776-cb30-43827310c65d 33:43.786 [INFO] TestAgent.server: member joined, marking health alive: member=Node-95204445-fc8e-d776-cb30-43827310c65d 33:43.826 [INFO] TestAgent.server: federation state anti-entropy synced 33:43.854 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:51630 latency=13.008577ms 33:43.869 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:51630 latency=9.170188ms 33:43.872 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=10000ms from=127.0.0.1:51630 latency=57.699µs 33:43.887 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=dcbd7bc6-ec81-a342-022d-d0d65c6ef340&flags=3304740253564472344 from=127.0.0.1:51630 latency=14.80847ms 33:43.895 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:51630 latency=4.851578ms 33:43.912 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:43.917 [INFO] TestAgent: Synced node info 33:43.942 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent=&index=13 from=127.0.0.1:51630 latency=31.978932ms 33:43.944 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=dcbd7bc6-ec81-a342-022d-d0d65c6ef340 from=127.0.0.1:51640 latency=22.466466ms 33:43.957 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:51640 latency=11.069267ms 33:43.964 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/dcbd7bc6-ec81-a342-022d-d0d65c6ef340 from=127.0.0.1:51630 latency=19.178056ms 33:44.010 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=15 from=127.0.0.1:51640 latency=49.301695ms 33:44.014 [INFO] TestAgent: Requesting shutdown 33:44.014 [INFO] TestAgent.server: shutting down server 33:44.014 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.014 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.014 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.014 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.014 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.014 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.014 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.014 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.014 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.014 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.024 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:44.036Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.040Z [INFO] agent.router.manager: shutting down 33:44.044 [INFO] TestAgent: consul server down 33:44.044 [INFO] TestAgent: shutdown complete 33:44.044 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30442 network=tcp 33:44.045 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30442 network=udp 33:44.045 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30443 network=tcp 33:44.548 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.548 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_TryLock (1.52s) 2021-10-05T16:33:43.279Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.436Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.496 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:78fabf2e-c1d9-8be0-9909-d0f7196e1f24 Address:127.0.0.1:30440}]" 33:43.496 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-78fabf2e-c1d9-8be0-9909-d0f7196e1f24.dc1 127.0.0.1 33:43.497 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30440 [Follower]" leader= 33:43.535 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.535 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30440 [Candidate]" term=2 33:43.545 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-78fabf2e-c1d9-8be0-9909-d0f7196e1f24 127.0.0.1 2021-10-05T16:33:43.545Z [INFO] agent.router: Initializing LAN area manager 33:43.546 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30435 network=udp 33:43.549 [INFO] TestAgent.server: Adding LAN server: server="Node-78fabf2e-c1d9-8be0-9909-d0f7196e1f24 (Addr: tcp/127.0.0.1:30440) (DC: dc1)" 33:43.564 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-78fabf2e-c1d9-8be0-9909-d0f7196e1f24.dc1 area=wan 33:43.566 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30435 network=tcp 33:43.567 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30436 network=tcp 33:43.567 [INFO] TestAgent: started state syncer 33:43.567 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30441 network=tcp 33:43.582 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.582 [DEBUG] TestAgent.server.raft: vote granted: from=78fabf2e-c1d9-8be0-9909-d0f7196e1f24 term=2 tally=1 33:43.582 [INFO] TestAgent.server.raft: election won: tally=1 33:43.582 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30440 [Leader]" 33:43.584 [INFO] TestAgent.server: cluster leadership acquired 33:43.584 [INFO] TestAgent.server: New leader elected: payload=Node-78fabf2e-c1d9-8be0-9909-d0f7196e1f24 33:43.608 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30440 33:43.660 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.718 [INFO] TestAgent: Synced node info 33:43.737 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.737 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.737 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.737 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.737 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.737 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-78fabf2e-c1d9-8be0-9909-d0f7196e1f24 33:43.737 [INFO] TestAgent.server: member joined, marking health alive: member=Node-78fabf2e-c1d9-8be0-9909-d0f7196e1f24 33:43.765 [INFO] TestAgent.server: federation state anti-entropy synced 33:43.874 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:51770 latency=1.57632ms 33:43.899 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:51770 latency=21.083131ms 33:43.911 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=15000ms from=127.0.0.1:51770 latency=267.402µs 33:43.956 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=757bd25c-1299-2405-360a-ade057884950&flags=3304740253564472344 from=127.0.0.1:51770 latency=44.553822ms 33:44.005 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:51770 latency=23.334578ms 33:44.025 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=757bd25c-1299-2405-360a-ade057884950 from=127.0.0.1:51788 latency=12.169547ms 33:44.025 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent=&index=14 from=127.0.0.1:51770 latency=17.5974ms 33:44.049 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:51788 latency=14.459852ms 33:44.078 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/757bd25c-1299-2405-360a-ade057884950 from=127.0.0.1:51770 latency=51.998224ms 33:44.080 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=15 from=127.0.0.1:51788 latency=30.22639ms 33:44.082 [INFO] TestAgent: Requesting shutdown 33:44.082 [INFO] TestAgent.server: shutting down server 33:44.082 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.082 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.082 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.082 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.082 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.082 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.082 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.082 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.082 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.082 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.094 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:44.106Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.106Z [INFO] agent.router.manager: shutting down 33:44.107 [INFO] TestAgent: consul server down 33:44.107 [INFO] TestAgent: shutdown complete 33:44.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30435 network=tcp 33:44.107 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30435 network=udp 33:44.108 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30436 network=tcp 33:44.612 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.612 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_NoShell (1.58s) 2021-10-05T16:33:43.429Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.547Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.655 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:da279459-eba7-14a0-300c-c74738528af9 Address:127.0.0.1:30482}]" 33:43.673 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-da279459-eba7-14a0-300c-c74738528af9.dc1 127.0.0.1 33:43.673 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-da279459-eba7-14a0-300c-c74738528af9 127.0.0.1 2021-10-05T16:33:43.673Z [INFO] agent.router: Initializing LAN area manager 33:43.674 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30477 network=udp 33:43.674 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30482 [Follower]" leader= 33:43.674 [INFO] TestAgent.server: Adding LAN server: server="Node-da279459-eba7-14a0-300c-c74738528af9 (Addr: tcp/127.0.0.1:30482) (DC: dc1)" 33:43.674 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-da279459-eba7-14a0-300c-c74738528af9.dc1 area=wan 33:43.674 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30477 network=tcp 33:43.675 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30478 network=tcp 33:43.675 [INFO] TestAgent: started state syncer 33:43.675 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30483 network=tcp 33:43.711 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.711 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30482 [Candidate]" term=2 33:43.735 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.736 [DEBUG] TestAgent.server.raft: vote granted: from=da279459-eba7-14a0-300c-c74738528af9 term=2 tally=1 33:43.736 [INFO] TestAgent.server.raft: election won: tally=1 33:43.736 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30482 [Leader]" 33:43.736 [INFO] TestAgent.server: cluster leadership acquired 33:43.736 [INFO] TestAgent.server: New leader elected: payload=Node-da279459-eba7-14a0-300c-c74738528af9 33:43.763 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30482 33:43.807 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.844 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.844 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.845 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.845 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.845 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.845 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-da279459-eba7-14a0-300c-c74738528af9 33:43.845 [INFO] TestAgent.server: member joined, marking health alive: member=Node-da279459-eba7-14a0-300c-c74738528af9 33:43.871 [INFO] TestAgent.server: federation state anti-entropy synced 33:43.884 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:39526 latency=1.683261ms 33:43.918 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:39526 latency=28.975144ms 33:43.923 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=15000ms from=127.0.0.1:39526 latency=52.357µs 33:43.957 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=c0cd0381-429a-eb69-617f-10f05622690a&flags=3304740253564472344 from=127.0.0.1:39526 latency=33.046936ms 33:44.006 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:39526 latency=15.048447ms 33:44.039 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent=&index=13 from=127.0.0.1:39526 latency=31.933746ms 33:44.058 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=c0cd0381-429a-eb69-617f-10f05622690a from=127.0.0.1:39538 latency=51.748844ms 33:44.059 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:39538 latency=509.119µs 33:44.076 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:44.099 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=14 from=127.0.0.1:39538 latency=38.693168ms 33:44.099 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/c0cd0381-429a-eb69-617f-10f05622690a from=127.0.0.1:39526 latency=40.429774ms 33:44.101 [INFO] TestAgent: Requesting shutdown 33:44.101 [INFO] TestAgent.server: shutting down server 33:44.101 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.101 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.101 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.101 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.101 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.101 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.101 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.101 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.101 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.101 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.116 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 33:44.120 [INFO] TestAgent: Synced node info 33:44.120 [DEBUG] TestAgent: Node info in sync 2021-10-05T16:33:44.120Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.120Z [INFO] agent.router.manager: shutting down 33:44.120 [INFO] TestAgent: consul server down 33:44.121 [INFO] TestAgent: shutdown complete 33:44.121 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30477 network=tcp 33:44.121 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30477 network=udp 33:44.121 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30478 network=tcp 33:44.636 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.636 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_MonitorRetry_Lock_Arg (1.59s) 2021-10-05T16:33:43.499Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.537Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.645 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:24f45052-4bf6-0c9e-273d-d9b253d13b6a Address:127.0.0.1:30461}]" 33:43.651 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30461 [Follower]" leader= 33:43.677 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-24f45052-4bf6-0c9e-273d-d9b253d13b6a.dc1 127.0.0.1 33:43.678 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-24f45052-4bf6-0c9e-273d-d9b253d13b6a 127.0.0.1 2021-10-05T16:33:43.678Z [INFO] agent.router: Initializing LAN area manager 33:43.678 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30456 network=udp 33:43.684 [INFO] TestAgent.server: Adding LAN server: server="Node-24f45052-4bf6-0c9e-273d-d9b253d13b6a (Addr: tcp/127.0.0.1:30461) (DC: dc1)" 33:43.684 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-24f45052-4bf6-0c9e-273d-d9b253d13b6a.dc1 area=wan 33:43.684 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30456 network=tcp 33:43.685 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30457 network=tcp 33:43.685 [INFO] TestAgent: started state syncer 33:43.685 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30462 network=tcp 33:43.720 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.720 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30461 [Candidate]" term=2 33:43.744 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.744 [DEBUG] TestAgent.server.raft: vote granted: from=24f45052-4bf6-0c9e-273d-d9b253d13b6a term=2 tally=1 33:43.744 [INFO] TestAgent.server.raft: election won: tally=1 33:43.744 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30461 [Leader]" 33:43.745 [INFO] TestAgent.server: cluster leadership acquired 33:43.745 [INFO] TestAgent.server: New leader elected: payload=Node-24f45052-4bf6-0c9e-273d-d9b253d13b6a 33:43.762 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30461 33:43.800 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.872 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.872 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.872 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.872 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.872 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.872 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-24f45052-4bf6-0c9e-273d-d9b253d13b6a 33:43.872 [INFO] TestAgent.server: member joined, marking health alive: member=Node-24f45052-4bf6-0c9e-273d-d9b253d13b6a 33:43.898 [INFO] TestAgent.server: federation state anti-entropy synced 33:43.914 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:44244 latency=4.192923ms 33:43.945 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:44244 latency=24.746189ms 33:43.955 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:43.957 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=15000ms from=127.0.0.1:44244 latency=65.859µs 33:43.995 [INFO] TestAgent: Synced node info 33:44.011 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=04851cc2-b78b-97d9-691d-1d9b95746e65&flags=3304740253564472344 from=127.0.0.1:44244 latency=24.301308ms 33:44.019 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:44244 latency=4.066691ms 33:44.083 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent=&index=14 from=127.0.0.1:44244 latency=62.937753ms 33:44.083 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=04851cc2-b78b-97d9-691d-1d9b95746e65 from=127.0.0.1:44260 latency=24.535902ms 33:44.085 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:44260 latency=211.506µs 33:44.110 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/04851cc2-b78b-97d9-691d-1d9b95746e65 from=127.0.0.1:44244 latency=25.737344ms 33:44.124 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=15 from=127.0.0.1:44260 latency=39.013404ms 33:44.126 [INFO] TestAgent: Requesting shutdown 33:44.126 [INFO] TestAgent.server: shutting down server 33:44.126 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.126 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.126 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.126 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.126 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.127 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.127 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.127 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.127 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.127 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.136 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:44.142Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.142Z [INFO] agent.router.manager: shutting down 33:44.142 [INFO] TestAgent: consul server down 33:44.142 [INFO] TestAgent: shutdown complete 33:44.142 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30456 network=tcp 33:44.142 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30456 network=udp 33:44.142 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30457 network=tcp 33:44.643 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.643 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_MonitorRetry_Lock_Default (1.60s) 2021-10-05T16:33:43.355Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.460Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.648 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f Address:127.0.0.1:30468}]" 33:43.649 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f.dc1 127.0.0.1 33:43.651 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f 127.0.0.1 2021-10-05T16:33:43.651Z [INFO] agent.router: Initializing LAN area manager 33:43.651 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30463 network=udp 33:43.651 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30468 [Follower]" leader= 33:43.674 [INFO] TestAgent.server: Adding LAN server: server="Node-3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f (Addr: tcp/127.0.0.1:30468) (DC: dc1)" 33:43.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30463 network=tcp 33:43.683 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f.dc1 area=wan 33:43.688 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30464 network=tcp 33:43.688 [INFO] TestAgent: started state syncer 33:43.689 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30469 network=tcp 33:43.714 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.714 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30468 [Candidate]" term=2 33:43.742 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.742 [DEBUG] TestAgent.server.raft: vote granted: from=3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f term=2 tally=1 33:43.742 [INFO] TestAgent.server.raft: election won: tally=1 33:43.742 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30468 [Leader]" 33:43.742 [INFO] TestAgent.server: cluster leadership acquired 33:43.742 [INFO] TestAgent.server: New leader elected: payload=Node-3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f 33:43.774 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30468 33:43.820 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.860 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.860 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.860 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.860 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.860 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.860 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f 33:43.860 [INFO] TestAgent.server: member joined, marking health alive: member=Node-3ba2c7c9-8f4b-5e10-e4a6-bc328b5be62f 33:43.883 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:48130 latency=1.781167ms 33:43.884 [INFO] TestAgent.server: federation state anti-entropy synced 33:43.919 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:48130 latency=4.189207ms 33:43.954 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/1cc0ed47-2b90-cb46-4233-50be73f71423?acquire=1cc0ed47-2b90-cb46-4233-50be73f71423&flags=16210313421097356768 from=127.0.0.1:48130 latency=25.59269ms 33:44.013 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?recurse=&wait=10000ms from=127.0.0.1:48130 latency=15.349598ms 33:44.026 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?cas=0&flags=16210313421097356768 from=127.0.0.1:48130 latency=12.164074ms 33:44.046 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:44.060 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:48146 latency=2.23063ms 33:44.081 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?consistent=&recurse= from=127.0.0.1:48130 latency=33.371273ms 33:44.082 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?cas=14&flags=16210313421097356768 from=127.0.0.1:48146 latency=21.063907ms 33:44.082 [INFO] TestAgent: Synced node info 33:44.089 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?consistent=&index=14&recurse= from=127.0.0.1:48130 latency=6.05369ms 33:44.089 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/1cc0ed47-2b90-cb46-4233-50be73f71423 from=127.0.0.1:48146 latency=6.538591ms 33:44.094 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?recurse= from=127.0.0.1:48146 latency=171.087µs 33:44.112 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/1cc0ed47-2b90-cb46-4233-50be73f71423 from=127.0.0.1:48130 latency=18.268874ms 33:44.125 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=16 from=127.0.0.1:48146 latency=24.351665ms 33:44.125 [INFO] TestAgent: Requesting shutdown 33:44.125 [INFO] TestAgent.server: shutting down server 33:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.125 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.125 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.126 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.126 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.126 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.126 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.126 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.136 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:44.148Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.148Z [INFO] agent.router.manager: shutting down 33:44.152 [INFO] TestAgent: consul server down 33:44.152 [INFO] TestAgent: shutdown complete 33:44.152 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30463 network=tcp 33:44.152 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30463 network=udp 33:44.152 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30464 network=tcp 33:44.653 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.653 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_TrySemaphore (1.61s) 2021-10-05T16:33:43.171Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.381Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.472 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:152b5795-c054-dfab-0950-c33e52f4a2d1 Address:127.0.0.1:30433}]" 33:43.502 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30433 [Follower]" leader= 33:43.545 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-152b5795-c054-dfab-0950-c33e52f4a2d1.dc1 127.0.0.1 33:43.546 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.546 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30433 [Candidate]" term=2 33:43.556 [WARN] TestAgent.server.raft: unable to get address for sever, using fallback address: id=152b5795-c054-dfab-0950-c33e52f4a2d1 fallback=127.0.0.1:30433 error="Could not find address for server id 152b5795-c054-dfab-0950-c33e52f4a2d1" 33:43.564 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-152b5795-c054-dfab-0950-c33e52f4a2d1 127.0.0.1 2021-10-05T16:33:43.565Z [INFO] agent.router: Initializing LAN area manager 33:43.565 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30428 network=udp 33:43.565 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-152b5795-c054-dfab-0950-c33e52f4a2d1.dc1 area=wan 33:43.565 [INFO] TestAgent.server: Adding LAN server: server="Node-152b5795-c054-dfab-0950-c33e52f4a2d1 (Addr: tcp/127.0.0.1:30433) (DC: dc1)" 33:43.565 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30428 network=tcp 33:43.566 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30429 network=tcp 33:43.566 [INFO] TestAgent: started state syncer 33:43.566 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30434 network=tcp 33:43.589 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.589 [DEBUG] TestAgent.server.raft: vote granted: from=152b5795-c054-dfab-0950-c33e52f4a2d1 term=2 tally=1 33:43.589 [INFO] TestAgent.server.raft: election won: tally=1 33:43.589 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30433 [Leader]" 33:43.594 [INFO] TestAgent.server: cluster leadership acquired 33:43.594 [INFO] TestAgent.server: New leader elected: payload=Node-152b5795-c054-dfab-0950-c33e52f4a2d1 33:43.637 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30433 33:43.740 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.741 [INFO] TestAgent: Synced node info 33:43.812 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.812 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.812 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.812 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.812 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.812 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-152b5795-c054-dfab-0950-c33e52f4a2d1 33:43.812 [INFO] TestAgent.server: member joined, marking health alive: member=Node-152b5795-c054-dfab-0950-c33e52f4a2d1 33:43.860 [INFO] TestAgent.server: federation state anti-entropy synced 33:44.017 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:38626 latency=7.872698ms 33:44.052 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:38626 latency=29.538669ms 33:44.053 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=15000ms from=127.0.0.1:38626 latency=84.097µs 33:44.064 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=0f8fc3e9-3128-0c99-2c18-48c1f0ae43de&flags=3304740253564472344 from=127.0.0.1:38626 latency=11.132848ms 33:44.085 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:38626 latency=14.061868ms 33:44.088 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=0f8fc3e9-3128-0c99-2c18-48c1f0ae43de from=127.0.0.1:38636 latency=6.937491ms 33:44.093 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent=&index=14 from=127.0.0.1:38626 latency=375.101µs 33:44.093 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:38636 latency=347.154µs 33:44.132 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=15 from=127.0.0.1:38636 latency=38.195423ms 33:44.132 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/0f8fc3e9-3128-0c99-2c18-48c1f0ae43de from=127.0.0.1:38638 latency=39.067056ms 33:44.133 [INFO] TestAgent: Requesting shutdown 33:44.133 [INFO] TestAgent.server: shutting down server 33:44.133 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.133 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.133 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.133 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.133 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.133 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.133 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.134 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.134 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.134 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.148 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:44.156Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.156Z [INFO] agent.router.manager: shutting down 33:44.156 [INFO] TestAgent: consul server down 33:44.156 [INFO] TestAgent: shutdown complete 33:44.156 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30428 network=tcp 33:44.156 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30428 network=udp 33:44.156 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30429 network=tcp 33:44.658 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.658 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand (1.63s) 2021-10-05T16:33:43.547Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.583Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.656 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c4fe0992-47ff-0a14-b583-67024e7909cc Address:127.0.0.1:30475}]" 33:43.684 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c4fe0992-47ff-0a14-b583-67024e7909cc.dc1 127.0.0.1 33:43.684 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30475 [Follower]" leader= 33:43.684 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c4fe0992-47ff-0a14-b583-67024e7909cc 127.0.0.1 2021-10-05T16:33:43.684Z [INFO] agent.router: Initializing LAN area manager 33:43.685 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30470 network=udp 33:43.685 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c4fe0992-47ff-0a14-b583-67024e7909cc.dc1 area=wan 33:43.685 [INFO] TestAgent.server: Adding LAN server: server="Node-c4fe0992-47ff-0a14-b583-67024e7909cc (Addr: tcp/127.0.0.1:30475) (DC: dc1)" 33:43.685 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30470 network=tcp 33:43.685 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30471 network=tcp 33:43.686 [INFO] TestAgent: started state syncer 33:43.686 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30476 network=tcp 33:43.749 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.749 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30475 [Candidate]" term=2 33:43.784 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.785 [DEBUG] TestAgent.server.raft: vote granted: from=c4fe0992-47ff-0a14-b583-67024e7909cc term=2 tally=1 33:43.785 [INFO] TestAgent.server.raft: election won: tally=1 33:43.785 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30475 [Leader]" 33:43.786 [INFO] TestAgent.server: cluster leadership acquired 33:43.786 [INFO] TestAgent.server: New leader elected: payload=Node-c4fe0992-47ff-0a14-b583-67024e7909cc 33:43.813 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30475 33:43.845 [INFO] TestAgent: Synced node info 33:43.845 [DEBUG] TestAgent: Node info in sync 33:43.872 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.942 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.942 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.942 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.942 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.942 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.943 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c4fe0992-47ff-0a14-b583-67024e7909cc 33:43.943 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c4fe0992-47ff-0a14-b583-67024e7909cc 33:43.963 [INFO] TestAgent.server: federation state anti-entropy synced 33:44.013 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:50486 latency=6.655732ms 33:44.046 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:50486 latency=30.326381ms 33:44.061 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/d30ded77-67bb-e139-d49d-d8051f131e06?acquire=d30ded77-67bb-e139-d49d-d8051f131e06&flags=16210313421097356768 from=127.0.0.1:50486 latency=9.124347ms 33:44.089 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?recurse=&wait=15000ms from=127.0.0.1:50486 latency=11.370338ms 33:44.100 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?cas=0&flags=16210313421097356768 from=127.0.0.1:50486 latency=7.755598ms 33:44.112 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?consistent=&recurse= from=127.0.0.1:50486 latency=4.85039ms 33:44.125 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:50504 latency=954.243µs 33:44.137 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?cas=15&flags=16210313421097356768 from=127.0.0.1:50504 latency=10.264694ms 33:44.137 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?consistent=&index=15&recurse= from=127.0.0.1:50486 latency=20.875278ms 33:44.147 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/d30ded77-67bb-e139-d49d-d8051f131e06 from=127.0.0.1:50504 latency=7.030172ms 33:44.157 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix?recurse= from=127.0.0.1:50504 latency=666.582µs 33:44.165 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/d30ded77-67bb-e139-d49d-d8051f131e06 from=127.0.0.1:50486 latency=9.423932ms 33:44.166 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=16 from=127.0.0.1:50504 latency=5.21845ms 33:44.167 [INFO] TestAgent: Requesting shutdown 33:44.167 [INFO] TestAgent.server: shutting down server 33:44.167 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.167 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.167 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.167 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.167 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.167 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.167 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.167 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.167 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.167 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.171 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:44.176Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.176Z [INFO] agent.router.manager: shutting down 33:44.176 [INFO] TestAgent: consul server down 33:44.176 [INFO] TestAgent: shutdown complete 33:44.176 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30470 network=tcp 33:44.176 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30470 network=udp 33:44.176 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30471 network=tcp 33:44.677 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.677 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_MonitorRetry_Semaphore_Arg (1.63s) 2021-10-05T16:33:43.387Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:43.501Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:43.620 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1d46da6e-9190-0492-409b-b1317a09a603 Address:127.0.0.1:30454}]" 33:43.621 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1d46da6e-9190-0492-409b-b1317a09a603.dc1 127.0.0.1 33:43.621 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1d46da6e-9190-0492-409b-b1317a09a603 127.0.0.1 2021-10-05T16:33:43.621Z [INFO] agent.router: Initializing LAN area manager 33:43.641 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30454 [Follower]" leader= 33:43.644 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30449 network=udp 33:43.644 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30449 network=tcp 33:43.644 [INFO] TestAgent.server: Adding LAN server: server="Node-1d46da6e-9190-0492-409b-b1317a09a603 (Addr: tcp/127.0.0.1:30454) (DC: dc1)" 33:43.645 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1d46da6e-9190-0492-409b-b1317a09a603.dc1 area=wan 33:43.646 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30450 network=tcp 33:43.646 [INFO] TestAgent: started state syncer 33:43.675 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30455 network=tcp 33:43.704 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:43.704 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30454 [Candidate]" term=2 33:43.749 [DEBUG] TestAgent.server.raft: votes: needed=1 33:43.749 [DEBUG] TestAgent.server.raft: vote granted: from=1d46da6e-9190-0492-409b-b1317a09a603 term=2 tally=1 33:43.749 [INFO] TestAgent.server.raft: election won: tally=1 33:43.749 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30454 [Leader]" 33:43.749 [INFO] TestAgent.server: cluster leadership acquired 33:43.749 [INFO] TestAgent.server: New leader elected: payload=Node-1d46da6e-9190-0492-409b-b1317a09a603 33:43.774 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30454 33:43.819 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:43.876 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:43.877 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:43.877 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:43.877 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:43.877 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:43.877 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1d46da6e-9190-0492-409b-b1317a09a603 33:43.877 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1d46da6e-9190-0492-409b-b1317a09a603 33:43.890 [INFO] TestAgent.server: federation state anti-entropy synced 33:43.940 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:44080 latency=14.163023ms 33:44.003 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:44080 latency=29.476493ms 33:44.016 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:44.020 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=15000ms from=127.0.0.1:44080 latency=37.877µs 33:44.038 [INFO] TestAgent: Synced node info 33:44.045 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:44.045 [DEBUG] TestAgent: Node info in sync 33:44.045 [DEBUG] TestAgent: Node info in sync 33:44.053 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=44c51ca8-382e-7827-f3f7-860ce5b61aeb&flags=3304740253564472344 from=127.0.0.1:44080 latency=31.787842ms 33:44.060 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:44080 latency=354.837µs 33:44.078 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=44c51ca8-382e-7827-f3f7-860ce5b61aeb from=127.0.0.1:44094 latency=10.21408ms 33:44.079 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent=&index=14 from=127.0.0.1:44080 latency=18.151565ms 33:44.079 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:44080 latency=188.07µs 33:44.124 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=15 from=127.0.0.1:44080 latency=43.903877ms 33:44.125 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/44c51ca8-382e-7827-f3f7-860ce5b61aeb from=127.0.0.1:44094 latency=45.304809ms 33:44.130 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:44102 latency=1.704003ms 33:44.145 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:44102 latency=10.763107ms 33:44.145 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=15000ms from=127.0.0.1:44102 latency=46.699µs 33:44.152 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=87f0291f-ac30-bae4-a849-50b974d12384&flags=3304740253564472344 from=127.0.0.1:44102 latency=6.867035ms 33:44.176 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=87f0291f-ac30-bae4-a849-50b974d12384 from=127.0.0.1:44102 latency=9.930749ms 33:44.176 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:44104 latency=10.18713ms 33:44.178 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:44102 latency=543.325µs 33:44.186 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/87f0291f-ac30-bae4-a849-50b974d12384 from=127.0.0.1:44104 latency=8.662713ms 33:44.186 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=20 from=127.0.0.1:44102 latency=7.967126ms 33:44.189 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:44106 latency=1.492689ms 33:44.203 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/create from=127.0.0.1:44106 latency=10.915316ms 33:44.206 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?wait=15000ms from=127.0.0.1:44106 latency=67.529µs 33:44.210 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?acquire=703ae6b1-c3f6-5678-9202-7e5f0be2ffc2&flags=3304740253564472344 from=127.0.0.1:44106 latency=3.844162ms 33:44.215 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent= from=127.0.0.1:44106 latency=1.744838ms 33:44.234 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/test/prefix/.lock?flags=3304740253564472344&release=703ae6b1-c3f6-5678-9202-7e5f0be2ffc2 from=127.0.0.1:44108 latency=3.991973ms 33:44.235 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock?consistent=&index=24 from=127.0.0.1:44106 latency=17.96711ms 33:44.236 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/kv/test/prefix/.lock from=127.0.0.1:44108 latency=560.964µs 33:44.242 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/kv/test/prefix/.lock?cas=25 from=127.0.0.1:44108 latency=5.783668ms 33:44.242 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/session/destroy/703ae6b1-c3f6-5678-9202-7e5f0be2ffc2 from=127.0.0.1:44106 latency=7.283986ms 33:44.243 [INFO] TestAgent: Requesting shutdown 33:44.243 [INFO] TestAgent.server: shutting down server 33:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:44.243 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:44.243 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:44.243 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:44.243 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:44.246 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:44.262Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:44.262Z [INFO] agent.router.manager: shutting down 33:44.262 [INFO] TestAgent: consul server down 33:44.262 [INFO] TestAgent: shutdown complete 33:44.262 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30449 network=tcp 33:44.262 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30449 network=udp 33:44.262 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30450 network=tcp 33:44.764 [INFO] TestAgent: Waiting for endpoints to shut down 33:44.764 [INFO] TestAgent: Endpoints down --- PASS: TestLockCommand_ChildExitCode (1.74s) --- PASS: TestLockCommand_ChildExitCode/clean_exit (0.20s) --- PASS: TestLockCommand_ChildExitCode/error_exit (0.06s) --- PASS: TestLockCommand_ChildExitCode/not_propagated (0.06s) PASS ok github.com/hashicorp/consul/command/lock 1.966s === RUN TestLoginCommand_noTabs === PAUSE TestLoginCommand_noTabs === RUN TestLoginCommand === PAUSE TestLoginCommand === RUN TestLoginCommand_k8s === PAUSE TestLoginCommand_k8s === RUN TestLoginCommand_jwt === PAUSE TestLoginCommand_jwt === CONT TestLoginCommand_noTabs --- PASS: TestLoginCommand_noTabs (0.00s) === CONT TestLoginCommand_jwt [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestLoginCommand_k8s === CONT TestLoginCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestLoginCommand/method_is_required === RUN TestLoginCommand/token-sink-file_is_required === RUN TestLoginCommand/bearer-token-file_is_required === RUN TestLoginCommand/bearer-token-file_is_empty === RUN TestLoginCommand/try_login_with_no_method_configured === RUN TestLoginCommand_jwt/success_-_jwt_static_keys === RUN TestLoginCommand/try_login_with_method_configured_but_no_binding_rules === RUN TestLoginCommand/try_login_with_method_configured_and_binding_rules === RUN TestLoginCommand_jwt/success_-_jwt_jwks === RUN TestLoginCommand_k8s/try_login_with_method_configured_and_binding_rules === RUN TestLoginCommand_jwt/success_-_jwt_oidc_discovery 2021-10-05T16:33:45.347Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:45.402Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:45.504 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 Address:127.0.0.1:27377}]" 33:45.504 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27377 [Follower]" leader= 33:45.505 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1.dc1 127.0.0.1 33:45.505 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 127.0.0.1 2021-10-05T16:33:45.505Z [INFO] agent.router: Initializing LAN area manager 33:45.506 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27372 network=udp 33:45.506 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1.dc1 area=wan 33:45.506 [INFO] TestAgent.server: Adding LAN server: server="Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 (Addr: tcp/127.0.0.1:27377) (DC: dc1)" 33:45.506 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27372 network=tcp 33:45.506 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27373 network=tcp 33:45.506 [INFO] TestAgent: started state syncer 33:45.506 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27378 network=tcp 33:45.556 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 33:45.556 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:45.556 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27377 [Candidate]" term=2 33:45.573 [DEBUG] TestAgent.server.raft: votes: needed=1 33:45.573 [DEBUG] TestAgent.server.raft: vote granted: from=5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 term=2 tally=1 33:45.573 [INFO] TestAgent.server.raft: election won: tally=1 33:45.573 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27377 [Leader]" 33:45.573 [INFO] TestAgent.server: cluster leadership acquired 33:45.573 [INFO] TestAgent.server: New leader elected: payload=Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 33:45.583 [INFO] TestAgent.server: initializing acls 33:45.587 [INFO] TestAgent.server: Created ACL 'global-management' policy 33:45.587 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 33:45.593 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 33:45.608 [INFO] TestAgent.server: Created ACL anonymous token from configuration 33:45.608 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 33:45.608 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 33:45.608 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 33:45.608 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1.dc1 33:45.608 [INFO] TestAgent.server: Updating LAN server: server="Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 (Addr: tcp/127.0.0.1:27377) (DC: dc1)" 33:45.608 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1.dc1 area=wan 33:45.624 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:45.664 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:45.664 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:45.664 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:45.664 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:45.664 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:45.664 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 33:45.664 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 33:45.674 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5b406c34-2b52-602f-1c1c-dda5fa5d3bb1 33:45.682 [INFO] TestAgent.server: federation state anti-entropy synced 33:45.703 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/login from=127.0.0.1:37542 error="ACL not found" 33:45.703 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:37542 latency=328.978µs 33:45.715 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:37544 latency=7.190473ms 33:45.717 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/login from=127.0.0.1:37548 error="Permission denied" 33:45.717 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:37548 latency=275.276µs 33:45.723 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:37544 latency=5.451188ms 33:45.743 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:37550 latency=8.130841ms 33:45.749 [INFO] TestAgent: Requesting shutdown 33:45.749 [INFO] TestAgent.server: shutting down server 33:45.749 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 33:45.749 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 33:45.749 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:45.749 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:45.749 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:45.749 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:45.749 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:45.749 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:45.749 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:45.749 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:45.749 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 33:45.749 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 33:45.749 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:45.749 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:45.749 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:45.759 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:45.767Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:45.767Z [INFO] agent.router.manager: shutting down 33:45.767 [INFO] TestAgent: consul server down 33:45.767 [INFO] TestAgent: shutdown complete 33:45.767 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27372 network=tcp 33:45.767 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27372 network=udp 33:45.767 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27373 network=tcp 33:46.268 [INFO] TestAgent: Waiting for endpoints to shut down 33:46.268 [INFO] TestAgent: Endpoints down --- PASS: TestLoginCommand (1.06s) --- PASS: TestLoginCommand/method_is_required (0.00s) --- PASS: TestLoginCommand/token-sink-file_is_required (0.00s) --- PASS: TestLoginCommand/bearer-token-file_is_required (0.00s) --- PASS: TestLoginCommand/bearer-token-file_is_empty (0.00s) --- PASS: TestLoginCommand/try_login_with_no_method_configured (0.00s) --- PASS: TestLoginCommand/try_login_with_method_configured_but_no_binding_rules (0.00s) --- PASS: TestLoginCommand/try_login_with_method_configured_and_binding_rules (0.03s) 2021-10-05T16:33:45.297Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:45.381Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:45.439 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7dff90bc-1d65-f82c-5684-093745dff02b Address:127.0.0.1:27370}]" 33:45.440 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7dff90bc-1d65-f82c-5684-093745dff02b.dc1 127.0.0.1 33:45.440 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27370 [Follower]" leader= 33:45.457 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7dff90bc-1d65-f82c-5684-093745dff02b 127.0.0.1 2021-10-05T16:33:45.457Z [INFO] agent.router: Initializing LAN area manager 33:45.458 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=udp 33:45.458 [INFO] TestAgent.server: Adding LAN server: server="Node-7dff90bc-1d65-f82c-5684-093745dff02b (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 33:45.458 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7dff90bc-1d65-f82c-5684-093745dff02b.dc1 area=wan 33:45.458 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=tcp 33:45.460 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27366 network=tcp 33:45.489 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:45.489 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27370 [Candidate]" term=2 33:45.505 [INFO] TestAgent: started state syncer 33:45.505 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27371 network=tcp 33:45.506 [DEBUG] TestAgent.server.raft: votes: needed=1 33:45.506 [DEBUG] TestAgent.server.raft: vote granted: from=7dff90bc-1d65-f82c-5684-093745dff02b term=2 tally=1 33:45.506 [INFO] TestAgent.server.raft: election won: tally=1 33:45.506 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27370 [Leader]" 33:45.506 [INFO] TestAgent.server: cluster leadership acquired 33:45.506 [INFO] TestAgent.server: New leader elected: payload=Node-7dff90bc-1d65-f82c-5684-093745dff02b 33:45.512 [INFO] TestAgent.server: initializing acls 33:45.520 [INFO] TestAgent.server: Created ACL 'global-management' policy 33:45.520 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 33:45.520 [INFO] TestAgent.server: initializing acls 33:45.520 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 33:45.526 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 33:45.538 [INFO] TestAgent.server: Created ACL anonymous token from configuration 33:45.538 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 33:45.538 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 33:45.538 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 33:45.538 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7dff90bc-1d65-f82c-5684-093745dff02b 33:45.538 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7dff90bc-1d65-f82c-5684-093745dff02b.dc1 33:45.538 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7dff90bc-1d65-f82c-5684-093745dff02b.dc1 area=wan 33:45.538 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 33:45.538 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-7dff90bc-1d65-f82c-5684-093745dff02b 33:45.538 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-7dff90bc-1d65-f82c-5684-093745dff02b.dc1 33:45.539 [INFO] TestAgent.server: Updating LAN server: server="Node-7dff90bc-1d65-f82c-5684-093745dff02b (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 33:45.539 [INFO] TestAgent.server: Updating LAN server: server="Node-7dff90bc-1d65-f82c-5684-093745dff02b (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 33:45.539 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-7dff90bc-1d65-f82c-5684-093745dff02b.dc1 area=wan 33:45.549 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:45.574 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:45.574 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:45.574 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:45.574 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:45.574 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:45.574 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7dff90bc-1d65-f82c-5684-093745dff02b 33:45.574 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7dff90bc-1d65-f82c-5684-093745dff02b 33:45.580 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7dff90bc-1d65-f82c-5684-093745dff02b 33:45.580 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7dff90bc-1d65-f82c-5684-093745dff02b 33:45.587 [INFO] TestAgent.server: federation state anti-entropy synced 33:45.639 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:45.654 [INFO] TestAgent: Synced node info 33:45.654 [DEBUG] TestAgent: Node info in sync 33:45.840 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:36456 latency=17.7665ms 33:45.856 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:36456 latency=15.562714ms 33:45.925 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:36460 latency=57.29204ms 33:45.933 [INFO] TestAgent: Requesting shutdown 33:45.933 [INFO] TestAgent.server: shutting down server 33:45.933 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 33:45.933 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 33:45.933 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:45.933 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:45.933 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:45.933 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:45.933 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:45.933 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:45.933 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:45.933 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 33:45.933 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 33:45.933 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:45.933 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:45.933 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:45.939 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:45.947Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:45.947Z [INFO] agent.router.manager: shutting down 33:45.947 [INFO] TestAgent: consul server down 33:45.947 [INFO] TestAgent: shutdown complete 33:45.947 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=tcp 33:45.947 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=udp 33:45.947 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27366 network=tcp 33:46.449 [INFO] TestAgent: Waiting for endpoints to shut down 33:46.449 [INFO] TestAgent: Endpoints down --- PASS: TestLoginCommand_k8s (1.25s) --- PASS: TestLoginCommand_k8s/try_login_with_method_configured_and_binding_rules (0.07s) 2021-10-05T16:33:45.299Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:45.347Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:45.422 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 Address:127.0.0.1:27363}]" 33:45.423 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7.dc1 127.0.0.1 33:45.424 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 127.0.0.1 2021-10-05T16:33:45.424Z [INFO] agent.router: Initializing LAN area manager 33:45.424 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 33:45.439 [INFO] TestAgent.server: Adding LAN server: server="Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 33:45.439 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=udp 33:45.439 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=tcp 33:45.440 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7.dc1 area=wan 33:45.457 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27359 network=tcp 33:45.457 [INFO] TestAgent: started state syncer 33:45.458 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27364 network=tcp 33:45.489 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 33:45.493 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:45.493 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 33:45.520 [DEBUG] TestAgent.server.raft: votes: needed=1 33:45.520 [DEBUG] TestAgent.server.raft: vote granted: from=1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 term=2 tally=1 33:45.520 [INFO] TestAgent.server.raft: election won: tally=1 33:45.520 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 33:45.520 [INFO] TestAgent.server: cluster leadership acquired 33:45.520 [INFO] TestAgent.server: New leader elected: payload=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 33:45.556 [INFO] TestAgent.server: initializing acls 33:45.568 [INFO] TestAgent.server: Created ACL 'global-management' policy 33:45.568 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 33:45.590 [INFO] TestAgent.server: initializing acls 33:45.590 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 33:45.605 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 33:45.605 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 33:45.610 [INFO] TestAgent.server: Created ACL anonymous token from configuration 33:45.610 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 33:45.610 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 33:45.610 [DEBUG] TestAgent.server: transitioning out of legacy ACL mode 33:45.611 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 33:45.612 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7.dc1 33:45.612 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7.dc1 area=wan 33:45.612 [INFO] TestAgent.server: Updating LAN server: server="Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 33:45.616 [INFO] TestAgent.server: Created ACL anonymous token from configuration 33:45.616 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 33:45.616 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7.dc1 33:45.617 [INFO] TestAgent.server: Updating LAN server: server="Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 33:45.617 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7.dc1 area=wan 33:45.640 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:45.682 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:45.682 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:45.682 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:45.682 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:45.682 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:45.682 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 33:45.682 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 33:45.688 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 33:45.688 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1e53b862-ecba-a9c9-0bbc-529c22b6e9c7 33:45.696 [INFO] TestAgent.server: federation state anti-entropy synced 33:45.739 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:60160 latency=26.40912ms 33:45.759 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:60160 latency=11.795717ms 33:45.764 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:45.784 [INFO] TestAgent: Synced node info 33:45.785 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:60166 latency=20.176725ms 33:45.829 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:60160 latency=29.038895ms 33:45.859 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:60160 latency=28.964037ms 33:45.901 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:60176 latency=32.082026ms 33:45.942 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:60160 latency=33.503724ms 33:45.979 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:60160 latency=36.345465ms 33:45.993 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:60198 latency=9.898714ms 33:46.004 [INFO] TestAgent: Requesting shutdown 33:46.004 [INFO] TestAgent.server: shutting down server 33:46.004 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:46.004 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 33:46.004 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 33:46.004 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:46.004 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:46.004 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:46.004 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:46.004 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:46.004 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:46.004 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:46.004 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 33:46.004 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 33:46.004 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:46.004 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:46.016 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:46.028Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:46.028Z [INFO] agent.router.manager: shutting down 33:46.028 [INFO] TestAgent: consul server down 33:46.028 [INFO] TestAgent: shutdown complete 33:46.028 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 33:46.028 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 33:46.028 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 33:46.532 [INFO] TestAgent: Waiting for endpoints to shut down 33:46.532 [INFO] TestAgent: Endpoints down --- PASS: TestLoginCommand_jwt (1.33s) --- PASS: TestLoginCommand_jwt/success_-_jwt_static_keys (0.09s) --- PASS: TestLoginCommand_jwt/success_-_jwt_jwks (0.11s) --- PASS: TestLoginCommand_jwt/success_-_jwt_oidc_discovery (0.10s) PASS ok github.com/hashicorp/consul/command/login 1.432s === RUN TestLogout_noTabs === PAUSE TestLogout_noTabs === RUN TestLogoutCommand === PAUSE TestLogoutCommand === RUN TestLogoutCommand_k8s === PAUSE TestLogoutCommand_k8s === CONT TestLogout_noTabs --- PASS: TestLogout_noTabs (0.00s) === CONT TestLogoutCommand_k8s [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestLogoutCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestLogoutCommand/no_token_specified === RUN TestLogoutCommand/logout_of_deleted_token === RUN TestLogoutCommand/logout_of_ordinary_token === RUN TestLogoutCommand_k8s/no_token_specified === RUN TestLogoutCommand/logout_of_login_token === RUN TestLogoutCommand_k8s/logout_of_deleted_token === RUN TestLogoutCommand_k8s/logout_of_ordinary_token === RUN TestLogoutCommand_k8s/logout_of_login_token 2021-10-05T16:33:45.606Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:45.621Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:45.667 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9791eff9-d60d-2b19-313d-921a922d3603 Address:127.0.0.1:26349}]" 33:45.668 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26349 [Follower]" leader= 33:45.668 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9791eff9-d60d-2b19-313d-921a922d3603.dc1 127.0.0.1 33:45.669 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9791eff9-d60d-2b19-313d-921a922d3603 127.0.0.1 2021-10-05T16:33:45.669Z [INFO] agent.router: Initializing LAN area manager 33:45.670 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26344 network=udp 33:45.670 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9791eff9-d60d-2b19-313d-921a922d3603.dc1 area=wan 33:45.670 [INFO] TestAgent.server: Adding LAN server: server="Node-9791eff9-d60d-2b19-313d-921a922d3603 (Addr: tcp/127.0.0.1:26349) (DC: dc1)" 33:45.670 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26344 network=tcp 33:45.671 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26345 network=tcp 33:45.671 [INFO] TestAgent: started state syncer 33:45.671 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26350 network=tcp 33:45.710 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:45.710 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26349 [Candidate]" term=2 33:45.720 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 33:45.738 [DEBUG] TestAgent.server.raft: votes: needed=1 33:45.738 [DEBUG] TestAgent.server.raft: vote granted: from=9791eff9-d60d-2b19-313d-921a922d3603 term=2 tally=1 33:45.738 [INFO] TestAgent.server.raft: election won: tally=1 33:45.738 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26349 [Leader]" 33:45.738 [INFO] TestAgent.server: cluster leadership acquired 33:45.738 [INFO] TestAgent.server: New leader elected: payload=Node-9791eff9-d60d-2b19-313d-921a922d3603 33:45.746 [INFO] TestAgent.server: initializing acls 33:45.751 [INFO] TestAgent.server: Created ACL 'global-management' policy 33:45.751 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 33:45.768 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 33:45.788 [INFO] TestAgent.server: Created ACL anonymous token from configuration 33:45.788 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 33:45.788 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 33:45.788 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-9791eff9-d60d-2b19-313d-921a922d3603 33:45.788 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-9791eff9-d60d-2b19-313d-921a922d3603.dc1 33:45.791 [INFO] TestAgent.server: Updating LAN server: server="Node-9791eff9-d60d-2b19-313d-921a922d3603 (Addr: tcp/127.0.0.1:26349) (DC: dc1)" 33:45.791 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-9791eff9-d60d-2b19-313d-921a922d3603.dc1 area=wan 33:45.807 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:45.880 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:45.880 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:45.880 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:45.880 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:45.880 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:45.880 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9791eff9-d60d-2b19-313d-921a922d3603 33:45.880 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9791eff9-d60d-2b19-313d-921a922d3603 33:45.896 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9791eff9-d60d-2b19-313d-921a922d3603 33:45.914 [INFO] TestAgent.server: federation state anti-entropy synced 33:45.936 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/logout from=127.0.0.1:43162 error="ACL not found" 33:45.939 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:43162 latency=2.250982ms 33:45.941 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/logout from=127.0.0.1:43168 error="ACL not found" 33:45.942 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:43168 latency=301.276µs 33:45.972 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:43170 latency=24.931303ms 33:45.977 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/logout from=127.0.0.1:43176 error="Permission denied" 33:45.980 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:43176 latency=2.664693ms 33:45.999 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:43170 latency=17.548429ms 33:46.020 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:43170 latency=20.076861ms 33:46.038 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:43170 latency=16.316355ms 33:46.048 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:46.080 [INFO] TestAgent: Synced node info 33:46.089 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:43182 latency=46.579923ms 33:46.092 [INFO] TestAgent: Requesting shutdown 33:46.092 [INFO] TestAgent.server: shutting down server 33:46.092 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 33:46.092 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 33:46.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:46.092 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:46.092 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:46.092 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:46.092 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:46.092 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:46.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:46.092 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 33:46.092 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 33:46.092 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:46.092 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:46.092 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:46.102 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:46.111Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:46.111Z [INFO] agent.router.manager: shutting down 33:46.111 [INFO] TestAgent: consul server down 33:46.111 [INFO] TestAgent: shutdown complete 33:46.111 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26344 network=tcp 33:46.111 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26344 network=udp 33:46.111 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26345 network=tcp 33:46.612 [INFO] TestAgent: Waiting for endpoints to shut down 33:46.612 [INFO] TestAgent: Endpoints down --- PASS: TestLogoutCommand (1.11s) --- PASS: TestLogoutCommand/no_token_specified (0.04s) --- PASS: TestLogoutCommand/logout_of_deleted_token (0.00s) --- PASS: TestLogoutCommand/logout_of_ordinary_token (0.00s) --- PASS: TestLogoutCommand/logout_of_login_token (0.05s) 2021-10-05T16:33:45.574Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:45.640Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:45.690 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:df457432-5f5b-c484-4f36-13fa1c576200 Address:127.0.0.1:26342}]" 33:45.691 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-df457432-5f5b-c484-4f36-13fa1c576200.dc1 127.0.0.1 33:45.692 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26342 [Follower]" leader= 33:45.692 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-df457432-5f5b-c484-4f36-13fa1c576200 127.0.0.1 2021-10-05T16:33:45.693Z [INFO] agent.router: Initializing LAN area manager 33:45.693 [INFO] TestAgent.server: Adding LAN server: server="Node-df457432-5f5b-c484-4f36-13fa1c576200 (Addr: tcp/127.0.0.1:26342) (DC: dc1)" 33:45.693 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-df457432-5f5b-c484-4f36-13fa1c576200.dc1 area=wan 33:45.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=udp 33:45.693 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=tcp 33:45.694 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26338 network=tcp 33:45.694 [INFO] TestAgent: started state syncer 33:45.694 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26343 network=tcp 33:45.738 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:45.738 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26342 [Candidate]" term=2 33:45.743 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=3 mode=2 found=true leader= 33:45.782 [DEBUG] TestAgent.server.raft: votes: needed=1 33:45.782 [DEBUG] TestAgent.server.raft: vote granted: from=df457432-5f5b-c484-4f36-13fa1c576200 term=2 tally=1 33:45.782 [INFO] TestAgent.server.raft: election won: tally=1 33:45.782 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26342 [Leader]" 33:45.784 [INFO] TestAgent.server: cluster leadership acquired 33:45.784 [INFO] TestAgent.server: New leader elected: payload=Node-df457432-5f5b-c484-4f36-13fa1c576200 33:45.792 [INFO] TestAgent.server: initializing acls 33:45.795 [INFO] TestAgent.server: Created ACL 'global-management' policy 33:45.795 [WARN] TestAgent.server: Configuring a non-UUID master token is deprecated 33:45.801 [INFO] TestAgent.server: Bootstrapped ACL master token from configuration 33:45.816 [INFO] TestAgent.server: Created ACL anonymous token from configuration 33:45.816 [INFO] TestAgent.leader: started routine: routine="legacy ACL token upgrade" 33:45.816 [INFO] TestAgent.leader: started routine: routine="acl token reaping" 33:45.816 [INFO] TestAgent.server.serf.lan: serf: EventMemberUpdate: Node-df457432-5f5b-c484-4f36-13fa1c576200 33:45.816 [INFO] TestAgent.server.serf.wan: serf: EventMemberUpdate: Node-df457432-5f5b-c484-4f36-13fa1c576200.dc1 33:45.817 [INFO] TestAgent.server: Updating LAN server: server="Node-df457432-5f5b-c484-4f36-13fa1c576200 (Addr: tcp/127.0.0.1:26342) (DC: dc1)" 33:45.817 [INFO] TestAgent.server: Handled event for server in area: event=member-update server=Node-df457432-5f5b-c484-4f36-13fa1c576200.dc1 area=wan 33:45.827 [INFO] TestAgent: Synced node info 33:45.827 [DEBUG] TestAgent: Node info in sync 33:45.847 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:45.874 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:45.874 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:45.874 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:45.874 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:45.874 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:45.874 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-df457432-5f5b-c484-4f36-13fa1c576200 33:45.874 [INFO] TestAgent.server: member joined, marking health alive: member=Node-df457432-5f5b-c484-4f36-13fa1c576200 33:45.885 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-df457432-5f5b-c484-4f36-13fa1c576200 33:45.900 [INFO] TestAgent.server: federation state anti-entropy synced 33:46.041 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/logout from=127.0.0.1:59102 error="ACL not found" 33:46.041 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:59102 latency=147.845µs 33:46.043 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/logout from=127.0.0.1:59106 error="ACL not found" 33:46.043 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:59106 latency=373.505µs 33:46.073 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/token from=127.0.0.1:59108 latency=21.302603ms 33:46.093 [ERROR] TestAgent.http: Request error: method=POST url=/v1/acl/logout from=127.0.0.1:59110 error="Permission denied" 33:46.095 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:59110 latency=1.331054ms 33:46.128 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/auth-method from=127.0.0.1:59108 latency=16.613478ms 33:46.152 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/acl/binding-rule from=127.0.0.1:59108 latency=19.871814ms 33:46.212 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/login from=127.0.0.1:59108 latency=56.35583ms 33:46.240 [DEBUG] TestAgent.http: Request finished: method=POST url=/v1/acl/logout from=127.0.0.1:59114 latency=16.389008ms 33:46.244 [INFO] TestAgent: Requesting shutdown 33:46.244 [INFO] TestAgent.server: shutting down server 33:46.244 [DEBUG] TestAgent.leader: stopping routine: routine="legacy ACL token upgrade" 33:46.244 [DEBUG] TestAgent.leader: stopping routine: routine="acl token reaping" 33:46.244 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:46.244 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:46.244 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:46.244 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:46.244 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:46.244 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:46.244 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:46.244 [DEBUG] TestAgent.leader: stopped routine: routine="legacy ACL token upgrade" 33:46.244 [DEBUG] TestAgent.leader: stopped routine: routine="acl token reaping" 33:46.244 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:46.244 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:46.244 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:46.260 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:46.269Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:46.269Z [INFO] agent.router.manager: shutting down 33:46.269 [INFO] TestAgent: consul server down 33:46.269 [INFO] TestAgent: shutdown complete 33:46.269 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=tcp 33:46.269 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=udp 33:46.269 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26338 network=tcp 33:46.772 [INFO] TestAgent: Waiting for endpoints to shut down 33:46.772 [INFO] TestAgent: Endpoints down --- PASS: TestLogoutCommand_k8s (1.27s) --- PASS: TestLogoutCommand_k8s/no_token_specified (0.01s) --- PASS: TestLogoutCommand_k8s/logout_of_deleted_token (0.00s) --- PASS: TestLogoutCommand_k8s/logout_of_ordinary_token (0.01s) --- PASS: TestLogoutCommand_k8s/logout_of_login_token (0.03s) PASS ok github.com/hashicorp/consul/command/logout 1.381s === RUN TestMaintCommand_noTabs === PAUSE TestMaintCommand_noTabs === RUN TestMaintCommand_ConflictingArgs === PAUSE TestMaintCommand_ConflictingArgs === RUN TestMaintCommand_NoArgs === PAUSE TestMaintCommand_NoArgs === RUN TestMaintCommand_EnableNodeMaintenance === PAUSE TestMaintCommand_EnableNodeMaintenance === RUN TestMaintCommand_DisableNodeMaintenance === PAUSE TestMaintCommand_DisableNodeMaintenance === RUN TestMaintCommand_EnableServiceMaintenance === PAUSE TestMaintCommand_EnableServiceMaintenance === RUN TestMaintCommand_DisableServiceMaintenance === PAUSE TestMaintCommand_DisableServiceMaintenance === RUN TestMaintCommand_ServiceMaintenance_NoService === PAUSE TestMaintCommand_ServiceMaintenance_NoService === CONT TestMaintCommand_noTabs --- PASS: TestMaintCommand_noTabs (0.00s) === CONT TestMaintCommand_ServiceMaintenance_NoService [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestMaintCommand_DisableNodeMaintenance === CONT TestMaintCommand_DisableServiceMaintenance === CONT TestMaintCommand_NoArgs === CONT TestMaintCommand_EnableServiceMaintenance === CONT TestMaintCommand_EnableNodeMaintenance === CONT TestMaintCommand_ConflictingArgs --- PASS: TestMaintCommand_ConflictingArgs (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:56.099Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:56.123Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:56.238 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7aac7243-27ba-ed5d-781c-ef9322cd3251 Address:127.0.0.1:26377}]" 33:56.238 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26377 [Follower]" leader= 33:56.244 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7aac7243-27ba-ed5d-781c-ef9322cd3251.dc1 127.0.0.1 33:56.250 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7aac7243-27ba-ed5d-781c-ef9322cd3251 127.0.0.1 2021-10-05T16:33:56.250Z [INFO] agent.router: Initializing LAN area manager 33:56.301 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26372 network=udp 33:56.301 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26372 network=tcp 33:56.301 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26373 network=tcp 33:56.302 [INFO] TestAgent: started state syncer 33:56.302 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26378 network=tcp 33:56.302 [INFO] TestAgent.server: Adding LAN server: server="Node-7aac7243-27ba-ed5d-781c-ef9322cd3251 (Addr: tcp/127.0.0.1:26377) (DC: dc1)" 33:56.302 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7aac7243-27ba-ed5d-781c-ef9322cd3251.dc1 area=wan 33:56.307 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:56.307 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26377 [Candidate]" term=2 33:56.344 [DEBUG] TestAgent.server.raft: votes: needed=1 33:56.344 [DEBUG] TestAgent.server.raft: vote granted: from=7aac7243-27ba-ed5d-781c-ef9322cd3251 term=2 tally=1 33:56.344 [INFO] TestAgent.server.raft: election won: tally=1 33:56.344 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26377 [Leader]" 33:56.348 [INFO] TestAgent.server: cluster leadership acquired 33:56.348 [INFO] TestAgent.server: New leader elected: payload=Node-7aac7243-27ba-ed5d-781c-ef9322cd3251 33:56.396 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:26377 33:56.428 [INFO] TestAgent: Synced node info 33:56.456 [INFO] TestAgent: Node entered maintenance mode 33:56.456 [DEBUG] TestAgent: Node info in sync 33:56.464 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:56.468 [INFO] TestAgent: Synced check: check=_node_maintenance 33:56.468 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/maintenance?enable=true&reason=broken from=127.0.0.1:50038 latency=26.926654ms 33:56.468 [INFO] TestAgent: Requesting shutdown 33:56.468 [INFO] TestAgent.server: shutting down server 33:56.468 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:56.484 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:56.506Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:56.506Z [INFO] agent.router.manager: shutting down 33:56.516 [INFO] TestAgent: consul server down 33:56.516 [INFO] TestAgent: shutdown complete 33:56.516 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26372 network=tcp 33:56.516 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26372 network=udp 33:56.516 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26373 network=tcp 33:56.516 [ERROR] TestAgent.server.connect: Raft apply failed: error="leadership lost while committing log" 33:56.516 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 33:56.516 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 33:57.017 [INFO] TestAgent: Waiting for endpoints to shut down 33:57.017 [INFO] TestAgent: Endpoints down --- PASS: TestMaintCommand_EnableNodeMaintenance (1.14s) 2021-10-05T16:33:56.157Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:56.218Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:56.338 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d880131c-e480-a291-b4a4-00b178b047ac Address:127.0.0.1:26363}]" 33:56.339 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d880131c-e480-a291-b4a4-00b178b047ac.dc1 127.0.0.1 33:56.340 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d880131c-e480-a291-b4a4-00b178b047ac 127.0.0.1 2021-10-05T16:33:56.340Z [INFO] agent.router: Initializing LAN area manager 33:56.340 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26363 [Follower]" leader= 33:56.340 [INFO] TestAgent.server: Adding LAN server: server="Node-d880131c-e480-a291-b4a4-00b178b047ac (Addr: tcp/127.0.0.1:26363) (DC: dc1)" 33:56.340 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26358 network=udp 33:56.340 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d880131c-e480-a291-b4a4-00b178b047ac.dc1 area=wan 33:56.341 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26358 network=tcp 33:56.342 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26359 network=tcp 33:56.342 [INFO] TestAgent: started state syncer 33:56.342 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26364 network=tcp 33:56.387 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:56.387 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26363 [Candidate]" term=2 33:56.405 [DEBUG] TestAgent.server.raft: votes: needed=1 33:56.405 [DEBUG] TestAgent.server.raft: vote granted: from=d880131c-e480-a291-b4a4-00b178b047ac term=2 tally=1 33:56.405 [INFO] TestAgent.server.raft: election won: tally=1 33:56.405 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26363 [Leader]" 33:56.408 [INFO] TestAgent.server: cluster leadership acquired 33:56.408 [INFO] TestAgent.server: New leader elected: payload=Node-d880131c-e480-a291-b4a4-00b178b047ac 33:56.416 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:26363 33:56.445 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:56.468 [INFO] TestAgent: Service entered maintenance mode: service=test 33:56.484 [INFO] TestAgent: Node entered maintenance mode 33:56.490 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:56.490 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:56.490 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:56.490 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:56.490 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:56.490 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d880131c-e480-a291-b4a4-00b178b047ac 33:56.490 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d880131c-e480-a291-b4a4-00b178b047ac 33:56.499 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:42904 latency=8.474588ms 33:56.511 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:42904 latency=452.857µs 33:56.512 [INFO] TestAgent: Requesting shutdown 33:56.512 [INFO] TestAgent.server: shutting down server 33:56.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:56.512 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:56.512 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:56.512 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:56.512 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:56.512 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:56.512 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:56.512 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:56.512 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:56.515 [INFO] TestAgent.server: federation state anti-entropy synced 33:56.515 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:56.518 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:56.525Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:56.525Z [INFO] agent.router.manager: shutting down 33:56.525 [INFO] TestAgent: consul server down 33:56.525 [INFO] TestAgent: shutdown complete 33:56.525 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26358 network=tcp 33:56.525 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26358 network=udp 33:56.525 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26359 network=tcp 33:57.028 [INFO] TestAgent: Waiting for endpoints to shut down 33:57.028 [INFO] TestAgent: Endpoints down --- PASS: TestMaintCommand_NoArgs (1.15s) 2021-10-05T16:33:56.079Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:56.209Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:56.322 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:c3e9a17f-f1aa-e059-6a1e-ac595c303ab3 Address:127.0.0.1:26349}]" 33:56.322 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-c3e9a17f-f1aa-e059-6a1e-ac595c303ab3.dc1 127.0.0.1 33:56.323 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-c3e9a17f-f1aa-e059-6a1e-ac595c303ab3 127.0.0.1 2021-10-05T16:33:56.323Z [INFO] agent.router: Initializing LAN area manager 33:56.323 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26344 network=udp 33:56.323 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26349 [Follower]" leader= 33:56.323 [INFO] TestAgent.server: Adding LAN server: server="Node-c3e9a17f-f1aa-e059-6a1e-ac595c303ab3 (Addr: tcp/127.0.0.1:26349) (DC: dc1)" 33:56.323 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-c3e9a17f-f1aa-e059-6a1e-ac595c303ab3.dc1 area=wan 33:56.323 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26344 network=tcp 33:56.337 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26345 network=tcp 33:56.337 [INFO] TestAgent: started state syncer 33:56.337 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26350 network=tcp 33:56.380 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:56.380 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26349 [Candidate]" term=2 33:56.398 [DEBUG] TestAgent.server.raft: votes: needed=1 33:56.398 [DEBUG] TestAgent.server.raft: vote granted: from=c3e9a17f-f1aa-e059-6a1e-ac595c303ab3 term=2 tally=1 33:56.398 [INFO] TestAgent.server.raft: election won: tally=1 33:56.398 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26349 [Leader]" 33:56.400 [INFO] TestAgent.server: cluster leadership acquired 33:56.400 [INFO] TestAgent.server: New leader elected: payload=Node-c3e9a17f-f1aa-e059-6a1e-ac595c303ab3 33:56.406 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:26349 33:56.428 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:56.475 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:56.475 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:56.475 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:56.475 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:56.475 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:56.475 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-c3e9a17f-f1aa-e059-6a1e-ac595c303ab3 33:56.475 [INFO] TestAgent.server: member joined, marking health alive: member=Node-c3e9a17f-f1aa-e059-6a1e-ac595c303ab3 33:56.516 [INFO] TestAgent.server: federation state anti-entropy synced 33:56.534 [INFO] TestAgent: Synced node info 33:56.534 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/maintenance?enable=false from=127.0.0.1:43242 latency=3.636772ms 33:56.535 [INFO] TestAgent: Requesting shutdown 33:56.535 [INFO] TestAgent.server: shutting down server 33:56.535 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:56.535 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:56.535 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:56.535 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:56.535 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:56.535 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:56.535 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:56.535 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:56.535 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:56.535 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:56.535 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:56.541 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:56.557Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:56.557Z [INFO] agent.router.manager: shutting down 33:56.557 [INFO] TestAgent: consul server down 33:56.557 [INFO] TestAgent: shutdown complete 33:56.557 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26344 network=tcp 33:56.557 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26344 network=udp 33:56.557 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26345 network=tcp 33:57.057 [INFO] TestAgent: Waiting for endpoints to shut down 33:57.057 [INFO] TestAgent: Endpoints down --- PASS: TestMaintCommand_DisableNodeMaintenance (1.18s) 2021-10-05T16:33:56.073Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:56.124Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:56.237 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:88d88f4b-bd75-29c5-d126-6fa72f6ed3b5 Address:127.0.0.1:26370}]" 33:56.238 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26370 [Follower]" leader= 33:56.253 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-88d88f4b-bd75-29c5-d126-6fa72f6ed3b5.dc1 127.0.0.1 33:56.253 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-88d88f4b-bd75-29c5-d126-6fa72f6ed3b5 127.0.0.1 2021-10-05T16:33:56.253Z [INFO] agent.router: Initializing LAN area manager 33:56.262 [INFO] TestAgent.server: Adding LAN server: server="Node-88d88f4b-bd75-29c5-d126-6fa72f6ed3b5 (Addr: tcp/127.0.0.1:26370) (DC: dc1)" 33:56.262 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-88d88f4b-bd75-29c5-d126-6fa72f6ed3b5.dc1 area=wan 33:56.303 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26365 network=udp 33:56.304 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26365 network=tcp 33:56.305 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26366 network=tcp 33:56.305 [INFO] TestAgent: started state syncer 33:56.305 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26371 network=tcp 33:56.307 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:56.307 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26370 [Candidate]" term=2 33:56.343 [DEBUG] TestAgent.server.raft: votes: needed=1 33:56.343 [DEBUG] TestAgent.server.raft: vote granted: from=88d88f4b-bd75-29c5-d126-6fa72f6ed3b5 term=2 tally=1 33:56.343 [INFO] TestAgent.server.raft: election won: tally=1 33:56.343 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26370 [Leader]" 33:56.343 [INFO] TestAgent.server: cluster leadership acquired 33:56.343 [INFO] TestAgent.server: New leader elected: payload=Node-88d88f4b-bd75-29c5-d126-6fa72f6ed3b5 33:56.350 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:26370 33:56.372 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:56.424 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:56.424 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:56.424 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:56.424 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:56.424 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:56.424 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-88d88f4b-bd75-29c5-d126-6fa72f6ed3b5 33:56.424 [INFO] TestAgent.server: member joined, marking health alive: member=Node-88d88f4b-bd75-29c5-d126-6fa72f6ed3b5 33:56.460 [INFO] TestAgent.server: federation state anti-entropy synced 33:56.557 [INFO] TestAgent: Service entered maintenance mode: service=test 33:56.561 [INFO] TestAgent: Synced node info 33:56.568 [INFO] TestAgent: Synced service: service=test 33:56.568 [DEBUG] TestAgent: Check in sync: check=_service_maintenance:test 33:56.568 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/maintenance/test?enable=true&reason=broken from=127.0.0.1:45924 latency=27.90238ms 33:56.568 [INFO] TestAgent: Requesting shutdown 33:56.568 [INFO] TestAgent.server: shutting down server 33:56.568 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:56.568 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:56.568 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:56.568 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:56.568 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:56.568 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:56.568 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:56.568 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:56.568 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:56.568 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:56.568 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:56.576 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:56.584Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:56.584Z [INFO] agent.router.manager: shutting down 33:56.584 [INFO] TestAgent: consul server down 33:56.584 [INFO] TestAgent: shutdown complete 33:56.584 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26365 network=tcp 33:56.584 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26365 network=udp 33:56.584 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26366 network=tcp 33:57.088 [INFO] TestAgent: Waiting for endpoints to shut down 33:57.088 [INFO] TestAgent: Endpoints down --- PASS: TestMaintCommand_EnableServiceMaintenance (1.21s) 2021-10-05T16:33:56.097Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:56.185Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:56.253 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:acb1be2b-2b35-7f88-f05a-c2750281225e Address:127.0.0.1:26356}]" 33:56.254 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26356 [Follower]" leader= 33:56.293 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:56.293 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26356 [Candidate]" term=2 33:56.301 [WARN] TestAgent.server.raft: unable to get address for sever, using fallback address: id=acb1be2b-2b35-7f88-f05a-c2750281225e fallback=127.0.0.1:26356 error="Could not find address for server id acb1be2b-2b35-7f88-f05a-c2750281225e" 33:56.303 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-acb1be2b-2b35-7f88-f05a-c2750281225e.dc1 127.0.0.1 33:56.303 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-acb1be2b-2b35-7f88-f05a-c2750281225e 127.0.0.1 2021-10-05T16:33:56.303Z [INFO] agent.router: Initializing LAN area manager 33:56.303 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26351 network=udp 33:56.304 [INFO] TestAgent.server: Adding LAN server: server="Node-acb1be2b-2b35-7f88-f05a-c2750281225e (Addr: tcp/127.0.0.1:26356) (DC: dc1)" 33:56.304 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-acb1be2b-2b35-7f88-f05a-c2750281225e.dc1 area=wan 33:56.304 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26351 network=tcp 33:56.305 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26352 network=tcp 33:56.305 [INFO] TestAgent: started state syncer 33:56.305 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26357 network=tcp 33:56.316 [DEBUG] TestAgent.server.raft: votes: needed=1 33:56.316 [DEBUG] TestAgent.server.raft: vote granted: from=acb1be2b-2b35-7f88-f05a-c2750281225e term=2 tally=1 33:56.316 [INFO] TestAgent.server.raft: election won: tally=1 33:56.316 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26356 [Leader]" 33:56.320 [INFO] TestAgent.server: cluster leadership acquired 33:56.320 [INFO] TestAgent.server: New leader elected: payload=Node-acb1be2b-2b35-7f88-f05a-c2750281225e 33:56.348 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:26356 33:56.370 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:56.404 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:56.404 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:56.404 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:56.404 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:56.404 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:56.404 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-acb1be2b-2b35-7f88-f05a-c2750281225e 33:56.404 [INFO] TestAgent.server: member joined, marking health alive: member=Node-acb1be2b-2b35-7f88-f05a-c2750281225e 33:56.425 [INFO] TestAgent.server: federation state anti-entropy synced 33:56.636 [INFO] TestAgent: Synced node info 33:56.652 [INFO] TestAgent: Synced service: service=test 33:56.652 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/maintenance/test?enable=false from=127.0.0.1:43500 latency=31.945332ms 33:56.656 [INFO] TestAgent: Requesting shutdown 33:56.656 [INFO] TestAgent.server: shutting down server 33:56.656 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:56.656 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:56.656 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:56.656 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:56.656 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:56.656 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:56.656 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:56.656 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:56.656 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:56.656 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:56.656 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:56.664 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:56.672Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:56.672Z [INFO] agent.router.manager: shutting down 33:56.672 [INFO] TestAgent: consul server down 33:56.672 [INFO] TestAgent: shutdown complete 33:56.672 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26351 network=tcp 33:56.672 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26351 network=udp 33:56.672 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26352 network=tcp 33:57.176 [INFO] TestAgent: Waiting for endpoints to shut down 33:57.176 [INFO] TestAgent: Endpoints down --- PASS: TestMaintCommand_DisableServiceMaintenance (1.30s) 2021-10-05T16:33:56.125Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:56.217Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:56.317 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0d378823-ee0f-452d-ff46-ad160e7533a1 Address:127.0.0.1:26342}]" 33:56.318 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0d378823-ee0f-452d-ff46-ad160e7533a1.dc1 127.0.0.1 33:56.318 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0d378823-ee0f-452d-ff46-ad160e7533a1 127.0.0.1 2021-10-05T16:33:56.318Z [INFO] agent.router: Initializing LAN area manager 33:56.320 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26342 [Follower]" leader= 33:56.320 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0d378823-ee0f-452d-ff46-ad160e7533a1.dc1 area=wan 33:56.320 [INFO] TestAgent.server: Adding LAN server: server="Node-0d378823-ee0f-452d-ff46-ad160e7533a1 (Addr: tcp/127.0.0.1:26342) (DC: dc1)" 33:56.321 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=udp 33:56.321 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=tcp 33:56.321 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26338 network=tcp 33:56.321 [INFO] TestAgent: started state syncer 33:56.324 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26343 network=tcp 33:56.383 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:56.384 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26342 [Candidate]" term=2 33:56.416 [DEBUG] TestAgent.server.raft: votes: needed=1 33:56.416 [DEBUG] TestAgent.server.raft: vote granted: from=0d378823-ee0f-452d-ff46-ad160e7533a1 term=2 tally=1 33:56.416 [INFO] TestAgent.server.raft: election won: tally=1 33:56.416 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26342 [Leader]" 33:56.416 [INFO] TestAgent.server: cluster leadership acquired 33:56.416 [INFO] TestAgent.server: New leader elected: payload=Node-0d378823-ee0f-452d-ff46-ad160e7533a1 33:56.456 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:26342 33:56.508 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:56.537 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:56.537 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:56.537 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:56.537 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:56.537 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:56.537 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0d378823-ee0f-452d-ff46-ad160e7533a1 33:56.537 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0d378823-ee0f-452d-ff46-ad160e7533a1 33:56.568 [INFO] TestAgent.server: federation state anti-entropy synced 33:56.749 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/maintenance/redis?enable=true&reason=broken from=127.0.0.1:59170 latency=280.052µs 33:56.749 [INFO] TestAgent: Requesting shutdown 33:56.749 [INFO] TestAgent.server: shutting down server 33:56.749 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:56.749 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:56.749 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:56.749 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:56.749 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:56.749 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:56.749 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:56.749 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:56.749 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:56.749 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:56.749 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:56.764 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:56.772Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:56.772Z [INFO] agent.router.manager: shutting down 33:56.772 [INFO] TestAgent: consul server down 33:56.772 [INFO] TestAgent: shutdown complete 33:56.772 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=tcp 33:56.772 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=udp 33:56.772 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26338 network=tcp 33:57.276 [INFO] TestAgent: Waiting for endpoints to shut down 33:57.276 [INFO] TestAgent: Endpoints down --- PASS: TestMaintCommand_ServiceMaintenance_NoService (1.40s) PASS ok github.com/hashicorp/consul/command/maint 1.526s === RUN TestMembersCommand_noTabs === PAUSE TestMembersCommand_noTabs === RUN TestMembersCommand === PAUSE TestMembersCommand === RUN TestMembersCommand_WAN === PAUSE TestMembersCommand_WAN === RUN TestMembersCommand_statusFilter === PAUSE TestMembersCommand_statusFilter === RUN TestMembersCommand_statusFilter_failed === PAUSE TestMembersCommand_statusFilter_failed === RUN TestMembersCommand_verticalBar === PAUSE TestMembersCommand_verticalBar === CONT TestMembersCommand_noTabs --- PASS: TestMembersCommand_noTabs (0.00s) === CONT TestMembersCommand_verticalBar [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestMembersCommand_statusFilter === CONT TestMembersCommand_statusFilter_failed === CONT TestMembersCommand_WAN === CONT TestMembersCommand [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:33:57.120Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:57.235Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:57.341 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dec05263-99c9-23c0-de97-7d417c0ec504 Address:127.0.0.1:15118}]" 33:57.356 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15118 [Follower]" leader= 33:57.389 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dec05263-99c9-23c0-de97-7d417c0ec504.dc1 127.0.0.1 33:57.389 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dec05263-99c9-23c0-de97-7d417c0ec504 127.0.0.1 2021-10-05T16:33:57.390Z [INFO] agent.router: Initializing LAN area manager 33:57.390 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=udp 33:57.390 [INFO] TestAgent.server: Adding LAN server: server="Node-dec05263-99c9-23c0-de97-7d417c0ec504 (Addr: tcp/127.0.0.1:15118) (DC: dc1)" 33:57.390 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dec05263-99c9-23c0-de97-7d417c0ec504.dc1 area=wan 33:57.390 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=tcp 33:57.391 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15114 network=tcp 33:57.391 [INFO] TestAgent: started state syncer 33:57.391 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15119 network=tcp 33:57.397 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:57.397 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15118 [Candidate]" term=2 33:57.418 [DEBUG] TestAgent.server.raft: votes: needed=1 33:57.418 [DEBUG] TestAgent.server.raft: vote granted: from=dec05263-99c9-23c0-de97-7d417c0ec504 term=2 tally=1 33:57.418 [INFO] TestAgent.server.raft: election won: tally=1 33:57.418 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15118 [Leader]" 33:57.418 [INFO] TestAgent.server: cluster leadership acquired 33:57.418 [INFO] TestAgent.server: New leader elected: payload=Node-dec05263-99c9-23c0-de97-7d417c0ec504 33:57.436 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15118 33:57.464 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/members?segment=_all from=127.0.0.1:39096 latency=17.143376ms 33:57.473 [INFO] TestAgent: Requesting shutdown 33:57.473 [INFO] TestAgent.server: shutting down server 33:57.473 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:57.473 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:57.481 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:57.482Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:57.482Z [INFO] agent.router.manager: shutting down 33:57.492 [ERROR] TestAgent.server: failed to establish leadership: error="leadership lost while committing log" 33:57.492 [INFO] TestAgent: consul server down 33:57.492 [INFO] TestAgent: shutdown complete 33:57.492 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 33:57.492 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=tcp 33:57.492 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 33:57.492 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=2 retry_limit=3 error="raft is already shutdown" 33:57.492 [ERROR] TestAgent.server: failed to transfer leadership: error="failed to transfer leadership in 3 attempts" 33:57.492 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=udp 33:57.492 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15114 network=tcp 33:57.996 [INFO] TestAgent: Waiting for endpoints to shut down 33:57.996 [INFO] TestAgent: Endpoints down --- PASS: TestMembersCommand_statusFilter (1.05s) 2021-10-05T16:33:57.158Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:57.222Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:57.305 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:02c682d0-bde3-939f-dd34-7e24463cf3a0 Address:127.0.0.1:15132}]" 33:57.306 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-02c682d0-bde3-939f-dd34-7e24463cf3a0.dc1 127.0.0.1 33:57.307 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-02c682d0-bde3-939f-dd34-7e24463cf3a0 127.0.0.1 2021-10-05T16:33:57.307Z [INFO] agent.router: Initializing LAN area manager 33:57.307 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15127 network=udp 33:57.307 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15132 [Follower]" leader= 33:57.307 [INFO] TestAgent.server: Adding LAN server: server="Node-02c682d0-bde3-939f-dd34-7e24463cf3a0 (Addr: tcp/127.0.0.1:15132) (DC: dc1)" 33:57.307 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-02c682d0-bde3-939f-dd34-7e24463cf3a0.dc1 area=wan 33:57.308 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15127 network=tcp 33:57.308 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15128 network=tcp 33:57.308 [INFO] TestAgent: started state syncer 33:57.308 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15133 network=tcp 33:57.356 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:57.356 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15132 [Candidate]" term=2 33:57.381 [DEBUG] TestAgent.server.raft: votes: needed=1 33:57.381 [DEBUG] TestAgent.server.raft: vote granted: from=02c682d0-bde3-939f-dd34-7e24463cf3a0 term=2 tally=1 33:57.381 [INFO] TestAgent.server.raft: election won: tally=1 33:57.381 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15132 [Leader]" 33:57.389 [INFO] TestAgent.server: cluster leadership acquired 33:57.390 [INFO] TestAgent.server: New leader elected: payload=Node-02c682d0-bde3-939f-dd34-7e24463cf3a0 33:57.401 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15132 33:57.417 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:57.466 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:57.466 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:57.466 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:57.466 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:57.466 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:57.466 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-02c682d0-bde3-939f-dd34-7e24463cf3a0 33:57.466 [INFO] TestAgent.server: member joined, marking health alive: member=Node-02c682d0-bde3-939f-dd34-7e24463cf3a0 33:57.496 [INFO] TestAgent.server: federation state anti-entropy synced 33:57.596 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 33:57.601 [INFO] TestAgent: Synced node info 33:57.601 [DEBUG] TestAgent: Node info in sync 33:57.640 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/members?segment=_all from=127.0.0.1:51594 latency=269.345µs 33:57.642 [INFO] TestAgent: Requesting shutdown 33:57.642 [INFO] TestAgent.server: shutting down server 33:57.642 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:57.642 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:57.642 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:57.642 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:57.642 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:57.642 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:57.642 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:57.642 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:57.642 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:57.642 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:57.650 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:57.656Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:57.656Z [INFO] agent.router.manager: shutting down 33:57.656 [INFO] TestAgent: consul server down 33:57.656 [INFO] TestAgent: shutdown complete 33:57.656 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15127 network=tcp 33:57.656 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15127 network=udp 33:57.656 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15128 network=tcp 33:58.160 [INFO] TestAgent: Waiting for endpoints to shut down 33:58.160 [INFO] TestAgent: Endpoints down --- PASS: TestMembersCommand (1.21s) 2021-10-05T16:33:57.155Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:57.284Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:57.385 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2d49d776-f98e-2c91-2bca-dd66d14593c1 Address:127.0.0.1:15125}]" 33:57.386 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2d49d776-f98e-2c91-2bca-dd66d14593c1.dc1 127.0.0.1 33:57.386 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2d49d776-f98e-2c91-2bca-dd66d14593c1 127.0.0.1 2021-10-05T16:33:57.386Z [INFO] agent.router: Initializing LAN area manager 33:57.386 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15120 network=udp 33:57.388 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15125 [Follower]" leader= 33:57.388 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15120 network=tcp 33:57.388 [INFO] TestAgent.server: Adding LAN server: server="Node-2d49d776-f98e-2c91-2bca-dd66d14593c1 (Addr: tcp/127.0.0.1:15125) (DC: dc1)" 33:57.388 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2d49d776-f98e-2c91-2bca-dd66d14593c1.dc1 area=wan 33:57.389 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15121 network=tcp 33:57.389 [INFO] TestAgent: started state syncer 33:57.389 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15126 network=tcp 33:57.440 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:57.440 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15125 [Candidate]" term=2 33:57.492 [DEBUG] TestAgent.server.raft: votes: needed=1 33:57.492 [DEBUG] TestAgent.server.raft: vote granted: from=2d49d776-f98e-2c91-2bca-dd66d14593c1 term=2 tally=1 33:57.493 [INFO] TestAgent.server.raft: election won: tally=1 33:57.493 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15125 [Leader]" 33:57.493 [INFO] TestAgent.server: cluster leadership acquired 33:57.493 [INFO] TestAgent.server: New leader elected: payload=Node-2d49d776-f98e-2c91-2bca-dd66d14593c1 33:57.510 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15125 33:57.526 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:57.556 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:57.556 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:57.556 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:57.556 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:57.556 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:57.556 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2d49d776-f98e-2c91-2bca-dd66d14593c1 33:57.556 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2d49d776-f98e-2c91-2bca-dd66d14593c1 33:57.599 [INFO] TestAgent.server: federation state anti-entropy synced 33:57.672 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/members?segment=_all&wan=1 from=127.0.0.1:57804 latency=1.264567ms 33:57.672 [INFO] TestAgent: Requesting shutdown 33:57.672 [INFO] TestAgent.server: shutting down server 33:57.672 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:57.672 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:57.672 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:57.672 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:57.672 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:57.672 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:57.672 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:57.673 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:57.673 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:57.673 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:57.673 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:57.677 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:57.684Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:57.684Z [INFO] agent.router.manager: shutting down 33:57.684 [INFO] TestAgent: consul server down 33:57.684 [INFO] TestAgent: shutdown complete 33:57.684 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15120 network=tcp 33:57.684 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15120 network=udp 33:57.684 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15121 network=tcp 33:58.188 [INFO] TestAgent: Waiting for endpoints to shut down 33:58.188 [INFO] TestAgent: Endpoints down --- PASS: TestMembersCommand_WAN (1.24s) 2021-10-05T16:33:57.186Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:57.253Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:57.387 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ba1bb00b-a098-e4e4-373f-993f86f574f6 Address:127.0.0.1:15139}]" 33:57.387 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ba1bb00b-a098-e4e4-373f-993f86f574f6.dc1 127.0.0.1 33:57.388 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ba1bb00b-a098-e4e4-373f-993f86f574f6 127.0.0.1 33:57.389 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15139 [Follower]" leader= 2021-10-05T16:33:57.388Z [INFO] agent.router: Initializing LAN area manager 33:57.389 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15134 network=udp 33:57.390 [INFO] TestAgent.server: Adding LAN server: server="Node-ba1bb00b-a098-e4e4-373f-993f86f574f6 (Addr: tcp/127.0.0.1:15139) (DC: dc1)" 33:57.390 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ba1bb00b-a098-e4e4-373f-993f86f574f6.dc1 area=wan 33:57.390 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15134 network=tcp 33:57.390 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15135 network=tcp 33:57.391 [INFO] TestAgent: started state syncer 33:57.391 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15140 network=tcp 33:57.444 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:57.444 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15139 [Candidate]" term=2 33:57.475 [DEBUG] TestAgent.server.raft: votes: needed=1 33:57.475 [DEBUG] TestAgent.server.raft: vote granted: from=ba1bb00b-a098-e4e4-373f-993f86f574f6 term=2 tally=1 33:57.475 [INFO] TestAgent.server.raft: election won: tally=1 33:57.475 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15139 [Leader]" 33:57.476 [INFO] TestAgent.server: cluster leadership acquired 33:57.477 [INFO] TestAgent.server: New leader elected: payload=Node-ba1bb00b-a098-e4e4-373f-993f86f574f6 33:57.520 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15139 33:57.556 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:57.628 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:57.628 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:57.628 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:57.628 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:57.628 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:57.628 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ba1bb00b-a098-e4e4-373f-993f86f574f6 33:57.628 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ba1bb00b-a098-e4e4-373f-993f86f574f6 33:57.658 [INFO] TestAgent: Synced node info 33:57.658 [DEBUG] TestAgent: Node info in sync 33:57.658 [INFO] TestAgent.server: federation state anti-entropy synced 33:57.713 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/members?segment=_all from=127.0.0.1:59666 latency=1.263121ms 33:57.716 [INFO] TestAgent: Requesting shutdown 33:57.716 [INFO] TestAgent.server: shutting down server 33:57.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:57.716 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:57.716 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:57.716 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:57.716 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:57.716 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:57.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:57.716 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:57.716 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:57.716 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:57.724 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:57.728Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:57.728Z [INFO] agent.router.manager: shutting down 33:57.728 [INFO] TestAgent: consul server down 33:57.728 [INFO] TestAgent: shutdown complete 33:57.728 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15134 network=tcp 33:57.728 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15134 network=udp 33:57.728 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15135 network=tcp 33:58.232 [INFO] TestAgent: Waiting for endpoints to shut down 33:58.232 [INFO] TestAgent: Endpoints down --- PASS: TestMembersCommand_statusFilter_failed (1.28s) 2021-10-05T16:33:57.158Z [WARN] agent: Node name "name|with|bars" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:33:57.158Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:33:57.226Z [WARN] agent.auto_config: Node name "name|with|bars" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:33:57.226Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 33:57.324 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:6ca7f9a3-0934-71ca-db9b-9d905953e467 Address:127.0.0.1:15111}]" 33:57.333 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: name|with|bars.dc1 127.0.0.1 33:57.340 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15111 [Follower]" leader= 33:57.374 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: name|with|bars 127.0.0.1 2021-10-05T16:33:57.374Z [INFO] agent.router: Initializing LAN area manager 33:57.375 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=udp 33:57.375 [INFO] TestAgent.server: Adding LAN server: server="name|with|bars (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 33:57.375 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=name|with|bars.dc1 area=wan 33:57.384 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=tcp 33:57.385 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15107 network=tcp 33:57.385 [INFO] TestAgent: started state syncer 33:57.386 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15112 network=tcp 33:57.399 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 33:57.399 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15111 [Candidate]" term=2 33:57.413 [DEBUG] TestAgent.server.raft: votes: needed=1 33:57.413 [DEBUG] TestAgent.server.raft: vote granted: from=6ca7f9a3-0934-71ca-db9b-9d905953e467 term=2 tally=1 33:57.413 [INFO] TestAgent.server.raft: election won: tally=1 33:57.413 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15111 [Leader]" 33:57.413 [INFO] TestAgent.server: cluster leadership acquired 33:57.413 [INFO] TestAgent.server: New leader elected: payload=name|with|bars 33:57.429 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15111 33:57.472 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 33:57.512 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 33:57.512 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 33:57.512 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 33:57.512 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 33:57.512 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 33:57.512 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=name|with|bars 33:57.512 [INFO] TestAgent.server: member joined, marking health alive: member=name|with|bars 33:57.519 [INFO] TestAgent.server: federation state anti-entropy synced 33:57.737 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/members?segment=_all from=127.0.0.1:57096 latency=446.377µs 33:57.737 [INFO] TestAgent: Requesting shutdown 33:57.737 [INFO] TestAgent.server: shutting down server 33:57.737 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 33:57.737 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 33:57.737 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 33:57.737 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 33:57.737 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 33:57.737 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 33:57.737 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 33:57.737 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 33:57.737 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 33:57.737 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 33:57.737 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 33:57.748 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:33:57.752Z [INFO] agent.router.manager: shutting down 2021-10-05T16:33:57.752Z [INFO] agent.router.manager: shutting down 33:57.752 [INFO] TestAgent: consul server down 33:57.752 [INFO] TestAgent: shutdown complete 33:57.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=tcp 33:57.752 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=udp 33:57.752 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15107 network=tcp 33:58.256 [INFO] TestAgent: Waiting for endpoints to shut down 33:58.256 [INFO] TestAgent: Endpoints down --- PASS: TestMembersCommand_verticalBar (1.31s) PASS ok github.com/hashicorp/consul/command/members 1.393s === RUN TestOperatorCommand_noTabs === PAUSE TestOperatorCommand_noTabs === CONT TestOperatorCommand_noTabs --- PASS: TestOperatorCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/operator 0.011s === RUN TestOperatorAutopilotCommand_noTabs === PAUSE TestOperatorAutopilotCommand_noTabs === CONT TestOperatorAutopilotCommand_noTabs --- PASS: TestOperatorAutopilotCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/operator/autopilot 0.043s === RUN TestOperatorAutopilotGetConfigCommand_noTabs === PAUSE TestOperatorAutopilotGetConfigCommand_noTabs === RUN TestOperatorAutopilotGetConfigCommand === PAUSE TestOperatorAutopilotGetConfigCommand === CONT TestOperatorAutopilotGetConfigCommand_noTabs --- PASS: TestOperatorAutopilotGetConfigCommand_noTabs (0.00s) === CONT TestOperatorAutopilotGetConfigCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:34:00.287Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:00.312Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:00.471 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:b832338e-3121-b1fd-4720-826a6f3aea38 Address:127.0.0.1:29405}]" 34:00.472 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29405 [Follower]" leader= 34:00.472 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-b832338e-3121-b1fd-4720-826a6f3aea38.dc1 127.0.0.1 34:00.473 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-b832338e-3121-b1fd-4720-826a6f3aea38 127.0.0.1 2021-10-05T16:34:00.473Z [INFO] agent.router: Initializing LAN area manager 34:00.474 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=udp 34:00.475 [INFO] TestAgent.server: Adding LAN server: server="Node-b832338e-3121-b1fd-4720-826a6f3aea38 (Addr: tcp/127.0.0.1:29405) (DC: dc1)" 34:00.475 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-b832338e-3121-b1fd-4720-826a6f3aea38.dc1 area=wan 34:00.475 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=tcp 34:00.475 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29401 network=tcp 34:00.475 [INFO] TestAgent: started state syncer 34:00.476 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29406 network=tcp 34:00.511 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:00.511 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29405 [Candidate]" term=2 34:00.523 [DEBUG] TestAgent.server.raft: votes: needed=1 34:00.523 [DEBUG] TestAgent.server.raft: vote granted: from=b832338e-3121-b1fd-4720-826a6f3aea38 term=2 tally=1 34:00.523 [INFO] TestAgent.server.raft: election won: tally=1 34:00.523 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29405 [Leader]" 34:00.523 [INFO] TestAgent.server: cluster leadership acquired 34:00.523 [INFO] TestAgent.server: New leader elected: payload=Node-b832338e-3121-b1fd-4720-826a6f3aea38 34:00.532 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29405 34:00.546 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:00.620 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:00.620 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:00.620 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:00.620 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:00.620 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:00.620 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-b832338e-3121-b1fd-4720-826a6f3aea38 34:00.620 [INFO] TestAgent.server: member joined, marking health alive: member=Node-b832338e-3121-b1fd-4720-826a6f3aea38 34:00.632 [INFO] TestAgent.server: federation state anti-entropy synced 34:00.642 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/autopilot/configuration from=127.0.0.1:35312 latency=3.439666ms 34:00.649 [INFO] TestAgent: Requesting shutdown 34:00.649 [INFO] TestAgent.server: shutting down server 34:00.649 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:00.649 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:00.649 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:00.649 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:00.649 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:00.649 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:00.649 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:00.649 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 34:00.649 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:00.649 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:00.649 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:00.661 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:00.668Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:00.668Z [INFO] agent.router.manager: shutting down 34:00.668 [INFO] TestAgent: consul server down 34:00.668 [INFO] TestAgent: shutdown complete 34:00.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=tcp 34:00.668 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=udp 34:00.668 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29401 network=tcp 34:01.172 [INFO] TestAgent: Waiting for endpoints to shut down 34:01.172 [INFO] TestAgent: Endpoints down --- PASS: TestOperatorAutopilotGetConfigCommand (0.94s) PASS ok github.com/hashicorp/consul/command/operator/autopilot/get 1.124s === RUN TestOperatorAutopilotSetConfigCommand_noTabs === PAUSE TestOperatorAutopilotSetConfigCommand_noTabs === RUN TestOperatorAutopilotSetConfigCommand === PAUSE TestOperatorAutopilotSetConfigCommand === CONT TestOperatorAutopilotSetConfigCommand_noTabs --- PASS: TestOperatorAutopilotSetConfigCommand_noTabs (0.00s) === CONT TestOperatorAutopilotSetConfigCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:34:02.844Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:02.905Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:02.988 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:cb8ccc42-266c-a3d2-1d62-f244470cad1b Address:127.0.0.1:26342}]" 34:02.989 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-cb8ccc42-266c-a3d2-1d62-f244470cad1b.dc1 127.0.0.1 34:02.990 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-cb8ccc42-266c-a3d2-1d62-f244470cad1b 127.0.0.1 2021-10-05T16:34:02.990Z [INFO] agent.router: Initializing LAN area manager 34:02.990 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=udp 34:02.990 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:26342 [Follower]" leader= 34:02.990 [INFO] TestAgent.server: Adding LAN server: server="Node-cb8ccc42-266c-a3d2-1d62-f244470cad1b (Addr: tcp/127.0.0.1:26342) (DC: dc1)" 34:02.991 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-cb8ccc42-266c-a3d2-1d62-f244470cad1b.dc1 area=wan 34:02.991 [INFO] TestAgent: Started DNS server: address=127.0.0.1:26337 network=tcp 34:02.991 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:26338 network=tcp 34:02.991 [INFO] TestAgent: started state syncer 34:02.991 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:26343 network=tcp 34:03.027 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:03.027 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:26342 [Candidate]" term=2 34:03.072 [DEBUG] TestAgent.server.raft: votes: needed=1 34:03.072 [DEBUG] TestAgent.server.raft: vote granted: from=cb8ccc42-266c-a3d2-1d62-f244470cad1b term=2 tally=1 34:03.072 [INFO] TestAgent.server.raft: election won: tally=1 34:03.072 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:26342 [Leader]" 34:03.076 [INFO] TestAgent.server: cluster leadership acquired 34:03.076 [INFO] TestAgent.server: New leader elected: payload=Node-cb8ccc42-266c-a3d2-1d62-f244470cad1b 34:03.108 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:26342 34:03.158 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:03.250 [INFO] TestAgent: Synced node info 34:03.250 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:03.250 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:03.250 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:03.250 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:03.250 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:03.250 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-cb8ccc42-266c-a3d2-1d62-f244470cad1b 34:03.250 [INFO] TestAgent.server: member joined, marking health alive: member=Node-cb8ccc42-266c-a3d2-1d62-f244470cad1b 34:03.262 [INFO] TestAgent.server: federation state anti-entropy synced 34:03.427 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/autopilot/configuration from=127.0.0.1:59204 latency=1.629888ms 34:03.434 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/operator/autopilot/configuration?cas=4 from=127.0.0.1:59204 latency=5.887554ms 34:03.435 [INFO] TestAgent: Requesting shutdown 34:03.435 [INFO] TestAgent.server: shutting down server 34:03.435 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:03.435 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:03.435 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:03.435 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:03.435 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:03.435 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:03.435 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:03.435 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:03.435 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:03.435 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:03.443 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:03.456Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:03.456Z [INFO] agent.router.manager: shutting down 34:03.456 [INFO] TestAgent: consul server down 34:03.456 [INFO] TestAgent: shutdown complete 34:03.456 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=tcp 34:03.456 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:26337 network=udp 34:03.456 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:26338 network=tcp 34:03.960 [INFO] TestAgent: Waiting for endpoints to shut down 34:03.960 [INFO] TestAgent: Endpoints down --- PASS: TestOperatorAutopilotSetConfigCommand (1.24s) PASS ok github.com/hashicorp/consul/command/operator/autopilot/set 1.491s === RUN TestOperatorRaftCommand_noTabs === PAUSE TestOperatorRaftCommand_noTabs === CONT TestOperatorRaftCommand_noTabs --- PASS: TestOperatorRaftCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/operator/raft 0.016s === RUN TestOperatorRaftListPeersCommand_noTabs === PAUSE TestOperatorRaftListPeersCommand_noTabs === RUN TestOperatorRaftListPeersCommand === PAUSE TestOperatorRaftListPeersCommand === RUN TestOperatorRaftListPeersCommand_verticalBar === PAUSE TestOperatorRaftListPeersCommand_verticalBar === CONT TestOperatorRaftListPeersCommand_noTabs --- PASS: TestOperatorRaftListPeersCommand_noTabs (0.00s) === CONT TestOperatorRaftListPeersCommand_verticalBar [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === CONT TestOperatorRaftListPeersCommand 2021-10-05T16:34:08.865Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:08.898Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:08.986 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:af9dead1-8fe9-16a5-50e9-07dd15fc16d9 Address:127.0.0.1:13076}]" 34:08.987 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-af9dead1-8fe9-16a5-50e9-07dd15fc16d9.dc1 127.0.0.1 34:08.987 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-af9dead1-8fe9-16a5-50e9-07dd15fc16d9 127.0.0.1 2021-10-05T16:34:08.987Z [INFO] agent.router: Initializing LAN area manager 34:08.987 [INFO] TestAgent: Started DNS server: address=127.0.0.1:13071 network=udp 34:08.987 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:13076 [Follower]" leader= 34:08.988 [INFO] TestAgent.server: Adding LAN server: server="Node-af9dead1-8fe9-16a5-50e9-07dd15fc16d9 (Addr: tcp/127.0.0.1:13076) (DC: dc1)" 34:08.988 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-af9dead1-8fe9-16a5-50e9-07dd15fc16d9.dc1 area=wan 34:08.988 [INFO] TestAgent: Started DNS server: address=127.0.0.1:13071 network=tcp 34:08.988 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:13072 network=tcp 34:08.988 [INFO] TestAgent: started state syncer 34:08.989 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:13077 network=tcp 34:09.029 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:09.029 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:13076 [Candidate]" term=2 34:09.070 [DEBUG] TestAgent.server.raft: votes: needed=1 34:09.070 [DEBUG] TestAgent.server.raft: vote granted: from=af9dead1-8fe9-16a5-50e9-07dd15fc16d9 term=2 tally=1 34:09.070 [INFO] TestAgent.server.raft: election won: tally=1 34:09.070 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:13076 [Leader]" 34:09.070 [INFO] TestAgent.server: cluster leadership acquired 34:09.070 [INFO] TestAgent.server: New leader elected: payload=Node-af9dead1-8fe9-16a5-50e9-07dd15fc16d9 34:09.082 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:13076 34:09.129 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:09.165 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/raft/configuration from=127.0.0.1:38988 latency=664.218µs 34:09.165 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:09.165 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:09.165 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:09.165 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:09.165 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:09.166 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-af9dead1-8fe9-16a5-50e9-07dd15fc16d9 34:09.166 [INFO] TestAgent.server: member joined, marking health alive: member=Node-af9dead1-8fe9-16a5-50e9-07dd15fc16d9 34:09.167 [INFO] TestAgent: Requesting shutdown 34:09.167 [INFO] TestAgent.server: shutting down server 34:09.167 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:09.167 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:09.167 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:09.167 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:09.167 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:09.167 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 34:09.167 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:09.167 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:09.167 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:09.171 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 34:09.173 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:09.173 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 2021-10-05T16:34:09.177Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:09.177Z [INFO] agent.router.manager: shutting down 34:09.177 [INFO] TestAgent: consul server down 34:09.177 [INFO] TestAgent: shutdown complete 34:09.177 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:13071 network=tcp 34:09.177 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:13071 network=udp 34:09.177 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:13072 network=tcp 34:09.680 [INFO] TestAgent: Waiting for endpoints to shut down 34:09.680 [INFO] TestAgent: Endpoints down --- PASS: TestOperatorRaftListPeersCommand (0.94s) 2021-10-05T16:34:08.880Z [WARN] agent: Node name "name|with|bars" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:34:08.880Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:08.899Z [WARN] agent.auto_config: Node name "name|with|bars" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021-10-05T16:34:08.899Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:08.989 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:25cc2c19-6f8a-a3e3-f4e7-478f308d8cbf Address:127.0.0.1:13069}]" 34:08.990 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: name|with|bars.dc1 127.0.0.1 34:08.991 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: name|with|bars 127.0.0.1 2021-10-05T16:34:08.991Z [INFO] agent.router: Initializing LAN area manager 34:08.991 [INFO] TestAgent: Started DNS server: address=127.0.0.1:13064 network=udp 34:08.991 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:13069 [Follower]" leader= 34:08.991 [INFO] TestAgent.server: Adding LAN server: server="name|with|bars (Addr: tcp/127.0.0.1:13069) (DC: dc1)" 34:08.991 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=name|with|bars.dc1 area=wan 34:08.991 [INFO] TestAgent: Started DNS server: address=127.0.0.1:13064 network=tcp 34:08.992 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:13065 network=tcp 34:08.992 [INFO] TestAgent: started state syncer 34:08.992 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:13070 network=tcp 34:09.059 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:09.059 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:13069 [Candidate]" term=2 34:09.074 [DEBUG] TestAgent.server.raft: votes: needed=1 34:09.074 [DEBUG] TestAgent.server.raft: vote granted: from=25cc2c19-6f8a-a3e3-f4e7-478f308d8cbf term=2 tally=1 34:09.074 [INFO] TestAgent.server.raft: election won: tally=1 34:09.074 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:13069 [Leader]" 34:09.074 [INFO] TestAgent.server: cluster leadership acquired 34:09.074 [INFO] TestAgent.server: New leader elected: payload=name|with|bars 34:09.092 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:13069 34:09.136 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:09.212 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:09.212 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:09.212 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:09.212 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:09.212 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:09.212 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=name|with|bars 34:09.212 [INFO] TestAgent.server: member joined, marking health alive: member=name|with|bars 34:09.241 [INFO] TestAgent.server: federation state anti-entropy synced 34:09.252 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/operator/raft/configuration from=127.0.0.1:51266 latency=320.542µs 34:09.252 [INFO] TestAgent: Requesting shutdown 34:09.252 [INFO] TestAgent.server: shutting down server 34:09.252 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:09.252 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:09.252 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:09.252 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:09.252 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:09.252 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:09.252 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:09.253 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 34:09.253 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:09.253 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:09.253 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:09.263 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:09.271Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:09.271Z [INFO] agent.router.manager: shutting down 34:09.271 [INFO] TestAgent: consul server down 34:09.271 [INFO] TestAgent: shutdown complete 34:09.271 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:13064 network=tcp 34:09.271 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:13064 network=udp 34:09.271 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:13065 network=tcp 34:09.772 [INFO] TestAgent: Waiting for endpoints to shut down 34:09.772 [INFO] TestAgent: Endpoints down --- PASS: TestOperatorRaftListPeersCommand_verticalBar (1.06s) PASS ok github.com/hashicorp/consul/command/operator/raft/listpeers 1.291s === RUN TestOperatorRaftRemovePeerCommand_noTabs === PAUSE TestOperatorRaftRemovePeerCommand_noTabs === RUN TestOperatorRaftRemovePeerCommand === PAUSE TestOperatorRaftRemovePeerCommand === CONT TestOperatorRaftRemovePeerCommand_noTabs --- PASS: TestOperatorRaftRemovePeerCommand_noTabs (0.00s) === CONT TestOperatorRaftRemovePeerCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestOperatorRaftRemovePeerCommand/Test_the_remove-peer_subcommand_directly === RUN TestOperatorRaftRemovePeerCommand/Test_the_remove-peer_subcommand_with_-id 2021-10-05T16:34:08.235Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:08.271Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:08.360 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7549470c-48c8-affe-c949-f23de85b0c45 Address:127.0.0.1:14090}]" 34:08.361 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7549470c-48c8-affe-c949-f23de85b0c45.dc1 127.0.0.1 34:08.361 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7549470c-48c8-affe-c949-f23de85b0c45 127.0.0.1 2021-10-05T16:34:08.361Z [INFO] agent.router: Initializing LAN area manager 34:08.374 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=udp 34:08.380 [INFO] TestAgent: Started DNS server: address=127.0.0.1:14085 network=tcp 34:08.374 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:14090 [Follower]" leader= 34:08.375 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7549470c-48c8-affe-c949-f23de85b0c45.dc1 area=wan 34:08.375 [INFO] TestAgent.server: Adding LAN server: server="Node-7549470c-48c8-affe-c949-f23de85b0c45 (Addr: tcp/127.0.0.1:14090) (DC: dc1)" 34:08.394 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:14086 network=tcp 34:08.394 [INFO] TestAgent: started state syncer 34:08.394 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:14091 network=tcp 34:08.432 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:08.432 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:14090 [Candidate]" term=2 34:08.467 [DEBUG] TestAgent.server.raft: votes: needed=1 34:08.467 [DEBUG] TestAgent.server.raft: vote granted: from=7549470c-48c8-affe-c949-f23de85b0c45 term=2 tally=1 34:08.467 [INFO] TestAgent.server.raft: election won: tally=1 34:08.467 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:14090 [Leader]" 34:08.467 [INFO] TestAgent.server: cluster leadership acquired 34:08.467 [INFO] TestAgent.server: New leader elected: payload=Node-7549470c-48c8-affe-c949-f23de85b0c45 34:08.473 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:14090 34:08.495 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:08.500 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/operator/raft/peer?address=nope from=127.0.0.1:45972 error="address "nope" was not found in the Raft configuration" 34:08.504 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/raft/peer?address=nope from=127.0.0.1:45972 latency=3.689621ms 34:08.505 [ERROR] TestAgent.http: Request error: method=DELETE url=/v1/operator/raft/peer?id=nope from=127.0.0.1:45974 error="id "nope" was not found in the Raft configuration" 34:08.506 [DEBUG] TestAgent.http: Request finished: method=DELETE url=/v1/operator/raft/peer?id=nope from=127.0.0.1:45974 latency=587.856µs 34:08.506 [INFO] TestAgent: Requesting shutdown 34:08.506 [INFO] TestAgent.server: shutting down server 34:08.506 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:08.506 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 34:08.516 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:08.523Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:08.523Z [INFO] agent.router.manager: shutting down 34:08.523 [INFO] TestAgent: consul server down 34:08.523 [INFO] TestAgent: shutdown complete 34:08.523 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=tcp 34:08.523 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:14085 network=udp 34:08.524 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:14086 network=tcp 34:08.528 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: raft is already shutdown" 34:08.529 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=0 retry_limit=3 error="raft is already shutdown" 34:08.529 [ERROR] TestAgent.server: failed to transfer leadership attempt, will retry: attempt=1 retry_limit=3 error="raft is already shutdown" 34:09.024 [INFO] TestAgent: Waiting for endpoints to shut down 34:09.024 [INFO] TestAgent: Endpoints down --- PASS: TestOperatorRaftRemovePeerCommand (0.94s) --- PASS: TestOperatorRaftRemovePeerCommand/Test_the_remove-peer_subcommand_directly (0.01s) --- PASS: TestOperatorRaftRemovePeerCommand/Test_the_remove-peer_subcommand_with_-id (0.00s) PASS ok github.com/hashicorp/consul/command/operator/raft/removepeer 1.245s === RUN TestReloadCommand_noTabs === PAUSE TestReloadCommand_noTabs === RUN TestReloadCommand === PAUSE TestReloadCommand === CONT TestReloadCommand_noTabs --- PASS: TestReloadCommand_noTabs (0.00s) === CONT TestReloadCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:34:12.927Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:12.950Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:13.037 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2d5007df-861d-2a0b-3911-ed60647710af Address:127.0.0.1:12048}]" 34:13.038 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2d5007df-861d-2a0b-3911-ed60647710af.dc1 127.0.0.1 34:13.039 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2d5007df-861d-2a0b-3911-ed60647710af 127.0.0.1 2021-10-05T16:34:13.039Z [INFO] agent.router: Initializing LAN area manager 34:13.039 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=udp 34:13.039 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:12048 [Follower]" leader= 34:13.047 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2d5007df-861d-2a0b-3911-ed60647710af.dc1 area=wan 34:13.047 [INFO] TestAgent.server: Adding LAN server: server="Node-2d5007df-861d-2a0b-3911-ed60647710af (Addr: tcp/127.0.0.1:12048) (DC: dc1)" 34:13.048 [INFO] TestAgent: Started DNS server: address=127.0.0.1:12043 network=tcp 34:13.050 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:12044 network=tcp 34:13.050 [INFO] TestAgent: started state syncer 34:13.050 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:12049 network=tcp 34:13.088 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:13.088 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:12048 [Candidate]" term=2 34:13.123 [DEBUG] TestAgent.server.raft: votes: needed=1 34:13.123 [DEBUG] TestAgent.server.raft: vote granted: from=2d5007df-861d-2a0b-3911-ed60647710af term=2 tally=1 34:13.123 [INFO] TestAgent.server.raft: election won: tally=1 34:13.123 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:12048 [Leader]" 34:13.123 [INFO] TestAgent.server: cluster leadership acquired 34:13.123 [INFO] TestAgent.server: New leader elected: payload=Node-2d5007df-861d-2a0b-3911-ed60647710af 34:13.130 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:12048 34:13.158 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 2021-10-05T16:34:13.213Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:13.216 [INFO] TestAgent: Requesting shutdown 34:13.216 [INFO] TestAgent.server: shutting down server 34:13.216 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:13.216 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 34:13.220 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:13.220 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:13.220 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:13.220 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:13.220 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:13.220 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2d5007df-861d-2a0b-3911-ed60647710af 34:13.224 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:13.236Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:13.236Z [INFO] agent.router.manager: shutting down 34:13.236 [INFO] TestAgent: consul server down 34:13.236 [INFO] TestAgent: shutdown complete 34:13.236 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=tcp 34:13.236 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:12043 network=udp 34:13.236 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:12044 network=tcp 34:13.236 [ERROR] TestAgent.server: failed to reconcile member: member="{Node-2d5007df-861d-2a0b-3911-ed60647710af 127.0.0.1 12046 map[acls:0 bootstrap:1 build:1.8.7: dc:dc1 ft_fs:1 id:2d5007df-861d-2a0b-3911-ed60647710af port:12048 raft_vsn:3 role:consul segment: vsn:2 vsn_max:3 vsn_min:2 wan_join_port:12047] alive 1 5 2 2 5 4}" error="leadership lost while committing log" 34:13.737 [INFO] TestAgent: Waiting for endpoints to shut down 34:13.737 [INFO] TestAgent: Endpoints down --- PASS: TestReloadCommand (0.89s) PASS ok github.com/hashicorp/consul/command/reload 1.100s === RUN TestRTTCommand_noTabs === PAUSE TestRTTCommand_noTabs === RUN TestRTTCommand_BadArgs === PAUSE TestRTTCommand_BadArgs === RUN TestRTTCommand_LAN === PAUSE TestRTTCommand_LAN === RUN TestRTTCommand_WAN === PAUSE TestRTTCommand_WAN === CONT TestRTTCommand_noTabs --- PASS: TestRTTCommand_noTabs (0.00s) === CONT TestRTTCommand_WAN [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestRTTCommand_BadArgs === RUN TestRTTCommand_BadArgs/#00 === RUN TestRTTCommand_BadArgs/node1_node2_node3 === CONT TestRTTCommand_LAN === RUN TestRTTCommand_BadArgs/-wan_node1_node2 [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestRTTCommand_BadArgs/-wan_node1.dc1_node2 === RUN TestRTTCommand_BadArgs/-wan_node1_node2.dc1 --- PASS: TestRTTCommand_BadArgs (0.00s) --- PASS: TestRTTCommand_BadArgs/#00 (0.00s) --- PASS: TestRTTCommand_BadArgs/node1_node2_node3 (0.00s) --- PASS: TestRTTCommand_BadArgs/-wan_node1_node2 (0.00s) --- PASS: TestRTTCommand_BadArgs/-wan_node1.dc1_node2 (0.00s) --- PASS: TestRTTCommand_BadArgs/-wan_node1_node2.dc1 (0.00s) 2021-10-05T16:34:13.886Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:13.913Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:13.964 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:63255a5c-81a2-ee18-987b-592e8c3f8a2b Address:127.0.0.1:27363}]" 34:13.964 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 34:13.965 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-63255a5c-81a2-ee18-987b-592e8c3f8a2b.dc1 127.0.0.1 34:13.970 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-63255a5c-81a2-ee18-987b-592e8c3f8a2b 127.0.0.1 2021-10-05T16:34:13.970Z [INFO] agent.router: Initializing LAN area manager 34:13.971 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=udp 34:13.971 [INFO] TestAgent.server: Adding LAN server: server="Node-63255a5c-81a2-ee18-987b-592e8c3f8a2b (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 34:13.971 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-63255a5c-81a2-ee18-987b-592e8c3f8a2b.dc1 area=wan 34:13.971 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27358 network=tcp 34:13.984 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27359 network=tcp 34:13.984 [INFO] TestAgent: started state syncer 34:13.984 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27364 network=tcp 34:14.017 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:14.017 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 34:14.031 [DEBUG] TestAgent.server.raft: votes: needed=1 34:14.031 [DEBUG] TestAgent.server.raft: vote granted: from=63255a5c-81a2-ee18-987b-592e8c3f8a2b term=2 tally=1 34:14.031 [INFO] TestAgent.server.raft: election won: tally=1 34:14.031 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 34:14.032 [INFO] TestAgent.server: cluster leadership acquired 34:14.032 [INFO] TestAgent.server: New leader elected: payload=Node-63255a5c-81a2-ee18-987b-592e8c3f8a2b 34:14.040 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27363 34:14.082 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:14.148 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:14.148 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:14.148 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:14.148 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:14.148 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:14.148 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-63255a5c-81a2-ee18-987b-592e8c3f8a2b 34:14.148 [INFO] TestAgent.server: member joined, marking health alive: member=Node-63255a5c-81a2-ee18-987b-592e8c3f8a2b 34:14.172 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:14.211 [INFO] TestAgent: Synced node info 34:14.211 [DEBUG] TestAgent: Node info in sync 34:14.211 [INFO] TestAgent.server: federation state anti-entropy synced 34:14.258 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/datacenters from=127.0.0.1:60354 latency=1.511142ms 34:14.269 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:60356 latency=4.772639ms 34:14.290 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/datacenters from=127.0.0.1:60356 latency=8.171123ms 34:14.305 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/datacenters from=127.0.0.1:60360 latency=11.877683ms 34:14.305 [INFO] TestAgent: Requesting shutdown 34:14.306 [INFO] TestAgent.server: shutting down server 34:14.306 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:14.306 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:14.306 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:14.306 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:14.306 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:14.306 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:14.306 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:14.306 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:14.306 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:14.306 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:14.311 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:14.320Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:14.320Z [INFO] agent.router.manager: shutting down 34:14.320 [INFO] TestAgent: consul server down 34:14.320 [INFO] TestAgent: shutdown complete 34:14.320 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 34:14.320 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 34:14.320 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 34:14.821 [INFO] TestAgent: Waiting for endpoints to shut down 34:14.821 [INFO] TestAgent: Endpoints down --- PASS: TestRTTCommand_WAN (1.00s) 2021-10-05T16:34:13.888Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:13.913Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:13.949 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:d9004e24-52dc-f31e-6cf7-1e1550dca682 Address:127.0.0.1:27370}]" 34:13.950 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-d9004e24-52dc-f31e-6cf7-1e1550dca682.dc1 127.0.0.1 34:13.951 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-d9004e24-52dc-f31e-6cf7-1e1550dca682 127.0.0.1 2021-10-05T16:34:13.951Z [INFO] agent.router: Initializing LAN area manager 34:13.951 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=udp 34:13.951 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:27370 [Follower]" leader= 34:13.952 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-d9004e24-52dc-f31e-6cf7-1e1550dca682.dc1 area=wan 34:13.952 [INFO] TestAgent: Started DNS server: address=127.0.0.1:27365 network=tcp 34:13.953 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:27366 network=tcp 34:13.953 [INFO] TestAgent: started state syncer 34:13.954 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:27371 network=tcp 34:13.954 [INFO] TestAgent.server: Adding LAN server: server="Node-d9004e24-52dc-f31e-6cf7-1e1550dca682 (Addr: tcp/127.0.0.1:27370) (DC: dc1)" 34:13.989 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:13.989 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:27370 [Candidate]" term=2 34:13.996 [DEBUG] TestAgent.server.raft: votes: needed=1 34:13.996 [DEBUG] TestAgent.server.raft: vote granted: from=d9004e24-52dc-f31e-6cf7-1e1550dca682 term=2 tally=1 34:13.996 [INFO] TestAgent.server.raft: election won: tally=1 34:13.996 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:27370 [Leader]" 34:13.997 [INFO] TestAgent.server: cluster leadership acquired 34:13.997 [INFO] TestAgent.server: New leader elected: payload=Node-d9004e24-52dc-f31e-6cf7-1e1550dca682 34:14.001 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27370 34:14.013 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:14.039 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:14.039 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:14.039 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:14.039 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:14.039 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:14.039 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-d9004e24-52dc-f31e-6cf7-1e1550dca682 34:14.039 [INFO] TestAgent.server: member joined, marking health alive: member=Node-d9004e24-52dc-f31e-6cf7-1e1550dca682 34:14.068 [INFO] TestAgent.server: federation state anti-entropy synced 34:14.144 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:14.155 [INFO] TestAgent: Synced node info 34:14.155 [DEBUG] TestAgent: Node info in sync 34:14.285 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/nodes from=127.0.0.1:36644 latency=391.796µs 34:14.316 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/nodes from=127.0.0.1:36648 latency=285.553µs 34:14.348 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/nodes from=127.0.0.1:36650 latency=260.834µs 34:14.351 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:36652 latency=1.268661ms 34:14.358 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/nodes from=127.0.0.1:36652 latency=288.419µs 34:14.364 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/coordinate/nodes from=127.0.0.1:36654 latency=249.205µs 34:14.368 [INFO] TestAgent: Requesting shutdown 34:14.368 [INFO] TestAgent.server: shutting down server 34:14.368 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:14.368 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:14.368 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:14.368 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:14.368 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:14.368 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:14.368 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:14.368 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:14.368 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:14.368 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:14.380 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:14.388Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:14.388Z [INFO] agent.router.manager: shutting down 34:14.388 [INFO] TestAgent: consul server down 34:14.388 [INFO] TestAgent: shutdown complete 34:14.388 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=tcp 34:14.388 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:27365 network=udp 34:14.388 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:27366 network=tcp 34:14.892 [INFO] TestAgent: Waiting for endpoints to shut down 34:14.892 [INFO] TestAgent: Endpoints down --- PASS: TestRTTCommand_LAN (1.06s) PASS ok github.com/hashicorp/consul/command/rtt 1.216s === RUN TestDevModeHasNoServices === PAUSE TestDevModeHasNoServices === RUN TestStructsToAgentService === PAUSE TestStructsToAgentService === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === CONT TestDevModeHasNoServices === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) === CONT TestStructsToAgentService === RUN TestStructsToAgentService/Basic_service_with_port === PAUSE TestStructsToAgentService/Basic_service_with_port === RUN TestStructsToAgentService/Service_with_a_check === PAUSE TestStructsToAgentService/Service_with_a_check === RUN TestStructsToAgentService/Service_with_an_unnamed_check === PAUSE TestStructsToAgentService/Service_with_an_unnamed_check === RUN TestStructsToAgentService/Service_with_a_zero-value_check === PAUSE TestStructsToAgentService/Service_with_a_zero-value_check === RUN TestStructsToAgentService/Service_with_checks === PAUSE TestStructsToAgentService/Service_with_checks === RUN TestStructsToAgentService/Proxy_service === PAUSE TestStructsToAgentService/Proxy_service === CONT TestStructsToAgentService/Basic_service_with_port === CONT TestStructsToAgentService/Proxy_service === CONT TestStructsToAgentService/Service_with_checks === CONT TestStructsToAgentService/Service_with_a_zero-value_check === CONT TestStructsToAgentService/Service_with_an_unnamed_check === CONT TestStructsToAgentService/Service_with_a_check --- PASS: TestStructsToAgentService (0.00s) --- PASS: TestStructsToAgentService/Basic_service_with_port (0.00s) --- PASS: TestStructsToAgentService/Proxy_service (0.00s) --- PASS: TestStructsToAgentService/Service_with_checks (0.00s) --- PASS: TestStructsToAgentService/Service_with_a_zero-value_check (0.00s) --- PASS: TestStructsToAgentService/Service_with_a_check (0.01s) --- PASS: TestStructsToAgentService/Service_with_an_unnamed_check (0.01s) --- PASS: TestDevModeHasNoServices (0.04s) PASS ok github.com/hashicorp/consul/command/services 0.139s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === RUN TestCommand_Validation === PAUSE TestCommand_Validation === RUN TestCommand_File_id === PAUSE TestCommand_File_id === RUN TestCommand_File_nameOnly === PAUSE TestCommand_File_nameOnly === RUN TestCommand_Flag === PAUSE TestCommand_Flag === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) === CONT TestCommand_Flag [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCommand_File_id === CONT TestCommand_File_nameOnly === CONT TestCommand_Validation === RUN TestCommand_Validation/no_args_or_id === RUN TestCommand_Validation/args_and_-id --- PASS: TestCommand_Validation (0.01s) --- PASS: TestCommand_Validation/no_args_or_id (0.00s) --- PASS: TestCommand_Validation/args_and_-id (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:34:20.579Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:20.623Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:20.666 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:2fa4d284-ed57-fe4b-254a-3467d475623d Address:127.0.0.1:20223}]" 34:20.667 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-2fa4d284-ed57-fe4b-254a-3467d475623d.dc1 127.0.0.1 34:20.668 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:20223 [Follower]" leader= 34:20.668 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-2fa4d284-ed57-fe4b-254a-3467d475623d 127.0.0.1 2021-10-05T16:34:20.668Z [INFO] agent.router: Initializing LAN area manager 34:20.668 [INFO] TestAgent.server: Adding LAN server: server="Node-2fa4d284-ed57-fe4b-254a-3467d475623d (Addr: tcp/127.0.0.1:20223) (DC: dc1)" 34:20.668 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-2fa4d284-ed57-fe4b-254a-3467d475623d.dc1 area=wan 34:20.668 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20218 network=udp 34:20.668 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20218 network=tcp 34:20.669 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:20219 network=tcp 34:20.669 [INFO] TestAgent: started state syncer 34:20.669 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:20224 network=tcp 34:20.704 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:20.704 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:20223 [Candidate]" term=2 34:20.714 [DEBUG] TestAgent.server.raft: votes: needed=1 34:20.714 [DEBUG] TestAgent.server.raft: vote granted: from=2fa4d284-ed57-fe4b-254a-3467d475623d term=2 tally=1 34:20.714 [INFO] TestAgent.server.raft: election won: tally=1 34:20.714 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:20223 [Leader]" 34:20.715 [INFO] TestAgent.server: cluster leadership acquired 34:20.715 [INFO] TestAgent.server: New leader elected: payload=Node-2fa4d284-ed57-fe4b-254a-3467d475623d 34:20.723 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:20223 34:20.804 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:20.836 [INFO] TestAgent: Synced node info 34:20.872 [INFO] TestAgent: Synced service: service=web 34:20.872 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:47584 latency=56.051047ms 34:20.891 [DEBUG] TestAgent: Node info in sync 34:20.898 [INFO] TestAgent: Synced service: service=db 34:20.898 [DEBUG] TestAgent: Service in sync: service=web 34:20.898 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:47584 latency=17.945768ms 34:20.898 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:20.898 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:20.898 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:20.898 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:20.898 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:20.898 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-2fa4d284-ed57-fe4b-254a-3467d475623d 34:20.898 [INFO] TestAgent.server: member joined, marking health alive: member=Node-2fa4d284-ed57-fe4b-254a-3467d475623d 34:20.932 [DEBUG] TestAgent: removed service: service=web 34:20.932 [DEBUG] TestAgent: Node info in sync 34:20.955 [INFO] TestAgent: Deregistered service: service=web 34:20.955 [DEBUG] TestAgent: Service in sync: service=db 34:20.955 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/deregister/web from=127.0.0.1:47588 latency=31.642773ms 34:20.955 [INFO] TestAgent.server: federation state anti-entropy synced 34:20.960 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:47584 latency=3.294304ms 34:20.962 [INFO] TestAgent: Requesting shutdown 34:20.963 [INFO] TestAgent.server: shutting down server 34:20.963 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:20.963 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:20.963 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:20.963 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:20.963 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:20.963 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:20.963 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:20.963 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 34:20.963 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:20.963 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:20.963 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:20.968 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:20.976Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:20.976Z [INFO] agent.router.manager: shutting down 34:20.976 [INFO] TestAgent: consul server down 34:20.976 [INFO] TestAgent: shutdown complete 34:20.976 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20218 network=tcp 34:20.976 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20218 network=udp 34:20.976 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:20219 network=tcp 34:21.477 [INFO] TestAgent: Waiting for endpoints to shut down 34:21.477 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_File_id (1.02s) 2021-10-05T16:34:20.544Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:20.570Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:20.724 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9cf95e72-480a-a2c6-6e0b-986c57d57156 Address:127.0.0.1:20216}]" 34:20.729 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9cf95e72-480a-a2c6-6e0b-986c57d57156.dc1 127.0.0.1 34:20.730 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9cf95e72-480a-a2c6-6e0b-986c57d57156 127.0.0.1 2021-10-05T16:34:20.730Z [INFO] agent.router: Initializing LAN area manager 34:20.735 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:20216 [Follower]" leader= 34:20.737 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20211 network=tcp 34:20.752 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9cf95e72-480a-a2c6-6e0b-986c57d57156.dc1 area=wan 34:20.752 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20211 network=udp 34:20.752 [INFO] TestAgent.server: Adding LAN server: server="Node-9cf95e72-480a-a2c6-6e0b-986c57d57156 (Addr: tcp/127.0.0.1:20216) (DC: dc1)" 34:20.784 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:20212 network=tcp 34:20.784 [INFO] TestAgent: started state syncer 34:20.785 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:20217 network=tcp 34:20.791 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:20.791 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:20216 [Candidate]" term=2 34:20.806 [DEBUG] TestAgent.server.raft: votes: needed=1 34:20.806 [DEBUG] TestAgent.server.raft: vote granted: from=9cf95e72-480a-a2c6-6e0b-986c57d57156 term=2 tally=1 34:20.806 [INFO] TestAgent.server.raft: election won: tally=1 34:20.806 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:20216 [Leader]" 34:20.808 [INFO] TestAgent.server: cluster leadership acquired 34:20.808 [INFO] TestAgent.server: New leader elected: payload=Node-9cf95e72-480a-a2c6-6e0b-986c57d57156 34:20.826 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:20216 34:20.867 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:20.932 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:20.932 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:20.932 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:20.932 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:20.932 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:20.932 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9cf95e72-480a-a2c6-6e0b-986c57d57156 34:20.932 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9cf95e72-480a-a2c6-6e0b-986c57d57156 34:20.940 [INFO] TestAgent: Synced node info 34:20.940 [DEBUG] TestAgent: Node info in sync 34:20.956 [INFO] TestAgent.server: federation state anti-entropy synced 34:20.976 [DEBUG] TestAgent: Node info in sync 34:20.992 [INFO] TestAgent: Synced service: service=web 34:20.992 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:34796 latency=23.673098ms 34:21.008 [DEBUG] TestAgent: Node info in sync 34:21.008 [DEBUG] TestAgent: Service in sync: service=web 34:21.024 [INFO] TestAgent: Synced service: service=db 34:21.024 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:34796 latency=27.847741ms 34:21.029 [DEBUG] TestAgent: removed service: service=web 34:21.029 [DEBUG] TestAgent: Node info in sync 34:21.039 [INFO] TestAgent: Deregistered service: service=web 34:21.039 [DEBUG] TestAgent: Service in sync: service=db 34:21.039 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/deregister/web from=127.0.0.1:34798 latency=10.055566ms 34:21.040 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:34796 latency=174.687µs 34:21.041 [INFO] TestAgent: Requesting shutdown 34:21.041 [INFO] TestAgent.server: shutting down server 34:21.041 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:21.041 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:21.041 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:21.041 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:21.041 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:21.041 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:21.041 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:21.041 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:21.041 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:21.041 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:21.044 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:21.050Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:21.051Z [INFO] agent.router.manager: shutting down 34:21.051 [INFO] TestAgent: consul server down 34:21.051 [INFO] TestAgent: shutdown complete 34:21.051 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20211 network=tcp 34:21.051 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20211 network=udp 34:21.051 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:20212 network=tcp 34:21.552 [INFO] TestAgent: Waiting for endpoints to shut down 34:21.552 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_Flag (1.10s) 2021-10-05T16:34:20.613Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:20.638Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:20.674 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dd8f845f-bdfa-9af0-8321-a38d382e4010 Address:127.0.0.1:20230}]" 34:20.674 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dd8f845f-bdfa-9af0-8321-a38d382e4010.dc1 127.0.0.1 34:20.675 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dd8f845f-bdfa-9af0-8321-a38d382e4010 127.0.0.1 2021-10-05T16:34:20.675Z [INFO] agent.router: Initializing LAN area manager 34:20.675 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20225 network=udp 34:20.675 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:20230 [Follower]" leader= 34:20.676 [INFO] TestAgent.server: Adding LAN server: server="Node-dd8f845f-bdfa-9af0-8321-a38d382e4010 (Addr: tcp/127.0.0.1:20230) (DC: dc1)" 34:20.676 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dd8f845f-bdfa-9af0-8321-a38d382e4010.dc1 area=wan 34:20.676 [INFO] TestAgent: Started DNS server: address=127.0.0.1:20225 network=tcp 34:20.677 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:20226 network=tcp 34:20.735 [INFO] TestAgent: started state syncer 34:20.735 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:20231 network=tcp 34:20.778 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:20.778 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:20230 [Candidate]" term=2 34:20.799 [DEBUG] TestAgent.server.raft: votes: needed=1 34:20.799 [DEBUG] TestAgent.server.raft: vote granted: from=dd8f845f-bdfa-9af0-8321-a38d382e4010 term=2 tally=1 34:20.799 [INFO] TestAgent.server.raft: election won: tally=1 34:20.799 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:20230 [Leader]" 34:20.799 [INFO] TestAgent.server: cluster leadership acquired 34:20.799 [INFO] TestAgent.server: New leader elected: payload=Node-dd8f845f-bdfa-9af0-8321-a38d382e4010 34:20.811 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:20230 34:20.838 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:20.900 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:20.900 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:20.900 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:20.900 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:20.900 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:20.900 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dd8f845f-bdfa-9af0-8321-a38d382e4010 34:20.900 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dd8f845f-bdfa-9af0-8321-a38d382e4010 34:20.928 [INFO] TestAgent.server: federation state anti-entropy synced 34:21.020 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:21.026 [INFO] TestAgent: Synced node info 34:21.026 [DEBUG] TestAgent: Node info in sync 34:21.160 [DEBUG] TestAgent: Node info in sync 34:21.176 [INFO] TestAgent: Synced service: service=web 34:21.176 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:54880 latency=27.709114ms 34:21.188 [DEBUG] TestAgent: Node info in sync 34:21.188 [DEBUG] TestAgent: Service in sync: service=web 34:21.208 [INFO] TestAgent: Synced service: service=db 34:21.208 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:54880 latency=27.995517ms 34:21.230 [DEBUG] TestAgent: removed service: service=web 34:21.230 [DEBUG] TestAgent: Node info in sync 34:21.237 [INFO] TestAgent: Deregistered service: service=web 34:21.237 [DEBUG] TestAgent: Service in sync: service=db 34:21.237 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/deregister/web from=127.0.0.1:54882 latency=6.642752ms 34:21.241 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:54880 latency=315.643µs 34:21.245 [INFO] TestAgent: Requesting shutdown 34:21.252 [INFO] TestAgent.server: shutting down server 34:21.252 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:21.252 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:21.252 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:21.252 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:21.252 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:21.252 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:21.253 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:21.253 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:21.253 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:21.253 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:21.262 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:21.276Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:21.276Z [INFO] agent.router.manager: shutting down 34:21.276 [INFO] TestAgent: consul server down 34:21.276 [INFO] TestAgent: shutdown complete 34:21.276 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20225 network=tcp 34:21.276 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:20225 network=udp 34:21.276 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:20226 network=tcp 34:21.780 [INFO] TestAgent: Waiting for endpoints to shut down 34:21.780 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_File_nameOnly (1.32s) PASS ok github.com/hashicorp/consul/command/services/deregister 1.515s === RUN TestCommand_noTabs === PAUSE TestCommand_noTabs === RUN TestCommand_Validation === PAUSE TestCommand_Validation === RUN TestCommand_File === PAUSE TestCommand_File === RUN TestCommand_Flags === PAUSE TestCommand_Flags === RUN TestCommand_Flags_TaggedAddresses === PAUSE TestCommand_Flags_TaggedAddresses === RUN TestCommand_FileWithUnnamedCheck === PAUSE TestCommand_FileWithUnnamedCheck === CONT TestCommand_noTabs --- PASS: TestCommand_noTabs (0.00s) === CONT TestCommand_FileWithUnnamedCheck [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestCommand_Flags === CONT TestCommand_File === CONT TestCommand_Flags_TaggedAddresses === CONT TestCommand_Validation === RUN TestCommand_Validation/no_args_or_id === RUN TestCommand_Validation/args_and_-name --- PASS: TestCommand_Validation (0.00s) --- PASS: TestCommand_Validation/no_args_or_id (0.00s) --- PASS: TestCommand_Validation/args_and_-name (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:34:26.171Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:26.222Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:26.300 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:1297140b-362e-d214-28f1-7527f1d413c5 Address:127.0.0.1:30440}]" 34:26.300 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30440 [Follower]" leader= 34:26.301 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-1297140b-362e-d214-28f1-7527f1d413c5.dc1 127.0.0.1 34:26.301 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-1297140b-362e-d214-28f1-7527f1d413c5 127.0.0.1 2021-10-05T16:34:26.301Z [INFO] agent.router: Initializing LAN area manager 34:26.302 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30435 network=udp 34:26.302 [INFO] TestAgent.server: Adding LAN server: server="Node-1297140b-362e-d214-28f1-7527f1d413c5 (Addr: tcp/127.0.0.1:30440) (DC: dc1)" 34:26.302 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-1297140b-362e-d214-28f1-7527f1d413c5.dc1 area=wan 34:26.325 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30435 network=tcp 34:26.343 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30436 network=tcp 34:26.343 [INFO] TestAgent: started state syncer 34:26.363 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30441 network=tcp 34:26.363 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:26.363 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30440 [Candidate]" term=2 34:26.394 [DEBUG] TestAgent.server.raft: votes: needed=1 34:26.394 [DEBUG] TestAgent.server.raft: vote granted: from=1297140b-362e-d214-28f1-7527f1d413c5 term=2 tally=1 34:26.394 [INFO] TestAgent.server.raft: election won: tally=1 34:26.394 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30440 [Leader]" 34:26.395 [INFO] TestAgent.server: cluster leadership acquired 34:26.395 [INFO] TestAgent.server: New leader elected: payload=Node-1297140b-362e-d214-28f1-7527f1d413c5 34:26.413 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30440 34:26.445 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:26.483 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:26.483 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:26.483 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:26.483 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:26.483 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:26.483 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-1297140b-362e-d214-28f1-7527f1d413c5 34:26.483 [INFO] TestAgent.server: member joined, marking health alive: member=Node-1297140b-362e-d214-28f1-7527f1d413c5 34:26.505 [INFO] TestAgent.server: federation state anti-entropy synced 34:26.577 [INFO] TestAgent: Synced node info 34:26.584 [INFO] TestAgent: Synced service: service=web 34:26.584 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:52090 latency=29.72219ms 34:26.585 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:26.585 [DEBUG] TestAgent: Node info in sync 34:26.599 [INFO] TestAgent: Synced service: service=web 34:26.599 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:52094 latency=12.623271ms 34:26.604 [INFO] TestAgent: Requesting shutdown 34:26.604 [INFO] TestAgent.server: shutting down server 34:26.604 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:26.604 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:26.604 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:26.604 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:26.604 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:26.604 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:26.604 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:26.604 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:26.604 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:26.604 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:26.622 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:26.633Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:26.633Z [INFO] agent.router.manager: shutting down 34:26.633 [INFO] TestAgent: consul server down 34:26.633 [INFO] TestAgent: shutdown complete 34:26.633 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30435 network=tcp 34:26.633 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30435 network=udp 34:26.633 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30436 network=tcp 34:27.133 [INFO] TestAgent: Waiting for endpoints to shut down 34:27.133 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_Flags_TaggedAddresses (1.07s) 2021-10-05T16:34:26.156Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:26.193Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:26.324 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:36e654cd-02d3-82f6-8e0b-e8b061e769bb Address:127.0.0.1:30433}]" 34:26.325 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-36e654cd-02d3-82f6-8e0b-e8b061e769bb.dc1 127.0.0.1 34:26.326 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-36e654cd-02d3-82f6-8e0b-e8b061e769bb 127.0.0.1 2021-10-05T16:34:26.326Z [INFO] agent.router: Initializing LAN area manager 34:26.340 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30428 network=udp 34:26.340 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30433 [Follower]" leader= 34:26.341 [INFO] TestAgent.server: Adding LAN server: server="Node-36e654cd-02d3-82f6-8e0b-e8b061e769bb (Addr: tcp/127.0.0.1:30433) (DC: dc1)" 34:26.341 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-36e654cd-02d3-82f6-8e0b-e8b061e769bb.dc1 area=wan 34:26.341 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30428 network=tcp 34:26.342 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30429 network=tcp 34:26.342 [INFO] TestAgent: started state syncer 34:26.363 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30434 network=tcp 34:26.404 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:26.404 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30433 [Candidate]" term=2 34:26.415 [DEBUG] TestAgent.server.raft: votes: needed=1 34:26.415 [DEBUG] TestAgent.server.raft: vote granted: from=36e654cd-02d3-82f6-8e0b-e8b061e769bb term=2 tally=1 34:26.415 [INFO] TestAgent.server.raft: election won: tally=1 34:26.415 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30433 [Leader]" 34:26.416 [INFO] TestAgent.server: cluster leadership acquired 34:26.416 [INFO] TestAgent.server: New leader elected: payload=Node-36e654cd-02d3-82f6-8e0b-e8b061e769bb 34:26.427 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30433 34:26.480 [INFO] TestAgent: Synced node info 34:26.502 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:26.525 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:26.525 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:26.525 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:26.525 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:26.525 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:26.525 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-36e654cd-02d3-82f6-8e0b-e8b061e769bb 34:26.525 [INFO] TestAgent.server: member joined, marking health alive: member=Node-36e654cd-02d3-82f6-8e0b-e8b061e769bb 34:26.552 [INFO] TestAgent.server: federation state anti-entropy synced 34:26.587 [DEBUG] TestAgent: Node info in sync 34:26.608 [INFO] TestAgent: Synced service: service=web 34:26.608 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:38932 latency=26.803192ms 34:26.620 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:38938 latency=3.831401ms 34:26.623 [INFO] TestAgent: Requesting shutdown 34:26.623 [INFO] TestAgent.server: shutting down server 34:26.623 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:26.623 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:26.623 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:26.623 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:26.623 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:26.623 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:26.623 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:26.623 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:26.623 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:26.623 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:26.627 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:26.637Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:26.637Z [INFO] agent.router.manager: shutting down 34:26.637 [INFO] TestAgent: consul server down 34:26.637 [INFO] TestAgent: shutdown complete 34:26.637 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30428 network=tcp 34:26.637 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30428 network=udp 34:26.637 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30429 network=tcp 34:27.143 [INFO] TestAgent: Waiting for endpoints to shut down 34:27.143 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_Flags (1.08s) 2021-10-05T16:34:26.147Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:26.193Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:26.324 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:5807623b-18a9-272d-38e1-92f9cb9fc2e7 Address:127.0.0.1:30447}]" 34:26.325 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-5807623b-18a9-272d-38e1-92f9cb9fc2e7.dc1 127.0.0.1 34:26.325 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-5807623b-18a9-272d-38e1-92f9cb9fc2e7 127.0.0.1 2021-10-05T16:34:26.325Z [INFO] agent.router: Initializing LAN area manager 34:26.326 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30442 network=udp 34:26.326 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30447 [Follower]" leader= 34:26.362 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-5807623b-18a9-272d-38e1-92f9cb9fc2e7.dc1 area=wan 34:26.362 [INFO] TestAgent.server: Adding LAN server: server="Node-5807623b-18a9-272d-38e1-92f9cb9fc2e7 (Addr: tcp/127.0.0.1:30447) (DC: dc1)" 34:26.362 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30442 network=tcp 34:26.362 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30443 network=tcp 34:26.362 [INFO] TestAgent: started state syncer 34:26.364 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30448 network=tcp 34:26.374 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:26.374 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30447 [Candidate]" term=2 34:26.408 [DEBUG] TestAgent.server.raft: votes: needed=1 34:26.408 [DEBUG] TestAgent.server.raft: vote granted: from=5807623b-18a9-272d-38e1-92f9cb9fc2e7 term=2 tally=1 34:26.408 [INFO] TestAgent.server.raft: election won: tally=1 34:26.408 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30447 [Leader]" 34:26.412 [INFO] TestAgent.server: cluster leadership acquired 34:26.412 [INFO] TestAgent.server: New leader elected: payload=Node-5807623b-18a9-272d-38e1-92f9cb9fc2e7 34:26.426 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30447 34:26.446 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:26.508 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:26.508 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:26.508 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:26.508 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:26.508 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:26.508 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-5807623b-18a9-272d-38e1-92f9cb9fc2e7 34:26.508 [INFO] TestAgent.server: member joined, marking health alive: member=Node-5807623b-18a9-272d-38e1-92f9cb9fc2e7 34:26.549 [INFO] TestAgent.server: federation state anti-entropy synced 34:26.627 [INFO] TestAgent: Synced node info 34:26.638 [INFO] TestAgent: Synced service: service=web 34:26.638 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:51958 latency=41.897622ms 34:26.638 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:26.638 [DEBUG] TestAgent: Node info in sync 34:26.653 [INFO] TestAgent: Synced service: service=web 34:26.654 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:51962 latency=15.104977ms 34:26.655 [INFO] TestAgent: Requesting shutdown 34:26.655 [INFO] TestAgent.server: shutting down server 34:26.655 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:26.655 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:26.655 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:26.655 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:26.655 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:26.655 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:26.655 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:26.655 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:26.655 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:26.655 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:26.663 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:26.678Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:26.678Z [INFO] agent.router.manager: shutting down 34:26.678 [INFO] TestAgent: consul server down 34:26.678 [INFO] TestAgent: shutdown complete 34:26.678 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30442 network=tcp 34:26.678 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30442 network=udp 34:26.678 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30443 network=tcp 34:27.180 [INFO] TestAgent: Waiting for endpoints to shut down 34:27.180 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_File (1.12s) 2021-10-05T16:34:26.175Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:26.213Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:26.268 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:7146fa77-93a2-68ca-b8d5-014693546a11 Address:127.0.0.1:30426}]" 34:26.269 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:30426 [Follower]" leader= 34:26.269 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-7146fa77-93a2-68ca-b8d5-014693546a11.dc1 127.0.0.1 34:26.270 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-7146fa77-93a2-68ca-b8d5-014693546a11 127.0.0.1 2021-10-05T16:34:26.270Z [INFO] agent.router: Initializing LAN area manager 34:26.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=udp 34:26.270 [INFO] TestAgent.server: Adding LAN server: server="Node-7146fa77-93a2-68ca-b8d5-014693546a11 (Addr: tcp/127.0.0.1:30426) (DC: dc1)" 34:26.270 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-7146fa77-93a2-68ca-b8d5-014693546a11.dc1 area=wan 34:26.270 [INFO] TestAgent: Started DNS server: address=127.0.0.1:30421 network=tcp 34:26.271 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:30422 network=tcp 34:26.271 [INFO] TestAgent: started state syncer 34:26.271 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:30427 network=tcp 34:26.341 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:26.341 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:30426 [Candidate]" term=2 34:26.368 [DEBUG] TestAgent.server.raft: votes: needed=1 34:26.368 [DEBUG] TestAgent.server.raft: vote granted: from=7146fa77-93a2-68ca-b8d5-014693546a11 term=2 tally=1 34:26.368 [INFO] TestAgent.server.raft: election won: tally=1 34:26.368 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:30426 [Leader]" 34:26.372 [INFO] TestAgent.server: cluster leadership acquired 34:26.372 [INFO] TestAgent.server: New leader elected: payload=Node-7146fa77-93a2-68ca-b8d5-014693546a11 34:26.389 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:30426 34:26.430 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:26.470 [INFO] TestAgent: Synced node info 34:26.501 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:26.501 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:26.501 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:26.501 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:26.501 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:26.501 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-7146fa77-93a2-68ca-b8d5-014693546a11 34:26.502 [INFO] TestAgent.server: member joined, marking health alive: member=Node-7146fa77-93a2-68ca-b8d5-014693546a11 34:26.522 [INFO] TestAgent.server: federation state anti-entropy synced 34:26.718 [DEBUG] TestAgent: Node info in sync 34:26.722 [INFO] TestAgent: Synced service: service=web 34:26.722 [DEBUG] TestAgent: Check in sync: check=service:web 34:26.722 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:56056 latency=22.159973ms 34:26.723 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/services from=127.0.0.1:56058 latency=329.974µs 34:26.727 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/checks from=127.0.0.1:56058 latency=447.365µs 34:26.728 [INFO] TestAgent: Requesting shutdown 34:26.728 [INFO] TestAgent.server: shutting down server 34:26.728 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:26.728 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:26.728 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:26.728 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:26.728 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:26.728 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:26.728 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:26.728 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:26.728 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:26.728 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:26.733 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:26.739Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:26.739Z [INFO] agent.router.manager: shutting down 34:26.740 [INFO] TestAgent: consul server down 34:26.740 [INFO] TestAgent: shutdown complete 34:26.740 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=tcp 34:26.740 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:30421 network=udp 34:26.740 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:30422 network=tcp 34:27.242 [INFO] TestAgent: Waiting for endpoints to shut down 34:27.242 [INFO] TestAgent: Endpoints down --- PASS: TestCommand_FileWithUnnamedCheck (1.18s) PASS ok github.com/hashicorp/consul/command/services/register 1.374s === RUN TestSnapshotCommand_noTabs === PAUSE TestSnapshotCommand_noTabs === CONT TestSnapshotCommand_noTabs --- PASS: TestSnapshotCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/snapshot 0.050s === RUN TestSnapshotInspectCommand_noTabs === PAUSE TestSnapshotInspectCommand_noTabs === RUN TestSnapshotInspectCommand_Validation === PAUSE TestSnapshotInspectCommand_Validation === RUN TestSnapshotInspectCommand === PAUSE TestSnapshotInspectCommand === CONT TestSnapshotInspectCommand_noTabs --- PASS: TestSnapshotInspectCommand_noTabs (0.00s) === CONT TestSnapshotInspectCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestSnapshotInspectCommand_Validation --- PASS: TestSnapshotInspectCommand_Validation (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range 2021-10-05T16:34:25.978Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:25.990Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:26.037 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:dfe0e081-bb22-dbc9-f502-857f4dcd2331 Address:127.0.0.1:22258}]" 34:26.038 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:22258 [Follower]" leader= 34:26.039 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-dfe0e081-bb22-dbc9-f502-857f4dcd2331.dc1 127.0.0.1 34:26.040 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-dfe0e081-bb22-dbc9-f502-857f4dcd2331 127.0.0.1 2021-10-05T16:34:26.040Z [INFO] agent.router: Initializing LAN area manager 34:26.049 [INFO] TestAgent.server: Adding LAN server: server="Node-dfe0e081-bb22-dbc9-f502-857f4dcd2331 (Addr: tcp/127.0.0.1:22258) (DC: dc1)" 34:26.049 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-dfe0e081-bb22-dbc9-f502-857f4dcd2331.dc1 area=wan 34:26.049 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=udp 34:26.049 [INFO] TestAgent: Started DNS server: address=127.0.0.1:22253 network=tcp 34:26.050 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:22254 network=tcp 34:26.050 [INFO] TestAgent: started state syncer 34:26.050 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:22259 network=tcp 34:26.108 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:26.108 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:22258 [Candidate]" term=2 34:26.128 [DEBUG] TestAgent.server.raft: votes: needed=1 34:26.128 [DEBUG] TestAgent.server.raft: vote granted: from=dfe0e081-bb22-dbc9-f502-857f4dcd2331 term=2 tally=1 34:26.128 [INFO] TestAgent.server.raft: election won: tally=1 34:26.128 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:22258 [Leader]" 34:26.134 [INFO] TestAgent.server: cluster leadership acquired 34:26.135 [INFO] TestAgent.server: New leader elected: payload=Node-dfe0e081-bb22-dbc9-f502-857f4dcd2331 34:26.160 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:22258 34:26.205 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:26.268 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:26.268 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:26.268 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:26.268 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:26.268 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:26.268 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-dfe0e081-bb22-dbc9-f502-857f4dcd2331 34:26.268 [INFO] TestAgent.server: member joined, marking health alive: member=Node-dfe0e081-bb22-dbc9-f502-857f4dcd2331 34:26.296 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:26.304 [INFO] TestAgent.server.fsm: snapshot created: duration=92.089µs 34:26.312 [INFO] TestAgent.server.raft: starting snapshot up to: index=10 34:26.312 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshotInspectCommand-TestAgent-agent515351129/raft/snapshots/2-10-1633451666312.tmp 34:26.312 [INFO] TestAgent.server: federation state anti-entropy synced 34:26.326 [INFO] TestAgent: Synced node info 34:26.326 [DEBUG] TestAgent: Node info in sync 34:26.342 [INFO] TestAgent.server.raft: snapshot complete up to: index=10 34:26.358 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/snapshot from=127.0.0.1:46916 latency=218.74556ms 34:26.360 [INFO] TestAgent: Requesting shutdown 34:26.360 [INFO] TestAgent.server: shutting down server 34:26.360 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:26.360 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:26.360 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:26.360 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:26.360 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:26.360 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:26.360 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:26.360 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:26.360 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:26.360 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:26.369 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:26.375Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:26.375Z [INFO] agent.router.manager: shutting down 34:26.375 [INFO] TestAgent: consul server down 34:26.375 [INFO] TestAgent: shutdown complete 34:26.375 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=tcp 34:26.375 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:22253 network=udp 34:26.375 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:22254 network=tcp 34:26.880 [INFO] TestAgent: Waiting for endpoints to shut down 34:26.880 [INFO] TestAgent: Endpoints down --- PASS: TestSnapshotInspectCommand (0.99s) PASS ok github.com/hashicorp/consul/command/snapshot/inspect 1.091s === RUN TestSnapshotRestoreCommand_noTabs === PAUSE TestSnapshotRestoreCommand_noTabs === RUN TestSnapshotRestoreCommand_Validation === PAUSE TestSnapshotRestoreCommand_Validation === RUN TestSnapshotRestoreCommand === PAUSE TestSnapshotRestoreCommand === RUN TestSnapshotRestoreCommand_TruncatedSnapshot === PAUSE TestSnapshotRestoreCommand_TruncatedSnapshot === CONT TestSnapshotRestoreCommand_noTabs === CONT TestSnapshotRestoreCommand_TruncatedSnapshot --- PASS: TestSnapshotRestoreCommand_noTabs (0.00s) === CONT TestSnapshotRestoreCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestSnapshotRestoreCommand_Validation --- PASS: TestSnapshotRestoreCommand_Validation (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_200_bytes_from_end === RUN TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_16_bytes_from_end === RUN TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_8_bytes_from_end === RUN TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_4_bytes_from_end === RUN TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_2_bytes_from_end === RUN TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_1_bytes_from_end 2021-10-05T16:34:26.572Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:26.614Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:26.679 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:ed65b7b3-8f4d-67bb-76ab-66348dfe15f1 Address:127.0.0.1:15111}]" 34:26.680 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15111 [Follower]" leader= 34:26.680 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-ed65b7b3-8f4d-67bb-76ab-66348dfe15f1.dc1 127.0.0.1 34:26.680 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-ed65b7b3-8f4d-67bb-76ab-66348dfe15f1 127.0.0.1 2021-10-05T16:34:26.681Z [INFO] agent.router: Initializing LAN area manager 34:26.681 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=udp 34:26.681 [INFO] TestAgent.server: Adding LAN server: server="Node-ed65b7b3-8f4d-67bb-76ab-66348dfe15f1 (Addr: tcp/127.0.0.1:15111) (DC: dc1)" 34:26.681 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-ed65b7b3-8f4d-67bb-76ab-66348dfe15f1.dc1 area=wan 34:26.681 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15106 network=tcp 34:26.682 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15107 network=tcp 34:26.682 [INFO] TestAgent: started state syncer 34:26.682 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15112 network=tcp 34:26.720 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:26.720 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15111 [Candidate]" term=2 34:26.741 [DEBUG] TestAgent.server.raft: votes: needed=1 34:26.741 [DEBUG] TestAgent.server.raft: vote granted: from=ed65b7b3-8f4d-67bb-76ab-66348dfe15f1 term=2 tally=1 34:26.741 [INFO] TestAgent.server.raft: election won: tally=1 34:26.741 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15111 [Leader]" 34:26.743 [INFO] TestAgent.server: cluster leadership acquired 34:26.743 [INFO] TestAgent.server: New leader elected: payload=Node-ed65b7b3-8f4d-67bb-76ab-66348dfe15f1 34:26.750 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15111 34:26.769 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:26.832 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:26.832 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:26.832 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:26.832 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:26.832 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:26.832 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-ed65b7b3-8f4d-67bb-76ab-66348dfe15f1 34:26.832 [INFO] TestAgent.server: member joined, marking health alive: member=Node-ed65b7b3-8f4d-67bb-76ab-66348dfe15f1 34:26.845 [INFO] TestAgent.server: federation state anti-entropy synced 34:26.919 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:26.925 [INFO] TestAgent: Synced node info 34:26.925 [DEBUG] TestAgent: Node info in sync 34:27.128 [INFO] TestAgent.server.fsm: snapshot created: duration=152.394µs 34:27.129 [INFO] TestAgent.server.raft: starting snapshot up to: index=12 34:27.129 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshotRestoreCommand-TestAgent-agent716578905/raft/snapshots/2-12-1633451667129.tmp 34:27.183 [INFO] TestAgent.server.raft: snapshot complete up to: index=12 34:27.226 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/snapshot from=127.0.0.1:57272 latency=97.54318ms 34:27.244 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshotRestoreCommand-TestAgent-agent716578905/raft/snapshots/2-13-1633451667244.tmp 34:27.272 [INFO] TestAgent.server.raft: copied to local snapshot: bytes=5146 34:27.273 [INFO] TestAgent.server.raft: restored user snapshot: index=1 34:27.308 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:27.308 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:27.308 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:27.308 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:27.308 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:27.308 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:27.308 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:27.308 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15111 34:27.309 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:27.309 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:27.309 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:27.309 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:27.309 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:57274 latency=81.37818ms 34:27.310 [INFO] TestAgent: Requesting shutdown 34:27.310 [INFO] TestAgent.server: shutting down server 34:27.310 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:27.310 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:27.310 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:27.310 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:27.310 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:27.310 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:27.310 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:27.310 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:27.312 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:27.312 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:27.312 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:27.312 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:27.319 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:27.338Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:27.338Z [INFO] agent.router.manager: shutting down 34:27.338 [INFO] TestAgent: consul server down 34:27.338 [INFO] TestAgent: shutdown complete 34:27.338 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=tcp 34:27.338 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15106 network=udp 34:27.338 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15107 network=tcp 34:27.840 [INFO] TestAgent: Waiting for endpoints to shut down 34:27.840 [INFO] TestAgent: Endpoints down --- PASS: TestSnapshotRestoreCommand (1.37s) 2021-10-05T16:34:26.572Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:26.614Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:26.660 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:45e73622-238a-6eb9-7ede-7f98ca64ca6e Address:127.0.0.1:15118}]" 34:26.661 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-45e73622-238a-6eb9-7ede-7f98ca64ca6e.dc1 127.0.0.1 34:26.662 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-45e73622-238a-6eb9-7ede-7f98ca64ca6e 127.0.0.1 2021-10-05T16:34:26.662Z [INFO] agent.router: Initializing LAN area manager 34:26.662 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=udp 34:26.662 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:15118 [Follower]" leader= 34:26.663 [INFO] TestAgent.server: Adding LAN server: server="Node-45e73622-238a-6eb9-7ede-7f98ca64ca6e (Addr: tcp/127.0.0.1:15118) (DC: dc1)" 34:26.663 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-45e73622-238a-6eb9-7ede-7f98ca64ca6e.dc1 area=wan 34:26.663 [INFO] TestAgent: Started DNS server: address=127.0.0.1:15113 network=tcp 34:26.663 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:15114 network=tcp 34:26.663 [INFO] TestAgent: started state syncer 34:26.663 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:15119 network=tcp 34:26.723 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:26.723 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:15118 [Candidate]" term=2 34:26.740 [DEBUG] TestAgent.server.raft: votes: needed=1 34:26.740 [DEBUG] TestAgent.server.raft: vote granted: from=45e73622-238a-6eb9-7ede-7f98ca64ca6e term=2 tally=1 34:26.740 [INFO] TestAgent.server.raft: election won: tally=1 34:26.740 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:15118 [Leader]" 34:26.743 [INFO] TestAgent.server: cluster leadership acquired 34:26.744 [INFO] TestAgent.server: New leader elected: payload=Node-45e73622-238a-6eb9-7ede-7f98ca64ca6e 34:26.752 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:15118 34:26.758 [INFO] TestAgent: Synced node info 34:26.787 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:26.805 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:26.805 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:26.805 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:26.805 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:26.805 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:26.805 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-45e73622-238a-6eb9-7ede-7f98ca64ca6e 34:26.806 [INFO] TestAgent.server: member joined, marking health alive: member=Node-45e73622-238a-6eb9-7ede-7f98ca64ca6e 34:26.824 [INFO] TestAgent.server: federation state anti-entropy synced 34:27.144 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/blob from=127.0.0.1:39278 latency=24.085405ms 34:27.153 [INFO] TestAgent.server.fsm: snapshot created: duration=71.869µs 34:27.153 [INFO] TestAgent.server.raft: starting snapshot up to: index=13 34:27.153 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshotRestoreCommand_TruncatedSnapshot-TestAgent-agent227043812/raft/snapshots/2-13-1633451667153.tmp 34:27.192 [INFO] TestAgent.server.raft: snapshot complete up to: index=13 34:27.258 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/snapshot from=127.0.0.1:39278 latency=104.846251ms 34:27.276 [ERROR] TestAgent.server: Failed to close snapshot decompressor: error="unexpected EOF" 34:27.276 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/snapshot from=127.0.0.1:39284 error="failed to read snapshot file: failed reading snapshot: unexpected EOF" 34:27.276 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:39284 latency=13.085588ms 34:27.286 [ERROR] TestAgent.server: Failed to close snapshot decompressor: error="unexpected EOF" 34:27.286 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/snapshot from=127.0.0.1:39286 error="failed to read snapshot file: failed reading snapshot: unexpected EOF" 34:27.287 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:39286 latency=2.638631ms 34:27.293 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/snapshot from=127.0.0.1:39288 error="unexpected EOF" 34:27.293 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:39288 latency=3.865512ms 34:27.303 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/snapshot from=127.0.0.1:39290 error="unexpected EOF" 34:27.303 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:39290 latency=2.455997ms 34:27.326 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/snapshot from=127.0.0.1:39292 error="unexpected EOF" 34:27.327 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:39292 latency=2.558589ms 34:27.340 [ERROR] TestAgent.http: Request error: method=PUT url=/v1/snapshot from=127.0.0.1:39294 error="unexpected EOF" 34:27.340 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:39294 latency=2.453752ms 34:27.344 [INFO] TestAgent: Requesting shutdown 34:27.344 [INFO] TestAgent.server: shutting down server 34:27.345 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:27.345 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:27.345 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:27.345 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:27.345 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:27.345 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:27.345 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:27.345 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:27.345 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:27.345 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:27.356 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:27.368Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:27.368Z [INFO] agent.router.manager: shutting down 34:27.368 [INFO] TestAgent: consul server down 34:27.368 [INFO] TestAgent: shutdown complete 34:27.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=tcp 34:27.368 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:15113 network=udp 34:27.368 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:15114 network=tcp 34:27.872 [INFO] TestAgent: Waiting for endpoints to shut down 34:27.872 [INFO] TestAgent: Endpoints down --- PASS: TestSnapshotRestoreCommand_TruncatedSnapshot (1.40s) --- PASS: TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_200_bytes_from_end (0.02s) --- PASS: TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_16_bytes_from_end (0.01s) --- PASS: TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_8_bytes_from_end (0.01s) --- PASS: TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_4_bytes_from_end (0.01s) --- PASS: TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_2_bytes_from_end (0.02s) --- PASS: TestSnapshotRestoreCommand_TruncatedSnapshot/truncate_1_bytes_from_end (0.02s) PASS ok github.com/hashicorp/consul/command/snapshot/restore 1.468s === RUN TestSnapshotSaveCommand_noTabs === PAUSE TestSnapshotSaveCommand_noTabs === RUN TestSnapshotSaveCommand_Validation === PAUSE TestSnapshotSaveCommand_Validation === RUN TestSnapshotSaveCommand === PAUSE TestSnapshotSaveCommand === RUN TestSnapshotSaveCommand_TruncatedStream === PAUSE TestSnapshotSaveCommand_TruncatedStream === CONT TestSnapshotSaveCommand_noTabs === CONT TestSnapshotSaveCommand_TruncatedStream === CONT TestSnapshotSaveCommand [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... === CONT TestSnapshotSaveCommand_Validation --- PASS: TestSnapshotSaveCommand_noTabs (0.00s) --- PASS: TestSnapshotSaveCommand_Validation (0.00s) [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestSnapshotSaveCommand_TruncatedStream/truncate_200_bytes_from_end === RUN TestSnapshotSaveCommand_TruncatedStream/truncate_16_bytes_from_end === RUN TestSnapshotSaveCommand_TruncatedStream/truncate_8_bytes_from_end === RUN TestSnapshotSaveCommand_TruncatedStream/truncate_4_bytes_from_end === RUN TestSnapshotSaveCommand_TruncatedStream/truncate_2_bytes_from_end === RUN TestSnapshotSaveCommand_TruncatedStream/truncate_1_bytes_from_end 2021-10-05T16:34:33.092Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:33.119Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:33.158 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:947f970f-87de-c220-8703-22c0b22135d2 Address:127.0.0.1:29412}]" 34:33.159 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29412 [Follower]" leader= 34:33.159 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-947f970f-87de-c220-8703-22c0b22135d2.dc1 127.0.0.1 34:33.160 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-947f970f-87de-c220-8703-22c0b22135d2 127.0.0.1 2021-10-05T16:34:33.160Z [INFO] agent.router: Initializing LAN area manager 34:33.160 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-947f970f-87de-c220-8703-22c0b22135d2.dc1 area=wan 34:33.160 [INFO] TestAgent.server: Adding LAN server: server="Node-947f970f-87de-c220-8703-22c0b22135d2 (Addr: tcp/127.0.0.1:29412) (DC: dc1)" 34:33.161 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=udp 34:33.161 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29407 network=tcp 34:33.161 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29408 network=tcp 34:33.161 [INFO] TestAgent: started state syncer 34:33.161 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29413 network=tcp 34:33.204 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:33.204 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29412 [Candidate]" term=2 34:33.234 [DEBUG] TestAgent.server.raft: votes: needed=1 34:33.234 [DEBUG] TestAgent.server.raft: vote granted: from=947f970f-87de-c220-8703-22c0b22135d2 term=2 tally=1 34:33.234 [INFO] TestAgent.server.raft: election won: tally=1 34:33.234 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29412 [Leader]" 34:33.236 [INFO] TestAgent.server: cluster leadership acquired 34:33.236 [INFO] TestAgent.server: New leader elected: payload=Node-947f970f-87de-c220-8703-22c0b22135d2 34:33.249 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29412 34:33.284 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:33.330 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:33.330 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:33.330 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:33.330 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:33.330 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:33.330 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-947f970f-87de-c220-8703-22c0b22135d2 34:33.330 [INFO] TestAgent.server: member joined, marking health alive: member=Node-947f970f-87de-c220-8703-22c0b22135d2 34:33.373 [INFO] TestAgent.server: federation state anti-entropy synced 34:33.452 [INFO] TestAgent.server.fsm: snapshot created: duration=101.631µs 34:33.452 [INFO] TestAgent.server.raft: starting snapshot up to: index=11 34:33.452 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshotSaveCommand-TestAgent-agent784167669/raft/snapshots/2-11-1633451673452.tmp 34:33.479 [INFO] TestAgent.server.raft: snapshot complete up to: index=11 34:33.487 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/snapshot from=127.0.0.1:45010 latency=35.148063ms 34:33.495 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:33.500 [INFO] TestAgent: Synced node info 34:33.500 [DEBUG] TestAgent: Node info in sync 34:33.512 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshotSaveCommand-TestAgent-agent784167669/raft/snapshots/2-13-1633451673512.tmp 34:33.550 [INFO] TestAgent.server.raft: copied to local snapshot: bytes=4876 34:33.552 [INFO] TestAgent.server.raft: restored user snapshot: index=1 34:33.568 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:33.568 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:33.568 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:33.568 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:33.568 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:33.568 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:33.568 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:33.568 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29412 34:33.569 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:33.569 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:33.569 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:33.569 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:33.569 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/snapshot from=127.0.0.1:45014 latency=64.663958ms 34:33.572 [INFO] TestAgent: Requesting shutdown 34:33.572 [INFO] TestAgent.server: shutting down server 34:33.572 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:33.572 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:33.572 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:33.572 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:33.572 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:33.572 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:33.572 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:33.572 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:33.572 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:33.572 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:33.572 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:33.572 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:33.576 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:33.581Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:33.581Z [INFO] agent.router.manager: shutting down 34:33.581 [INFO] TestAgent: consul server down 34:33.581 [INFO] TestAgent: shutdown complete 34:33.581 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=tcp 34:33.581 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29407 network=udp 34:33.581 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29408 network=tcp 34:34.084 [INFO] TestAgent: Waiting for endpoints to shut down 34:34.084 [INFO] TestAgent: Endpoints down --- PASS: TestSnapshotSaveCommand (1.08s) 2021-10-05T16:34:33.077Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:33.101Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:33.161 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:0ac72770-fb2f-1d9c-8846-680ec417fa07 Address:127.0.0.1:29405}]" 34:33.161 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:29405 [Follower]" leader= 34:33.162 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-0ac72770-fb2f-1d9c-8846-680ec417fa07.dc1 127.0.0.1 34:33.163 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-0ac72770-fb2f-1d9c-8846-680ec417fa07 127.0.0.1 2021-10-05T16:34:33.163Z [INFO] agent.router: Initializing LAN area manager 34:33.163 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=udp 34:33.163 [INFO] TestAgent.server: Adding LAN server: server="Node-0ac72770-fb2f-1d9c-8846-680ec417fa07 (Addr: tcp/127.0.0.1:29405) (DC: dc1)" 34:33.163 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-0ac72770-fb2f-1d9c-8846-680ec417fa07.dc1 area=wan 34:33.163 [INFO] TestAgent: Started DNS server: address=127.0.0.1:29400 network=tcp 34:33.164 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:29401 network=tcp 34:33.164 [INFO] TestAgent: started state syncer 34:33.164 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:29406 network=tcp 34:33.208 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:33.208 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:29405 [Candidate]" term=2 34:33.233 [DEBUG] TestAgent.server.raft: votes: needed=1 34:33.233 [DEBUG] TestAgent.server.raft: vote granted: from=0ac72770-fb2f-1d9c-8846-680ec417fa07 term=2 tally=1 34:33.233 [INFO] TestAgent.server.raft: election won: tally=1 34:33.233 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:29405 [Leader]" 34:33.236 [INFO] TestAgent.server: cluster leadership acquired 34:33.236 [INFO] TestAgent.server: New leader elected: payload=Node-0ac72770-fb2f-1d9c-8846-680ec417fa07 34:33.243 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:29405 34:33.257 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:33.312 [INFO] TestAgent: Synced node info 34:33.343 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:33.343 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:33.343 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:33.343 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:33.343 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:33.343 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-0ac72770-fb2f-1d9c-8846-680ec417fa07 34:33.343 [INFO] TestAgent.server: member joined, marking health alive: member=Node-0ac72770-fb2f-1d9c-8846-680ec417fa07 34:33.380 [INFO] TestAgent.server: federation state anti-entropy synced 34:33.423 [DEBUG] TestAgent.http: Request finished: method=PUT url=/v1/kv/blob from=127.0.0.1:35510 latency=10.792316ms 34:33.424 [INFO] TestAgent.server.fsm: snapshot created: duration=60.071µs 34:33.424 [INFO] TestAgent.server.raft: starting snapshot up to: index=13 34:33.424 [INFO] TestAgent.server.snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshotSaveCommand_TruncatedStream-TestAgent-agent680610414/raft/snapshots/2-13-1633451673424.tmp 34:33.444 [INFO] TestAgent.server.raft: snapshot complete up to: index=13 34:33.468 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:33.468 [DEBUG] TestAgent: Node info in sync 34:33.468 [DEBUG] TestAgent: Node info in sync 34:33.475 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/snapshot from=127.0.0.1:35510 latency=51.112381ms 34:33.618 [INFO] TestAgent: Requesting shutdown 34:33.618 [INFO] TestAgent.server: shutting down server 34:33.618 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:33.618 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:33.618 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:33.618 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:33.618 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:33.618 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:33.618 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:33.618 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:33.618 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:33.618 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:33.627 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:33.644Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:33.644Z [INFO] agent.router.manager: shutting down 34:33.644 [INFO] TestAgent: consul server down 34:33.644 [INFO] TestAgent: shutdown complete 34:33.644 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=tcp 34:33.644 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:29400 network=udp 34:33.644 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:29401 network=tcp 34:34.144 [INFO] TestAgent: Waiting for endpoints to shut down 34:34.144 [INFO] TestAgent: Endpoints down --- PASS: TestSnapshotSaveCommand_TruncatedStream (1.14s) --- PASS: TestSnapshotSaveCommand_TruncatedStream/truncate_200_bytes_from_end (0.02s) --- PASS: TestSnapshotSaveCommand_TruncatedStream/truncate_16_bytes_from_end (0.02s) --- PASS: TestSnapshotSaveCommand_TruncatedStream/truncate_8_bytes_from_end (0.02s) --- PASS: TestSnapshotSaveCommand_TruncatedStream/truncate_4_bytes_from_end (0.02s) --- PASS: TestSnapshotSaveCommand_TruncatedStream/truncate_2_bytes_from_end (0.01s) --- PASS: TestSnapshotSaveCommand_TruncatedStream/truncate_1_bytes_from_end (0.02s) PASS ok github.com/hashicorp/consul/command/snapshot/save 1.236s === RUN TestValidateCommand_noTabs === PAUSE TestValidateCommand_noTabs === RUN TestValidateCommand_FailOnEmptyFile === PAUSE TestValidateCommand_FailOnEmptyFile === RUN TestValidateCommand_SucceedOnMinimalConfigFile === PAUSE TestValidateCommand_SucceedOnMinimalConfigFile === RUN TestValidateCommand_SucceedWithMinimalJSONConfigFormat === PAUSE TestValidateCommand_SucceedWithMinimalJSONConfigFormat === RUN TestValidateCommand_SucceedWithMinimalHCLConfigFormat === PAUSE TestValidateCommand_SucceedWithMinimalHCLConfigFormat === RUN TestValidateCommand_SucceedWithJSONAsHCL === PAUSE TestValidateCommand_SucceedWithJSONAsHCL === RUN TestValidateCommand_SucceedOnMinimalConfigDir === PAUSE TestValidateCommand_SucceedOnMinimalConfigDir === RUN TestValidateCommand_FailForInvalidJSONConfigFormat === PAUSE TestValidateCommand_FailForInvalidJSONConfigFormat === RUN TestValidateCommand_Quiet === PAUSE TestValidateCommand_Quiet === CONT TestValidateCommand_noTabs === CONT TestValidateCommand_SucceedWithJSONAsHCL --- PASS: TestValidateCommand_noTabs (0.00s) === CONT TestValidateCommand_SucceedWithMinimalHCLConfigFormat === CONT TestValidateCommand_SucceedWithMinimalJSONConfigFormat === CONT TestValidateCommand_SucceedOnMinimalConfigFile === CONT TestValidateCommand_FailOnEmptyFile === CONT TestValidateCommand_Quiet === CONT TestValidateCommand_FailForInvalidJSONConfigFormat === CONT TestValidateCommand_SucceedOnMinimalConfigDir --- PASS: TestValidateCommand_FailForInvalidJSONConfigFormat (0.03s) --- PASS: TestValidateCommand_SucceedOnMinimalConfigDir (0.05s) --- PASS: TestValidateCommand_Quiet (0.06s) --- PASS: TestValidateCommand_SucceedOnMinimalConfigFile (0.07s) --- PASS: TestValidateCommand_FailOnEmptyFile (0.07s) --- PASS: TestValidateCommand_SucceedWithJSONAsHCL (0.07s) --- PASS: TestValidateCommand_SucceedWithMinimalJSONConfigFormat (0.07s) --- PASS: TestValidateCommand_SucceedWithMinimalHCLConfigFormat (0.08s) PASS ok github.com/hashicorp/consul/command/validate 0.120s === RUN TestFormat === RUN TestFormat/pretty === RUN TestFormat/json --- PASS: TestFormat (0.01s) --- PASS: TestFormat/pretty (0.01s) --- PASS: TestFormat/json (0.01s) === RUN TestVersionCommand_noTabs === PAUSE TestVersionCommand_noTabs === CONT TestVersionCommand_noTabs --- PASS: TestVersionCommand_noTabs (0.00s) PASS ok github.com/hashicorp/consul/command/version 0.077s === RUN TestWatchCommand_noTabs === PAUSE TestWatchCommand_noTabs === RUN TestWatchCommand === PAUSE TestWatchCommand === RUN TestWatchCommand_loadToken [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestWatchCommand_loadToken/token_arg === RUN TestWatchCommand_loadToken/token_env === RUN TestWatchCommand_loadToken/token_file_arg === RUN TestWatchCommand_loadToken/token_file_env 2021-10-05T16:34:38.811Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:38.863Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:38.931 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:9c764cc1-2a31-50db-e236-540311d0e28c Address:127.0.0.1:23279}]" 34:38.932 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23279 [Follower]" leader= 34:38.932 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-9c764cc1-2a31-50db-e236-540311d0e28c.dc1 127.0.0.1 34:38.933 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-9c764cc1-2a31-50db-e236-540311d0e28c 127.0.0.1 2021-10-05T16:34:38.933Z [INFO] agent.router: Initializing LAN area manager 34:38.933 [INFO] TestAgent.server: Adding LAN server: server="Node-9c764cc1-2a31-50db-e236-540311d0e28c (Addr: tcp/127.0.0.1:23279) (DC: dc1)" 34:38.933 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-9c764cc1-2a31-50db-e236-540311d0e28c.dc1 area=wan 34:38.933 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=udp 34:38.937 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23274 network=tcp 34:38.937 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23275 network=tcp 34:38.937 [INFO] TestAgent: started state syncer 34:38.937 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23280 network=tcp 34:38.970 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:38.970 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23279 [Candidate]" term=2 34:38.979 [DEBUG] TestAgent.server.raft: votes: needed=1 34:38.979 [DEBUG] TestAgent.server.raft: vote granted: from=9c764cc1-2a31-50db-e236-540311d0e28c term=2 tally=1 34:38.979 [INFO] TestAgent.server.raft: election won: tally=1 34:38.979 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23279 [Leader]" 34:38.980 [INFO] TestAgent.server: cluster leadership acquired 34:38.980 [INFO] TestAgent.server: New leader elected: payload=Node-9c764cc1-2a31-50db-e236-540311d0e28c 34:38.991 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23279 34:39.040 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:39.062 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:39.062 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:39.062 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:39.062 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:39.062 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:39.062 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-9c764cc1-2a31-50db-e236-540311d0e28c 34:39.062 [INFO] TestAgent.server: member joined, marking health alive: member=Node-9c764cc1-2a31-50db-e236-540311d0e28c 34:39.098 [INFO] TestAgent.server: federation state anti-entropy synced 34:39.192 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:39.200 [INFO] TestAgent: Synced node info 34:39.200 [DEBUG] TestAgent: Node info in sync 34:39.315 [INFO] TestAgent: Requesting shutdown 34:39.315 [INFO] TestAgent.server: shutting down server 34:39.315 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:39.315 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:39.315 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:39.315 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:39.315 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:39.315 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:39.315 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:39.315 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:39.315 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:39.315 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:39.329 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:39.336Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:39.336Z [INFO] agent.router.manager: shutting down 34:39.336 [INFO] TestAgent: consul server down 34:39.336 [INFO] TestAgent: shutdown complete 34:39.336 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=tcp 34:39.336 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23274 network=udp 34:39.336 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23275 network=tcp 34:39.840 [INFO] TestAgent: Waiting for endpoints to shut down 34:39.840 [INFO] TestAgent: Endpoints down --- PASS: TestWatchCommand_loadToken (1.17s) --- PASS: TestWatchCommand_loadToken/token_arg (0.00s) --- PASS: TestWatchCommand_loadToken/token_env (0.00s) --- PASS: TestWatchCommand_loadToken/token_file_arg (0.00s) --- PASS: TestWatchCommand_loadToken/token_file_env (0.00s) === RUN TestWatchCommandNoConnect === PAUSE TestWatchCommandNoConnect === RUN TestWatchCommandNoAgentService === PAUSE TestWatchCommandNoAgentService === CONT TestWatchCommand_noTabs --- PASS: TestWatchCommand_noTabs (0.00s) === CONT TestWatchCommandNoAgentService === CONT TestWatchCommandNoConnect === CONT TestWatchCommand 2021-10-05T16:34:39.902Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:39.961Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:39.988 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:29af1436-d9ec-ff96-b4cc-8d78d4bc02da Address:127.0.0.1:23286}]" 34:39.989 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-29af1436-d9ec-ff96-b4cc-8d78d4bc02da.dc1 127.0.0.1 34:39.989 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-29af1436-d9ec-ff96-b4cc-8d78d4bc02da 127.0.0.1 2021-10-05T16:34:39.989Z [INFO] agent.router: Initializing LAN area manager 34:39.990 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23281 network=udp 34:39.990 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23286 [Follower]" leader= 34:39.990 [INFO] TestAgent.server: Adding LAN server: server="Node-29af1436-d9ec-ff96-b4cc-8d78d4bc02da (Addr: tcp/127.0.0.1:23286) (DC: dc1)" 34:39.990 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-29af1436-d9ec-ff96-b4cc-8d78d4bc02da.dc1 area=wan 34:39.990 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23281 network=tcp 34:39.991 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23282 network=tcp 34:39.991 [INFO] TestAgent: started state syncer 34:39.991 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23287 network=tcp 34:40.038 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:40.038 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23286 [Candidate]" term=2 34:40.063 [DEBUG] TestAgent.server.raft: votes: needed=1 34:40.063 [DEBUG] TestAgent.server.raft: vote granted: from=29af1436-d9ec-ff96-b4cc-8d78d4bc02da term=2 tally=1 34:40.063 [INFO] TestAgent.server.raft: election won: tally=1 34:40.063 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23286 [Leader]" 34:40.063 [INFO] TestAgent.server: cluster leadership acquired 34:40.084 [INFO] TestAgent.server: New leader elected: payload=Node-29af1436-d9ec-ff96-b4cc-8d78d4bc02da 34:40.108 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23286 34:40.148 [INFO] TestAgent: Requesting shutdown 34:40.148 [INFO] TestAgent.server: shutting down server 34:40.148 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:40.148 [ERROR] TestAgent.anti_entropy: failed to sync remote state: error="No cluster leader" 34:40.154 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 34:40.160 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 2021-10-05T16:34:40.162Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:40.162Z [INFO] agent.router.manager: shutting down 34:40.189 [INFO] TestAgent: consul server down 34:40.189 [INFO] TestAgent: shutdown complete 34:40.189 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23281 network=tcp 34:40.189 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23281 network=udp 34:40.189 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23282 network=tcp 34:40.189 [ERROR] TestAgent.server: failed to establish leadership: error="error generating CA root certificate: error computing next serial number: leadership lost while committing log" 34:40.692 [INFO] TestAgent: Waiting for endpoints to shut down 34:40.692 [INFO] TestAgent: Endpoints down --- PASS: TestWatchCommandNoAgentService (0.85s) 2021-10-05T16:34:39.899Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:39.923Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:40.011 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:22d7fe81-c1db-7a1d-d3a7-8a2696f44e72 Address:127.0.0.1:23300}]" 34:40.011 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23300 [Follower]" leader= 34:40.012 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-22d7fe81-c1db-7a1d-d3a7-8a2696f44e72.dc1 127.0.0.1 34:40.013 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-22d7fe81-c1db-7a1d-d3a7-8a2696f44e72 127.0.0.1 2021-10-05T16:34:40.013Z [INFO] agent.router: Initializing LAN area manager 34:40.013 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-22d7fe81-c1db-7a1d-d3a7-8a2696f44e72.dc1 area=wan 34:40.013 [INFO] TestAgent.server: Adding LAN server: server="Node-22d7fe81-c1db-7a1d-d3a7-8a2696f44e72 (Addr: tcp/127.0.0.1:23300) (DC: dc1)" 34:40.013 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23295 network=udp 34:40.013 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23295 network=tcp 34:40.014 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23296 network=tcp 34:40.060 [INFO] TestAgent: started state syncer 34:40.060 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23301 network=tcp 34:40.084 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:40.084 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23300 [Candidate]" term=2 34:40.132 [DEBUG] TestAgent.server.raft: votes: needed=1 34:40.132 [DEBUG] TestAgent.server.raft: vote granted: from=22d7fe81-c1db-7a1d-d3a7-8a2696f44e72 term=2 tally=1 34:40.132 [INFO] TestAgent.server.raft: election won: tally=1 34:40.132 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23300 [Leader]" 34:40.132 [INFO] TestAgent.server: cluster leadership acquired 34:40.132 [INFO] TestAgent.server: New leader elected: payload=Node-22d7fe81-c1db-7a1d-d3a7-8a2696f44e72 34:40.159 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23300 34:40.194 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:40.230 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:40.230 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:40.230 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:40.230 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:40.230 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:40.230 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-22d7fe81-c1db-7a1d-d3a7-8a2696f44e72 34:40.230 [INFO] TestAgent.server: member joined, marking health alive: member=Node-22d7fe81-c1db-7a1d-d3a7-8a2696f44e72 34:40.260 [INFO] TestAgent.server: federation state anti-entropy synced 34:40.464 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:40.480 [INFO] TestAgent: Synced node info 34:40.480 [DEBUG] TestAgent: Node info in sync 34:40.482 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/agent/self from=127.0.0.1:47712 latency=8.356702ms 34:40.490 [DEBUG] TestAgent.http: Request finished: method=GET url=/v1/catalog/nodes from=127.0.0.1:47714 latency=489.373µs 34:40.491 [INFO] TestAgent: Requesting shutdown 34:40.491 [INFO] TestAgent.server: shutting down server 34:40.491 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:40.491 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:40.491 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:40.491 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:40.491 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:40.491 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:40.491 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:40.491 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:40.491 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:40.491 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:40.497 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:40.512Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:40.512Z [INFO] agent.router.manager: shutting down 34:40.512 [INFO] TestAgent: consul server down 34:40.512 [INFO] TestAgent: shutdown complete 34:40.512 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23295 network=tcp 34:40.512 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23295 network=udp 34:40.512 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23296 network=tcp 34:41.013 [INFO] TestAgent: Waiting for endpoints to shut down 34:41.013 [INFO] TestAgent: Endpoints down --- PASS: TestWatchCommand (1.17s) 2021-10-05T16:34:39.902Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:39.945Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:40.048 [INFO] TestAgent.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:bb157f4e-f046-89e8-0343-2318537658f4 Address:127.0.0.1:23293}]" 34:40.049 [INFO] TestAgent.server.raft: entering follower state: follower="Node at 127.0.0.1:23293 [Follower]" leader= 34:40.049 [INFO] TestAgent.server.serf.wan: serf: EventMemberJoin: Node-bb157f4e-f046-89e8-0343-2318537658f4.dc1 127.0.0.1 34:40.050 [INFO] TestAgent.server.serf.lan: serf: EventMemberJoin: Node-bb157f4e-f046-89e8-0343-2318537658f4 127.0.0.1 2021-10-05T16:34:40.050Z [INFO] agent.router: Initializing LAN area manager 34:40.060 [INFO] TestAgent.server: Adding LAN server: server="Node-bb157f4e-f046-89e8-0343-2318537658f4 (Addr: tcp/127.0.0.1:23293) (DC: dc1)" 34:40.060 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23288 network=udp 34:40.061 [INFO] TestAgent.server: Handled event for server in area: event=member-join server=Node-bb157f4e-f046-89e8-0343-2318537658f4.dc1 area=wan 34:40.062 [INFO] TestAgent: Started DNS server: address=127.0.0.1:23288 network=tcp 34:40.063 [INFO] TestAgent: Started HTTP server: address=127.0.0.1:23289 network=tcp 34:40.063 [INFO] TestAgent: started state syncer 34:40.063 [INFO] TestAgent: Started gRPC server: address=127.0.0.1:23294 network=tcp 34:40.100 [WARN] TestAgent.server.raft: heartbeat timeout reached, starting election: last-leader= 34:40.100 [INFO] TestAgent.server.raft: entering candidate state: node="Node at 127.0.0.1:23293 [Candidate]" term=2 34:40.148 [DEBUG] TestAgent.server.raft: votes: needed=1 34:40.148 [DEBUG] TestAgent.server.raft: vote granted: from=bb157f4e-f046-89e8-0343-2318537658f4 term=2 tally=1 34:40.148 [INFO] TestAgent.server.raft: election won: tally=1 34:40.148 [INFO] TestAgent.server.raft: entering leader state: leader="Node at 127.0.0.1:23293 [Leader]" 34:40.152 [INFO] TestAgent.server: cluster leadership acquired 34:40.152 [INFO] TestAgent.server: New leader elected: payload=Node-bb157f4e-f046-89e8-0343-2318537658f4 34:40.169 [DEBUG] TestAgent.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:23293 34:40.188 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:40.229 [INFO] TestAgent.server.connect: initialized primary datacenter CA with provider: provider=consul 34:40.229 [INFO] TestAgent.leader: started routine: routine="federation state anti-entropy" 34:40.229 [INFO] TestAgent.leader: started routine: routine="federation state pruning" 34:40.229 [INFO] TestAgent.leader: started routine: routine="intermediate cert renew watch" 34:40.229 [INFO] TestAgent.leader: started routine: routine="CA root pruning" 34:40.229 [DEBUG] TestAgent.server: Skipping self join check for node since the cluster is too small: node=Node-bb157f4e-f046-89e8-0343-2318537658f4 34:40.229 [INFO] TestAgent.server: member joined, marking health alive: member=Node-bb157f4e-f046-89e8-0343-2318537658f4 34:40.256 [INFO] TestAgent.server: federation state anti-entropy synced 34:40.444 [DEBUG] TestAgent: Skipping remote check since it is managed automatically: check=serfHealth 34:40.460 [INFO] TestAgent: Synced node info 34:40.494 [INFO] TestAgent: Requesting shutdown 34:40.494 [INFO] TestAgent.server: shutting down server 34:40.494 [DEBUG] TestAgent.leader: stopping routine: routine="CA root pruning" 34:40.494 [DEBUG] TestAgent.leader: stopping routine: routine="federation state anti-entropy" 34:40.494 [DEBUG] TestAgent.leader: stopping routine: routine="federation state pruning" 34:40.494 [DEBUG] TestAgent.leader: stopping routine: routine="intermediate cert renew watch" 34:40.494 [ERROR] TestAgent.server: error performing anti-entropy sync of federation state: error="context canceled" 34:40.494 [WARN] TestAgent.server.serf.lan: serf: Shutdown without a Leave 34:40.494 [DEBUG] TestAgent.leader: stopped routine: routine="federation state anti-entropy" 34:40.494 [DEBUG] TestAgent.leader: stopped routine: routine="CA root pruning" 34:40.494 [DEBUG] TestAgent.leader: stopped routine: routine="federation state pruning" 34:40.494 [DEBUG] TestAgent.leader: stopped routine: routine="intermediate cert renew watch" 34:40.520 [WARN] TestAgent.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:40.527Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:40.527Z [INFO] agent.router.manager: shutting down 34:40.527 [INFO] TestAgent: consul server down 34:40.527 [INFO] TestAgent: shutdown complete 34:40.527 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23288 network=tcp 34:40.527 [INFO] TestAgent: Stopping server: protocol=DNS address=127.0.0.1:23288 network=udp 34:40.527 [INFO] TestAgent: Stopping server: protocol=HTTP address=127.0.0.1:23289 network=tcp 34:41.028 [INFO] TestAgent: Waiting for endpoints to shut down 34:41.028 [INFO] TestAgent: Endpoints down --- PASS: TestWatchCommandNoConnect (1.26s) PASS ok github.com/hashicorp/consul/command/watch 2.621s === RUN TestStaticResolver_Resolve === RUN TestStaticResolver_Resolve/simples --- PASS: TestStaticResolver_Resolve (0.00s) --- PASS: TestStaticResolver_Resolve/simples (0.00s) === RUN TestConsulResolver_Resolve [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range === RUN TestConsulResolver_Resolve/basic_service_discovery === RUN TestConsulResolver_Resolve/basic_service_with_native_service === RUN TestConsulResolver_Resolve/Bad_Type_errors === RUN TestConsulResolver_Resolve/Non-existent_service_errors === RUN TestConsulResolver_Resolve/timeout_errors === RUN TestConsulResolver_Resolve/prepared_query_by_id === RUN TestConsulResolver_Resolve/prepared_query_by_name 2021-10-05T16:34:45.567Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:45.586Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:45.621 [INFO] test-consul.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:3ec88015-d183-bcde-b264-236e8f1161cf Address:127.0.0.1:27363}]" 34:45.622 [INFO] test-consul.server.serf.wan: serf: EventMemberJoin: Node-3ec88015-d183-bcde-b264-236e8f1161cf.dc1 127.0.0.1 34:45.622 [INFO] test-consul.server.serf.lan: serf: EventMemberJoin: Node-3ec88015-d183-bcde-b264-236e8f1161cf 127.0.0.1 2021-10-05T16:34:45.623Z [INFO] agent.router: Initializing LAN area manager 34:45.623 [INFO] test-consul.server.raft: entering follower state: follower="Node at 127.0.0.1:27363 [Follower]" leader= 34:45.626 [INFO] test-consul.server: Adding LAN server: server="Node-3ec88015-d183-bcde-b264-236e8f1161cf (Addr: tcp/127.0.0.1:27363) (DC: dc1)" 34:45.626 [INFO] test-consul.server: Handled event for server in area: event=member-join server=Node-3ec88015-d183-bcde-b264-236e8f1161cf.dc1 area=wan 34:45.626 [INFO] test-consul: Started DNS server: address=127.0.0.1:27358 network=udp 34:45.626 [INFO] test-consul: Started DNS server: address=127.0.0.1:27358 network=tcp 34:45.627 [INFO] test-consul: Started HTTP server: address=127.0.0.1:27359 network=tcp 34:45.627 [INFO] test-consul: started state syncer 34:45.627 [INFO] test-consul: Started gRPC server: address=127.0.0.1:27364 network=tcp 34:45.664 [WARN] test-consul.server.raft: heartbeat timeout reached, starting election: last-leader= 34:45.664 [INFO] test-consul.server.raft: entering candidate state: node="Node at 127.0.0.1:27363 [Candidate]" term=2 34:45.689 [DEBUG] test-consul.server.raft: votes: needed=1 34:45.689 [DEBUG] test-consul.server.raft: vote granted: from=3ec88015-d183-bcde-b264-236e8f1161cf term=2 tally=1 34:45.689 [INFO] test-consul.server.raft: election won: tally=1 34:45.689 [INFO] test-consul.server.raft: entering leader state: leader="Node at 127.0.0.1:27363 [Leader]" 34:45.690 [INFO] test-consul.server: cluster leadership acquired 34:45.690 [INFO] test-consul.server: New leader elected: payload=Node-3ec88015-d183-bcde-b264-236e8f1161cf 34:45.709 [DEBUG] test-consul.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27363 34:45.726 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:45.766 [INFO] test-consul.server.connect: initialized primary datacenter CA with provider: provider=consul 34:45.766 [INFO] test-consul.leader: started routine: routine="federation state anti-entropy" 34:45.766 [INFO] test-consul.leader: started routine: routine="federation state pruning" 34:45.766 [INFO] test-consul.leader: started routine: routine="intermediate cert renew watch" 34:45.766 [INFO] test-consul.leader: started routine: routine="CA root pruning" 34:45.766 [DEBUG] test-consul.server: Skipping self join check for node since the cluster is too small: node=Node-3ec88015-d183-bcde-b264-236e8f1161cf 34:45.766 [INFO] test-consul.server: member joined, marking health alive: member=Node-3ec88015-d183-bcde-b264-236e8f1161cf 34:45.785 [INFO] test-consul.server: federation state anti-entropy synced 34:45.919 [INFO] test-consul: Synced node info 34:45.935 [INFO] test-consul: Synced service: service=web 34:45.935 [DEBUG] test-consul.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:32838 latency=27.459309ms 34:45.938 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.938 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.938 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.938 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.960 [DEBUG] test-consul: Node info in sync 34:45.960 [DEBUG] test-consul: Service in sync: service=web 34:45.982 [INFO] test-consul: Synced service: service=web-proxy 34:45.982 [DEBUG] test-consul.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:32838 latency=45.749867ms 34:45.984 [DEBUG] test-consul: Skipping remote check since it is managed automatically: check=serfHealth 34:45.984 [DEBUG] test-consul: Node info in sync 34:45.984 [DEBUG] test-consul: Service in sync: service=web 34:45.991 [INFO] test-consul: Synced service: service=web-proxy 34:45.992 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy-2 id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.992 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy-2 id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.992 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy-2 id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.993 [ERROR] test-consul.proxycfg: watch error: service_id=web-proxy-2 id=service-http-checks: error="error filling agent cache: Internal cache failure: service '' not in agent state" 34:45.995 [DEBUG] test-consul: Node info in sync 34:45.995 [DEBUG] test-consul: Service in sync: service=web 34:45.995 [DEBUG] test-consul: Service in sync: service=web-proxy 34:46.001 [INFO] test-consul: Synced service: service=web-proxy-2 34:46.001 [DEBUG] test-consul.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:32838 latency=16.619119ms 34:46.010 [DEBUG] test-consul: Node info in sync 34:46.025 [INFO] test-consul: Synced service: service=db 34:46.025 [DEBUG] test-consul: Service in sync: service=web 34:46.025 [DEBUG] test-consul: Service in sync: service=web-proxy 34:46.025 [DEBUG] test-consul: Service in sync: service=web-proxy-2 34:46.025 [DEBUG] test-consul.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:32838 latency=20.533682ms 34:46.049 [DEBUG] test-consul.http: Request finished: method=POST url=/v1/query from=127.0.0.1:32838 latency=17.019856ms 34:46.061 [DEBUG] test-consul.http: Request finished: method=GET url=/v1/health/connect/web?connect=true&passing=1&stale= from=127.0.0.1:32838 latency=4.441464ms 34:46.089 [DEBUG] test-consul.http: Request finished: method=GET url=/v1/health/connect/db?connect=true&passing=1&stale= from=127.0.0.1:32838 latency=1.514703ms 34:46.090 [DEBUG] test-consul.http: Request finished: method=GET url=/v1/health/connect/foo?connect=true&passing=1&stale= from=127.0.0.1:32838 latency=225.967µs 34:46.091 [DEBUG] test-consul.http: Request finished: method=GET url=/v1/query/5037624d-a413-2f19-c6a3-886d475a8c65/execute?connect=true&stale= from=127.0.0.1:32838 latency=372.975µs 34:46.096 [DEBUG] test-consul.http: Request finished: method=GET url=/v1/query/test-query/execute?connect=true&stale= from=127.0.0.1:32838 latency=437.189µs 34:46.097 [INFO] test-consul: Requesting shutdown 34:46.097 [INFO] test-consul.server: shutting down server 34:46.097 [DEBUG] test-consul.leader: stopping routine: routine="CA root pruning" 34:46.097 [DEBUG] test-consul.leader: stopping routine: routine="federation state anti-entropy" 34:46.097 [DEBUG] test-consul.leader: stopping routine: routine="federation state pruning" 34:46.097 [DEBUG] test-consul.leader: stopping routine: routine="intermediate cert renew watch" 34:46.097 [WARN] test-consul.server.serf.lan: serf: Shutdown without a Leave 34:46.097 [ERROR] test-consul.server: error performing anti-entropy sync of federation state: error="context canceled" 34:46.097 [DEBUG] test-consul.leader: stopped routine: routine="federation state anti-entropy" 34:46.097 [DEBUG] test-consul.leader: stopped routine: routine="CA root pruning" 34:46.097 [DEBUG] test-consul.leader: stopped routine: routine="federation state pruning" 34:46.097 [DEBUG] test-consul.leader: stopped routine: routine="intermediate cert renew watch" 34:46.108 [WARN] test-consul.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:46.116Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:46.116Z [INFO] agent.router.manager: shutting down 34:46.116 [INFO] test-consul: consul server down 34:46.116 [INFO] test-consul: shutdown complete 34:46.116 [INFO] test-consul: Stopping server: protocol=DNS address=127.0.0.1:27358 network=tcp 34:46.116 [INFO] test-consul: Stopping server: protocol=DNS address=127.0.0.1:27358 network=udp 34:46.116 [INFO] test-consul: Stopping server: protocol=HTTP address=127.0.0.1:27359 network=tcp 34:46.619 [INFO] test-consul: Waiting for endpoints to shut down 34:46.619 [INFO] test-consul: Endpoints down --- PASS: TestConsulResolver_Resolve (1.15s) --- PASS: TestConsulResolver_Resolve/basic_service_discovery (0.02s) --- PASS: TestConsulResolver_Resolve/basic_service_with_native_service (0.01s) --- PASS: TestConsulResolver_Resolve/Bad_Type_errors (0.00s) --- PASS: TestConsulResolver_Resolve/Non-existent_service_errors (0.00s) --- PASS: TestConsulResolver_Resolve/timeout_errors (0.00s) --- PASS: TestConsulResolver_Resolve/prepared_query_by_id (0.00s) --- PASS: TestConsulResolver_Resolve/prepared_query_by_name (0.00s) === RUN TestConsulResolverFromAddrFunc === RUN TestConsulResolverFromAddrFunc/service === RUN TestConsulResolverFromAddrFunc/query === RUN TestConsulResolverFromAddrFunc/service_with_dc === RUN TestConsulResolverFromAddrFunc/query_with_dc === RUN TestConsulResolverFromAddrFunc/invalid_host:port === RUN TestConsulResolverFromAddrFunc/custom_domain === RUN TestConsulResolverFromAddrFunc/unsupported_query_type === RUN TestConsulResolverFromAddrFunc/unsupported_query_type_and_datacenter === RUN TestConsulResolverFromAddrFunc/unsupported_query_type_and_datacenter#01 === RUN TestConsulResolverFromAddrFunc/unsupported_tag_filter === RUN TestConsulResolverFromAddrFunc/unsupported_tag_filter_with_DC --- PASS: TestConsulResolverFromAddrFunc (0.00s) --- PASS: TestConsulResolverFromAddrFunc/service (0.00s) --- PASS: TestConsulResolverFromAddrFunc/query (0.00s) --- PASS: TestConsulResolverFromAddrFunc/service_with_dc (0.00s) --- PASS: TestConsulResolverFromAddrFunc/query_with_dc (0.00s) --- PASS: TestConsulResolverFromAddrFunc/invalid_host:port (0.00s) --- PASS: TestConsulResolverFromAddrFunc/custom_domain (0.00s) --- PASS: TestConsulResolverFromAddrFunc/unsupported_query_type (0.00s) --- PASS: TestConsulResolverFromAddrFunc/unsupported_query_type_and_datacenter (0.00s) --- PASS: TestConsulResolverFromAddrFunc/unsupported_query_type_and_datacenter#01 (0.00s) --- PASS: TestConsulResolverFromAddrFunc/unsupported_tag_filter (0.00s) --- PASS: TestConsulResolverFromAddrFunc/unsupported_tag_filter_with_DC (0.00s) === RUN TestService_Name --- PASS: TestService_Name (0.01s) === RUN TestService_Dial service_test.go:36: DM-skipped --- SKIP: TestService_Dial (0.00s) === RUN TestService_ServerTLSConfig service_test.go:129: DM-skipped --- SKIP: TestService_ServerTLSConfig (0.00s) === RUN TestService_HTTPClient 2021/10/05 16:34:46 starting test connect HTTPS server on 127.0.0.1:27365 2021/10/05 16:34:46 test connect service listening on 127.0.0.1:27365 --- PASS: TestService_HTTPClient (0.06s) === RUN TestService_HasDefaultHTTPResolverFromAddr --- PASS: TestService_HasDefaultHTTPResolverFromAddr (0.00s) === RUN Test_verifyServerCertMatchesURI 2021-10-05T16:34:46.692Z [ERROR] connect.watch: Watch errored: service=foo type=connect_roots error="Get "http://127.0.0.1:8500/v1/agent/connect/ca/roots": dial tcp 127.0.0.1:8500: connect: connection refused" retry=5s 2021-10-05T16:34:46.692Z [ERROR] connect.watch: Watch errored: service=foo type=connect_leaf error="Get "http://127.0.0.1:8500/v1/agent/connect/ca/leaf/foo": dial tcp 127.0.0.1:8500: connect: connection refused" retry=5s === RUN Test_verifyServerCertMatchesURI/simple_match === RUN Test_verifyServerCertMatchesURI/different_trust-domain_allowed === RUN Test_verifyServerCertMatchesURI/mismatch === RUN Test_verifyServerCertMatchesURI/no_certs === RUN Test_verifyServerCertMatchesURI/nil_certs --- PASS: Test_verifyServerCertMatchesURI (0.01s) --- PASS: Test_verifyServerCertMatchesURI/simple_match (0.00s) --- PASS: Test_verifyServerCertMatchesURI/different_trust-domain_allowed (0.00s) --- PASS: Test_verifyServerCertMatchesURI/mismatch (0.00s) --- PASS: Test_verifyServerCertMatchesURI/no_certs (0.00s) --- PASS: Test_verifyServerCertMatchesURI/nil_certs (0.00s) === RUN TestClientSideVerifier === RUN TestClientSideVerifier/ok_service_ca1 === RUN TestClientSideVerifier/untrusted_CA === RUN TestClientSideVerifier/cross_signed_intermediate === RUN TestClientSideVerifier/cross_signed_without_intermediate --- PASS: TestClientSideVerifier (0.04s) --- PASS: TestClientSideVerifier/ok_service_ca1 (0.00s) --- PASS: TestClientSideVerifier/untrusted_CA (0.00s) --- PASS: TestClientSideVerifier/cross_signed_intermediate (0.01s) --- PASS: TestClientSideVerifier/cross_signed_without_intermediate (0.00s) === RUN TestServerSideVerifier === RUN TestServerSideVerifier/ok_service_ca1,_allow === RUN TestServerSideVerifier/untrusted_CA 2021-10-05T16:34:47.298Z [ERROR] TestServerSideVerifier/untrusted_CA: failed TLS verification: error="x509: certificate signed by unknown authority" === RUN TestServerSideVerifier/cross_signed_intermediate,_allow === RUN TestServerSideVerifier/cross_signed_without_intermediate 2021-10-05T16:34:47.328Z [ERROR] TestServerSideVerifier/cross_signed_without_intermediate: failed TLS verification: error="x509: certificate signed by unknown authority" === RUN TestServerSideVerifier/ok_service_ca1,_deny 2021-10-05T16:34:47.353Z [ERROR] TestServerSideVerifier/ok_service_ca1,_deny: authz call denied: reason="Matched intention: DENY default/* => default/db (ID: 7f9a2049-55b7-51d1-e993-c55eed0193ab, Precedence: 8)" === RUN TestServerSideVerifier/cross_signed_intermediate,_deny 2021-10-05T16:34:47.384Z [ERROR] TestServerSideVerifier/cross_signed_intermediate,_deny: authz call denied: reason="Matched intention: DENY default/* => default/db (ID: 7f9a2049-55b7-51d1-e993-c55eed0193ab, Precedence: 8)" 2021-10-05T16:34:46.815Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:46.835Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:46.885 [INFO] test-consul.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:62cca5be-25fa-37e1-f032-1eae13ae23de Address:127.0.0.1:27371}]" 34:46.886 [INFO] test-consul.server.serf.wan: serf: EventMemberJoin: Node-62cca5be-25fa-37e1-f032-1eae13ae23de.dc1 127.0.0.1 34:46.886 [INFO] test-consul.server.serf.lan: serf: EventMemberJoin: Node-62cca5be-25fa-37e1-f032-1eae13ae23de 127.0.0.1 2021-10-05T16:34:46.886Z [INFO] agent.router: Initializing LAN area manager 34:46.887 [INFO] test-consul: Started DNS server: address=127.0.0.1:27366 network=udp 34:46.887 [INFO] test-consul.server.raft: entering follower state: follower="Node at 127.0.0.1:27371 [Follower]" leader= 34:46.887 [INFO] test-consul.server: Adding LAN server: server="Node-62cca5be-25fa-37e1-f032-1eae13ae23de (Addr: tcp/127.0.0.1:27371) (DC: dc1)" 34:46.887 [INFO] test-consul.server: Handled event for server in area: event=member-join server=Node-62cca5be-25fa-37e1-f032-1eae13ae23de.dc1 area=wan 34:46.887 [INFO] test-consul: Started DNS server: address=127.0.0.1:27366 network=tcp 34:46.888 [INFO] test-consul: Started HTTP server: address=127.0.0.1:27367 network=tcp 34:46.888 [INFO] test-consul: started state syncer 34:46.888 [INFO] test-consul: Started gRPC server: address=127.0.0.1:27372 network=tcp 34:46.951 [WARN] test-consul.server.raft: heartbeat timeout reached, starting election: last-leader= 34:46.951 [INFO] test-consul.server.raft: entering candidate state: node="Node at 127.0.0.1:27371 [Candidate]" term=2 34:46.962 [DEBUG] test-consul.server.raft: votes: needed=1 34:46.962 [DEBUG] test-consul.server.raft: vote granted: from=62cca5be-25fa-37e1-f032-1eae13ae23de term=2 tally=1 34:46.962 [INFO] test-consul.server.raft: election won: tally=1 34:46.962 [INFO] test-consul.server.raft: entering leader state: leader="Node at 127.0.0.1:27371 [Leader]" 34:46.964 [INFO] test-consul.server: cluster leadership acquired 34:46.964 [INFO] test-consul.server: New leader elected: payload=Node-62cca5be-25fa-37e1-f032-1eae13ae23de 34:46.967 [DEBUG] test-consul.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:27371 34:46.979 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:47.023 [INFO] test-consul.server.connect: initialized primary datacenter CA with provider: provider=consul 34:47.023 [INFO] test-consul.leader: started routine: routine="federation state anti-entropy" 34:47.023 [INFO] test-consul.leader: started routine: routine="federation state pruning" 34:47.023 [INFO] test-consul.leader: started routine: routine="intermediate cert renew watch" 34:47.024 [INFO] test-consul.leader: started routine: routine="CA root pruning" 34:47.024 [DEBUG] test-consul.server: Skipping self join check for node since the cluster is too small: node=Node-62cca5be-25fa-37e1-f032-1eae13ae23de 34:47.024 [INFO] test-consul.server: member joined, marking health alive: member=Node-62cca5be-25fa-37e1-f032-1eae13ae23de 34:47.036 [INFO] test-consul.server: federation state anti-entropy synced 34:47.171 [DEBUG] test-consul: Skipping remote check since it is managed automatically: check=serfHealth 34:47.175 [INFO] test-consul: Synced node info 34:47.175 [DEBUG] test-consul: Node info in sync 34:47.196 [DEBUG] test-consul.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:35072 latency=11.460664ms 34:47.216 [DEBUG] test-consul.http: Request finished: method=POST url=/v1/connect/intentions from=127.0.0.1:35072 latency=16.03238ms 34:47.297 [DEBUG] test-consul.http: Request finished: method=POST url=/v1/agent/connect/authorize from=127.0.0.1:35072 latency=766.991µs 34:47.314 [DEBUG] test-consul.http: Request finished: method=POST url=/v1/agent/connect/authorize from=127.0.0.1:35072 latency=500.029µs 34:47.352 [DEBUG] test-consul.http: Request finished: method=POST url=/v1/agent/connect/authorize from=127.0.0.1:35072 latency=8.546987ms 34:47.384 [DEBUG] test-consul.http: Request finished: method=POST url=/v1/agent/connect/authorize from=127.0.0.1:35072 latency=4.002034ms 34:47.385 [INFO] test-consul: Requesting shutdown 34:47.385 [INFO] test-consul.server: shutting down server 34:47.385 [DEBUG] test-consul.leader: stopping routine: routine="federation state pruning" 34:47.385 [DEBUG] test-consul.leader: stopping routine: routine="intermediate cert renew watch" 34:47.385 [DEBUG] test-consul.leader: stopping routine: routine="CA root pruning" 34:47.385 [DEBUG] test-consul.leader: stopping routine: routine="federation state anti-entropy" 34:47.385 [WARN] test-consul.server.serf.lan: serf: Shutdown without a Leave 34:47.385 [ERROR] test-consul.server: error performing anti-entropy sync of federation state: error="context canceled" 34:47.385 [DEBUG] test-consul.leader: stopped routine: routine="federation state anti-entropy" 34:47.385 [DEBUG] test-consul.leader: stopped routine: routine="federation state pruning" 34:47.385 [DEBUG] test-consul.leader: stopped routine: routine="intermediate cert renew watch" 34:47.385 [DEBUG] test-consul.leader: stopped routine: routine="CA root pruning" 34:47.400 [WARN] test-consul.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:47.408Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:47.408Z [INFO] agent.router.manager: shutting down 34:47.408 [INFO] test-consul: consul server down 34:47.408 [INFO] test-consul: shutdown complete 34:47.408 [INFO] test-consul: Stopping server: protocol=DNS address=127.0.0.1:27366 network=tcp 34:47.408 [INFO] test-consul: Stopping server: protocol=DNS address=127.0.0.1:27366 network=udp 34:47.408 [INFO] test-consul: Stopping server: protocol=HTTP address=127.0.0.1:27367 network=tcp 34:47.909 [INFO] test-consul: Waiting for endpoints to shut down 34:47.909 [INFO] test-consul: Endpoints down --- PASS: TestServerSideVerifier (1.16s) --- PASS: TestServerSideVerifier/ok_service_ca1,_allow (0.02s) --- PASS: TestServerSideVerifier/untrusted_CA (0.00s) --- PASS: TestServerSideVerifier/cross_signed_intermediate,_allow (0.02s) --- PASS: TestServerSideVerifier/cross_signed_without_intermediate (0.00s) --- PASS: TestServerSideVerifier/ok_service_ca1,_deny (0.02s) --- PASS: TestServerSideVerifier/cross_signed_intermediate,_deny (0.03s) === RUN TestDynamicTLSConfig --- PASS: TestDynamicTLSConfig (0.02s) === RUN TestDynamicTLSConfig_Ready --- PASS: TestDynamicTLSConfig_Ready (0.04s) PASS ok github.com/hashicorp/consul/connect 2.795s ? github.com/hashicorp/consul/connect/certgen [no test files] === RUN TestUpstreamResolverFuncFromClient === PAUSE TestUpstreamResolverFuncFromClient === RUN TestAgentConfigWatcherSidecarProxy === PAUSE TestAgentConfigWatcherSidecarProxy === RUN TestConn conn_test.go:68: DM-skipped --- SKIP: TestConn (0.00s) === RUN TestConnSrcClosing === PAUSE TestConnSrcClosing === RUN TestConnDstClosing === PAUSE TestConnDstClosing === RUN TestPublicListener listener_test.go:110: DM-skipped --- SKIP: TestPublicListener (0.00s) === RUN TestUpstreamListener listener_test.go:164: DM-skipped --- SKIP: TestUpstreamListener (0.00s) === RUN TestProxy_public proxy_test.go:21: DM-skipped --- SKIP: TestProxy_public (0.00s) === CONT TestUpstreamResolverFuncFromClient === RUN TestUpstreamResolverFuncFromClient/service === RUN TestUpstreamResolverFuncFromClient/prepared_query === RUN TestUpstreamResolverFuncFromClient/unknown_behaves_like_service --- PASS: TestUpstreamResolverFuncFromClient (0.00s) --- PASS: TestUpstreamResolverFuncFromClient/service (0.00s) --- PASS: TestUpstreamResolverFuncFromClient/prepared_query (0.00s) --- PASS: TestUpstreamResolverFuncFromClient/unknown_behaves_like_service (0.00s) === CONT TestConnDstClosing === CONT TestConnSrcClosing === CONT TestAgentConfigWatcherSidecarProxy [INFO] freeport: blockSize 1500 too big for system limit 1024. Adjusting... [INFO] freeport: detected ephemeral port range of [32768, 60999] [INFO] freeport: reducing max blocks from 30 to 22 to avoid the ephemeral port range --- PASS: TestConnDstClosing (0.03s) --- PASS: TestConnSrcClosing (0.03s) 2021-10-05T16:34:44.990Z [ERROR] TestAgentConfigWatcherSidecarProxy.watch: Watch errored: service_id=web-sidecar-proxy type=agent_service error="Get "http://127.0.0.1:22254/v1/agent/service/web-sidecar-proxy?hash=790f39b13effbdf2": dial tcp 127.0.0.1:22254: connect: connection refused" retry=5s 2021-10-05T16:34:44.359Z [WARN] agent: bootstrap = true: do not enable unless necessary 2021-10-05T16:34:44.375Z [WARN] agent.auto_config: bootstrap = true: do not enable unless necessary 34:44.419 [INFO] agent_smith.server.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f Address:127.0.0.1:22258}]" 34:44.420 [INFO] agent_smith.server.raft: entering follower state: follower="Node at 127.0.0.1:22258 [Follower]" leader= 34:44.420 [INFO] agent_smith.server.serf.wan: serf: EventMemberJoin: Node-a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f.dc1 127.0.0.1 34:44.421 [INFO] agent_smith.server.serf.lan: serf: EventMemberJoin: Node-a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f 127.0.0.1 2021-10-05T16:34:44.421Z [INFO] agent.router: Initializing LAN area manager 34:44.421 [INFO] agent_smith: Started DNS server: address=127.0.0.1:22253 network=udp 34:44.421 [INFO] agent_smith.server: Adding LAN server: server="Node-a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f (Addr: tcp/127.0.0.1:22258) (DC: dc1)" 34:44.421 [INFO] agent_smith.server: Handled event for server in area: event=member-join server=Node-a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f.dc1 area=wan 34:44.422 [INFO] agent_smith: Started DNS server: address=127.0.0.1:22253 network=tcp 34:44.422 [INFO] agent_smith: Started HTTP server: address=127.0.0.1:22254 network=tcp 34:44.422 [INFO] agent_smith: started state syncer 34:44.422 [INFO] agent_smith: Started gRPC server: address=127.0.0.1:22259 network=tcp 34:44.468 [WARN] agent_smith.server.raft: heartbeat timeout reached, starting election: last-leader= 34:44.468 [INFO] agent_smith.server.raft: entering candidate state: node="Node at 127.0.0.1:22258 [Candidate]" term=2 34:44.490 [DEBUG] agent_smith.server.raft: votes: needed=1 34:44.490 [DEBUG] agent_smith.server.raft: vote granted: from=a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f term=2 tally=1 34:44.490 [INFO] agent_smith.server.raft: election won: tally=1 34:44.490 [INFO] agent_smith.server.raft: entering leader state: leader="Node at 127.0.0.1:22258 [Leader]" 34:44.491 [INFO] agent_smith.server: cluster leadership acquired 34:44.491 [INFO] agent_smith.server: New leader elected: payload=Node-a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f 34:44.508 [DEBUG] agent_smith.server: Cannot upgrade to new ACLs: leaderMode=0 mode=0 found=true leader=127.0.0.1:22258 34:44.572 [DEBUG] connect.ca.consul: consul CA provider configured: id=07:80:c8:de:f6:41:86:29:8f:9c:b8:17:d6:48:c2:d5:c5:5c:7f:0c:03:f7:cf:97:5a:a7:c1:68:aa:23:ae:81 is_primary=true 34:44.640 [INFO] agent_smith.server.connect: initialized primary datacenter CA with provider: provider=consul 34:44.640 [INFO] agent_smith.leader: started routine: routine="federation state anti-entropy" 34:44.640 [INFO] agent_smith.leader: started routine: routine="federation state pruning" 34:44.640 [INFO] agent_smith.leader: started routine: routine="intermediate cert renew watch" 34:44.640 [INFO] agent_smith.leader: started routine: routine="CA root pruning" 34:44.640 [DEBUG] agent_smith.server: Skipping self join check for node since the cluster is too small: node=Node-a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f 34:44.640 [INFO] agent_smith.server: member joined, marking health alive: member=Node-a6ccd965-588e-b9b3-0c4a-f6c74a3ca31f 34:44.658 [INFO] agent_smith.server: federation state anti-entropy synced 34:44.844 [DEBUG] agent_smith: Skipping remote check since it is managed automatically: check=serfHealth 34:44.864 [INFO] agent_smith: Synced node info 34:44.893 [INFO] agent_smith: Synced service: service=web 34:44.906 [INFO] agent_smith: Synced service: service=web-sidecar-proxy 34:44.906 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:1 34:44.906 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:2 34:44.906 [DEBUG] agent_smith: Node info in sync 34:44.906 [DEBUG] agent_smith: Service in sync: service=web 34:44.906 [DEBUG] agent_smith: Service in sync: service=web-sidecar-proxy 34:44.906 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:1 34:44.906 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:2 34:44.906 [DEBUG] agent_smith: Node info in sync 34:44.906 [DEBUG] agent_smith: Service in sync: service=web 34:44.906 [DEBUG] agent_smith: Service in sync: service=web-sidecar-proxy 34:44.906 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:1 34:44.906 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:2 34:44.906 [DEBUG] agent_smith.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:47542 latency=85.891567ms 34:44.908 [DEBUG] agent_smith.http: Request finished: method=GET url=/v1/agent/service/web-sidecar-proxy from=127.0.0.1:47542 latency=1.080533ms 34:44.964 [DEBUG] agent_smith: Node info in sync 34:44.970 [INFO] agent_smith: Synced service: service=web 34:44.978 [INFO] agent_smith: Synced service: service=web-sidecar-proxy 34:44.978 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:2 34:44.978 [DEBUG] agent_smith: Check in sync: check=service:web-sidecar-proxy:1 34:44.978 [DEBUG] agent_smith.http: Request finished: method=PUT url=/v1/agent/service/register from=127.0.0.1:47546 latency=40.02743ms 34:44.979 [DEBUG] agent_smith.http: Request finished: method=GET url=/v1/agent/service/web-sidecar-proxy?hash=e79fad2be70b72e8 from=127.0.0.1:47542 latency=58.549464ms 34:44.979 [INFO] agent_smith: Requesting shutdown 34:44.979 [INFO] agent_smith.server: shutting down server 34:44.979 [DEBUG] agent_smith.leader: stopping routine: routine="federation state anti-entropy" 34:44.979 [DEBUG] agent_smith.leader: stopping routine: routine="federation state pruning" 34:44.979 [DEBUG] agent_smith.leader: stopping routine: routine="intermediate cert renew watch" 34:44.979 [DEBUG] agent_smith.leader: stopping routine: routine="CA root pruning" 34:44.979 [WARN] agent_smith.server.serf.lan: serf: Shutdown without a Leave 34:44.980 [ERROR] agent_smith.server: error performing anti-entropy sync of federation state: error="context canceled" 34:44.980 [DEBUG] agent_smith.leader: stopped routine: routine="federation state anti-entropy" 34:44.980 [DEBUG] agent_smith.leader: stopped routine: routine="federation state pruning" 34:44.980 [DEBUG] agent_smith.leader: stopped routine: routine="intermediate cert renew watch" 34:44.980 [DEBUG] agent_smith.leader: stopped routine: routine="CA root pruning" 34:44.987 [WARN] agent_smith.server.serf.wan: serf: Shutdown without a Leave 2021-10-05T16:34:44.987Z [INFO] agent.router.manager: shutting down 2021-10-05T16:34:44.987Z [INFO] agent.router.manager: shutting down 34:44.987 [INFO] agent_smith: consul server down 34:44.987 [INFO] agent_smith: shutdown complete 34:44.987 [INFO] agent_smith: Stopping server: protocol=DNS address=127.0.0.1:22253 network=tcp 34:44.987 [INFO] agent_smith: Stopping server: protocol=DNS address=127.0.0.1:22253 network=udp 34:44.987 [INFO] agent_smith: Stopping server: protocol=HTTP address=127.0.0.1:22254 network=tcp 34:44.989 [DEBUG] agent_smith.http: Request finished: method=GET url=/v1/agent/service/web-sidecar-proxy?hash=790f39b13effbdf2 from=127.0.0.1:47542 latency=9.520377ms 34:45.488 [INFO] agent_smith: Waiting for endpoints to shut down 34:45.488 [INFO] agent_smith: Endpoints down --- PASS: TestAgentConfigWatcherSidecarProxy (1.27s) PASS ok github.com/hashicorp/consul/connect/proxy 1.536s === RUN TestConfigValidate === RUN TestConfigValidate/type=jwt/invalid_pubkey === RUN TestConfigValidate/bad_type === RUN TestConfigValidate/type=oidc/missing_required_OIDCDiscoveryURL === RUN TestConfigValidate/type=oidc/incompatible_with_JWTValidationPubKeys === RUN TestConfigValidate/type=inferred_oidc/valid_redirect_uris === RUN TestConfigValidate/type=oidc/incompatible_with_BoundIssuer === RUN TestConfigValidate/type=oidc/invalid_repeated_value_claim_mappings === RUN TestConfigValidate/type=jwt/all_required_for_public_keys === RUN TestConfigValidate/type=jwt/incompatible_with_OIDCScopes === RUN TestConfigValidate/type=jwt/incompatible_with_JWKSCACert === RUN TestConfigValidate/type=jwt/jwks_bad_certs === RUN TestConfigValidate/type=inferred_oidc/incompatible_with_JWKSURL === RUN TestConfigValidate/type=oidc/incompatible_with_ExpirationLeeway === RUN TestConfigValidate/type=inferred_oidc/invalid_redirect_uris === RUN TestConfigValidate/type=oidc/valid_algorithm === RUN TestConfigValidate/type=inferred_oidc/invalid_repeated_value_claim_mappings === RUN TestConfigValidate/type=jwt/jwks_invalid_404 === RUN TestConfigValidate/type=oidc/invalid_repeated_list_claim_mappings === RUN TestConfigValidate/type=oidc/valid_claim_mappings === RUN TestConfigValidate/type=jwt/bad_discovery_cert === RUN TestConfigValidate/type=jwt/valid_claim_mappings === RUN TestConfigValidate/type=jwt/incompatible_with_OIDCDiscoveryCACert === RUN TestConfigValidate/type=jwt/too_many_methods_(discovery_+_pubkeys) === RUN TestConfigValidate/type=jwt/valid_algorithm === RUN TestConfigValidate/type=inferred_oidc/incompatible_with_JWKSCACert === RUN TestConfigValidate/type=inferred_oidc/missing_required_OIDCDiscoveryURL === RUN TestConfigValidate/type=oidc/good_discovery_cert === RUN TestConfigValidate/type=inferred_oidc/missing_required_AllowedRedirectURIs === RUN TestConfigValidate/type=oidc/incompatible_with_ClockSkewLeeway === RUN TestConfigValidate/type=oidc/incompatible_with_JWKSURL === RUN TestConfigValidate/type=inferred_oidc/invalid_repeated_list_claim_mappings === RUN TestConfigValidate/type=inferred_oidc/incompatible_with_JWTValidationPubKeys === RUN TestConfigValidate/type=oidc/all_required === RUN TestConfigValidate/type=jwt/all_required_for_oidc_discovery === RUN TestConfigValidate/type=jwt/invalid_algorithm === RUN TestConfigValidate/type=oidc/incompatible_with_JWKSCACert === RUN TestConfigValidate/type=inferred_oidc/valid_claim_mappings === RUN TestConfigValidate/type=inferred_oidc/bad_discovery_cert === RUN TestConfigValidate/type=jwt/jwks_mismatched_certs === RUN TestConfigValidate/type=jwt/incompatible_with_AllowedRedirectURIs === RUN TestConfigValidate/type=inferred_oidc/missing_required_OIDCClientSecret === RUN TestConfigValidate/type=inferred_oidc/incompatible_with_ExpirationLeeway === RUN TestConfigValidate/type=inferred_oidc/incompatible_with_ClockSkewLeeway === RUN TestConfigValidate/type=jwt/incompatible_with_OIDCClientSecret === RUN TestConfigValidate/type=jwt/good_discovery_cert === RUN TestConfigValidate/type=jwt/too_many_methods_(discovery_+_jwks_+_pubkeys) === RUN TestConfigValidate/type=oidc/invalid_algorithm === RUN TestConfigValidate/type=inferred_oidc/garbage_discovery_cert === RUN TestConfigValidate/type=oidc/invalid_redirect_uris === RUN TestConfigValidate/type=oidc/bad_discovery_cert === RUN TestConfigValidate/type=jwt/invalid_repeated_list_claim_mappings === RUN TestConfigValidate/type=jwt/too_many_methods_(discovery_+_jwks) === RUN TestConfigValidate/type=jwt/all_required_for_jwks === RUN TestConfigValidate/type=inferred_oidc/incompatible_with_NotBeforeLeeway === RUN TestConfigValidate/type=inferred_oidc/good_discovery_cert === RUN TestConfigValidate/type=oidc/valid_redirect_uris === RUN TestConfigValidate/type=inferred_oidc/valid_algorithm === RUN TestConfigValidate/type=inferred_oidc/incompatible_with_BoundIssuer === RUN TestConfigValidate/type=jwt/invalid_repeated_value_claim_mappings === RUN TestConfigValidate/type=jwt/incompatible_with_VerboseOIDCLogging === RUN TestConfigValidate/type=inferred_oidc/all_required === RUN TestConfigValidate/type=oidc/missing_required_AllowedRedirectURIs === RUN TestConfigValidate/type=jwt/incompatible_with_OIDCClientID === RUN TestConfigValidate/type=oidc/missing_required_OIDCClientSecret === RUN TestConfigValidate/type=oidc/incompatible_with_NotBeforeLeeway === RUN TestConfigValidate/type=oidc/garbage_discovery_cert === RUN TestConfigValidate/type=inferred_oidc/missing_required_OIDCClientID === RUN TestConfigValidate/type=inferred_oidc/invalid_algorithm === RUN TestConfigValidate/type=oidc/missing_required_OIDCClientID === RUN TestConfigValidate/type=jwt/too_many_methods_(jwks_+_pubkeys) --- PASS: TestConfigValidate (0.51s) --- PASS: TestConfigValidate/type=jwt/invalid_pubkey (0.00s) --- PASS: TestConfigValidate/bad_type (0.00s) --- PASS: TestConfigValidate/type=oidc/missing_required_OIDCDiscoveryURL (0.00s) --- PASS: TestConfigValidate/type=oidc/incompatible_with_JWTValidationPubKeys (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/valid_redirect_uris (0.02s) --- PASS: TestConfigValidate/type=oidc/incompatible_with_BoundIssuer (0.00s) --- PASS: TestConfigValidate/type=oidc/invalid_repeated_value_claim_mappings (0.02s) --- PASS: TestConfigValidate/type=jwt/all_required_for_public_keys (0.00s) --- PASS: TestConfigValidate/type=jwt/incompatible_with_OIDCScopes (0.00s) --- PASS: TestConfigValidate/type=jwt/incompatible_with_JWKSCACert (0.00s) --- PASS: TestConfigValidate/type=jwt/jwks_bad_certs (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/incompatible_with_JWKSURL (0.00s) --- PASS: TestConfigValidate/type=oidc/incompatible_with_ExpirationLeeway (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/invalid_redirect_uris (0.00s) --- PASS: TestConfigValidate/type=oidc/valid_algorithm (0.02s) --- PASS: TestConfigValidate/type=inferred_oidc/invalid_repeated_value_claim_mappings (0.03s) --- PASS: TestConfigValidate/type=jwt/jwks_invalid_404 (0.02s) --- PASS: TestConfigValidate/type=oidc/invalid_repeated_list_claim_mappings (0.02s) --- PASS: TestConfigValidate/type=oidc/valid_claim_mappings (0.02s) --- PASS: TestConfigValidate/type=jwt/bad_discovery_cert (0.02s) --- PASS: TestConfigValidate/type=jwt/valid_claim_mappings (0.00s) --- PASS: TestConfigValidate/type=jwt/incompatible_with_OIDCDiscoveryCACert (0.00s) --- PASS: TestConfigValidate/type=jwt/too_many_methods_(discovery_+_pubkeys) (0.00s) --- PASS: TestConfigValidate/type=jwt/valid_algorithm (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/incompatible_with_JWKSCACert (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/missing_required_OIDCDiscoveryURL (0.00s) --- PASS: TestConfigValidate/type=oidc/good_discovery_cert (0.02s) --- PASS: TestConfigValidate/type=inferred_oidc/missing_required_AllowedRedirectURIs (0.00s) --- PASS: TestConfigValidate/type=oidc/incompatible_with_ClockSkewLeeway (0.00s) --- PASS: TestConfigValidate/type=oidc/incompatible_with_JWKSURL (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/invalid_repeated_list_claim_mappings (0.01s) --- PASS: TestConfigValidate/type=inferred_oidc/incompatible_with_JWTValidationPubKeys (0.00s) --- PASS: TestConfigValidate/type=oidc/all_required (0.02s) --- PASS: TestConfigValidate/type=jwt/all_required_for_oidc_discovery (0.02s) --- PASS: TestConfigValidate/type=jwt/invalid_algorithm (0.00s) --- PASS: TestConfigValidate/type=oidc/incompatible_with_JWKSCACert (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/valid_claim_mappings (0.02s) --- PASS: TestConfigValidate/type=inferred_oidc/bad_discovery_cert (0.06s) --- PASS: TestConfigValidate/type=jwt/jwks_mismatched_certs (0.02s) --- PASS: TestConfigValidate/type=jwt/incompatible_with_AllowedRedirectURIs (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/missing_required_OIDCClientSecret (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/incompatible_with_ExpirationLeeway (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/incompatible_with_ClockSkewLeeway (0.00s) --- PASS: TestConfigValidate/type=jwt/incompatible_with_OIDCClientSecret (0.00s) --- PASS: TestConfigValidate/type=jwt/good_discovery_cert (0.01s) --- PASS: TestConfigValidate/type=jwt/too_many_methods_(discovery_+_jwks_+_pubkeys) (0.00s) --- PASS: TestConfigValidate/type=oidc/invalid_algorithm (0.01s) --- PASS: TestConfigValidate/type=inferred_oidc/garbage_discovery_cert (0.00s) --- PASS: TestConfigValidate/type=oidc/invalid_redirect_uris (0.00s) --- PASS: TestConfigValidate/type=oidc/bad_discovery_cert (0.02s) --- PASS: TestConfigValidate/type=jwt/invalid_repeated_list_claim_mappings (0.00s) --- PASS: TestConfigValidate/type=jwt/too_many_methods_(discovery_+_jwks) (0.00s) --- PASS: TestConfigValidate/type=jwt/all_required_for_jwks (0.02s) --- PASS: TestConfigValidate/type=inferred_oidc/incompatible_with_NotBeforeLeeway (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/good_discovery_cert (0.04s) --- PASS: TestConfigValidate/type=oidc/valid_redirect_uris (0.01s) --- PASS: TestConfigValidate/type=inferred_oidc/valid_algorithm (0.02s) --- PASS: TestConfigValidate/type=inferred_oidc/incompatible_with_BoundIssuer (0.00s) --- PASS: TestConfigValidate/type=jwt/invalid_repeated_value_claim_mappings (0.00s) --- PASS: TestConfigValidate/type=jwt/incompatible_with_VerboseOIDCLogging (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/all_required (0.01s) --- PASS: TestConfigValidate/type=oidc/missing_required_AllowedRedirectURIs (0.00s) --- PASS: TestConfigValidate/type=jwt/incompatible_with_OIDCClientID (0.00s) --- PASS: TestConfigValidate/type=oidc/missing_required_OIDCClientSecret (0.00s) --- PASS: TestConfigValidate/type=oidc/incompatible_with_NotBeforeLeeway (0.00s) --- PASS: TestConfigValidate/type=oidc/garbage_discovery_cert (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/missing_required_OIDCClientID (0.00s) --- PASS: TestConfigValidate/type=inferred_oidc/invalid_algorithm (0.02s) --- PASS: TestConfigValidate/type=oidc/missing_required_OIDCClientID (0.00s) --- PASS: TestConfigValidate/type=jwt/too_many_methods_(jwks_+_pubkeys) (0.00s) === RUN TestJWT_OIDC_Functions_Fail === RUN TestJWT_OIDC_Functions_Fail/static === RUN TestJWT_OIDC_Functions_Fail/static/GetAuthCodeURL === RUN TestJWT_OIDC_Functions_Fail/static/ClaimsFromAuthCode === RUN TestJWT_OIDC_Functions_Fail/JWKS === RUN TestJWT_OIDC_Functions_Fail/JWKS/GetAuthCodeURL === RUN TestJWT_OIDC_Functions_Fail/JWKS/ClaimsFromAuthCode === RUN TestJWT_OIDC_Functions_Fail/oidc_discovery === RUN TestJWT_OIDC_Functions_Fail/oidc_discovery/GetAuthCodeURL === RUN TestJWT_OIDC_Functions_Fail/oidc_discovery/ClaimsFromAuthCode --- PASS: TestJWT_OIDC_Functions_Fail (0.20s) --- PASS: TestJWT_OIDC_Functions_Fail/static (0.00s) --- PASS: TestJWT_OIDC_Functions_Fail/static/GetAuthCodeURL (0.00s) --- PASS: TestJWT_OIDC_Functions_Fail/static/ClaimsFromAuthCode (0.00s) --- PASS: TestJWT_OIDC_Functions_Fail/JWKS (0.07s) --- PASS: TestJWT_OIDC_Functions_Fail/JWKS/GetAuthCodeURL (0.04s) --- PASS: TestJWT_OIDC_Functions_Fail/JWKS/ClaimsFromAuthCode (0.03s) --- PASS: TestJWT_OIDC_Functions_Fail/oidc_discovery (0.14s) --- PASS: TestJWT_OIDC_Functions_Fail/oidc_discovery/GetAuthCodeURL (0.05s) --- PASS: TestJWT_OIDC_Functions_Fail/oidc_discovery/ClaimsFromAuthCode (0.09s) === RUN TestJWT_ClaimsFromJWT === RUN TestJWT_ClaimsFromJWT/static === RUN TestJWT_ClaimsFromJWT/static/missing_audience === RUN TestJWT_ClaimsFromJWT/static/valid_inputs === RUN TestJWT_ClaimsFromJWT/static/unusable_claims === RUN TestJWT_ClaimsFromJWT/static/bad_signature === RUN TestJWT_ClaimsFromJWT/static/bad_issuer === RUN TestJWT_ClaimsFromJWT/static/bad_audience === RUN TestJWT_ClaimsFromJWT/JWKS === RUN TestJWT_ClaimsFromJWT/JWKS/missing_audience === RUN TestJWT_ClaimsFromJWT/JWKS/valid_inputs === RUN TestJWT_ClaimsFromJWT/JWKS/unusable_claims === RUN TestJWT_ClaimsFromJWT/JWKS/bad_signature === RUN TestJWT_ClaimsFromJWT/JWKS/bad_issuer === RUN TestJWT_ClaimsFromJWT/JWKS/bad_audience === RUN TestJWT_ClaimsFromJWT/oidc_discovery === RUN TestJWT_ClaimsFromJWT/oidc_discovery/missing_audience jwt_test.go:140: why? === RUN TestJWT_ClaimsFromJWT/oidc_discovery/valid_inputs === RUN TestJWT_ClaimsFromJWT/oidc_discovery/unusable_claims === RUN TestJWT_ClaimsFromJWT/oidc_discovery/bad_signature === RUN TestJWT_ClaimsFromJWT/oidc_discovery/bad_issuer === RUN TestJWT_ClaimsFromJWT/oidc_discovery/bad_audience --- PASS: TestJWT_ClaimsFromJWT (0.82s) --- PASS: TestJWT_ClaimsFromJWT/static (0.04s) --- PASS: TestJWT_ClaimsFromJWT/static/missing_audience (0.01s) --- PASS: TestJWT_ClaimsFromJWT/static/valid_inputs (0.01s) --- PASS: TestJWT_ClaimsFromJWT/static/unusable_claims (0.01s) --- PASS: TestJWT_ClaimsFromJWT/static/bad_signature (0.01s) --- PASS: TestJWT_ClaimsFromJWT/static/bad_issuer (0.01s) --- PASS: TestJWT_ClaimsFromJWT/static/bad_audience (0.01s) --- PASS: TestJWT_ClaimsFromJWT/JWKS (0.43s) --- PASS: TestJWT_ClaimsFromJWT/JWKS/missing_audience (0.07s) --- PASS: TestJWT_ClaimsFromJWT/JWKS/valid_inputs (0.06s) --- PASS: TestJWT_ClaimsFromJWT/JWKS/unusable_claims (0.07s) --- PASS: TestJWT_ClaimsFromJWT/JWKS/bad_signature (0.07s) --- PASS: TestJWT_ClaimsFromJWT/JWKS/bad_issuer (0.08s) --- PASS: TestJWT_ClaimsFromJWT/JWKS/bad_audience (0.09s) --- PASS: TestJWT_ClaimsFromJWT/oidc_discovery (0.35s) --- SKIP: TestJWT_ClaimsFromJWT/oidc_discovery/missing_audience (0.00s) --- PASS: TestJWT_ClaimsFromJWT/oidc_discovery/valid_inputs (0.09s) --- PASS: TestJWT_ClaimsFromJWT/oidc_discovery/unusable_claims (0.07s) --- PASS: TestJWT_ClaimsFromJWT/oidc_discovery/bad_signature (0.07s) --- PASS: TestJWT_ClaimsFromJWT/oidc_discovery/bad_issuer (0.06s) --- PASS: TestJWT_ClaimsFromJWT/oidc_discovery/bad_audience (0.07s) === RUN TestJWT_ClaimsFromJWT_ExpiryClaims === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_iat_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_iat_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_iat_with_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_iat_with_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_iat_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_iat_with_clock_skew_leeway --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims (0.00s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static (0.00s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_iat_with_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway (0.03s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf (0.03s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway (0.03s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway (0.05s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway (0.07s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf (0.04s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_iat_with_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway (0.07s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway (0.08s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/no_expire_leeway_using_iat_with_clock_skew_leeway (0.05s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_no_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway (0.05s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway (0.04s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway (0.09s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/static/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway (0.06s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS (0.00s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway (0.14s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf (0.15s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway (0.20s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_iat_with_clock_skew_leeway (0.20s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_no_clock_skew_leeway (0.22s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway (0.24s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_auto_clock_skew_leeway (0.26s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_custom_clock_skew_leeway (0.22s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_no_expire_leeway_using_nbf_with_clock_skew_leeway (0.26s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway (0.17s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway (0.30s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_no_clock_skew_leeway (0.23s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway (0.17s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_iat_with_auto_clock_skew_leeway (0.24s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_no_clock_skew_leeway (0.19s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway (0.19s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_iat_with_clock_skew_leeway_with_default_leeway (0.18s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway_and_nbf (0.24s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_no_clock_skew_leeway (0.18s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_iat_with_custom_clock_skew_leeway (0.35s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/auto_expire_leeway_using_nbf_with_auto_clock_skew_leeway (0.31s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway (0.19s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_auto_expire_leeway_using_nbf_with_custom_clock_skew_leeway (0.20s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/no_expire_leeway_using_iat_with_clock_skew_leeway (0.14s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/expired_custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway (0.15s) --- PASS: TestJWT_ClaimsFromJWT_ExpiryClaims/JWKS/custom_expire_leeway_using_nbf_with_clock_skew_leeway_with_default_leeway (0.17s) === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/nbf_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/nbf_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/nbf_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/nbf_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === RUN TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === PAUSE TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/nbf_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/nbf_leeway_using_iat_with_no_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway === CONT TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims (0.00s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static (0.00s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway (0.00s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/nbf_leeway_using_iat_with_no_clock_skew_leeway (0.00s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway (0.00s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway (0.03s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.03s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.03s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.01s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.03s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.05s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/static/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.02s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS (0.00s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.15s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway (0.18s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.18s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.18s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.20s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_auto_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.20s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_nbf_leeway_using_iat_with_no_clock_skew_leeway (0.18s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_auto_clock_skew_leeway (0.26s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.25s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_no_nbf_leeway_using_iat_with_custom_clock_skew_leeway (0.34s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/nbf_leeway_using_iat_with_no_clock_skew_leeway (0.16s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_auto_clock_skew_leeway (0.17s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.19s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_no_clock_skew_leeway_with_default_leeway (0.16s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.25s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/not_yet_valid_custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.15s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_custom_clock_skew_leeway (0.22s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/no_nbf_leeway_using_iat_with_auto_clock_skew_leeway (0.23s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/custom_nbf_leeway_using_exp_with_custom_clock_skew_leeway (0.19s) --- PASS: TestJWT_ClaimsFromJWT_NotBeforeClaims/JWKS/auto_nbf_leeway_using_exp_with_no_clock_skew_leeway (0.16s) === RUN TestParsePublicKeyPEM === RUN TestParsePublicKeyPEM/rsa === RUN TestParsePublicKeyPEM/ecdsa === RUN TestParsePublicKeyPEM/ed25519 --- PASS: TestParsePublicKeyPEM (2.98s) --- PASS: TestParsePublicKeyPEM/rsa (2.98s) --- PASS: TestParsePublicKeyPEM/ecdsa (0.00s) --- PASS: TestParsePublicKeyPEM/ed25519 (0.00s) === RUN TestOIDC_AuthURL === RUN TestOIDC_AuthURL/normal_case === PAUSE TestOIDC_AuthURL/normal_case === RUN TestOIDC_AuthURL/invalid_RedirectURI === PAUSE TestOIDC_AuthURL/invalid_RedirectURI === RUN TestOIDC_AuthURL/missing_RedirectURI === PAUSE TestOIDC_AuthURL/missing_RedirectURI === CONT TestOIDC_AuthURL/normal_case === CONT TestOIDC_AuthURL/missing_RedirectURI === CONT TestOIDC_AuthURL/invalid_RedirectURI --- PASS: TestOIDC_AuthURL (0.00s) --- PASS: TestOIDC_AuthURL/missing_RedirectURI (0.08s) --- PASS: TestOIDC_AuthURL/invalid_RedirectURI (0.10s) --- PASS: TestOIDC_AuthURL/normal_case (0.11s) === RUN TestOIDC_JWT_Functions_Fail --- PASS: TestOIDC_JWT_Functions_Fail (0.06s) === RUN TestOIDC_ClaimsFromAuthCode === RUN TestOIDC_ClaimsFromAuthCode/successful_login === RUN TestOIDC_ClaimsFromAuthCode/failed_login_unusable_claims === RUN TestOIDC_ClaimsFromAuthCode/successful_login_-_no_userinfo === RUN TestOIDC_ClaimsFromAuthCode/failed_login_-_bad_nonce === PAUSE TestOIDC_ClaimsFromAuthCode/failed_login_-_bad_nonce === RUN TestOIDC_ClaimsFromAuthCode/missing_state === RUN TestOIDC_ClaimsFromAuthCode/unknown_state === RUN TestOIDC_ClaimsFromAuthCode/valid_state,_missing_code === RUN TestOIDC_ClaimsFromAuthCode/failed_code_exchange === RUN TestOIDC_ClaimsFromAuthCode/no_id_token_returned === RUN TestOIDC_ClaimsFromAuthCode/no_response_from_provider === RUN TestOIDC_ClaimsFromAuthCode/invalid_bound_audience === CONT TestOIDC_ClaimsFromAuthCode/failed_login_-_bad_nonce --- PASS: TestOIDC_ClaimsFromAuthCode (0.59s) --- PASS: TestOIDC_ClaimsFromAuthCode/successful_login (0.08s) --- PASS: TestOIDC_ClaimsFromAuthCode/failed_login_unusable_claims (0.07s) --- PASS: TestOIDC_ClaimsFromAuthCode/successful_login_-_no_userinfo (0.08s) --- PASS: TestOIDC_ClaimsFromAuthCode/missing_state (0.05s) --- PASS: TestOIDC_ClaimsFromAuthCode/unknown_state (0.07s) --- PASS: TestOIDC_ClaimsFromAuthCode/valid_state,_missing_code (0.05s) --- PASS: TestOIDC_ClaimsFromAuthCode/failed_code_exchange (0.06s) --- PASS: TestOIDC_ClaimsFromAuthCode/no_id_token_returned (0.04s) --- PASS: TestOIDC_ClaimsFromAuthCode/no_response_from_provider (0.05s) --- PASS: TestOIDC_ClaimsFromAuthCode/invalid_bound_audience (0.04s) --- PASS: TestOIDC_ClaimsFromAuthCode/failed_login_-_bad_nonce (0.05s) === RUN TestExtractStringMetadata === RUN TestExtractStringMetadata/empty === RUN TestExtractStringMetadata/all === RUN TestExtractStringMetadata/some === RUN TestExtractStringMetadata/none === RUN TestExtractStringMetadata/nested_data === RUN TestExtractStringMetadata/error:_a_struct_isn't_stringifiable === RUN TestExtractStringMetadata/error:_a_slice_isn't_stringifiable --- PASS: TestExtractStringMetadata (0.00s) --- PASS: TestExtractStringMetadata/empty (0.00s) --- PASS: TestExtractStringMetadata/all (0.00s) --- PASS: TestExtractStringMetadata/some (0.00s) --- PASS: TestExtractStringMetadata/none (0.00s) --- PASS: TestExtractStringMetadata/nested_data (0.00s) --- PASS: TestExtractStringMetadata/error:_a_struct_isn't_stringifiable (0.00s) --- PASS: TestExtractStringMetadata/error:_a_slice_isn't_stringifiable (0.00s) === RUN TestExtractListMetadata === RUN TestExtractListMetadata/list_omits_empty_strings === RUN TestExtractListMetadata/JSONPointer === RUN TestExtractListMetadata/error:_a_struct_isn't_stringifiable_(singular) === RUN TestExtractListMetadata/all_-_list === RUN TestExtractListMetadata/some_-_list === RUN TestExtractListMetadata/none_-_list === RUN TestExtractListMetadata/error:_a_slice_isn't_stringifiable_(singular) === RUN TestExtractListMetadata/nested_data_-_singular === RUN TestExtractListMetadata/non-string-slice_data_(string) === RUN TestExtractListMetadata/some_-_singular === RUN TestExtractListMetadata/all_-_singular === RUN TestExtractListMetadata/none_-_singular === RUN TestExtractListMetadata/nested_data_-_list === RUN TestExtractListMetadata/JSONPointer_not_found === RUN TestExtractListMetadata/empty --- PASS: TestExtractListMetadata (0.00s) --- PASS: TestExtractListMetadata/list_omits_empty_strings (0.00s) --- PASS: TestExtractListMetadata/JSONPointer (0.00s) --- PASS: TestExtractListMetadata/error:_a_struct_isn't_stringifiable_(singular) (0.00s) --- PASS: TestExtractListMetadata/all_-_list (0.00s) --- PASS: TestExtractListMetadata/some_-_list (0.00s) --- PASS: TestExtractListMetadata/none_-_list (0.00s) --- PASS: TestExtractListMetadata/error:_a_slice_isn't_stringifiable_(singular) (0.00s) --- PASS: TestExtractListMetadata/nested_data_-_singular (0.00s) --- PASS: TestExtractListMetadata/non-string-slice_data_(string) (0.00s) --- PASS: TestExtractListMetadata/some_-_singular (0.00s) --- PASS: TestExtractListMetadata/all_-_singular (0.00s) --- PASS: TestExtractListMetadata/none_-_singular (0.00s) --- PASS: TestExtractListMetadata/nested_data_-_list (0.00s) --- PASS: TestExtractListMetadata/JSONPointer_not_found (0.00s) --- PASS: TestExtractListMetadata/empty (0.00s) === RUN TestGetClaim === RUN TestGetClaim/a === RUN TestGetClaim//a === RUN TestGetClaim/b === RUN TestGetClaim//c/d === RUN TestGetClaim//c/e/1 === RUN TestGetClaim//c/f/g === RUN TestGetClaim/nope === RUN TestGetClaim//c/f/h === RUN TestGetClaim/#00 === RUN TestGetClaim/\ === RUN TestGetClaim/h === RUN TestGetClaim/i === RUN TestGetClaim//c/e === RUN TestGetClaim//c/f --- PASS: TestGetClaim (0.00s) --- PASS: TestGetClaim/a (0.00s) --- PASS: TestGetClaim//a (0.00s) --- PASS: TestGetClaim/b (0.00s) --- PASS: TestGetClaim//c/d (0.00s) --- PASS: TestGetClaim//c/e/1 (0.00s) --- PASS: TestGetClaim//c/f/g (0.00s) --- PASS: TestGetClaim/nope (0.00s) --- PASS: TestGetClaim//c/f/h (0.00s) --- PASS: TestGetClaim/#00 (0.00s) --- PASS: TestGetClaim/\ (0.00s) --- PASS: TestGetClaim/h (0.00s) --- PASS: TestGetClaim/i (0.00s) --- PASS: TestGetClaim//c/e (0.00s) --- PASS: TestGetClaim//c/f (0.00s) === RUN TestNormalizeList === RUN TestNormalizeList/[]interface_{}{"green",_42} === RUN TestNormalizeList/[]interface_{}{"green"} === RUN TestNormalizeList/[]interface_{}{} === RUN TestNormalizeList/"green" === RUN TestNormalizeList/"" === RUN TestNormalizeList/42 === RUN TestNormalizeList/struct_{_A_int_}{A:5} === RUN TestNormalizeList/ --- PASS: TestNormalizeList (0.00s) --- PASS: TestNormalizeList/[]interface_{}{"green",_42} (0.00s) --- PASS: TestNormalizeList/[]interface_{}{"green"} (0.00s) --- PASS: TestNormalizeList/[]interface_{}{} (0.00s) --- PASS: TestNormalizeList/"green" (0.00s) --- PASS: TestNormalizeList/"" (0.00s) --- PASS: TestNormalizeList/42 (0.00s) --- PASS: TestNormalizeList/struct_{_A_int_}{A:5} (0.00s) --- PASS: TestNormalizeList/ (0.00s) === RUN TestStringifyMetadataValue === RUN TestStringifyMetadataValue/int32 === RUN TestStringifyMetadataValue/uint32 === RUN TestStringifyMetadataValue/uint === RUN TestStringifyMetadataValue/int_slice === RUN TestStringifyMetadataValue/nil === RUN TestStringifyMetadataValue/empty_string === RUN TestStringifyMetadataValue/int8 === RUN TestStringifyMetadataValue/int64 === RUN TestStringifyMetadataValue/uint8 === RUN TestStringifyMetadataValue/map === RUN TestStringifyMetadataValue/string === RUN TestStringifyMetadataValue/false === RUN TestStringifyMetadataValue/float64 === RUN TestStringifyMetadataValue/float32 === RUN TestStringifyMetadataValue/int16 === RUN TestStringifyMetadataValue/uint64 === RUN TestStringifyMetadataValue/string_slice === RUN TestStringifyMetadataValue/true === RUN TestStringifyMetadataValue/json_number === RUN TestStringifyMetadataValue/int === RUN TestStringifyMetadataValue/uint16 === RUN TestStringifyMetadataValue/struct --- PASS: TestStringifyMetadataValue (0.00s) --- PASS: TestStringifyMetadataValue/int32 (0.00s) --- PASS: TestStringifyMetadataValue/uint32 (0.00s) --- PASS: TestStringifyMetadataValue/uint (0.00s) --- PASS: TestStringifyMetadataValue/int_slice (0.00s) --- PASS: TestStringifyMetadataValue/nil (0.00s) --- PASS: TestStringifyMetadataValue/empty_string (0.00s) --- PASS: TestStringifyMetadataValue/int8 (0.00s) --- PASS: TestStringifyMetadataValue/int64 (0.00s) --- PASS: TestStringifyMetadataValue/uint8 (0.00s) --- PASS: TestStringifyMetadataValue/map (0.00s) --- PASS: TestStringifyMetadataValue/string (0.00s) --- PASS: TestStringifyMetadataValue/false (0.00s) --- PASS: TestStringifyMetadataValue/float64 (0.00s) --- PASS: TestStringifyMetadataValue/float32 (0.00s) --- PASS: TestStringifyMetadataValue/int16 (0.00s) --- PASS: TestStringifyMetadataValue/uint64 (0.00s) --- PASS: TestStringifyMetadataValue/string_slice (0.00s) --- PASS: TestStringifyMetadataValue/true (0.00s) --- PASS: TestStringifyMetadataValue/json_number (0.00s) --- PASS: TestStringifyMetadataValue/int (0.00s) --- PASS: TestStringifyMetadataValue/uint16 (0.00s) --- PASS: TestStringifyMetadataValue/struct (0.00s) === RUN TestValidateAudience === RUN TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"a"}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"a"}_strict=true === RUN TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"b"}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"b"}_strict=true === RUN TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{""}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{""}_strict=true === RUN TestValidateAudience/boundAudiences=[]string{}_audience=[]string{"a"}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{}_audience=[]string{"a"}_strict=true === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a"}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a"}_strict=true === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"b"}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"b"}_strict=true === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a",_"b",_"c"}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a",_"b",_"c"}_strict=true === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"c",_"d"}_strict=false === RUN TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"c",_"d"}_strict=true --- PASS: TestValidateAudience (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"a"}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"a"}_strict=true (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"b"}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{"b"}_strict=true (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{""}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a"}_audience=[]string{""}_strict=true (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{}_audience=[]string{"a"}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{}_audience=[]string{"a"}_strict=true (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a"}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a"}_strict=true (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"b"}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"b"}_strict=true (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a",_"b",_"c"}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"a",_"b",_"c"}_strict=true (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"c",_"d"}_strict=false (0.00s) --- PASS: TestValidateAudience/boundAudiences=[]string{"a",_"b"}_audience=[]string{"c",_"d"}_strict=true (0.00s) === RUN TestValidRedirect === RUN TestValidRedirect/uri="https://example.com"_allowed=[]string{"https://example.com"} === RUN TestValidRedirect/uri="https://example.com:5000"_allowed=[]string{"a",_"b",_"https://example.com:5000"} === RUN TestValidRedirect/uri="https://example.com/a/b/c"_allowed=[]string{"a",_"b",_"https://example.com/a/b/c"} === RUN TestValidRedirect/uri="https://localhost:9000"_allowed=[]string{"a",_"b",_"https://localhost:5000"} === RUN TestValidRedirect/uri="https://127.0.0.1:9000"_allowed=[]string{"a",_"b",_"https://127.0.0.1:5000"} === RUN TestValidRedirect/uri="https://[::1]:9000"_allowed=[]string{"a",_"b",_"https://[::1]:5000"} === RUN TestValidRedirect/uri="https://[::1]:9000/x/y?r=42"_allowed=[]string{"a",_"b",_"https://[::1]:5000/x/y?r=42"} === RUN TestValidRedirect/uri="https://example.com"_allowed=[]string{} === RUN TestValidRedirect/uri="http://example.com"_allowed=[]string{"a",_"b",_"https://example.com"} === RUN TestValidRedirect/uri="https://example.com:9000"_allowed=[]string{"a",_"b",_"https://example.com:5000"} === RUN TestValidRedirect/uri="https://[::2]:9000"_allowed=[]string{"a",_"b",_"https://[::2]:5000"} === RUN TestValidRedirect/uri="https://localhost:5000"_allowed=[]string{"a",_"b",_"https://127.0.0.1:5000"} === RUN TestValidRedirect/uri="https://localhost:5000"_allowed=[]string{"a",_"b",_"https://127.0.0.1:5000"}#01 === RUN TestValidRedirect/uri="https://localhost:5000"_allowed=[]string{"a",_"b",_"http://localhost:5000"} === RUN TestValidRedirect/uri="https://[::1]:5000/x/y?r=42"_allowed=[]string{"a",_"b",_"https://[::1]:5000/x/y?r=43"} === RUN TestValidRedirect/uri="%%%%%%%%%%%"_allowed=[]string{} --- PASS: TestValidRedirect (0.00s) --- PASS: TestValidRedirect/uri="https://example.com"_allowed=[]string{"https://example.com"} (0.00s) --- PASS: TestValidRedirect/uri="https://example.com:5000"_allowed=[]string{"a",_"b",_"https://example.com:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://example.com/a/b/c"_allowed=[]string{"a",_"b",_"https://example.com/a/b/c"} (0.00s) --- PASS: TestValidRedirect/uri="https://localhost:9000"_allowed=[]string{"a",_"b",_"https://localhost:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://127.0.0.1:9000"_allowed=[]string{"a",_"b",_"https://127.0.0.1:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://[::1]:9000"_allowed=[]string{"a",_"b",_"https://[::1]:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://[::1]:9000/x/y?r=42"_allowed=[]string{"a",_"b",_"https://[::1]:5000/x/y?r=42"} (0.00s) --- PASS: TestValidRedirect/uri="https://example.com"_allowed=[]string{} (0.00s) --- PASS: TestValidRedirect/uri="http://example.com"_allowed=[]string{"a",_"b",_"https://example.com"} (0.00s) --- PASS: TestValidRedirect/uri="https://example.com:9000"_allowed=[]string{"a",_"b",_"https://example.com:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://[::2]:9000"_allowed=[]string{"a",_"b",_"https://[::2]:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://localhost:5000"_allowed=[]string{"a",_"b",_"https://127.0.0.1:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://localhost:5000"_allowed=[]string{"a",_"b",_"https://127.0.0.1:5000"}#01 (0.00s) --- PASS: TestValidRedirect/uri="https://localhost:5000"_allowed=[]string{"a",_"b",_"http://localhost:5000"} (0.00s) --- PASS: TestValidRedirect/uri="https://[::1]:5000/x/y?r=42"_allowed=[]string{"a",_"b",_"https://[::1]:5000/x/y?r=43"} (0.00s) --- PASS: TestValidRedirect/uri="%%%%%%%%%%%"_allowed=[]string{} (0.00s) PASS ok github.com/hashicorp/consul/internal/go-sso/oidcauth 6.608s === RUN TestStrListContains --- PASS: TestStrListContains (0.00s) PASS ok github.com/hashicorp/consul/internal/go-sso/oidcauth/internal/strutil 0.052s ? github.com/hashicorp/consul/internal/go-sso/oidcauth/oidcauthtest [no test files] === RUN TestIsPrivateIP === RUN TestIsPrivateIP/10.0.0.1 === RUN TestIsPrivateIP/100.64.0.1 === RUN TestIsPrivateIP/172.16.0.1 === RUN TestIsPrivateIP/192.168.0.1 === RUN TestIsPrivateIP/192.0.0.1 === RUN TestIsPrivateIP/192.0.2.1 === RUN TestIsPrivateIP/127.0.0.1 === RUN TestIsPrivateIP/169.254.0.1 === RUN TestIsPrivateIP/1.2.3.4 === RUN TestIsPrivateIP/::1 === RUN TestIsPrivateIP/fe80::1 === RUN TestIsPrivateIP/fc00::1 === RUN TestIsPrivateIP/fec0::1 === RUN TestIsPrivateIP/2001:db8::1 === RUN TestIsPrivateIP/2004:db6::1 --- PASS: TestIsPrivateIP (0.00s) --- PASS: TestIsPrivateIP/10.0.0.1 (0.00s) --- PASS: TestIsPrivateIP/100.64.0.1 (0.00s) --- PASS: TestIsPrivateIP/172.16.0.1 (0.00s) --- PASS: TestIsPrivateIP/192.168.0.1 (0.00s) --- PASS: TestIsPrivateIP/192.0.0.1 (0.00s) --- PASS: TestIsPrivateIP/192.0.2.1 (0.00s) --- PASS: TestIsPrivateIP/127.0.0.1 (0.00s) --- PASS: TestIsPrivateIP/169.254.0.1 (0.00s) --- PASS: TestIsPrivateIP/1.2.3.4 (0.00s) --- PASS: TestIsPrivateIP/::1 (0.00s) --- PASS: TestIsPrivateIP/fe80::1 (0.00s) --- PASS: TestIsPrivateIP/fc00::1 (0.00s) --- PASS: TestIsPrivateIP/fec0::1 (0.00s) --- PASS: TestIsPrivateIP/2001:db8::1 (0.00s) --- PASS: TestIsPrivateIP/2004:db6::1 (0.00s) === RUN TestIsIPv6 === RUN TestIsIPv6/10.0.0.1 === RUN TestIsIPv6/100.64.0.1 === RUN TestIsIPv6/172.16.0.1 === RUN TestIsIPv6/192.168.0.1 === RUN TestIsIPv6/192.0.0.1 === RUN TestIsIPv6/192.0.2.1 === RUN TestIsIPv6/127.0.0.1 === RUN TestIsIPv6/169.254.0.1 === RUN TestIsIPv6/1.2.3.4 === RUN TestIsIPv6/::1 === RUN TestIsIPv6/fe80::1 === RUN TestIsIPv6/fc00::1 === RUN TestIsIPv6/fec0::1 === RUN TestIsIPv6/2001:db8::1 === RUN TestIsIPv6/2004:db6::1 === RUN TestIsIPv6/example.com === RUN TestIsIPv6/localhost === RUN TestIsIPv6/1.257.0.1 --- PASS: TestIsIPv6 (0.00s) --- PASS: TestIsIPv6/10.0.0.1 (0.00s) --- PASS: TestIsIPv6/100.64.0.1 (0.00s) --- PASS: TestIsIPv6/172.16.0.1 (0.00s) --- PASS: TestIsIPv6/192.168.0.1 (0.00s) --- PASS: TestIsIPv6/192.0.0.1 (0.00s) --- PASS: TestIsIPv6/192.0.2.1 (0.00s) --- PASS: TestIsIPv6/127.0.0.1 (0.00s) --- PASS: TestIsIPv6/169.254.0.1 (0.00s) --- PASS: TestIsIPv6/1.2.3.4 (0.00s) --- PASS: TestIsIPv6/::1 (0.00s) --- PASS: TestIsIPv6/fe80::1 (0.00s) --- PASS: TestIsIPv6/fc00::1 (0.00s) --- PASS: TestIsIPv6/fec0::1 (0.00s) --- PASS: TestIsIPv6/2001:db8::1 (0.00s) --- PASS: TestIsIPv6/2004:db6::1 (0.00s) --- PASS: TestIsIPv6/example.com (0.00s) --- PASS: TestIsIPv6/localhost (0.00s) --- PASS: TestIsIPv6/1.257.0.1 (0.00s) PASS ok github.com/hashicorp/consul/ipaddr 0.043s === RUN TestDurationMinusBuffer --- PASS: TestDurationMinusBuffer (0.00s) === RUN TestDurationMinusBufferDomain --- PASS: TestDurationMinusBufferDomain (0.00s) === RUN TestRandomStagger --- PASS: TestRandomStagger (0.00s) === RUN TestRateScaledInterval --- PASS: TestRateScaledInterval (0.00s) === RUN TestMapWalk map_walker_test.go:10: DM-skipped --- SKIP: TestMapWalk (0.00s) === RUN TestJitterRandomStagger === PAUSE TestJitterRandomStagger === RUN TestRetryWaiter_calculateWait === PAUSE TestRetryWaiter_calculateWait === RUN TestRetryWaiter_WaitChans === PAUSE TestRetryWaiter_WaitChans === RUN TestRTT_ComputeDistance === RUN TestRTT_ComputeDistance/10_ms === RUN TestRTT_ComputeDistance/0_ms === RUN TestRTT_ComputeDistance/2_ms === RUN TestRTT_ComputeDistance/2_ms_reversed === RUN TestRTT_ComputeDistance/a_nil === RUN TestRTT_ComputeDistance/b_nil === RUN TestRTT_ComputeDistance/both_nil --- PASS: TestRTT_ComputeDistance (0.00s) --- PASS: TestRTT_ComputeDistance/10_ms (0.00s) --- PASS: TestRTT_ComputeDistance/0_ms (0.00s) --- PASS: TestRTT_ComputeDistance/2_ms (0.00s) --- PASS: TestRTT_ComputeDistance/2_ms_reversed (0.00s) --- PASS: TestRTT_ComputeDistance/a_nil (0.00s) --- PASS: TestRTT_ComputeDistance/b_nil (0.00s) --- PASS: TestRTT_ComputeDistance/both_nil (0.00s) === RUN TestRTT_Intersect === RUN TestRTT_Intersect/nil_maps === RUN TestRTT_Intersect/two_servers === RUN TestRTT_Intersect/two_clients === RUN TestRTT_Intersect/server1_and_client_alpha === RUN TestRTT_Intersect/server1_and_client_beta_1 === RUN TestRTT_Intersect/server1_and_client_alpha_reversed === RUN TestRTT_Intersect/server1_and_client_beta_1_reversed === RUN TestRTT_Intersect/nothing_in_common === RUN TestRTT_Intersect/nothing_in_common_reversed --- PASS: TestRTT_Intersect (0.00s) --- PASS: TestRTT_Intersect/nil_maps (0.00s) --- PASS: TestRTT_Intersect/two_servers (0.00s) --- PASS: TestRTT_Intersect/two_clients (0.00s) --- PASS: TestRTT_Intersect/server1_and_client_alpha (0.00s) --- PASS: TestRTT_Intersect/server1_and_client_beta_1 (0.00s) --- PASS: TestRTT_Intersect/server1_and_client_alpha_reversed (0.00s) --- PASS: TestRTT_Intersect/server1_and_client_beta_1_reversed (0.00s) --- PASS: TestRTT_Intersect/nothing_in_common (0.00s) --- PASS: TestRTT_Intersect/nothing_in_common_reversed (0.00s) === RUN TestStopChannelContext --- PASS: TestStopChannelContext (0.00s) === RUN TestTelemetryConfig_MergeDefaults === RUN TestTelemetryConfig_MergeDefaults/basic_merge === RUN TestTelemetryConfig_MergeDefaults/exhaustive --- PASS: TestTelemetryConfig_MergeDefaults (0.00s) --- PASS: TestTelemetryConfig_MergeDefaults/basic_merge (0.00s) --- PASS: TestTelemetryConfig_MergeDefaults/exhaustive (0.00s) === RUN TestTranslateKeys === RUN TestTranslateKeys/x->y === RUN TestTranslateKeys/discard_x === RUN TestTranslateKeys/b.x->b.y === RUN TestTranslateKeys/json:_x->y === RUN TestTranslateKeys/json:_X->y === RUN TestTranslateKeys/json:_discard_x === RUN TestTranslateKeys/json:_b.x->b.y === RUN TestTranslateKeys/json:_b[0].x->b[0].y --- PASS: TestTranslateKeys (0.00s) --- PASS: TestTranslateKeys/x->y (0.00s) --- PASS: TestTranslateKeys/discard_x (0.00s) --- PASS: TestTranslateKeys/b.x->b.y (0.00s) --- PASS: TestTranslateKeys/json:_x->y (0.00s) --- PASS: TestTranslateKeys/json:_X->y (0.00s) --- PASS: TestTranslateKeys/json:_discard_x (0.00s) --- PASS: TestTranslateKeys/json:_b.x->b.y (0.00s) --- PASS: TestTranslateKeys/json:_b[0].x->b[0].y (0.00s) === RUN TestUserAgent --- PASS: TestUserAgent (0.00s) === RUN TestMathAbsInt --- PASS: TestMathAbsInt (0.00s) === RUN TestMathMaxInt --- PASS: TestMathMaxInt (0.00s) === RUN TestMathMinInt --- PASS: TestMathMinInt (0.00s) === RUN TestMathMaxUint64 --- PASS: TestMathMaxUint64 (0.00s) === CONT TestJitterRandomStagger === RUN TestJitterRandomStagger/0_percent === PAUSE TestJitterRandomStagger/0_percent === RUN TestJitterRandomStagger/10_percent === PAUSE TestJitterRandomStagger/10_percent === RUN TestJitterRandomStagger/100_percent === PAUSE TestJitterRandomStagger/100_percent === CONT TestJitterRandomStagger/0_percent === CONT TestRetryWaiter_WaitChans === RUN TestRetryWaiter_WaitChans/Minimum_Wait_-_Success === PAUSE TestRetryWaiter_WaitChans/Minimum_Wait_-_Success === RUN TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIf === PAUSE TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIf === RUN TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIfErr === PAUSE TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIfErr === RUN TestRetryWaiter_WaitChans/Maximum_Wait_-_Failed === PAUSE TestRetryWaiter_WaitChans/Maximum_Wait_-_Failed === RUN TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIf === PAUSE TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIf === RUN TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIfErr === PAUSE TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIfErr === CONT TestRetryWaiter_WaitChans/Minimum_Wait_-_Success === CONT TestRetryWaiter_calculateWait === RUN TestRetryWaiter_calculateWait/Defaults === PAUSE TestRetryWaiter_calculateWait/Defaults === RUN TestRetryWaiter_calculateWait/Minimum_Wait === PAUSE TestRetryWaiter_calculateWait/Minimum_Wait === RUN TestRetryWaiter_calculateWait/Minimum_Failures === PAUSE TestRetryWaiter_calculateWait/Minimum_Failures === RUN TestRetryWaiter_calculateWait/Maximum_Wait === PAUSE TestRetryWaiter_calculateWait/Maximum_Wait === CONT TestRetryWaiter_calculateWait/Defaults === CONT TestJitterRandomStagger/100_percent === CONT TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIfErr === CONT TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIf === CONT TestJitterRandomStagger/10_percent === CONT TestRetryWaiter_calculateWait/Minimum_Failures === CONT TestRetryWaiter_calculateWait/Minimum_Wait === CONT TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIf --- PASS: TestJitterRandomStagger (0.00s) --- PASS: TestJitterRandomStagger/0_percent (0.00s) --- PASS: TestJitterRandomStagger/100_percent (0.00s) --- PASS: TestJitterRandomStagger/10_percent (0.00s) === CONT TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIfErr === CONT TestRetryWaiter_WaitChans/Maximum_Wait_-_Failed === CONT TestRetryWaiter_calculateWait/Maximum_Wait --- PASS: TestRetryWaiter_calculateWait (0.00s) --- PASS: TestRetryWaiter_calculateWait/Defaults (0.00s) --- PASS: TestRetryWaiter_calculateWait/Minimum_Failures (0.00s) --- PASS: TestRetryWaiter_calculateWait/Minimum_Wait (0.00s) --- PASS: TestRetryWaiter_calculateWait/Maximum_Wait (0.00s) --- PASS: TestRetryWaiter_WaitChans (0.00s) --- PASS: TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIf (0.21s) --- PASS: TestRetryWaiter_WaitChans/Minimum_Wait_-_Success (0.21s) --- PASS: TestRetryWaiter_WaitChans/Minimum_Wait_-_WaitIfErr (0.21s) --- PASS: TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIfErr (0.25s) --- PASS: TestRetryWaiter_WaitChans/Maximum_Wait_-_WaitIf (0.25s) --- PASS: TestRetryWaiter_WaitChans/Maximum_Wait_-_Failed (0.25s) PASS ok github.com/hashicorp/consul/lib 0.283s === RUN TestHookTranslateKeys === RUN TestHookTranslateKeys/target_of_type_struct,_with_struct_receiver === RUN TestHookTranslateKeys/target_of_type_ptr,_with_struct_receiver === RUN TestHookTranslateKeys/target_of_type_ptr,_with_ptr_receiver === RUN TestHookTranslateKeys/target_of_type_ptr,_with_struct_receiver#01 === RUN TestHookTranslateKeys/target_of_type_map === RUN TestHookTranslateKeys/value_already_exists_for_canonical_key --- PASS: TestHookTranslateKeys (0.00s) --- PASS: TestHookTranslateKeys/target_of_type_struct,_with_struct_receiver (0.00s) --- PASS: TestHookTranslateKeys/target_of_type_ptr,_with_struct_receiver (0.00s) --- PASS: TestHookTranslateKeys/target_of_type_ptr,_with_ptr_receiver (0.00s) --- PASS: TestHookTranslateKeys/target_of_type_ptr,_with_struct_receiver#01 (0.00s) --- PASS: TestHookTranslateKeys/target_of_type_map (0.00s) --- PASS: TestHookTranslateKeys/value_already_exists_for_canonical_key (0.00s) === RUN TestHookTranslateKeys_TargetStructHasPointerReceiver --- PASS: TestHookTranslateKeys_TargetStructHasPointerReceiver (0.00s) === RUN TestHookTranslateKeys_DoesNotModifySourceData --- PASS: TestHookTranslateKeys_DoesNotModifySourceData (0.00s) === RUN TestTranslationsForType --- PASS: TestTranslationsForType (0.00s) === RUN TestHookWeakDecodeFromSlice_DoesNotModifySliceTargets --- PASS: TestHookWeakDecodeFromSlice_DoesNotModifySliceTargets (0.00s) === RUN TestHookWeakDecodeFromSlice_DoesNotModifySliceTargetsFromSliceInterface --- PASS: TestHookWeakDecodeFromSlice_DoesNotModifySliceTargetsFromSliceInterface (0.00s) === RUN TestHookWeakDecodeFromSlice_ErrorsWithMultipleNestedBlocks --- PASS: TestHookWeakDecodeFromSlice_ErrorsWithMultipleNestedBlocks (0.00s) === RUN TestHookWeakDecodeFromSlice_UnpacksNestedBlocks --- PASS: TestHookWeakDecodeFromSlice_UnpacksNestedBlocks (0.00s) === RUN TestHookWeakDecodeFromSlice_NestedOpaqueConfig --- PASS: TestHookWeakDecodeFromSlice_NestedOpaqueConfig (0.00s) PASS ok github.com/hashicorp/consul/lib/decode 0.038s === RUN TestWriteAtomic --- PASS: TestWriteAtomic (0.01s) PASS ok github.com/hashicorp/consul/lib/file 0.050s === RUN TestDynamic === PAUSE TestDynamic === RUN TestDynamicPanic === PAUSE TestDynamicPanic === RUN TestDynamicAcquire === PAUSE TestDynamicAcquire === CONT TestDynamic === CONT TestDynamicAcquire === CONT TestDynamicPanic --- PASS: TestDynamicPanic (0.00s) --- PASS: TestDynamicAcquire (0.06s) --- PASS: TestDynamic (1.45s) PASS ok github.com/hashicorp/consul/lib/semaphore 1.478s === RUN TestContains --- PASS: TestContains (0.00s) === RUN TestEqual === RUN TestEqual/[]string(nil)_=?=_[]string(nil) === RUN TestEqual/[]string(nil)_=?=_[]string{} === RUN TestEqual/[]string{}_=?=_[]string{} === RUN TestEqual/[]string{"a"}_=?=_[]string{"a"} === RUN TestEqual/[]string{}_=?=_[]string{"a"} === RUN TestEqual/[]string{"a"}_=?=_[]string{"a",_"b"} === RUN TestEqual/[]string{"a",_"b"}_=?=_[]string{"a",_"b"} === RUN TestEqual/[]string{"a",_"b"}_=?=_[]string{"b",_"a"} --- PASS: TestEqual (0.00s) --- PASS: TestEqual/[]string(nil)_=?=_[]string(nil) (0.00s) --- PASS: TestEqual/[]string(nil)_=?=_[]string{} (0.00s) --- PASS: TestEqual/[]string{}_=?=_[]string{} (0.00s) --- PASS: TestEqual/[]string{"a"}_=?=_[]string{"a"} (0.00s) --- PASS: TestEqual/[]string{}_=?=_[]string{"a"} (0.00s) --- PASS: TestEqual/[]string{"a"}_=?=_[]string{"a",_"b"} (0.00s) --- PASS: TestEqual/[]string{"a",_"b"}_=?=_[]string{"a",_"b"} (0.00s) --- PASS: TestEqual/[]string{"a",_"b"}_=?=_[]string{"b",_"a"} (0.00s) === RUN TestMergeSorted === RUN TestMergeSorted/one_and_one === RUN TestMergeSorted/two_and_one === RUN TestMergeSorted/two_and_two === RUN TestMergeSorted/two_and_two_dupe === RUN TestMergeSorted/nil === RUN TestMergeSorted/empty === RUN TestMergeSorted/one_and_none === RUN TestMergeSorted/one_and_one_dupe --- PASS: TestMergeSorted (0.00s) --- PASS: TestMergeSorted/one_and_one (0.00s) --- PASS: TestMergeSorted/two_and_one (0.00s) --- PASS: TestMergeSorted/two_and_two (0.00s) --- PASS: TestMergeSorted/two_and_two_dupe (0.00s) --- PASS: TestMergeSorted/nil (0.00s) --- PASS: TestMergeSorted/empty (0.00s) --- PASS: TestMergeSorted/one_and_none (0.00s) --- PASS: TestMergeSorted/one_and_one_dupe (0.00s) PASS ok github.com/hashicorp/consul/lib/stringslice 0.018s === RUN TestInterpolateHIL === RUN TestInterpolateHIL/empty_lower=false === RUN TestInterpolateHIL/empty_lower=true === RUN TestInterpolateHIL/just_lowercase_var_lower=false === RUN TestInterpolateHIL/just_lowercase_var_lower=true === RUN TestInterpolateHIL/just_uppercase_var_lower=false === RUN TestInterpolateHIL/just_uppercase_var_lower=true === RUN TestInterpolateHIL/var_without_start_lower=false === RUN TestInterpolateHIL/var_without_start_lower=true === RUN TestInterpolateHIL/two_vars_missing_second_start_lower=false === RUN TestInterpolateHIL/two_vars_missing_second_start_lower=true === RUN TestInterpolateHIL/two_vars_missing_first_end_lower=false === RUN TestInterpolateHIL/two_vars_missing_first_end_lower=true === RUN TestInterpolateHIL/uppercase_var_in_middle_lower=false === RUN TestInterpolateHIL/uppercase_var_in_middle_lower=true === RUN TestInterpolateHIL/two_vars_lower=false === RUN TestInterpolateHIL/two_vars_lower=true === RUN TestInterpolateHIL/missing_map_val_lower=false === RUN TestInterpolateHIL/missing_map_val_lower=true === RUN TestInterpolateHIL/no_varname_lower=false === RUN TestInterpolateHIL/no_varname_lower=true === RUN TestInterpolateHIL/missing_map_key_lower=false === RUN TestInterpolateHIL/missing_map_key_lower=true === RUN TestInterpolateHIL/just_start_lower=false === RUN TestInterpolateHIL/just_start_lower=true === RUN TestInterpolateHIL/no_vars_lower=false === RUN TestInterpolateHIL/no_vars_lower=true === RUN TestInterpolateHIL/lowercase_var_in_middle_lower=false === RUN TestInterpolateHIL/lowercase_var_in_middle_lower=true === RUN TestInterpolateHIL/just_end_lower=false === RUN TestInterpolateHIL/just_end_lower=true === RUN TestInterpolateHIL/backwards_lower=false === RUN TestInterpolateHIL/backwards_lower=true === RUN TestInterpolateHIL/var_without_end_lower=false === RUN TestInterpolateHIL/var_without_end_lower=true --- PASS: TestInterpolateHIL (0.00s) --- PASS: TestInterpolateHIL/empty_lower=false (0.00s) --- PASS: TestInterpolateHIL/empty_lower=true (0.00s) --- PASS: TestInterpolateHIL/just_lowercase_var_lower=false (0.00s) --- PASS: TestInterpolateHIL/just_lowercase_var_lower=true (0.00s) --- PASS: TestInterpolateHIL/just_uppercase_var_lower=false (0.00s) --- PASS: TestInterpolateHIL/just_uppercase_var_lower=true (0.00s) --- PASS: TestInterpolateHIL/var_without_start_lower=false (0.00s) --- PASS: TestInterpolateHIL/var_without_start_lower=true (0.00s) --- PASS: TestInterpolateHIL/two_vars_missing_second_start_lower=false (0.00s) --- PASS: TestInterpolateHIL/two_vars_missing_second_start_lower=true (0.00s) --- PASS: TestInterpolateHIL/two_vars_missing_first_end_lower=false (0.00s) --- PASS: TestInterpolateHIL/two_vars_missing_first_end_lower=true (0.00s) --- PASS: TestInterpolateHIL/uppercase_var_in_middle_lower=false (0.00s) --- PASS: TestInterpolateHIL/uppercase_var_in_middle_lower=true (0.00s) --- PASS: TestInterpolateHIL/two_vars_lower=false (0.00s) --- PASS: TestInterpolateHIL/two_vars_lower=true (0.00s) --- PASS: TestInterpolateHIL/missing_map_val_lower=false (0.00s) --- PASS: TestInterpolateHIL/missing_map_val_lower=true (0.00s) --- PASS: TestInterpolateHIL/no_varname_lower=false (0.00s) --- PASS: TestInterpolateHIL/no_varname_lower=true (0.00s) --- PASS: TestInterpolateHIL/missing_map_key_lower=false (0.00s) --- PASS: TestInterpolateHIL/missing_map_key_lower=true (0.00s) --- PASS: TestInterpolateHIL/just_start_lower=false (0.00s) --- PASS: TestInterpolateHIL/just_start_lower=true (0.00s) --- PASS: TestInterpolateHIL/no_vars_lower=false (0.00s) --- PASS: TestInterpolateHIL/no_vars_lower=true (0.00s) --- PASS: TestInterpolateHIL/lowercase_var_in_middle_lower=false (0.00s) --- PASS: TestInterpolateHIL/lowercase_var_in_middle_lower=true (0.00s) --- PASS: TestInterpolateHIL/just_end_lower=false (0.00s) --- PASS: TestInterpolateHIL/just_end_lower=true (0.00s) --- PASS: TestInterpolateHIL/backwards_lower=false (0.00s) --- PASS: TestInterpolateHIL/backwards_lower=true (0.00s) --- PASS: TestInterpolateHIL/var_without_end_lower=false (0.00s) --- PASS: TestInterpolateHIL/var_without_end_lower=true (0.00s) PASS ok github.com/hashicorp/consul/lib/template 0.038s === RUN TestGatedWriter_impl --- PASS: TestGatedWriter_impl (0.00s) === RUN TestGatedWriter --- PASS: TestGatedWriter (0.00s) === RUN TestGRPCLogger --- PASS: TestGRPCLogger (0.00s) === RUN TestGRPCLogger_V === RUN TestGRPCLogger_V/ERR,-1 === RUN TestGRPCLogger_V/ERR,0 === RUN TestGRPCLogger_V/ERR,1 === RUN TestGRPCLogger_V/ERR,2 === RUN TestGRPCLogger_V/ERR,3 === RUN TestGRPCLogger_V/WARN,-1 === RUN TestGRPCLogger_V/WARN,0 === RUN TestGRPCLogger_V/WARN,1 === RUN TestGRPCLogger_V/WARN,2 === RUN TestGRPCLogger_V/WARN,3 === RUN TestGRPCLogger_V/INFO,-1 === RUN TestGRPCLogger_V/INFO,0 === RUN TestGRPCLogger_V/INFO,1 === RUN TestGRPCLogger_V/INFO,2 === RUN TestGRPCLogger_V/INFO,3 === RUN TestGRPCLogger_V/DEBUG,-1 === RUN TestGRPCLogger_V/DEBUG,0 === RUN TestGRPCLogger_V/DEBUG,1 === RUN TestGRPCLogger_V/DEBUG,2 === RUN TestGRPCLogger_V/DEBUG,3 === RUN TestGRPCLogger_V/TRACE,-1 === RUN TestGRPCLogger_V/TRACE,0 === RUN TestGRPCLogger_V/TRACE,1 === RUN TestGRPCLogger_V/TRACE,2 === RUN TestGRPCLogger_V/TRACE,3 --- PASS: TestGRPCLogger_V (0.00s) --- PASS: TestGRPCLogger_V/ERR,-1 (0.00s) --- PASS: TestGRPCLogger_V/ERR,0 (0.00s) --- PASS: TestGRPCLogger_V/ERR,1 (0.00s) --- PASS: TestGRPCLogger_V/ERR,2 (0.00s) --- PASS: TestGRPCLogger_V/ERR,3 (0.00s) --- PASS: TestGRPCLogger_V/WARN,-1 (0.00s) --- PASS: TestGRPCLogger_V/WARN,0 (0.00s) --- PASS: TestGRPCLogger_V/WARN,1 (0.00s) --- PASS: TestGRPCLogger_V/WARN,2 (0.00s) --- PASS: TestGRPCLogger_V/WARN,3 (0.00s) --- PASS: TestGRPCLogger_V/INFO,-1 (0.00s) --- PASS: TestGRPCLogger_V/INFO,0 (0.00s) --- PASS: TestGRPCLogger_V/INFO,1 (0.00s) --- PASS: TestGRPCLogger_V/INFO,2 (0.00s) --- PASS: TestGRPCLogger_V/INFO,3 (0.00s) --- PASS: TestGRPCLogger_V/DEBUG,-1 (0.00s) --- PASS: TestGRPCLogger_V/DEBUG,0 (0.00s) --- PASS: TestGRPCLogger_V/DEBUG,1 (0.00s) --- PASS: TestGRPCLogger_V/DEBUG,2 (0.00s) --- PASS: TestGRPCLogger_V/DEBUG,3 (0.00s) --- PASS: TestGRPCLogger_V/TRACE,-1 (0.00s) --- PASS: TestGRPCLogger_V/TRACE,0 (0.00s) --- PASS: TestGRPCLogger_V/TRACE,1 (0.00s) --- PASS: TestGRPCLogger_V/TRACE,2 (0.00s) --- PASS: TestGRPCLogger_V/TRACE,3 (0.00s) === RUN TestLogFile_timeRotation === PAUSE TestLogFile_timeRotation === RUN TestLogFile_openNew === PAUSE TestLogFile_openNew === RUN TestLogFile_byteRotation === PAUSE TestLogFile_byteRotation === RUN TestLogFile_deleteArchives === PAUSE TestLogFile_deleteArchives === RUN TestLogFile_deleteArchivesDisabled === PAUSE TestLogFile_deleteArchivesDisabled === RUN TestLogFile_rotationDisabled === PAUSE TestLogFile_rotationDisabled === RUN TestLogger_SetupBasic === PAUSE TestLogger_SetupBasic === RUN TestLogger_SetupInvalidLogLevel === PAUSE TestLogger_SetupInvalidLogLevel === RUN TestLogger_SetupLoggerErrorLevel === PAUSE TestLogger_SetupLoggerErrorLevel === RUN TestLogger_SetupLoggerDebugLevel === PAUSE TestLogger_SetupLoggerDebugLevel === RUN TestLogger_SetupLoggerWithName === PAUSE TestLogger_SetupLoggerWithName === RUN TestLogger_SetupLoggerWithJSON === PAUSE TestLogger_SetupLoggerWithJSON === RUN TestLogger_SetupLoggerWithValidLogPath === PAUSE TestLogger_SetupLoggerWithValidLogPath === RUN TestLogger_SetupLoggerWithInValidLogPath === PAUSE TestLogger_SetupLoggerWithInValidLogPath === RUN TestLogger_SetupLoggerWithInValidLogPathPermission === PAUSE TestLogger_SetupLoggerWithInValidLogPathPermission === CONT TestLogFile_timeRotation === CONT TestLogger_SetupLoggerWithInValidLogPathPermission --- PASS: TestLogger_SetupLoggerWithInValidLogPathPermission (0.00s) === CONT TestLogger_SetupLoggerWithInValidLogPath --- PASS: TestLogger_SetupLoggerWithInValidLogPath (0.00s) === CONT TestLogger_SetupLoggerWithValidLogPath --- PASS: TestLogger_SetupLoggerWithValidLogPath (0.00s) === CONT TestLogger_SetupLoggerWithJSON --- PASS: TestLogger_SetupLoggerWithJSON (0.00s) === CONT TestLogger_SetupLoggerWithName --- PASS: TestLogger_SetupLoggerWithName (0.00s) === CONT TestLogger_SetupLoggerDebugLevel --- PASS: TestLogger_SetupLoggerDebugLevel (0.00s) === CONT TestLogger_SetupLoggerErrorLevel === RUN TestLogger_SetupLoggerErrorLevel/ERR_log_level === RUN TestLogger_SetupLoggerErrorLevel/ERROR_log_level --- PASS: TestLogger_SetupLoggerErrorLevel (0.00s) --- PASS: TestLogger_SetupLoggerErrorLevel/ERR_log_level (0.00s) --- PASS: TestLogger_SetupLoggerErrorLevel/ERROR_log_level (0.00s) === CONT TestLogger_SetupInvalidLogLevel --- PASS: TestLogger_SetupInvalidLogLevel (0.00s) === CONT TestLogger_SetupBasic --- PASS: TestLogger_SetupBasic (0.00s) === CONT TestLogFile_rotationDisabled --- PASS: TestLogFile_rotationDisabled (0.00s) === CONT TestLogFile_deleteArchivesDisabled --- PASS: TestLogFile_deleteArchivesDisabled (0.00s) === CONT TestLogFile_deleteArchives --- PASS: TestLogFile_deleteArchives (0.00s) === CONT TestLogFile_byteRotation --- PASS: TestLogFile_byteRotation (0.00s) === CONT TestLogFile_openNew --- PASS: TestLogFile_openNew (0.00s) --- PASS: TestLogFile_timeRotation (2.01s) PASS ok github.com/hashicorp/consul/logging 2.070s === RUN TestMonitor_Start === PAUSE TestMonitor_Start === RUN TestMonitor_Stop === PAUSE TestMonitor_Stop === RUN TestMonitor_DroppedMessages === PAUSE TestMonitor_DroppedMessages === RUN TestMonitor_ZeroBufSizeDefault === PAUSE TestMonitor_ZeroBufSizeDefault === RUN TestMonitor_WriteStopped === PAUSE TestMonitor_WriteStopped === CONT TestMonitor_Start --- PASS: TestMonitor_Start (0.00s) === CONT TestMonitor_WriteStopped --- PASS: TestMonitor_WriteStopped (0.00s) === CONT TestMonitor_ZeroBufSizeDefault === CONT TestMonitor_DroppedMessages === CONT TestMonitor_Stop --- PASS: TestMonitor_Stop (0.10s) --- PASS: TestMonitor_ZeroBufSizeDefault (0.10s) --- PASS: TestMonitor_DroppedMessages (0.10s) PASS ok github.com/hashicorp/consul/logging/monitor 0.165s === RUN TestHookPBTimestampToTime --- PASS: TestHookPBTimestampToTime (0.00s) === RUN TestHookTimeToPBTimestamp --- PASS: TestHookTimeToPBTimestamp (0.00s) === RUN TestHookTimeToPBTimestamp_ZeroTime --- PASS: TestHookTimeToPBTimestamp_ZeroTime (0.00s) PASS ok github.com/hashicorp/consul/proto 0.038s ? github.com/hashicorp/consul/proto/pbacl [no test files] ? github.com/hashicorp/consul/proto/pbautoconf [no test files] ? github.com/hashicorp/consul/proto/pbcommon [no test files] ? github.com/hashicorp/consul/proto/pbconfig [no test files] ? github.com/hashicorp/consul/proto/pbconnect [no test files] === RUN TestGetEphemeralPortRange ephemeral_linux_test.go:17: min=32768, max=60999 --- PASS: TestGetEphemeralPortRange (0.00s) === RUN TestTakeReturn freeport_test.go:13: DM-skipped --- SKIP: TestTakeReturn (0.00s) === RUN TestIntervalOverlap === RUN TestIntervalOverlap/0:0_vs_0:0 === RUN TestIntervalOverlap/1:1_vs_1:1 === RUN TestIntervalOverlap/1:3_vs_1:3 === RUN TestIntervalOverlap/1:3_vs_4:6 === RUN TestIntervalOverlap/1:4_vs_3:6 === RUN TestIntervalOverlap/1:6_vs_3:4 --- PASS: TestIntervalOverlap (0.00s) --- PASS: TestIntervalOverlap/0:0_vs_0:0 (0.00s) --- PASS: TestIntervalOverlap/1:1_vs_1:1 (0.00s) --- PASS: TestIntervalOverlap/1:3_vs_1:3 (0.00s) --- PASS: TestIntervalOverlap/1:3_vs_4:6 (0.00s) --- PASS: TestIntervalOverlap/1:4_vs_3:6 (0.00s) --- PASS: TestIntervalOverlap/1:6_vs_3:4 (0.00s) PASS ok github.com/hashicorp/consul/sdk/freeport 0.015s ? github.com/hashicorp/consul/sdk/testutil [no test files] === RUN TestRetryer retry_test.go:12: DM-skipped --- SKIP: TestRetryer (0.00s) PASS ok github.com/hashicorp/consul/sdk/testutil/retry 0.044s ? github.com/hashicorp/consul/sentinel [no test files] ? github.com/hashicorp/consul/service_os [no test files] === RUN TestArchive --- PASS: TestArchive (0.00s) === RUN TestArchive_GoodData --- PASS: TestArchive_GoodData (0.00s) === RUN TestArchive_BadData --- PASS: TestArchive_BadData (0.01s) === RUN TestArchive_hashList --- PASS: TestArchive_hashList (0.00s) === RUN TestSnapshot 2021-10-05T16:34:51.138Z [INFO] raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:server-202a10d1-926a-cb64-bb95-be0ca00d1c72 Address:202a10d1-926a-cb64-bb95-be0ca00d1c72}]" 2021-10-05T16:34:51.140Z [INFO] raft: entering follower state: follower="Node at 202a10d1-926a-cb64-bb95-be0ca00d1c72 [Follower]" leader= 2021-10-05T16:34:52.548Z [WARN] raft: heartbeat timeout reached, starting election: last-leader= 2021-10-05T16:34:52.548Z [INFO] raft: entering candidate state: node="Node at 202a10d1-926a-cb64-bb95-be0ca00d1c72 [Candidate]" term=2 2021-10-05T16:34:52.548Z [DEBUG] raft: votes: needed=1 2021-10-05T16:34:52.548Z [DEBUG] raft: vote granted: from=server-202a10d1-926a-cb64-bb95-be0ca00d1c72 term=2 tally=1 2021-10-05T16:34:52.548Z [INFO] raft: election won: tally=1 2021-10-05T16:34:52.548Z [INFO] raft: entering leader state: leader="Node at 202a10d1-926a-cb64-bb95-be0ca00d1c72 [Leader]" 2021-10-05T16:34:55.180Z [INFO] raft: starting snapshot up to: index=65538 2021-10-05T16:34:55.180Z [INFO] snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshot-snapshot290043556/before/snapshots/2-65538-1633451695180.tmp 2021-10-05T16:34:55.364Z [INFO] raft: compacting logs: from=1 to=55298 2021-10-05T16:34:55.370Z [INFO] raft: snapshot complete up to: index=65538 2021-10-05T16:34:57.055Z [INFO] raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:server-795d65c7-0739-c41b-9bb9-45c1b748ca8d Address:795d65c7-0739-c41b-9bb9-45c1b748ca8d}]" 2021-10-05T16:34:57.055Z [INFO] raft: entering follower state: follower="Node at 795d65c7-0739-c41b-9bb9-45c1b748ca8d [Follower]" leader= 2021-10-05T16:34:58.908Z [WARN] raft: heartbeat timeout reached, starting election: last-leader= 2021-10-05T16:34:58.908Z [INFO] raft: entering candidate state: node="Node at 795d65c7-0739-c41b-9bb9-45c1b748ca8d [Candidate]" term=2 2021-10-05T16:34:58.908Z [DEBUG] raft: votes: needed=1 2021-10-05T16:34:58.908Z [DEBUG] raft: vote granted: from=server-795d65c7-0739-c41b-9bb9-45c1b748ca8d term=2 tally=1 2021-10-05T16:34:58.908Z [INFO] raft: election won: tally=1 2021-10-05T16:34:58.908Z [INFO] raft: entering leader state: leader="Node at 795d65c7-0739-c41b-9bb9-45c1b748ca8d [Leader]" 2021-10-05T16:34:59.222Z [INFO] snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshot-snapshot290043556/after/snapshots/2-65539-1633451699222.tmp 2021-10-05T16:34:59.343Z [INFO] raft: copied to local snapshot: bytes=16973829 2021-10-05T16:34:59.461Z [INFO] raft: restored user snapshot: index=1 --- PASS: TestSnapshot (8.36s) === RUN TestSnapshot_Nil --- PASS: TestSnapshot_Nil (0.00s) === RUN TestSnapshot_BadVerify --- PASS: TestSnapshot_BadVerify (0.00s) === RUN TestSnapshot_TruncatedVerify 2021-10-05T16:34:59.494Z [INFO] raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:server-e3e8f0dc-0e38-d273-0218-406de4708b5a Address:e3e8f0dc-0e38-d273-0218-406de4708b5a}]" 2021-10-05T16:34:59.494Z [INFO] raft: entering follower state: follower="Node at e3e8f0dc-0e38-d273-0218-406de4708b5a [Follower]" leader= 2021-10-05T16:35:00.884Z [WARN] raft: heartbeat timeout reached, starting election: last-leader= 2021-10-05T16:35:00.884Z [INFO] raft: entering candidate state: node="Node at e3e8f0dc-0e38-d273-0218-406de4708b5a [Candidate]" term=2 2021-10-05T16:35:00.884Z [DEBUG] raft: votes: needed=1 2021-10-05T16:35:00.884Z [DEBUG] raft: vote granted: from=server-e3e8f0dc-0e38-d273-0218-406de4708b5a term=2 tally=1 2021-10-05T16:35:00.884Z [INFO] raft: election won: tally=1 2021-10-05T16:35:00.884Z [INFO] raft: entering leader state: leader="Node at e3e8f0dc-0e38-d273-0218-406de4708b5a [Leader]" 2021-10-05T16:35:03.950Z [INFO] raft: starting snapshot up to: index=65538 2021-10-05T16:35:03.950Z [INFO] snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshot_TruncatedVerify-snapshot334375517/before/snapshots/2-65538-1633451703950.tmp 2021-10-05T16:35:04.099Z [INFO] raft: compacting logs: from=1 to=55298 2021-10-05T16:35:04.104Z [INFO] raft: snapshot complete up to: index=65538 === RUN TestSnapshot_TruncatedVerify/truncate_200_bytes_from_end === RUN TestSnapshot_TruncatedVerify/truncate_16_bytes_from_end === RUN TestSnapshot_TruncatedVerify/truncate_8_bytes_from_end === RUN TestSnapshot_TruncatedVerify/truncate_4_bytes_from_end === RUN TestSnapshot_TruncatedVerify/truncate_2_bytes_from_end === RUN TestSnapshot_TruncatedVerify/truncate_1_bytes_from_end --- PASS: TestSnapshot_TruncatedVerify (7.20s) --- PASS: TestSnapshot_TruncatedVerify/truncate_200_bytes_from_end (0.20s) --- PASS: TestSnapshot_TruncatedVerify/truncate_16_bytes_from_end (0.20s) --- PASS: TestSnapshot_TruncatedVerify/truncate_8_bytes_from_end (0.20s) --- PASS: TestSnapshot_TruncatedVerify/truncate_4_bytes_from_end (0.20s) --- PASS: TestSnapshot_TruncatedVerify/truncate_2_bytes_from_end (0.20s) --- PASS: TestSnapshot_TruncatedVerify/truncate_1_bytes_from_end (0.20s) === RUN TestSnapshot_BadRestore 2021-10-05T16:35:06.696Z [INFO] raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:server-6153b2a5-8642-cd42-a490-a550ba4dc7ec Address:6153b2a5-8642-cd42-a490-a550ba4dc7ec}]" 2021-10-05T16:35:06.696Z [INFO] raft: entering follower state: follower="Node at 6153b2a5-8642-cd42-a490-a550ba4dc7ec [Follower]" leader= 2021-10-05T16:35:08.584Z [WARN] raft: heartbeat timeout reached, starting election: last-leader= 2021-10-05T16:35:08.584Z [INFO] raft: entering candidate state: node="Node at 6153b2a5-8642-cd42-a490-a550ba4dc7ec [Candidate]" term=2 2021-10-05T16:35:08.584Z [DEBUG] raft: votes: needed=1 2021-10-05T16:35:08.584Z [DEBUG] raft: vote granted: from=server-6153b2a5-8642-cd42-a490-a550ba4dc7ec term=2 tally=1 2021-10-05T16:35:08.584Z [INFO] raft: election won: tally=1 2021-10-05T16:35:08.584Z [INFO] raft: entering leader state: leader="Node at 6153b2a5-8642-cd42-a490-a550ba4dc7ec [Leader]" 2021-10-05T16:35:09.149Z [INFO] raft: starting snapshot up to: index=16386 2021-10-05T16:35:09.149Z [INFO] snapshot: creating new snapshot: path=/tmp/consul-test/TestSnapshot_BadRestore-snapshot487753879/before/snapshots/2-16386-1633451709149.tmp 2021-10-05T16:35:09.219Z [INFO] raft: compacting logs: from=1 to=6146 2021-10-05T16:35:09.220Z [INFO] raft: snapshot complete up to: index=16386 2021-10-05T16:35:09.656Z [INFO] raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:server-a14fff90-b72b-ee04-ed13-4c35565c3e02 Address:a14fff90-b72b-ee04-ed13-4c35565c3e02}]" 2021-10-05T16:35:09.656Z [INFO] raft: entering follower state: follower="Node at a14fff90-b72b-ee04-ed13-4c35565c3e02 [Follower]" leader= 2021-10-05T16:35:11.300Z [WARN] raft: heartbeat timeout reached, starting election: last-leader= 2021-10-05T16:35:11.300Z [INFO] raft: entering candidate state: node="Node at a14fff90-b72b-ee04-ed13-4c35565c3e02 [Candidate]" term=2 2021-10-05T16:35:11.300Z [DEBUG] raft: votes: needed=1 2021-10-05T16:35:11.300Z [DEBUG] raft: vote granted: from=server-a14fff90-b72b-ee04-ed13-4c35565c3e02 term=2 tally=1 2021-10-05T16:35:11.300Z [INFO] raft: election won: tally=1 2021-10-05T16:35:11.300Z [INFO] raft: entering leader state: leader="Node at a14fff90-b72b-ee04-ed13-4c35565c3e02 [Leader]" 2021-10-05T16:35:11.302Z [ERROR] TestSnapshot_BadRestore: Failed to close snapshot decompressor: error="unexpected EOF" --- PASS: TestSnapshot_BadRestore (4.61s) PASS ok github.com/hashicorp/consul/snapshot 20.212s ? github.com/hashicorp/consul/testrpc [no test files] === RUN TestConfigurator_outgoingWrapper_OK --- PASS: TestConfigurator_outgoingWrapper_OK (0.03s) === RUN TestConfigurator_outgoingWrapper_noverify_OK --- PASS: TestConfigurator_outgoingWrapper_noverify_OK (0.02s) === RUN TestConfigurator_outgoingWrapper_BadDC --- PASS: TestConfigurator_outgoingWrapper_BadDC (0.02s) === RUN TestConfigurator_outgoingWrapper_BadCert --- PASS: TestConfigurator_outgoingWrapper_BadCert (0.02s) === RUN TestConfigurator_outgoingWrapperALPN_OK --- PASS: TestConfigurator_outgoingWrapperALPN_OK (0.04s) === RUN TestConfigurator_outgoingWrapperALPN_serverHasNoNodeNameInSAN --- PASS: TestConfigurator_outgoingWrapperALPN_serverHasNoNodeNameInSAN (0.02s) === RUN TestConfigurator_outgoingWrapperALPN_BadDC --- PASS: TestConfigurator_outgoingWrapperALPN_BadDC (0.02s) === RUN TestConfigurator_outgoingWrapperALPN_BadCert --- PASS: TestConfigurator_outgoingWrapperALPN_BadCert (0.02s) === RUN TestConfigurator_wrapTLS_OK --- PASS: TestConfigurator_wrapTLS_OK (0.02s) === RUN TestConfigurator_wrapTLS_BadCert --- PASS: TestConfigurator_wrapTLS_BadCert (0.03s) === RUN TestConfig_ParseCiphers --- PASS: TestConfig_ParseCiphers (0.00s) === RUN TestConfigurator_loadKeyPair --- PASS: TestConfigurator_loadKeyPair (0.00s) === RUN TestConfig_SpecifyDC --- PASS: TestConfig_SpecifyDC (0.00s) === RUN TestConfigurator_NewConfigurator 2021-10-05T16:34:51.347Z [TRACE] TestConfigurator_NewConfigurator.tlsutil: Update: version=1 --- PASS: TestConfigurator_NewConfigurator (0.00s) === RUN TestConfigurator_ErrorPropagation --- PASS: TestConfigurator_ErrorPropagation (0.01s) === RUN TestConfigurator_CommonTLSConfigServerNameNodeName --- PASS: TestConfigurator_CommonTLSConfigServerNameNodeName (0.00s) === RUN TestConfigurator_LoadCAs --- PASS: TestConfigurator_LoadCAs (0.00s) === RUN TestConfigurator_CommonTLSConfigInsecureSkipVerify --- PASS: TestConfigurator_CommonTLSConfigInsecureSkipVerify (0.00s) === RUN TestConfigurator_CommonTLSConfigPreferServerCipherSuites --- PASS: TestConfigurator_CommonTLSConfigPreferServerCipherSuites (0.00s) === RUN TestConfigurator_CommonTLSConfigCipherSuites --- PASS: TestConfigurator_CommonTLSConfigCipherSuites (0.00s) === RUN TestConfigurator_CommonTLSConfigGetClientCertificate --- PASS: TestConfigurator_CommonTLSConfigGetClientCertificate (0.00s) === RUN TestConfigurator_CommonTLSConfigGetCertificate --- PASS: TestConfigurator_CommonTLSConfigGetCertificate (0.00s) === RUN TestConfigurator_CommonTLSConfigCAs --- PASS: TestConfigurator_CommonTLSConfigCAs (0.00s) === RUN TestConfigurator_CommonTLSConfigTLSMinVersion --- PASS: TestConfigurator_CommonTLSConfigTLSMinVersion (0.00s) === RUN TestConfigurator_CommonTLSConfigVerifyIncoming --- PASS: TestConfigurator_CommonTLSConfigVerifyIncoming (0.00s) === RUN TestConfigurator_OutgoingRPCTLSDisabled --- PASS: TestConfigurator_OutgoingRPCTLSDisabled (0.00s) === RUN TestConfigurator_MutualTLSCapable === RUN TestConfigurator_MutualTLSCapable/no_ca === RUN TestConfigurator_MutualTLSCapable/ca_and_no_keys === RUN TestConfigurator_MutualTLSCapable/ca_and_manual_key === RUN TestConfigurator_MutualTLSCapable/autoencrypt_ca_and_no_autoencrypt_keys === RUN TestConfigurator_MutualTLSCapable/autoencrypt_ca_and_autoencrypt_key --- PASS: TestConfigurator_MutualTLSCapable (0.00s) --- PASS: TestConfigurator_MutualTLSCapable/no_ca (0.00s) --- PASS: TestConfigurator_MutualTLSCapable/ca_and_no_keys (0.00s) --- PASS: TestConfigurator_MutualTLSCapable/ca_and_manual_key (0.00s) --- PASS: TestConfigurator_MutualTLSCapable/autoencrypt_ca_and_no_autoencrypt_keys (0.00s) --- PASS: TestConfigurator_MutualTLSCapable/autoencrypt_ca_and_autoencrypt_key (0.00s) === RUN TestConfigurator_VerifyIncomingRPC --- PASS: TestConfigurator_VerifyIncomingRPC (0.00s) === RUN TestConfigurator_VerifyIncomingHTTPS --- PASS: TestConfigurator_VerifyIncomingHTTPS (0.00s) === RUN TestConfigurator_EnableAgentTLSForChecks --- PASS: TestConfigurator_EnableAgentTLSForChecks (0.00s) === RUN TestConfigurator_IncomingRPCConfig --- PASS: TestConfigurator_IncomingRPCConfig (0.00s) === RUN TestConfigurator_IncomingALPNRPCConfig --- PASS: TestConfigurator_IncomingALPNRPCConfig (0.00s) === RUN TestConfigurator_IncomingHTTPSConfig --- PASS: TestConfigurator_IncomingHTTPSConfig (0.00s) === RUN TestConfigurator_OutgoingTLSConfigForChecks --- PASS: TestConfigurator_OutgoingTLSConfigForChecks (0.00s) === RUN TestConfigurator_OutgoingRPCConfig --- PASS: TestConfigurator_OutgoingRPCConfig (0.00s) === RUN TestConfigurator_OutgoingALPNRPCConfig --- PASS: TestConfigurator_OutgoingALPNRPCConfig (0.00s) === RUN TestConfigurator_OutgoingRPCWrapper --- PASS: TestConfigurator_OutgoingRPCWrapper (0.00s) === RUN TestConfigurator_OutgoingALPNRPCWrapper --- PASS: TestConfigurator_OutgoingALPNRPCWrapper (0.00s) === RUN TestConfigurator_UpdateChecks --- PASS: TestConfigurator_UpdateChecks (0.00s) === RUN TestConfigurator_UpdateSetsStuff --- PASS: TestConfigurator_UpdateSetsStuff (0.00s) === RUN TestConfigurator_ServerNameOrNodeName --- PASS: TestConfigurator_ServerNameOrNodeName (0.00s) === RUN TestConfigurator_VerifyOutgoing --- PASS: TestConfigurator_VerifyOutgoing (0.00s) === RUN TestConfigurator_Domain --- PASS: TestConfigurator_Domain (0.00s) === RUN TestConfigurator_VerifyServerHostname --- PASS: TestConfigurator_VerifyServerHostname (0.00s) === RUN TestConfigurator_AutoEncrytCertExpired --- PASS: TestConfigurator_AutoEncrytCertExpired (0.00s) === RUN TestConfig_tlsVersions --- PASS: TestConfig_tlsVersions (0.00s) === RUN TestSerialNumber --- PASS: TestSerialNumber (0.00s) === RUN TestGeneratePrivateKey === PAUSE TestGeneratePrivateKey === RUN TestGenerateCA === PAUSE TestGenerateCA === RUN TestGenerateCert generate_test.go:101: DM-skipped --- SKIP: TestGenerateCert (0.00s) === CONT TestGeneratePrivateKey === CONT TestGenerateCA --- PASS: TestGeneratePrivateKey (0.00s) --- PASS: TestGenerateCA (0.00s) PASS ok github.com/hashicorp/consul/tlsutil 0.280s ? github.com/hashicorp/consul/types [no test files] ? github.com/hashicorp/consul/version [no test files] make[1]: Leaving directory '/build/consul-1.8.7+dfsg1' create-stamp debian/debhelper-build-stamp fakeroot debian/rules binary dh binary --buildsystem=golang --with=golang,bash-completion --builddirectory=_build dh_testroot -O--buildsystem=golang -O--builddirectory=_build dh_prep -O--buildsystem=golang -O--builddirectory=_build dh_installdirs -O--buildsystem=golang -O--builddirectory=_build dh_auto_install -O--buildsystem=golang -O--builddirectory=_build cd _build && mkdir -p /build/consul-1.8.7\+dfsg1/debian/tmp/usr cd _build && cp -r bin /build/consul-1.8.7\+dfsg1/debian/tmp/usr debian/rules override_dh_install make[1]: Entering directory '/build/consul-1.8.7+dfsg1' ## Do not install "github.com/hashicorp/consul/vendor" to -dev package. dh_install -X/src/github.com/hashicorp/consul/vendor -Xcertgen make[1]: Leaving directory '/build/consul-1.8.7+dfsg1' dh_installdocs -O--buildsystem=golang -O--builddirectory=_build dh_installchangelogs -O--buildsystem=golang -O--builddirectory=_build dh_installexamples -O--buildsystem=golang -O--builddirectory=_build dh_bash-completion -O--buildsystem=golang -O--builddirectory=_build debian/rules override_dh_installinit make[1]: Entering directory '/build/consul-1.8.7+dfsg1' dh_installinit --no-enable --no-start make[1]: Leaving directory '/build/consul-1.8.7+dfsg1' debian/rules override_dh_installsystemd make[1]: Entering directory '/build/consul-1.8.7+dfsg1' dh_installsystemd --no-enable --no-start make[1]: Leaving directory '/build/consul-1.8.7+dfsg1' dh_installsystemduser -O--buildsystem=golang -O--builddirectory=_build dh_lintian -O--buildsystem=golang -O--builddirectory=_build dh_perl -O--buildsystem=golang -O--builddirectory=_build dh_link -O--buildsystem=golang -O--builddirectory=_build dh_strip_nondeterminism -O--buildsystem=golang -O--builddirectory=_build dh_compress -O--buildsystem=golang -O--builddirectory=_build dh_fixperms -O--buildsystem=golang -O--builddirectory=_build dh_missing -O--buildsystem=golang -O--builddirectory=_build dh_dwz -O--buildsystem=golang -O--builddirectory=_build dwz: debian/consul/usr/bin/consul: .debug_info section not present dh_strip -O--buildsystem=golang -O--builddirectory=_build dh_strip: warning: Could not find the BuildID in debian/consul/usr/bin/consul dh_makeshlibs -O--buildsystem=golang -O--builddirectory=_build dh_shlibdeps -O--buildsystem=golang -O--builddirectory=_build dh_installdeb -O--buildsystem=golang -O--builddirectory=_build dh_golang -O--buildsystem=golang -O--builddirectory=_build dh_gencontrol -O--buildsystem=golang -O--builddirectory=_build dh_md5sums -O--buildsystem=golang -O--builddirectory=_build dh_builddeb -O--buildsystem=golang -O--builddirectory=_build dpkg-deb: building package 'golang-github-hashicorp-consul-dev' in '../golang-github-hashicorp-consul-dev_1.8.7+dfsg1-2_all.deb'. dpkg-deb: building package 'consul' in '../consul_1.8.7+dfsg1-2_i386.deb'. dpkg-genbuildinfo --build=binary dpkg-genchanges --build=binary >../consul_1.8.7+dfsg1-2_i386.changes dpkg-genchanges: info: binary-only upload (no source code included) dpkg-source --after-build . dpkg-buildpackage: info: binary-only upload (no source included) dpkg-genchanges: info: not including original source code in upload I: copying local configuration I: user script /srv/workspace/pbuilder/12155/tmp/hooks/B01_cleanup starting I: user script /srv/workspace/pbuilder/12155/tmp/hooks/B01_cleanup finished I: unmounting dev/ptmx filesystem I: unmounting dev/pts filesystem I: unmounting dev/shm filesystem I: unmounting proc filesystem I: unmounting sys filesystem I: cleaning the build env I: removing directory /srv/workspace/pbuilder/12155 and its subdirectories I: Current time: Wed Oct 6 06:36:56 +14 2021 I: pbuilder-time-stamp: 1633451816